"./sync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Starting (try 1/5) 2025/08/27 01:19:42 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-fadumuh8suca" 2025/08/27 01:19:42 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/08/27 01:19:42 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/27 01:19:42 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/27 01:19:42 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/08/27 01:19:43 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/27 01:19:43 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/27 01:32:54 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/27 02:19:42 DEBUG : Config file has changed externally - reloading 2025/08/27 02:19:42 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/27 02:19:42 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/27 02:19:43 DEBUG : pacer: Reducing sleep to 45m0s 2025/08/27 02:43:09 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/27 03:19:42 DEBUG : Config file has changed externally - reloading 2025/08/27 03:19:42 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/27 03:19:42 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/27 03:19:43 DEBUG : Too many requests. Trying again in 44608 seconds. 2025/08/27 03:19:43 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 12h23m28s) 2025/08/27 03:19:43 DEBUG : pacer: Rate limited, increasing sleep to 12h23m28s 2025/08/27 03:43:09 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/27 04:04:42 DEBUG : Config file has changed externally - reloading 2025/08/27 04:04:42 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/27 04:04:43 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/27 04:04:43 DEBUG : TestOneDrive: Saved new token in config file 2025/08/27 04:04:43 DEBUG : Too many requests. Trying again in 43200 seconds. 2025/08/27 04:04:43 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 12h0m0s) 2025/08/27 04:04:43 DEBUG : pacer: Rate limited, increasing sleep to 12h0m0s 2025/08/27 05:04:42 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/27 16:28:11 DEBUG : Config file has changed externally - reloading 2025/08/27 16:28:11 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/27 16:28:11 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/27 16:28:11 DEBUG : Too many requests. Trying again in 8101 seconds. 2025/08/27 16:28:11 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 2h15m1s) 2025/08/27 16:28:11 DEBUG : pacer: Rate limited, increasing sleep to 2h15m1s 2025/08/27 16:43:10 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/28 04:28:11 DEBUG : Config file has changed externally - reloading 2025/08/28 04:28:11 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/28 04:28:11 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/28 04:28:11 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/28 04:28:11 DEBUG : TestOneDrive: Saved new token in config file 2025/08/28 04:28:12 DEBUG : Too many requests. Trying again in 7200 seconds. 2025/08/28 04:28:12 DEBUG : pacer: low level retry 4/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 2h0m0s) 2025/08/28 04:28:12 DEBUG : pacer: Rate limited, increasing sleep to 2h0m0s 2025/08/28 05:28:10 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/28 06:43:12 DEBUG : Config file has changed externally - reloading 2025/08/28 06:43:12 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/28 06:43:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/28 06:43:12 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/28 06:43:12 DEBUG : TestOneDrive: Saved new token in config file 2025/08/28 06:43:12 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/28 06:43:12 DEBUG : pacer: low level retry 5/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/28 06:43:12 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/08/28 07:43:11 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/28 08:43:12 DEBUG : Config file has changed externally - reloading 2025/08/28 08:43:12 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/28 08:43:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/28 08:43:12 DEBUG : pacer: Reducing sleep to 45m0s 2025/08/28 08:57:04 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/28 09:43:12 DEBUG : Config file has changed externally - reloading 2025/08/28 09:43:12 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/28 09:43:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/28 09:43:12 DEBUG : Too many requests. Trying again in 118800 seconds. 2025/08/28 09:43:12 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 33h0m0s) 2025/08/28 09:43:12 DEBUG : pacer: Rate limited, increasing sleep to 33h0m0s 2025/08/28 09:57:30 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/28 10:28:12 DEBUG : Config file has changed externally - reloading 2025/08/28 10:28:12 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/28 10:28:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/28 10:28:12 DEBUG : Too many requests. Trying again in 115200 seconds. 2025/08/28 10:28:12 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 32h0m0s) 2025/08/28 10:28:12 DEBUG : pacer: Rate limited, increasing sleep to 32h0m0s 2025/08/28 10:57:30 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/29 19:28:12 DEBUG : Config file has changed externally - reloading 2025/08/29 19:28:12 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/29 19:28:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/29 19:28:13 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/29 19:28:13 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/29 19:28:13 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/08/29 20:06:35 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/31 03:28:12 DEBUG : Config file has changed externally - reloading 2025/08/31 03:28:12 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/31 03:28:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/31 03:28:12 DEBUG : pacer: Reducing sleep to 45m0s 2025/08/31 03:28:12 DEBUG : Creating backend with remote "/tmp/rclone931652247" === RUN TestPipe --- PASS: TestPipe (0.01s) === RUN TestPipeConcurrent --- PASS: TestPipeConcurrent (0.04s) === RUN TestPipeOrderBy === RUN TestPipeOrderBy/#00 === RUN TestPipeOrderBy/size === RUN TestPipeOrderBy/name === RUN TestPipeOrderBy/modtime === RUN TestPipeOrderBy/size,ascending === RUN TestPipeOrderBy/name,asc === RUN TestPipeOrderBy/modtime,ascending === RUN TestPipeOrderBy/size,descending === RUN TestPipeOrderBy/name,desc === RUN TestPipeOrderBy/modtime,descending === RUN TestPipeOrderBy/size,mixed,50 === RUN TestPipeOrderBy/size,mixed,51 --- PASS: TestPipeOrderBy (0.00s) --- PASS: TestPipeOrderBy/#00 (0.00s) --- PASS: TestPipeOrderBy/size (0.00s) --- PASS: TestPipeOrderBy/name (0.00s) --- PASS: TestPipeOrderBy/modtime (0.00s) --- PASS: TestPipeOrderBy/size,ascending (0.00s) --- PASS: TestPipeOrderBy/name,asc (0.00s) --- PASS: TestPipeOrderBy/modtime,ascending (0.00s) --- PASS: TestPipeOrderBy/size,descending (0.00s) --- PASS: TestPipeOrderBy/name,desc (0.00s) --- PASS: TestPipeOrderBy/modtime,descending (0.00s) --- PASS: TestPipeOrderBy/size,mixed,50 (0.00s) --- PASS: TestPipeOrderBy/size,mixed,51 (0.00s) === RUN TestNewLess === RUN TestNewLess/blankOK === RUN TestNewLess/tooManyParts === RUN TestNewLess/tooManyParts2 === RUN TestNewLess/badMixed === RUN TestNewLess/unknownComparison === RUN TestNewLess/unknownSortDirection === RUN TestNewLess/size === RUN TestNewLess/name === RUN TestNewLess/modtime === RUN TestNewLess/size,ascending === RUN TestNewLess/name,asc === RUN TestNewLess/modtime,ascending === RUN TestNewLess/size,descending === RUN TestNewLess/name,desc === RUN TestNewLess/modtime,descending === RUN TestNewLess/modtime,mixed === RUN TestNewLess/modtime,mixed,30 --- PASS: TestNewLess (0.00s) --- PASS: TestNewLess/blankOK (0.00s) --- PASS: TestNewLess/tooManyParts (0.00s) --- PASS: TestNewLess/tooManyParts2 (0.00s) --- PASS: TestNewLess/badMixed (0.00s) --- PASS: TestNewLess/unknownComparison (0.00s) --- PASS: TestNewLess/unknownSortDirection (0.00s) --- PASS: TestNewLess/size (0.00s) --- PASS: TestNewLess/name (0.00s) --- PASS: TestNewLess/modtime (0.00s) --- PASS: TestNewLess/size,ascending (0.00s) --- PASS: TestNewLess/name,asc (0.00s) --- PASS: TestNewLess/modtime,ascending (0.00s) --- PASS: TestNewLess/size,descending (0.00s) --- PASS: TestNewLess/name,desc (0.00s) --- PASS: TestNewLess/modtime,descending (0.00s) --- PASS: TestNewLess/modtime,mixed (0.00s) --- PASS: TestNewLess/modtime,mixed,30 (0.00s) === RUN TestRcCopy rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcCopy (0.00s) === RUN TestRcMove rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcMove (0.00s) === RUN TestRcSync rc_test.go:16: Skipping test on non local remote --- SKIP: TestRcSync (0.00s) === RUN TestCopyWithDryRun run.go:180: Remote "OneDrive root 'rclone-test-fadumuh8suca'", Local "Local file system at /tmp/rclone931652247", Modify Window "1s" 2025/08/31 04:22:45 DEBUG : OneDrive root 'rclone-test-fadumuh8suca': Token expired but no uploads in progress - doing nothing 2025/08/31 04:28:12 DEBUG : Config file has changed externally - reloading 2025/08/31 04:28:12 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/31 04:28:12 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/31 04:28:12 DEBUG : pacer: Reducing sleep to 33m45s panic: test timed out after 1h0m0s running tests: TestCopyWithDryRun (1h0m0s) goroutine 175 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 61 minutes]: testing.(*T).Run(0xc000103880, {0x276ab3a?, 0xc00006bad8?}, 0x2889d70) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000103880) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000103880, 0xc00006bc18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc00017da28, {0x3faeda0, 0x6c, 0x6c}, {0xee045b84c?, 0x3fc4f20?, 0x3fc4f20?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc000427860) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc000427860) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/fs/sync.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:45 main.main() _testmain.go:261 +0xa9 goroutine 23 [syscall, 5948 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 24 [chan receive, 5948 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 25 [select, 6 minutes]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc000493e00) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 308 [sleep]: time.Sleep(0x274a48a7800) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0xc0000857a0?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 306 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:168 +0xef goroutine 306 [chan receive]: github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc0002e5680) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:161 +0x25 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc0002e5680, 0xc0008da370, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:198 +0x5c github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc0002e5680, 0xc0008da370) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:218 +0x93 github.com/rclone/rclone/backend/onedrive.(*Fs).CreateDir(0xc0000f3680, {0x2bd4f70, 0xc0005843f0}, {0xc000490cf0, 0x25}, {0xc00015f4dd, 0x18}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1258 +0x2ec github.com/rclone/rclone/lib/dircache.(*DirCache)._findDir(0xc000454510, {0x2bd4f70, 0xc0005843f0}, {0xc00015f4dd, 0x18}, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:242 +0x172 github.com/rclone/rclone/lib/dircache.(*DirCache)._findRoot(0xc000454510, {0x2bd4f70?, 0xc0005843f0?}, 0x40?) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:305 +0x45 github.com/rclone/rclone/lib/dircache.(*DirCache).FindDir(0xc000454510, {0x2bd4f70, 0xc0005843f0}, {0x0, 0x0}, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:201 +0xcd github.com/rclone/rclone/backend/onedrive.(*Fs).Mkdir(0x276bbe4?, {0x2bd4f70?, 0xc0005843f0?}, {0x0?, 0x1?}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1566 +0x2f github.com/rclone/rclone/fstest.(*Run).ForceMkdir(0xc000051110, {0x2bd4f70?, 0xc0005843f0?}, {0x2beba60, 0xc0000f3680}) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:235 +0x38 github.com/rclone/rclone/fstest.(*Run).Mkdir(0xc000051110, {0x2bd4f70, 0xc0005843f0}, {0x2beba60, 0xc0000f3680}) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 +0x71 github.com/rclone/rclone/fs/sync.TestCopyWithDryRun(0xc0008d9dc0) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:54 +0x145 testing.tRunner(0xc0008d9dc0, 0x2889d70) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 173 [IO wait]: internal/poll.runtime_pollWait(0x718208bcb5d8, 0x72) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc00039e380?, 0xc000037300?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc00039e380, {0xc000037300, 0x1300, 0x1300}) /usr/local/go/src/internal/poll/fd_unix.go:165 +0x27a net.(*netFD).Read(0xc00039e380, {0xc000037300?, 0x11cb?, 0xc0002ee380?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc0006ae008, {0xc000037300?, 0xc000037430?, 0x5?}) /usr/local/go/src/net/net.go:194 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc000679488, {0xc000037300?, 0x7182080566d8?, 0x7182510bba78?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x29 crypto/tls.(*atLeastReader).Read(0xc000679ae8, {0xc000037300?, 0x11cb?, 0xc0004e4b08?}) /usr/local/go/src/crypto/tls/conn.go:809 +0x3b bytes.(*Buffer).ReadFrom(0xc0001ebb38, {0x2baf120, 0xc000679ae8}) /usr/local/go/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc0001eb888, {0x718208056438, 0xc000679488}, 0x4426d4?) /usr/local/go/src/crypto/tls/conn.go:831 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc0001eb888, 0x0) /usr/local/go/src/crypto/tls/conn.go:629 +0x3cf crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:591 crypto/tls.(*Conn).Read(0xc0001eb888, {0xc000379000, 0x1000, 0xc000096ca0?}) /usr/local/go/src/crypto/tls/conn.go:1385 +0x145 bufio.(*Reader).Read(0xc0009763c0, {0xc00017e580, 0x9, 0x3f31f20?}) /usr/local/go/src/bufio/bufio.go:245 +0x197 io.ReadAtLeast({0x2bac4e0, 0xc0009763c0}, {0xc00017e580, 0x9, 0x9}, 0x9) /usr/local/go/src/io/io.go:335 +0x91 io.ReadFull(...) /usr/local/go/src/io/io.go:354 net/http.http2readFrameHeader({0xc00017e580, 0x9, 0xc00001b7d0?}, {0x2bac4e0?, 0xc0009763c0?}) /usr/local/go/src/net/http/h2_bundle.go:1805 +0x65 net/http.(*http2Framer).ReadFrame(0xc00017e540) /usr/local/go/src/net/http/h2_bundle.go:2072 +0x7d net/http.(*http2clientConnReadLoop).run(0xc000096fa8) /usr/local/go/src/net/http/h2_bundle.go:9933 +0xda net/http.(*http2ClientConn).readLoop(0xc0005021c0) /usr/local/go/src/net/http/h2_bundle.go:9812 +0x79 created by net/http.(*http2Transport).newClientConn in goroutine 172 /usr/local/go/src/net/http/h2_bundle.go:8334 +0xde5 "./sync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Finished ERROR in 99h8m30.497229257s (try 1/5): exit status 2: Failed []