"./bisync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Starting (try 1/5) 2025/11/15 03:49:02 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-yuxenoz8cova" 2025/11/15 03:49:02 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/15 03:49:02 DEBUG : Too many requests. Trying again in 375 seconds. 2025/11/15 03:49:02 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 6m15s) 2025/11/15 03:49:02 DEBUG : pacer: Rate limited, increasing sleep to 6m15s 2025/11/15 03:49:03 DEBUG : Too many requests. Trying again in 374 seconds. 2025/11/15 03:49:03 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 6m14s) 2025/11/15 03:49:03 DEBUG : pacer: Rate limited, increasing sleep to 6m14s 2025/11/15 03:55:15 DEBUG : OneDrive root 'rclone-test-yuxenoz8cova': Background refresher detected expired token but no uploads in progress - doing nothing 2025/11/15 03:55:17 DEBUG : TestOneDrive: Token expired 2025/11/15 03:55:17 DEBUG : Config file has changed externally - reloading 2025/11/15 03:55:17 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/11/15 03:55:17 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/11/15 03:55:17 DEBUG : TestOneDrive: Token refresh successful 2025/11/15 03:55:18 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/11/15 03:55:18 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/11/15 03:55:18 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/11/15 04:01:32 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/11/15 04:01:32 DEBUG : pacer: low level retry 4/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/11/15 04:55:16 DEBUG : OneDrive root 'rclone-test-yuxenoz8cova': Background refresher detected expired token but no uploads in progress - doing nothing 2025/11/15 05:01:32 DEBUG : TestOneDrive: Token expired 2025/11/15 05:01:32 DEBUG : Config file has changed externally - reloading 2025/11/15 05:01:32 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/11/15 05:01:32 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/11/15 05:01:32 DEBUG : TestOneDrive: Token refresh successful 2025/11/15 05:01:32 DEBUG : pacer: Reducing sleep to 45m0s 2025/11/15 05:55:16 DEBUG : OneDrive root 'rclone-test-yuxenoz8cova': Background refresher detected expired token but no uploads in progress - doing nothing 2025/11/15 06:01:32 DEBUG : TestOneDrive: Token expired 2025/11/15 06:01:32 DEBUG : Config file has changed externally - reloading 2025/11/15 06:01:32 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/11/15 06:01:32 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/11/15 06:01:32 DEBUG : TestOneDrive: Token refresh successful 2025/11/15 06:01:32 DEBUG : pacer: Reducing sleep to 33m45s 2025/11/15 06:46:32 DEBUG : Too many requests. Trying again in 18000 seconds. 2025/11/15 06:46:32 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 5h0m0s) 2025/11/15 06:46:32 DEBUG : pacer: Rate limited, increasing sleep to 5h0m0s 2025/11/15 06:55:16 DEBUG : OneDrive root 'rclone-test-yuxenoz8cova': Background refresher detected expired token but no uploads in progress - doing nothing 2025/11/15 07:20:17 DEBUG : TestOneDrive: Token expired 2025/11/15 07:20:17 DEBUG : Config file has changed externally - reloading 2025/11/15 07:20:17 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/11/15 07:20:17 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/11/15 07:20:17 DEBUG : TestOneDrive: Token refresh successful 2025/11/15 07:20:17 DEBUG : pacer: Reducing sleep to 3h45m0s 2025/11/15 07:20:17 DEBUG : Creating backend with remote "/tmp/rclone3360861638" === RUN TestBisyncRemoteLocal 2025/11/15 07:20:17 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-heridow4ximo" 2025/11/15 07:20:18 DEBUG : Too many requests. Trying again in 175555 seconds. 2025/11/15 07:20:18 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 48h45m55s) 2025/11/15 07:20:18 DEBUG : pacer: Rate limited, increasing sleep to 48h45m55s 2025/11/15 07:20:18 DEBUG : Too many requests. Trying again in 175555 seconds. 2025/11/15 07:20:18 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 48h45m55s) 2025/11/15 07:55:17 DEBUG : OneDrive root 'rclone-test-yuxenoz8cova': Background refresher detected expired token but no uploads in progress - doing nothing 2025/11/15 07:55:17 DEBUG : OneDrive root 'rclone-test-heridow4ximo': Background refresher detected expired token but no uploads in progress - doing nothing panic: test timed out after 1h0m0s running tests: TestBisyncRemoteLocal (1h0m0s) goroutine 151 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 61 minutes]: testing.(*T).Run(0xc000186e00, {0x28e9343?, 0xc00006b6e0?}, 0x2a24480) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000186e00) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000186e00, 0xc00006b820) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc00063ea20, {0x4269580, 0x4, 0x4}, {0xee0aa20b1?, 0x42a7dc0?, 0x42a7dc0?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc0006a7040) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc0006a7040) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:74 +0xa6 github.com/rclone/rclone/cmd/bisync_test.TestMain(0xc0006a7040) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:243 +0xf2 main.main() _testmain.go:55 +0xa8 goroutine 20 [syscall, 271 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 21 [chan receive, 271 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 22 [chan receive, 271 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 23 [select, 25 minutes]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc00072d5c0) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 94 [sleep, 61 minutes]: time.Sleep(0x105ef39b2000) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0x0?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:170 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0xf6 goroutine 134 [chan receive, 61 minutes]: github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc00080aae0, 0x0) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:162 +0x26 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc00080aae0, 0xc00072ce00, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:215 +0xb2 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc00080aae0, 0xc00072ce00) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:235 +0x93 github.com/rclone/rclone/backend/onedrive.(*Fs).readMetaDataForPathRelativeToID(0xc00078c180, {0x2dbea78, 0x42cb700}, {0xc00080c060, 0x25}, {0xc0006de12d, 0x18}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:934 +0x2c9 github.com/rclone/rclone/backend/onedrive.(*Fs).FindLeaf(0xc00078c180, {0x2dbea78, 0x42cb700}, {0xc00080c060, 0x25}, {0xc0006de12d, 0x18}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1232 +0x77 github.com/rclone/rclone/lib/dircache.(*DirCache)._findDir(0xc0001f8d80, {0x2dbea78, 0x42cb700}, {0xc0006de12d, 0x18}, 0x0) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:234 +0x112 github.com/rclone/rclone/lib/dircache.(*DirCache)._findRoot(0xc0001f8d80, {0x2dbea78?, 0x42cb700?}, 0x0?) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:305 +0x45 github.com/rclone/rclone/lib/dircache.(*DirCache).FindRoot(0xc0006de12d?, {0x2dbea78?, 0x42cb700?}, 0x25?) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:291 +0xa9 github.com/rclone/rclone/backend/onedrive.NewFs({0x2dbea78, 0x42cb700}, {0xc0006de120, 0xc}, {0xc0006de12d, 0x18}, {0x2da9220, 0xc000393b60}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1157 +0xb65 github.com/rclone/rclone/fs.NewFs({0x2dbea78, 0x42cb700}, {0xc0006de120, 0x25}) /home/rclone/go/src/github.com/rclone/rclone/fs/newfs.go:75 +0x378 github.com/rclone/rclone/fstest.RandomRemote() /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:465 +0x51 github.com/rclone/rclone/cmd/bisync_test.TestBisyncRemoteLocal(0xc000186fc0) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:251 +0x9d testing.tRunner(0xc000186fc0, 0x2a24480) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 135 [select, 25 minutes]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc00072c400) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 134 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 164 [sleep, 61 minutes]: time.Sleep(0x9faa9569de00) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0xc00072d5c0?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:170 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 134 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0xf6 "./bisync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Finished ERROR in 4h31m15.136319839s (try 1/5): exit status 2: Failed []