"./bisync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Starting (try 1/5) 2025/08/02 01:15:00 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-loleyef3mimi" 2025/08/02 01:15:00 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/08/02 01:15:00 DEBUG : Too many requests. Trying again in 3472 seconds. 2025/08/02 01:15:00 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 57m52s) 2025/08/02 01:15:00 DEBUG : pacer: Rate limited, increasing sleep to 57m52s 2025/08/02 01:15:02 DEBUG : Too many requests. Trying again in 3470 seconds. 2025/08/02 01:15:02 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 57m50s) 2025/08/02 01:15:02 DEBUG : pacer: Rate limited, increasing sleep to 57m50s 2025/08/02 01:22:30 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/02 02:12:52 DEBUG : Config file has changed externally - reloading 2025/08/02 02:12:52 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/02 02:12:52 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/02 02:12:53 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/02 02:12:53 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/02 02:12:53 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/08/02 03:10:43 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/02 03:10:43 DEBUG : pacer: low level retry 4/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/02 03:12:51 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/02 04:10:42 DEBUG : Config file has changed externally - reloading 2025/08/02 04:10:42 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/02 04:10:42 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/02 04:10:43 DEBUG : pacer: Reducing sleep to 45m0s 2025/08/02 04:12:49 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/02 05:10:42 DEBUG : Config file has changed externally - reloading 2025/08/02 05:10:42 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/02 05:10:42 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/02 05:10:43 DEBUG : pacer: Reducing sleep to 33m45s 2025/08/02 05:12:49 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/02 05:55:42 DEBUG : Config file has changed externally - reloading 2025/08/02 05:55:42 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/02 05:55:42 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/02 05:55:43 DEBUG : Too many requests. Trying again in 72000 seconds. 2025/08/02 05:55:43 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 20h0m0s) 2025/08/02 05:55:43 DEBUG : pacer: Rate limited, increasing sleep to 20h0m0s 2025/08/02 06:12:49 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/02 06:29:27 DEBUG : Config file has changed externally - reloading 2025/08/02 06:29:27 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/02 06:29:27 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/02 06:29:28 DEBUG : Too many requests. Trying again in 86400 seconds. 2025/08/02 06:29:28 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 24h0m0s) 2025/08/02 06:29:28 DEBUG : pacer: Rate limited, increasing sleep to 24h0m0s 2025/08/02 07:12:51 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/03 02:29:27 DEBUG : Config file has changed externally - reloading 2025/08/03 02:29:27 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/03 02:29:27 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/03 02:29:28 DEBUG : Too many requests. Trying again in 127889 seconds. 2025/08/03 02:29:28 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 35h31m29s) 2025/08/03 02:29:28 DEBUG : pacer: Rate limited, increasing sleep to 35h31m29s 2025/08/03 03:00:55 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/04 02:29:27 DEBUG : Config file has changed externally - reloading 2025/08/04 02:29:27 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/04 02:29:27 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/04 02:29:28 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/04 02:29:28 DEBUG : TestOneDrive: Saved new token in config file 2025/08/04 02:29:30 DEBUG : pacer: Reducing sleep to 26h38m36.75s 2025/08/04 02:29:30 DEBUG : Creating backend with remote "/tmp/rclone1491909158" === RUN TestBisyncRemoteLocal 2025/08/04 02:29:30 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-fuliwic0vulo" 2025/08/04 02:29:30 DEBUG : Too many requests. Trying again in 54000 seconds. 2025/08/04 02:29:30 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 15h0m0s) 2025/08/04 02:29:30 DEBUG : pacer: Rate limited, increasing sleep to 15h0m0s 2025/08/04 02:29:31 DEBUG : Too many requests. Trying again in 53999 seconds. 2025/08/04 02:29:31 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 14h59m59s) 2025/08/04 02:29:31 DEBUG : pacer: Rate limited, increasing sleep to 14h59m59s 2025/08/04 03:29:27 DEBUG : OneDrive root 'rclone-test-loleyef3mimi': Token expired but no uploads in progress - doing nothing 2025/08/04 03:29:27 DEBUG : OneDrive root 'rclone-test-fuliwic0vulo': Token expired but no uploads in progress - doing nothing panic: test timed out after 1h0m0s running tests: TestBisyncRemoteLocal (1h0m0s) goroutine 190 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 60 minutes]: testing.(*T).Run(0xc00035f340, {0x272bfb9?, 0xc000069ad8?}, 0x2856a20) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc00035f340) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc00035f340, 0xc000069c18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc000556ea0, {0x3f58d40, 0x3, 0x3}, {0xee022120a?, 0x3f98220?, 0x3f98220?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc0004c39a0) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc0004c39a0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/cmd/bisync_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:229 main.main() _testmain.go:53 +0xa9 goroutine 39 [syscall, 3014 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 187 [sleep, 60 minutes]: time.Sleep(0x311cdad16000) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0xc0006eb888?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 143 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:168 +0xef goroutine 40 [chan receive, 3014 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 41 [select]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc00042b400) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 124 [sleep, 60 minutes]: time.Sleep(0x74507a6a6a00) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0xc0006eb188?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:168 +0xef goroutine 143 [chan receive, 60 minutes]: github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc000695200) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:161 +0x25 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000695200, 0xc00092b000, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:198 +0x5c github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000695200, 0xc00092b000) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:218 +0x93 github.com/rclone/rclone/backend/onedrive.(*Fs).readMetaDataForPath(0xc0005c5980, {0x2b98f68, 0x3fbba60}, {0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:949 +0x2d9 github.com/rclone/rclone/backend/onedrive.NewFs({0x2b98f68, 0x3fbba60}, {0xc00075bd70, 0xc}, {0xc00075bd7d, 0x18}, {0x2b843b8, 0xc0003e27b0}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1139 +0xa39 github.com/rclone/rclone/fs.NewFs({0x2b98f68, 0x3fbba60}, {0xc00075bd70, 0x25}) /home/rclone/go/src/github.com/rclone/rclone/fs/newfs.go:75 +0x378 github.com/rclone/rclone/fstest.RandomRemote() /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:462 +0x51 github.com/rclone/rclone/cmd/bisync_test.TestBisyncRemoteLocal(0xc00035f500) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:237 +0x9d testing.tRunner(0xc00035f500, 0x2856a20) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 144 [select]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc00092afc0) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 143 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 "./bisync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Finished ERROR in 50h14m30.141059023s (try 1/5): exit status 2: Failed []