"./bisync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Starting (try 1/5) 2025/10/10 01:45:10 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-qodegeh6vado" 2025/10/10 01:45:10 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/10/10 01:45:10 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/10/10 01:45:11 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/10/10 01:45:11 DEBUG : TestOneDrive: Saved new token in config file 2025/10/10 01:45:11 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/10/10 01:45:11 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/10/10 01:45:11 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/10/10 01:45:12 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/10/10 01:45:12 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/10/10 02:45:10 DEBUG : OneDrive root 'rclone-test-qodegeh6vado': Token expired but no uploads in progress - doing nothing 2025/10/10 02:45:11 DEBUG : Config file has changed externally - reloading 2025/10/10 02:45:11 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/10/10 02:45:12 DEBUG : Config file has changed externally - reloading 2025/10/10 02:45:12 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/10/10 02:45:12 DEBUG : TestOneDrive: Saved new token in config file 2025/10/10 02:45:12 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/10/10 02:45:12 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/10/10 03:45:11 DEBUG : OneDrive root 'rclone-test-qodegeh6vado': Token expired but no uploads in progress - doing nothing 2025/10/10 03:45:11 DEBUG : Config file has changed externally - reloading 2025/10/10 03:45:11 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/10/10 03:45:12 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/10/10 03:45:12 DEBUG : TestOneDrive: Saved new token in config file 2025/10/10 03:45:12 DEBUG : pacer: Reducing sleep to 45m0s 2025/10/10 03:45:12 DEBUG : Creating backend with remote "/tmp/rclone3643933140" === RUN TestBisyncRemoteLocal 2025/10/10 03:45:12 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-daparex2hoje" 2025/10/10 03:45:14 NOTICE: remote: TestOneDrive:rclone-test-daparex2hoje === RUN TestBisyncRemoteLocal/all_changed 2025/10/10 03:45:14 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-daparex2hoje/034514vi" 2025/10/10 03:45:15 INFO : path1: Making directory 2025/10/10 03:45:16 DEBUG : Too many requests. Trying again in 50397 seconds. 2025/10/10 03:45:16 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 13h59m57s) 2025/10/10 03:45:16 DEBUG : pacer: Rate limited, increasing sleep to 13h59m57s 2025/10/10 03:45:16 DEBUG : Too many requests. Trying again in 53997 seconds. 2025/10/10 03:45:16 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 14h59m57s) 2025/10/10 03:45:16 DEBUG : pacer: Rate limited, increasing sleep to 14h59m57s 2025/10/10 04:45:11 DEBUG : OneDrive root 'rclone-test-daparex2hoje': Token expired but no uploads in progress - doing nothing 2025/10/10 04:45:11 DEBUG : OneDrive root 'rclone-test-qodegeh6vado': Token expired but no uploads in progress - doing nothing panic: test timed out after 1h0m0s running tests: TestBisyncRemoteLocal (1h0m0s) TestBisyncRemoteLocal/all_changed (59m59s) goroutine 194 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 60 minutes]: testing.(*T).Run(0xc000186fc0, {0x27f2d59?, 0xc00006b6e0?}, 0x291f168) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000186fc0) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000186fc0, 0xc00006b820) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc0007c4030, {0x408be80, 0x4, 0x4}, {0xee07a7848?, 0x40c9f00?, 0x40c9f00?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc0003f9ae0) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc0003f9ae0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/cmd/bisync_test.TestMain(0xc0003f9ae0) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:243 +0xf2 main.main() _testmain.go:55 +0xa8 goroutine 7 [syscall, 180 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 8 [chan receive, 180 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 9 [chan receive, 180 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 10 [select]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc000430c40) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 156 [chan receive, 60 minutes]: github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc0007e4e40, 0x0) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:163 +0x26 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc0007e4e40, 0xc0004c20f0, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:231 +0xa5 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc0007e4e40, 0xc0004c20f0) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:251 +0x93 github.com/rclone/rclone/backend/onedrive.(*Fs).CreateDir(0xc000a3a780, {0x2c77608, 0xc0007c2360}, {0xc00085e0c0, 0x25}, {0xc000717a7d, 0x18}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1258 +0x2ec github.com/rclone/rclone/lib/dircache.(*DirCache)._findDir(0xc000860090, {0x2c77608, 0xc0007c2360}, {0xc000717a7d, 0x18}, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:242 +0x172 github.com/rclone/rclone/lib/dircache.(*DirCache)._findDir(0xc000860090, {0x2c77608, 0xc0007c2360}, {0xc000717a7d, 0x21}, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:227 +0xc5 github.com/rclone/rclone/lib/dircache.(*DirCache)._findRoot(0xc000860090, {0x2c77608?, 0xc0007c2360?}, 0x0?) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:305 +0x45 github.com/rclone/rclone/lib/dircache.(*DirCache).FindDir(0xc000860090, {0x2c77608, 0xc0007c2360}, {0x27bfe8b, 0x5}, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:201 +0xcd github.com/rclone/rclone/backend/onedrive.(*Fs).Mkdir(0x27bfe06?, {0x2c77608?, 0xc0007c2360?}, {0x27bfe8b?, 0x10?}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1566 +0x2f github.com/rclone/rclone/fs/operations.Mkdir({0x2c77608, 0xc0007c2360}, {0x2c8f270, 0xc000a3a780}, {0x27bfe8b, 0x5}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations.go:1052 +0x109 github.com/rclone/rclone/cmd/bisync_test.(*bisyncTest).makeTempRemote(0xc0003dd500, {0x2c77608, 0xc0007c2360}, {0xc0007b0000, 0x25}, {0x27bfe8b, 0x5}) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:639 +0x466 github.com/rclone/rclone/cmd/bisync_test.(*bisyncTest).runTestCase(0xc0003dd500, {0x2c77608, 0xc0007c2360}, 0xc0003dd340, {0xc00062da35, 0xb}) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:432 +0x149 github.com/rclone/rclone/cmd/bisync_test.testBisync.func4(0xc0003dd340) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:405 +0x234 testing.tRunner(0xc0003dd340, 0xc0007e4a80) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 120 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 155 [chan receive, 60 minutes]: github.com/rclone/rclone/lib/atexit.Register.func1.1() /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:45 +0x29 created by github.com/rclone/rclone/lib/atexit.Register.func1 in goroutine 120 /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:44 +0x68 goroutine 120 [chan receive, 60 minutes]: testing.(*T).Run(0xc000187500, {0xc00062da35?, 0x2c3ca70?}, 0xc0007e4a80) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/cmd/bisync_test.testBisync({0x2c77608, 0xc0007c2360}, 0xc000187500, {0xc0007b0000, 0x25}, {0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:398 +0x94f github.com/rclone/rclone/cmd/bisync_test.TestBisyncRemoteLocal(0xc000187500) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:256 +0x175 testing.tRunner(0xc000187500, 0x291f168) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 147 [select]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc0008321c0) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 120 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 183 [select]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc000355860, {0x2c77640, 0xc000630190}) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:352 +0x145 created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 182 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:389 +0x11a goroutine 173 [sleep, 60 minutes]: time.Sleep(0x2dd5f7486200) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0x4c696b48647a6c57?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:171 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 156 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:170 +0xf6 "./bisync.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Finished ERROR in 3h0m2.276926813s (try 1/5): exit status 2: Failed []