"./gitannex.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Starting (try 3/5) 2025/08/02 06:12:52 DEBUG : Creating backend with remote "TestOneDrive:rclone-test-tiqizaf0nobe" 2025/08/02 06:12:52 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/08/02 06:12:52 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/02 06:12:52 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/02 06:12:52 DEBUG : TestOneDrive: Saved new token in config file 2025/08/02 06:12:53 DEBUG : Too many requests. Trying again in 104400 seconds. 2025/08/02 06:12:53 DEBUG : pacer: low level retry 1/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 29h0m0s) 2025/08/02 06:12:53 DEBUG : pacer: Rate limited, increasing sleep to 29h0m0s 2025/08/02 06:12:53 DEBUG : Too many requests. Trying again in 3600 seconds. 2025/08/02 06:12:53 DEBUG : pacer: low level retry 2/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 1h0m0s) 2025/08/02 06:12:53 DEBUG : pacer: Rate limited, increasing sleep to 1h0m0s 2025/08/02 07:12:51 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing 2025/08/03 11:12:53 DEBUG : Config file has changed externally - reloading 2025/08/03 11:12:53 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/03 11:12:53 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/03 11:12:53 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/03 11:12:53 DEBUG : TestOneDrive: Saved new token in config file 2025/08/03 11:12:54 DEBUG : Too many requests. Trying again in 97200 seconds. 2025/08/03 11:12:54 DEBUG : pacer: low level retry 3/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 27h0m0s) 2025/08/03 11:12:54 DEBUG : pacer: Rate limited, increasing sleep to 27h0m0s 2025/08/03 12:12:52 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing 2025/08/03 12:12:53 DEBUG : TestOneDrive: Loaded invalid token from config file - ignoring 2025/08/03 12:12:53 DEBUG : Saving config "token" in section "TestOneDrive" of the config file 2025/08/03 12:12:53 DEBUG : TestOneDrive: Saved new token in config file 2025/08/03 12:12:54 DEBUG : Too many requests. Trying again in 93600 seconds. 2025/08/03 12:12:54 DEBUG : pacer: low level retry 4/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 26h0m0s) 2025/08/03 12:12:54 DEBUG : pacer: Rate limited, increasing sleep to 26h0m0s 2025/08/03 13:12:52 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing 2025/08/04 15:12:53 DEBUG : Config file has changed externally - reloading 2025/08/04 15:12:53 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/04 15:12:53 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/04 15:12:53 DEBUG : Too many requests. Trying again in 14400 seconds. 2025/08/04 15:12:53 DEBUG : pacer: low level retry 5/10 (error accessDenied: throttledRequest: Too Many Requests: trying again in 4h0m0s) 2025/08/04 15:12:53 DEBUG : pacer: Rate limited, increasing sleep to 4h0m0s 2025/08/04 16:01:02 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing 2025/08/05 17:12:53 DEBUG : Config file has changed externally - reloading 2025/08/05 17:12:53 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/05 17:12:53 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/05 17:12:53 DEBUG : pacer: Reducing sleep to 3h0m0s 2025/08/05 17:40:40 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing 2025/08/05 21:12:53 DEBUG : Config file has changed externally - reloading 2025/08/05 21:12:53 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/05 21:12:53 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/05 21:12:53 DEBUG : pacer: Reducing sleep to 2h15m0s 2025/08/05 21:22:32 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing 2025/08/06 00:12:53 DEBUG : Config file has changed externally - reloading 2025/08/06 00:12:53 DEBUG : TestOneDrive: Loaded fresh token from config file 2025/08/06 00:12:53 DEBUG : TestOneDrive: Loaded new refresh token from config file 2025/08/06 00:12:53 DEBUG : pacer: Reducing sleep to 1h41m15s 2025/08/06 00:12:53 DEBUG : Creating backend with remote "/tmp/rclone1397644939" === RUN TestEndToEnd e2e_test.go:189: Skipping because fstest remote was specified. --- SKIP: TestEndToEnd (0.00s) === RUN TestEndToEndMigration e2e_test.go:189: Skipping because fstest remote was specified. --- SKIP: TestEndToEndMigration (0.00s) === RUN TestEndToEndRepoLayoutCompat e2e_test.go:189: Skipping because fstest remote was specified. --- SKIP: TestEndToEndRepoLayoutCompat (0.00s) === RUN TestFixArgsForSymlinkIdentity --- PASS: TestFixArgsForSymlinkIdentity (0.00s) === RUN TestFixArgsForSymlinkCorrectName --- PASS: TestFixArgsForSymlinkCorrectName (0.00s) === RUN TestMessageParser === RUN TestMessageParser/OneParam === PAUSE TestMessageParser/OneParam === RUN TestMessageParser/TwoParams === PAUSE TestMessageParser/TwoParams === RUN TestMessageParser/TwoParamsNoTrailingNewline === PAUSE TestMessageParser/TwoParamsNoTrailingNewline === RUN TestMessageParser/ThreeParamsWhereFinalParamContainsSpaces === PAUSE TestMessageParser/ThreeParamsWhereFinalParamContainsSpaces === RUN TestMessageParser/OneLongFinalParameter === PAUSE TestMessageParser/OneLongFinalParameter === RUN TestMessageParser/MultipleSpaces === PAUSE TestMessageParser/MultipleSpaces === RUN TestMessageParser/StartsWithSpace === PAUSE TestMessageParser/StartsWithSpace === CONT TestMessageParser/OneParam === CONT TestMessageParser/OneLongFinalParameter === RUN TestMessageParser/OneLongFinalParameter/lineEnding === RUN TestMessageParser/OneLongFinalParameter/lineEnding0a === CONT TestMessageParser/ThreeParamsWhereFinalParamContainsSpaces === CONT TestMessageParser/TwoParams === CONT TestMessageParser/TwoParamsNoTrailingNewline === CONT TestMessageParser/MultipleSpaces === CONT TestMessageParser/StartsWithSpace === RUN TestMessageParser/OneLongFinalParameter/lineEnding0d === RUN TestMessageParser/OneLongFinalParameter/lineEnding0d0a === RUN TestMessageParser/OneLongFinalParameter/lineEnding0a0d --- PASS: TestMessageParser (0.00s) --- PASS: TestMessageParser/OneParam (0.00s) --- PASS: TestMessageParser/ThreeParamsWhereFinalParamContainsSpaces (0.00s) --- PASS: TestMessageParser/TwoParams (0.00s) --- PASS: TestMessageParser/TwoParamsNoTrailingNewline (0.00s) --- PASS: TestMessageParser/MultipleSpaces (0.00s) --- PASS: TestMessageParser/StartsWithSpace (0.00s) --- PASS: TestMessageParser/OneLongFinalParameter (0.00s) --- PASS: TestMessageParser/OneLongFinalParameter/lineEnding (0.00s) --- PASS: TestMessageParser/OneLongFinalParameter/lineEnding0a (0.00s) --- PASS: TestMessageParser/OneLongFinalParameter/lineEnding0d (0.00s) --- PASS: TestMessageParser/OneLongFinalParameter/lineEnding0d0a (0.00s) --- PASS: TestMessageParser/OneLongFinalParameter/lineEnding0a0d (0.00s) === RUN TestConfigDefinitionOneName --- PASS: TestConfigDefinitionOneName (0.00s) === RUN TestConfigDefinitionTwoNames --- PASS: TestConfigDefinitionTwoNames (0.00s) === RUN TestConfigDefinitionThreeNames --- PASS: TestConfigDefinitionThreeNames (0.00s) === RUN TestWindowsFilepathRelQuirk gitannex_test.go:371: --- SKIP: TestWindowsFilepathRelQuirk (0.00s) === RUN TestReadLineHasShortDeadline --- PASS: TestReadLineHasShortDeadline (0.05s) === RUN TestGitAnnexFstestBackendCases === RUN TestGitAnnexFstestBackendCases/HandlesInit run.go:180: Remote "OneDrive root 'rclone-test-tiqizaf0nobe'", Local "Local file system at /tmp/rclone1397644939", Modify Window "1s" 2025/08/06 00:40:40 DEBUG : OneDrive root 'rclone-test-tiqizaf0nobe': Token expired but no uploads in progress - doing nothing panic: test timed out after 1h0m0s running tests: TestGitAnnexFstestBackendCases (1h0m0s) TestGitAnnexFstestBackendCases/HandlesInit (1h0m0s) goroutine 122 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 61 minutes]: testing.(*T).Run(0xc000505a40, {0x271aed4?, 0xc00006dad8?}, 0x281ef00) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000505a40) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000505a40, 0xc00006dc18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc00083f278, {0x3f0a560, 0xc, 0xc}, {0xee0249505?, 0x3f43b20?, 0x3f43b20?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc00059db80) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc00059db80) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/cmd/gitannex.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1408 main.main() _testmain.go:69 +0xa9 goroutine 159 [sleep, 61 minutes]: time.Sleep(0x75ded9f6800) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0x0?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:168 +0xef goroutine 230 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 12 [syscall, 5460 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 13 [chan receive, 5460 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 14 [select, 34 minutes]: github.com/rclone/rclone/lib/oauthutil.(*Renew).renewOnExpiry(0xc0006a7180) /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:43 +0x86 created by github.com/rclone/rclone/lib/oauthutil.NewRenew in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/lib/oauthutil/renew.go:32 +0xe5 goroutine 210 [chan receive, 61 minutes]: testing.(*T).Run(0xc000568c40, {0x26da383?, 0xf?}, 0xc000308f30) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/cmd/gitannex.TestGitAnnexFstestBackendCases(0xc000568c40) /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1415 +0x67 testing.tRunner(0xc000568c40, 0x281ef00) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 232 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 233 [chan receive, 61 minutes]: github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc000393260) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:161 +0x25 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000393260, 0xc0002eb700, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:198 +0x5c github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000393260, 0xc0002eb700) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:218 +0x93 github.com/rclone/rclone/backend/onedrive.(*Fs).readMetaDataForPathRelativeToID(0xc000642300, {0x2b57e48, 0x3f670e0}, {0xc000aac0f0, 0x25}, {0xc0003c58cd, 0x18}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:934 +0x2c9 github.com/rclone/rclone/backend/onedrive.(*Fs).FindLeaf(0xc000642300, {0x2b57e48, 0x3f670e0}, {0xc000aac0f0, 0x25}, {0xc0003c58cd, 0x18}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1232 +0x77 github.com/rclone/rclone/lib/dircache.(*DirCache)._findDir(0xc000180bd0, {0x2b57e48, 0x3f670e0}, {0xc0003c58cd, 0x18}, 0x0) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:234 +0x112 github.com/rclone/rclone/lib/dircache.(*DirCache)._findRoot(0xc000180bd0, {0x2b57e48?, 0x3f670e0?}, 0xd0?) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:305 +0x45 github.com/rclone/rclone/lib/dircache.(*DirCache).FindDir(0xc000180bd0, {0x2b57e48, 0x3f670e0}, {0x0, 0x0}, 0x0) /home/rclone/go/src/github.com/rclone/rclone/lib/dircache/dircache.go:201 +0xcd github.com/rclone/rclone/backend/onedrive.(*Fs).List(0xc000642300, {0x2b57e48, 0x3f670e0}, {0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/onedrive/onedrive.go:1380 +0x65 github.com/rclone/rclone/fs/list.DirSorted({0x2b57e48, 0x3f670e0}, {0x2b6f5f0, 0xc000642300}, 0x1, {0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/fs/list/list.go:26 +0x67 github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:403 +0x1e9 created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 231 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 227 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 228 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 229 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 226 [select, 61 minutes]: github.com/rclone/rclone/fs/walk.walk.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:398 +0x16c created by github.com/rclone/rclone/fs/walk.walk in goroutine 211 /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:395 +0x1df goroutine 211 [sync.WaitGroup.Wait, 61 minutes]: sync.runtime_SemacquireWaitGroup(0xc00009fb68?) /usr/local/go/src/runtime/sema.go:110 +0x25 sync.(*WaitGroup).Wait(0x2b57e48?) /usr/local/go/src/sync/waitgroup.go:118 +0x48 github.com/rclone/rclone/fs/walk.walk({0x2b57e48, 0x3f670e0}, {0x2b6f5f0, 0xc000642300}, {0x0, 0x0}, 0x1, 0xffffffffffffffff, 0xc00035cc00, 0x2820490) /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:453 +0x355 github.com/rclone/rclone/fs/walk.walkListDirSorted(...) /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:349 github.com/rclone/rclone/fs/walk.Walk({0x2b57e48, 0x3f670e0}, {0x2b6f5f0, 0xc000642300}, {0x0, 0x0}, 0x1, 0xffffffffffffffff, 0xc00035cc00) /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:76 +0x2a5 github.com/rclone/rclone/fs/walk.listRwalk({0x2b57e48, 0x3f670e0}, {0x2b6f5f0, 0xc000642300}, {0x0, 0x0}, 0x1, 0xffffffffffffffff, 0x3, 0xc00035cb40) /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:170 +0x10d github.com/rclone/rclone/fs/walk.ListR({0x2b57e48, 0x3f670e0}, {0x2b6f5f0, 0xc000642300}, {0x0, 0x0}, 0x1, 0xffffffffffffffff, 0x3, 0xc00035cb40) /home/rclone/go/src/github.com/rclone/rclone/fs/walk/walk.go:160 +0x236 github.com/rclone/rclone/fstest.newRunIndividual.func1() /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:150 +0x107 github.com/rclone/rclone/fstest.(*Run).Finalise(0xc0002fd5e0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 +0x1c github.com/rclone/rclone/cmd/gitannex.TestGitAnnexFstestBackendCases.func1.1() /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1417 +0x17 testing.(*common).Cleanup.func1() /usr/local/go/src/testing/testing.go:1211 +0x106 testing.(*common).runCleanup(0xc000568e00, 0xc00030cdc0?) /usr/local/go/src/testing/testing.go:1445 +0xea testing.tRunner.func2() /usr/local/go/src/testing/testing.go:1786 +0x25 testing.tRunner(0xc000568e00, 0xc000308f30) /usr/local/go/src/testing/testing.go:1798 +0x11e created by testing.(*T).Run in goroutine 210 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 192 [select, 61 minutes]: io.(*pipe).read(0xc000a3ea20, {0xc00056a000, 0x1000, 0xc0000b5e00?}) /usr/local/go/src/io/pipe.go:57 +0xa5 io.(*PipeReader).Read(0xc21cc566551f3754?, {0xc00056a000?, 0x419691?, 0x419691?}) /usr/local/go/src/io/pipe.go:134 +0x1a bufio.(*Reader).fill(0xc000a3eae0) /usr/local/go/src/bufio/bufio.go:113 +0x103 bufio.(*Reader).ReadSlice(0xc000a3eae0, 0xa) /usr/local/go/src/bufio/bufio.go:380 +0x29 bufio.(*Reader).collectFragments(0xc000a3eae0, 0xa) /usr/local/go/src/bufio/bufio.go:455 +0x70 bufio.(*Reader).ReadString(0xc0001102a0?, 0x40?) /usr/local/go/src/bufio/bufio.go:502 +0x1f github.com/rclone/rclone/cmd/gitannex.(*testState).readLineWithTimeout.func1() /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:285 +0x45 created by github.com/rclone/rclone/cmd/gitannex.(*testState).readLineWithTimeout in goroutine 191 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:284 +0xf7 "./gitannex.test -test.v -test.timeout 1h0m0s -remote TestOneDrive: -verbose" - Finished ERROR in 91h0m1.568591019s (try 3/5): exit status 2: Failed []