"./gitannex.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(CheckPresentAndTransfer|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace)$'" - Starting (try 2/5) 2026/02/06 03:16:32 DEBUG : Creating backend with remote "TestDrime:rclone-test-cicumut3loku" 2026/02/06 03:16:32 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/06 03:16:33 DEBUG : Creating backend with remote "/tmp/rclone4244379539" === RUN TestGitAnnexFstestBackendCases === RUN TestGitAnnexFstestBackendCases/TransferStoreAbsolute run.go:185: Remote "drime root 'rclone-test-cicumut3loku'", Local "Local file system at /tmp/rclone4244379539", Modify Window "876000h0m0s" 2026/02/06 03:16:33 DEBUG : Creating backend with remote "TestDrime:rclone-test-cicumut3loku" 2026/02/06 03:16:34 DEBUG : Creating backend with remote "/tmp/rclone4244379539" 2026/02/06 03:16:34 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/02/06 03:16:43 DEBUG : KeyAbsolute: size = 5 OK 2026/02/06 03:16:43 INFO : file.txt: Copied (new) to: KeyAbsolute 2026/02/06 03:16:44 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/02/06 03:16:49 DEBUG : KeyAbsolute2: size = 5 OK 2026/02/06 03:16:49 INFO : file.txt: Copied (new) to: KeyAbsolute2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1002 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute Messages: listing wrong, want KeyAbsolute (5), KeyAbsolute2 (5) got KeyAbsolute (5) fstest.go:203: Not found "KeyAbsolute2" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1002 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: 0 actual : 1 Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1417 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute Messages: listing wrong, want got KeyAbsolute (5), KeyAbsolute2 (5) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1417 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute Messages: Unexpected file "KeyAbsolute" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1417 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute Messages: Unexpected file "KeyAbsolute2" === RUN TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace run.go:185: Remote "drime root 'rclone-test-cicumut3loku'", Local "Local file system at /tmp/rclone4244379539", Modify Window "876000h0m0s" 2026/02/06 03:17:08 DEBUG : Creating backend with remote "TestDrime:rclone-test-cicumut3loku" 2026/02/06 03:17:09 DEBUG : Creating backend with remote "../../rclone4244379539" 2026/02/06 03:17:09 DEBUG : fs cache: renaming cache item "../../rclone4244379539" to be canonical "/tmp/rclone4244379539" 2026/02/06 03:17:09 DEBUG : filename with spaces.txt: Need to transfer - File not found at Destination 2026/02/06 03:17:11 DEBUG : KeyRelative: size = 5 OK 2026/02/06 03:17:11 INFO : filename with spaces.txt: Copied (new) to: KeyRelative fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1089 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace Messages: listing wrong, want KeyRelative (5) got fstest.go:203: Not found "KeyRelative" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1089 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: 0 actual : 1 Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1417 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace Messages: listing wrong, want got KeyRelative (5) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1417 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace Messages: Unexpected file "KeyRelative" 2026/02/06 03:17:30 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/06 03:17:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/06 03:17:30 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/06 03:17:30 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/06 03:17:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/06 03:17:31 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/06 03:17:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/06 03:17:31 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/06 03:17:31 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/06 03:17:31 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/06 03:17:31 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/06 03:17:31 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/06 03:17:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/06 03:17:32 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/06 03:17:32 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/06 03:17:32 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/06 03:17:34 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/06 03:17:34 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/06 03:17:36 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/06 03:17:36 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "KeyRelative" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/06 03:17:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/06 03:17:41 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/06 03:17:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/06 03:18:12 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/06 03:18:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/06 03:18:52 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/06 03:19:12 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/06 03:19:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/06 03:19:52 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/06 03:20:12 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/06 03:20:32 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "KeyRelative" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/06 03:20:52 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/06 03:21:12 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/06 03:21:32 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/06 03:21:52 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/06 03:22:12 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/06 03:22:32 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/06 03:22:52 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/06 03:23:12 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/06 03:23:32 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/06 03:23:52 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "KeyRelative" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "KeyRelative" failed: failed to delete item: Error "Server Error" 2026/02/06 03:24:12 DEBUG : pacer: Reducing sleep to 10s === RUN TestGitAnnexFstestBackendCases/CheckPresentAndTransfer run.go:185: Remote "drime root 'rclone-test-cicumut3loku'", Local "Local file system at /tmp/rclone4244379539", Modify Window "876000h0m0s" 2026/02/06 03:24:12 DEBUG : Config file has changed externally - reloading 2026/02/06 03:24:12 DEBUG : Creating backend with remote "TestDrime:rclone-test-cicumut3loku" 2026/02/06 03:24:13 DEBUG : Creating backend with remote "/tmp/rclone4244379539" 2026/02/06 03:24:13 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/02/06 03:24:16 DEBUG : KeyAbsolute: size = 5 OK 2026/02/06 03:24:16 INFO : file.txt: Copied (new) to: KeyAbsolute 2026/02/06 03:24:32 DEBUG : pacer: Reducing sleep to 5s 2026/02/06 03:24:42 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/06 03:24:47 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/06 03:24:49 DEBUG : pacer: Reducing sleep to 625ms 2026/02/06 03:24:51 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/06 03:24:51 DEBUG : pacer: Reducing sleep to 156.25ms === RUN TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey run.go:185: Remote "drime root 'rclone-test-cicumut3loku'", Local "Local file system at /tmp/rclone4244379539", Modify Window "876000h0m0s" 2026/02/06 03:24:51 DEBUG : Creating backend with remote "TestDrime:rclone-test-cicumut3loku" 2026/02/06 03:24:52 DEBUG : Creating backend with remote "/tmp/rclone4244379539" 2026/02/06 03:24:52 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/02/06 03:24:56 DEBUG : SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key: size = 5 OK 2026/02/06 03:24:56 INFO : file.txt: Copied (new) to: SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key 2026/02/06 03:24:56 DEBUG : pacer: Reducing sleep to 78.125ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/06 03:24:58 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/06 03:24:58 DEBUG : pacer: Reducing sleep to 19.53125ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/06 03:25:00 DEBUG : pacer: Reducing sleep to 10ms fstest.go:292: Sleeping for 7s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- FAIL: TestGitAnnexFstestBackendCases (523.54s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStoreAbsolute (34.97s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace (423.78s) --- PASS: TestGitAnnexFstestBackendCases/CheckPresentAndTransfer (39.27s) --- PASS: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey (25.52s) FAIL 2026/02/06 03:25:17 DEBUG : drime root 'rclone-test-cicumut3loku': Purge remote "./gitannex.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(CheckPresentAndTransfer|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace)$'" - Finished ERROR in 8m45.529258742s (try 2/5): exit status 1: Failed [TestGitAnnexFstestBackendCases/TransferStoreAbsolute TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace]