"./gitannex.test -test.v -test.timeout 1h0m0s -remote TestCloudinary: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(Remove|RemovePreexistingFile|StoreCheckpresentRetrieve|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace|TransferStoreRelative)$'" - Starting (try 4/5) 2025/03/21 02:05:29 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:29 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/03/21 02:05:30 DEBUG : Creating backend with remote "/tmp/rclone408929207" === RUN TestGitAnnexFstestBackendCases === RUN TestGitAnnexFstestBackendCases/TransferStoreAbsolute run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:30 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:30 DEBUG : Creating backend with remote "/tmp/rclone408929207" 2025/03/21 02:05:31 DEBUG : file.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:31 DEBUG : file.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:31 INFO : file.txt: Copied (new) to: KeyAbsolute 2025/03/21 02:05:32 DEBUG : file.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:32 DEBUG : file.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:32 INFO : file.txt: Copied (new) to: KeyAbsolute2 gitannex_test.go:320: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:320 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:964 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1405 Error: Not equal: expected: "CHECKPRESENT-SUCCESS KeyAbsolute2\n" actual : "CHECKPRESENT-FAILURE KeyAbsolute2\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -CHECKPRESENT-SUCCESS KeyAbsolute2 +CHECKPRESENT-FAILURE KeyAbsolute2 Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute === RUN TestGitAnnexFstestBackendCases/TransferStoreRelative run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:35 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:36 DEBUG : Creating backend with remote "../../rclone408929207" 2025/03/21 02:05:36 DEBUG : fs cache: renaming cache item "../../rclone408929207" to be canonical "/tmp/rclone408929207" 2025/03/21 02:05:36 DEBUG : file.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:37 DEBUG : file.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:37 INFO : file.txt: Copied (new) to: KeyRelative gitannex_test.go:320: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:320 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1009 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1405 Error: Not equal: expected: "CHECKPRESENT-SUCCESS KeyRelative\n" actual : "CHECKPRESENT-FAILURE KeyRelative\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -CHECKPRESENT-SUCCESS KeyRelative +CHECKPRESENT-FAILURE KeyRelative Test: TestGitAnnexFstestBackendCases/TransferStoreRelative === RUN TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:38 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:39 DEBUG : Creating backend with remote "../../rclone408929207" 2025/03/21 02:05:39 DEBUG : fs cache: renaming cache item "../../rclone408929207" to be canonical "/tmp/rclone408929207" 2025/03/21 02:05:39 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:39 DEBUG : pacer: low level retry 1/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:39 DEBUG : pacer: Rate limited, increasing sleep to 2µs 2025/03/21 02:05:39 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:39 DEBUG : pacer: low level retry 2/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:39 DEBUG : pacer: Rate limited, increasing sleep to 4µs 2025/03/21 02:05:39 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:39 DEBUG : pacer: low level retry 3/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:39 DEBUG : pacer: Rate limited, increasing sleep to 8µs 2025/03/21 02:05:40 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:40 DEBUG : pacer: low level retry 4/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:40 DEBUG : pacer: Rate limited, increasing sleep to 10µs 2025/03/21 02:05:40 DEBUG : pacer: Reducing sleep to 7.5µs 2025/03/21 02:05:40 DEBUG : filename with spaces.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:41 DEBUG : filename with spaces.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:41 INFO : filename with spaces.txt: Copied (new) to: KeyRelative 2025/03/21 02:05:41 DEBUG : pacer: Reducing sleep to 5.625µs gitannex_test.go:320: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:320 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1051 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1405 Error: Not equal: expected: "CHECKPRESENT-SUCCESS KeyRelative\n" actual : "CHECKPRESENT-FAILURE KeyRelative\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -CHECKPRESENT-SUCCESS KeyRelative +CHECKPRESENT-FAILURE KeyRelative Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace === RUN TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:43 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:43 DEBUG : Creating backend with remote "/tmp/rclone408929207" 2025/03/21 02:05:43 DEBUG : file.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:44 DEBUG : file.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:44 INFO : file.txt: Copied (new) to: SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key gitannex_test.go:320: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:320 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1150 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1405 Error: Not equal: expected: "CHECKPRESENT-SUCCESS SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key\n" actual : "CHECKPRESENT-FAILURE SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -CHECKPRESENT-SUCCESS SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key +CHECKPRESENT-FAILURE SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key Test: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey === RUN TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:46 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:46 DEBUG : Creating backend with remote "/tmp/rclone408929207" 2025/03/21 02:05:47 DEBUG : file.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:47 DEBUG : file.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:47 INFO : file.txt: Copied (new) to: SomeKey gitannex_test.go:320: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:320 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1192 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1405 Error: Not equal: expected: "CHECKPRESENT-SUCCESS SomeKey\n" actual : "CHECKPRESENT-FAILURE SomeKey\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -CHECKPRESENT-SUCCESS SomeKey +CHECKPRESENT-FAILURE SomeKey Test: TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve === RUN TestGitAnnexFstestBackendCases/RemovePreexistingFile run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:51 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:52 INFO : SomeKey: Deleted 2025/03/21 02:05:53 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:53 DEBUG : pacer: low level retry 1/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:53 DEBUG : pacer: Rate limited, increasing sleep to 2µs 2025/03/21 02:05:53 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:53 DEBUG : pacer: low level retry 2/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:53 DEBUG : pacer: Rate limited, increasing sleep to 4µs 2025/03/21 02:05:53 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:53 DEBUG : pacer: low level retry 3/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:53 DEBUG : pacer: Rate limited, increasing sleep to 8µs 2025/03/21 02:05:53 DEBUG : Retrying API error partial response so waiting for eventual consistency 2025/03/21 02:05:53 DEBUG : pacer: low level retry 4/10 (error partial response so waiting for eventual consistency) 2025/03/21 02:05:53 DEBUG : pacer: Rate limited, increasing sleep to 10µs 2025/03/21 02:05:54 DEBUG : pacer: Reducing sleep to 7.5µs === RUN TestGitAnnexFstestBackendCases/Remove run.go:180: Remote "Cloudinary root 'rclone-test-moqaqet2cohu'", Local "Local file system at /tmp/rclone408929207", Modify Window "876000h0m0s" 2025/03/21 02:05:55 DEBUG : Creating backend with remote "TestCloudinary:rclone-test-moqaqet2cohu" 2025/03/21 02:05:56 DEBUG : Creating backend with remote "/tmp/rclone408929207" 2025/03/21 02:05:56 DEBUG : file.txt: Need to transfer - File not found at Destination 2025/03/21 02:05:57 DEBUG : file.txt: md5 = eb61eead90e3b899c6bcbe27ac581660 OK 2025/03/21 02:05:57 INFO : file.txt: Copied (new) to: SomeKey gitannex_test.go:320: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:320 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1270 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1405 Error: Not equal: expected: "CHECKPRESENT-SUCCESS SomeKey\n" actual : "CHECKPRESENT-FAILURE SomeKey\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -CHECKPRESENT-SUCCESS SomeKey +CHECKPRESENT-FAILURE SomeKey Test: TestGitAnnexFstestBackendCases/Remove --- FAIL: TestGitAnnexFstestBackendCases (28.56s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStoreAbsolute (5.14s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStoreRelative (3.35s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace (4.08s) --- FAIL: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey (3.32s) --- FAIL: TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve (3.63s) --- PASS: TestGitAnnexFstestBackendCases/RemovePreexistingFile (5.48s) --- FAIL: TestGitAnnexFstestBackendCases/Remove (3.56s) FAIL 2025/03/21 02:05:59 DEBUG : Cloudinary root 'rclone-test-moqaqet2cohu': Purge dir "" "./gitannex.test -test.v -test.timeout 1h0m0s -remote TestCloudinary: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(Remove|RemovePreexistingFile|StoreCheckpresentRetrieve|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace|TransferStoreRelative)$'" - Finished ERROR in 29.787105837s (try 4/5): exit status 1: Failed [TestGitAnnexFstestBackendCases/TransferStoreAbsolute TestGitAnnexFstestBackendCases/TransferStoreRelative TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve TestGitAnnexFstestBackendCases/Remove]