"./gitannex.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(CheckPresentAndTransfer|CheckpresentTransferCheckpresent|Remove|RemovePreexistingFile|StoreCheckpresentRetrieve|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace|TransferStoreRelative)$'" - Starting (try 5/5) 2026/04/14 03:27:06 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:06 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/14 03:27:07 DEBUG : Creating backend with remote "/tmp/rclone1460641896" === RUN TestGitAnnexFstestBackendCases === RUN TestGitAnnexFstestBackendCases/TransferStoreAbsolute run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:27:07 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:08 DEBUG : Creating backend with remote "/tmp/rclone1460641896" 2026/04/14 03:27:08 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:27:09 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:09 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:27:10 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:10 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:10 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:27:10 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:10 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:10 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:27:10 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:11 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:11 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:27:11 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:11 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:11 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:27:11 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:12 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:12 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:27:12 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:12 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:12 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:27:12 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:12 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:12 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:27:13 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:13 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:13 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:27:13 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:13 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:13 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:27:13 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:990 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE KeyAbsolute\n" actual : "TRANSFER-FAILURE STORE KeyAbsolute failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE KeyAbsolute +TRANSFER-FAILURE STORE KeyAbsolute failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute === RUN TestGitAnnexFstestBackendCases/TransferStoreRelative run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:27:14 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:15 DEBUG : Creating backend with remote "../../rclone1460641896" 2026/04/14 03:27:15 DEBUG : fs cache: renaming cache item "../../rclone1460641896" to be canonical "/tmp/rclone1460641896" 2026/04/14 03:27:15 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:27:16 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:16 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:16 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:27:16 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:16 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:16 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:16 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:27:16 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:16 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:16 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:16 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:27:17 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:17 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:17 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:27:17 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:17 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:17 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:27:18 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:18 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:18 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:27:18 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:18 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:18 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:27:18 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:19 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:19 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:27:19 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:19 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:19 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:27:19 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:19 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:19 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:27:19 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1044 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE KeyRelative\n" actual : "TRANSFER-FAILURE STORE KeyRelative failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE KeyRelative +TRANSFER-FAILURE STORE KeyRelative failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/TransferStoreRelative === RUN TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:27:20 DEBUG : Config file has changed externally - reloading 2026/04/14 03:27:20 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:21 DEBUG : Creating backend with remote "../../rclone1460641896" 2026/04/14 03:27:21 DEBUG : fs cache: renaming cache item "../../rclone1460641896" to be canonical "/tmp/rclone1460641896" 2026/04/14 03:27:21 DEBUG : filename with spaces.txt: Need to transfer - File not found at Destination 2026/04/14 03:27:21 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:21 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:21 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:27:22 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:22 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:22 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:27:22 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:22 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:22 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:27:22 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:23 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:23 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:27:23 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:23 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:23 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:27:23 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:24 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:24 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:27:24 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:24 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:24 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:27:24 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:24 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:24 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:27:25 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:25 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:27:25 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:25 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:27:25 ERROR : filename with spaces.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1086 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE KeyRelative\n" actual : "TRANSFER-FAILURE STORE KeyRelative failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE KeyRelative +TRANSFER-FAILURE STORE KeyRelative failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace === RUN TestGitAnnexFstestBackendCases/CheckPresentAndTransfer run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:27:26 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:27 DEBUG : Creating backend with remote "/tmp/rclone1460641896" 2026/04/14 03:27:27 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:27:27 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:27 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:27:27 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:28 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:28 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:27:28 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:28 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:28 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:27:28 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:29 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:29 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:27:29 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:29 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:29 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:27:29 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:29 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:29 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:27:30 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:30 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:30 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:27:30 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:30 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:30 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:27:30 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:31 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:31 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:27:31 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:31 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:31 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:27:31 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1119 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE KeyAbsolute\n" actual : "TRANSFER-FAILURE STORE KeyAbsolute failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE KeyAbsolute +TRANSFER-FAILURE STORE KeyAbsolute failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/CheckPresentAndTransfer === RUN TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:27:32 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:33 DEBUG : Creating backend with remote "/tmp/rclone1460641896" 2026/04/14 03:27:33 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:27:33 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:33 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:33 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:27:34 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:34 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:34 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:27:34 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:34 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:34 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:27:35 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:35 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:35 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:27:35 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:35 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:35 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:27:35 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:36 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:27:36 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:36 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:27:36 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:36 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:27:37 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:37 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:37 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:27:37 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:37 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:37 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:27:37 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1156 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE foo\n" actual : "TRANSFER-FAILURE STORE foo failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE foo +TRANSFER-FAILURE STORE foo failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent === RUN TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:27:38 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:27:39 DEBUG : Creating backend with remote "/tmp/rclone1460641896" 2026/04/14 03:27:39 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:27:39 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:39 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:39 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:27:40 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:40 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:27:40 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:27:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:27:40 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:27:40 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:40 DEBUG : pacer: low level retry 1/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:40 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/04/14 03:27:40 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:40 DEBUG : pacer: low level retry 2/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:40 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/04/14 03:27:41 DEBUG : pacer: Reducing sleep to 40ms 2026/04/14 03:27:41 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:41 DEBUG : pacer: low level retry 1/1 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:41 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/04/14 03:27:41 DEBUG : file.txt: Received error: failed to upload file: Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n" - low level retry 3/10 2026/04/14 03:27:41 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:41 DEBUG : pacer: low level retry 1/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:41 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/04/14 03:27:41 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:41 DEBUG : pacer: low level retry 2/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:41 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/04/14 03:27:41 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:41 DEBUG : pacer: low level retry 3/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:41 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/04/14 03:27:41 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:41 DEBUG : pacer: low level retry 4/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:41 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/04/14 03:27:42 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/14 03:27:42 DEBUG : pacer: low level retry 5/10 (error Error "503 Service Unavailable (503): \r\n503 Service Temporarily Unavailable\r\n\r\n

503 Service Temporarily Unavailable

\r\n
nginx
\r\n\r\n\r\n") 2026/04/14 03:27:42 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:27:43 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/14 03:27:46 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:46 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:27:46 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:27:47 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/14 03:27:50 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:50 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:27:50 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:27:51 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/14 03:27:54 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:54 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:27:54 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:27:55 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/14 03:27:57 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:27:57 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:27:57 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:27:59 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/14 03:28:01 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:01 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:28:01 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:28:03 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/14 03:28:05 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:05 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/14 03:28:05 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:28:05 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1185 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key\n" actual : "TRANSFER-FAILURE STORE SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key +TRANSFER-FAILURE STORE SHA256E-s1048576--7ba87e06b9b7903cfbaf4a38736766c161e3e7b42f06fe57f040aa410a8f0701.this-is-a-test-key failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey === RUN TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:28:06 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:28:06 DEBUG : Creating backend with remote "/tmp/rclone1460641896" 2026/04/14 03:28:07 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:28:07 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:07 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:07 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:28:07 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:08 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:08 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:28:08 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:08 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:08 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:28:08 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:08 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:08 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:28:09 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:09 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:09 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:28:09 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:09 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:09 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:28:10 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:10 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:10 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:28:10 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:10 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:10 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:28:10 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:11 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:11 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:28:11 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:11 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:11 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:28:11 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1227 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE SomeKey\n" actual : "TRANSFER-FAILURE STORE SomeKey failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE SomeKey +TRANSFER-FAILURE STORE SomeKey failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve === RUN TestGitAnnexFstestBackendCases/RemovePreexistingFile run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:28:12 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 1/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:15 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:15 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:15 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 2/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:17 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:17 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 3/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:19 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:20 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:20 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 4/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:22 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:22 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 5/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:24 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 6/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:27 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:27 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 7/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:29 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:29 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 8/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:32 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:32 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:32 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-cujazeb1xete': 9/10 (failed to upload file: Error "Server Error") 2026/04/14 03:28:34 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:34 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:290: Failed to put "SomeKey" to "drime root 'rclone-test-cujazeb1xete'": failed to upload file: Error "Server Error" 2026/04/14 03:28:34 DEBUG : pacer: Reducing sleep to 10ms === RUN TestGitAnnexFstestBackendCases/Remove run.go:185: Remote "drime root 'rclone-test-cujazeb1xete'", Local "Local file system at /tmp/rclone1460641896", Modify Window "876000h0m0s" 2026/04/14 03:28:35 DEBUG : Creating backend with remote "TestDrime:rclone-test-cujazeb1xete" 2026/04/14 03:28:36 DEBUG : Creating backend with remote "/tmp/rclone1460641896" 2026/04/14 03:28:36 DEBUG : file.txt: Need to transfer - File not found at Destination 2026/04/14 03:28:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:36 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/14 03:28:37 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:37 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:37 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/14 03:28:37 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:37 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:37 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/14 03:28:37 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:38 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:38 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/14 03:28:38 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:38 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:38 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/14 03:28:38 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:39 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:39 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:39 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/14 03:28:39 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:39 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:39 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:39 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/14 03:28:39 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:40 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/14 03:28:40 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:40 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/14 03:28:40 DEBUG : pacer: Reducing sleep to 10ms 2026/04/14 03:28:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/14 03:28:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/14 03:28:40 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/14 03:28:40 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error" gitannex_test.go:308: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:308 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1305 /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446 Error: Not equal: expected: "TRANSFER-SUCCESS STORE SomeKey\n" actual : "TRANSFER-FAILURE STORE SomeKey failed to copy file: failed to upload file: Error \"Server Error\"\n" Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -TRANSFER-SUCCESS STORE SomeKey +TRANSFER-FAILURE STORE SomeKey failed to copy file: failed to upload file: Error "Server Error" Test: TestGitAnnexFstestBackendCases/Remove --- FAIL: TestGitAnnexFstestBackendCases (94.09s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStoreAbsolute (7.25s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStoreRelative (5.80s) --- FAIL: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace (5.76s) --- FAIL: TestGitAnnexFstestBackendCases/CheckPresentAndTransfer (6.11s) --- FAIL: TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent (6.10s) --- FAIL: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey (27.80s) --- FAIL: TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve (5.91s) --- FAIL: TestGitAnnexFstestBackendCases/RemovePreexistingFile (23.20s) --- FAIL: TestGitAnnexFstestBackendCases/Remove (6.16s) FAIL 2026/04/14 03:28:41 DEBUG : drime root 'rclone-test-cujazeb1xete': Purge remote "./gitannex.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(CheckPresentAndTransfer|CheckpresentTransferCheckpresent|Remove|RemovePreexistingFile|StoreCheckpresentRetrieve|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace|TransferStoreRelative)$'" - Finished ERROR in 1m35.474854795s (try 5/5): exit status 1: Failed [TestGitAnnexFstestBackendCases/TransferStoreAbsolute TestGitAnnexFstestBackendCases/TransferStoreRelative TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace TestGitAnnexFstestBackendCases/CheckPresentAndTransfer TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve TestGitAnnexFstestBackendCases/RemovePreexistingFile TestGitAnnexFstestBackendCases/Remove]