"./gitannex.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(CheckPresentAndTransfer|CheckpresentTransferCheckpresent|Remove|RemovePreexistingFile|StoreCheckpresentRetrieve|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace|TransferStoreRelative)$'" - Starting (try 3/5)
2026/04/10 04:52:44 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:52:44 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/04/10 04:52:46 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:52:46 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:52:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:52:46 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:52:46 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:52:46 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/10 04:52:49 DEBUG : pacer: Reducing sleep to 20ms
2026/04/10 04:52:49 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
=== RUN TestGitAnnexFstestBackendCases
=== RUN TestGitAnnexFstestBackendCases/TransferStoreAbsolute
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:52:49 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:52:52 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
2026/04/10 04:52:54 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:52:55 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:52:55 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:52:55 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:52:55 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:52:55 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:52:55 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/10 04:52:57 DEBUG : pacer: Reducing sleep to 20ms
2026/04/10 04:52:58 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:52:59 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:52:59 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:52:59 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:53:00 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:02 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:02 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:53:04 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:06 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:06 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:06 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:53:08 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:10 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:10 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:53:14 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:18 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:18 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:990
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/TransferStoreAbsolute
2026/04/10 04:53:21 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:22 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:25 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
2026/04/10 04:53:27 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:30 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:30 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10
2026/04/10 04:53:30 ERROR : file.txt: Failed to copy: failed to open source object: lstat /tmp/rclone3448640029/file.txt: no such file or directory
=== RUN TestGitAnnexFstestBackendCases/TransferStoreRelative
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:53:35 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:53:38 DEBUG : Creating backend with remote "../../rclone3448640029"
2026/04/10 04:53:38 DEBUG : fs cache: renaming cache item "../../rclone3448640029" to be canonical "/tmp/rclone3448640029"
2026/04/10 04:53:40 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:53:43 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:43 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:53:44 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:46 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:46 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:53:47 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:48 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:48 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:48 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:53:50 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:52 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:52 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:52 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:53:53 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:55 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:55 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:55 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
2026/04/10 04:53:57 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:53:58 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:53:58 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:53:58 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
2026/04/10 04:53:59 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:00 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:00 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:00 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10
2026/04/10 04:54:02 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:04 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:04 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:04 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1044
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/TransferStoreRelative
2026/04/10 04:54:05 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:07 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:07 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:07 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 8/10
2026/04/10 04:54:09 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:11 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:11 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10
2026/04/10 04:54:11 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error"
=== RUN TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:54:12 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:54:14 DEBUG : Creating backend with remote "../../rclone3448640029"
2026/04/10 04:54:14 DEBUG : fs cache: renaming cache item "../../rclone3448640029" to be canonical "/tmp/rclone3448640029"
2026/04/10 04:54:16 DEBUG : filename with spaces.txt: Need to transfer - File not found at Destination
2026/04/10 04:54:20 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:20 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:20 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:54:22 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:25 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:54:27 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:28 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:28 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:54:30 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:32 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:32 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:32 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:54:34 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:36 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
2026/04/10 04:54:39 DEBUG : pacer: Reducing sleep to 10ms
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1086
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace
2026/04/10 04:54:43 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:43 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
2026/04/10 04:54:46 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:54:49 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:54:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:54:49 DEBUG : filename with spaces.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10
2026/04/10 04:54:49 ERROR : filename with spaces.txt: Failed to copy: failed to open source object: lstat /tmp/rclone3448640029/filename with spaces.txt: no such file or directory
=== RUN TestGitAnnexFstestBackendCases/CheckPresentAndTransfer
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:54:53 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:54:56 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
2026/04/10 04:54:58 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:55:02 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:02 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:55:04 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:06 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:06 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:06 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:55:08 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:10 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:10 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:55:12 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:15 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:15 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:15 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:55:17 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:19 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:19 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
2026/04/10 04:55:21 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:23 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:23 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
2026/04/10 04:55:25 DEBUG : pacer: Reducing sleep to 10ms
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1119
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/CheckPresentAndTransfer
2026/04/10 04:55:27 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:27 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10
2026/04/10 04:55:29 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:31 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:31 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10
2026/04/10 04:55:31 ERROR : file.txt: Failed to copy: failed to open source object: lstat /tmp/rclone3448640029/file.txt: no such file or directory
=== RUN TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:55:34 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:55:38 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
2026/04/10 04:55:40 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:55:44 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:44 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:44 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:55:47 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:50 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:50 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:50 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:55:55 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:55:59 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:55:59 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:55:59 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:56:04 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:56:07 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:07 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:07 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1156
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent
2026/04/10 04:56:10 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:56:13 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:13 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
2026/04/10 04:56:16 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:56:18 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:18 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
2026/04/10 04:56:18 ERROR : file.txt: Failed to copy: failed to open source object: lstat /tmp/rclone3448640029/file.txt: no such file or directory
=== RUN TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:56:19 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:56:21 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
2026/04/10 04:56:23 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:56:27 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:27 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:56:30 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:56:32 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:32 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:32 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:56:34 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:56:37 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:37 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:56:37 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:56:37 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:56:37 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/10 04:56:39 DEBUG : pacer: Reducing sleep to 20ms
2026/04/10 04:56:42 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:42 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/10 04:56:42 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:56:44 DEBUG : pacer: Reducing sleep to 20ms
2026/04/10 04:56:45 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:45 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/10 04:56:45 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
2026/04/10 04:56:45 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:56:45 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:56:45 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/10 04:56:47 DEBUG : pacer: Reducing sleep to 40ms
2026/04/10 04:56:48 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:48 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/10 04:56:48 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1185
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey
2026/04/10 04:56:49 DEBUG : pacer: Reducing sleep to 40ms
2026/04/10 04:56:50 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:56:50 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:56:50 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:56:51 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:51 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/10 04:56:51 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10
2026/04/10 04:56:53 DEBUG : pacer: Reducing sleep to 40ms
2026/04/10 04:56:53 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:56:53 DEBUG : pacer: low level retry 1/1 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:56:53 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/10 04:56:53 DEBUG : file.txt: Received error: failed to upload file: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n" - low level retry 7/10
2026/04/10 04:56:54 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:56:54 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:56:54 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/10 04:56:54 DEBUG : pacer: Reducing sleep to 40ms
2026/04/10 04:56:54 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/10 04:56:54 DEBUG : pacer: low level retry 1/1 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/10 04:56:54 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/10 04:56:54 DEBUG : file.txt: Received error: failed to upload file: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n" - low level retry 8/10
2026/04/10 04:56:55 DEBUG : pacer: Reducing sleep to 20ms
2026/04/10 04:56:55 DEBUG : pacer: Reducing sleep to 40ms
2026/04/10 04:56:56 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:56:57 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:56:57 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/10 04:56:57 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 9/10
2026/04/10 04:56:57 ERROR : file.txt: Failed to copy: failed to upload file: Error "Server Error"
=== RUN TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:56:58 DEBUG : Config file has changed externally - reloading
2026/04/10 04:56:58 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:57:02 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
2026/04/10 04:57:05 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:57:12 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:57:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:57:12 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:57:17 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:57:21 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:57:21 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:57:21 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:57:25 DEBUG : pacer: Reducing sleep to 10ms
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1227
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve
2026/04/10 04:57:29 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:57:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:57:29 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:57:32 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:57:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:57:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:57:36 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:57:36 ERROR : file.txt: Failed to copy: failed to open source object: lstat /tmp/rclone3448640029/file.txt: no such file or directory
=== RUN TestGitAnnexFstestBackendCases/RemovePreexistingFile
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:57:48 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:57:48 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 1/10 (failed to upload file: Error "Server Error")
2026/04/10 04:57:52 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:57:54 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:57:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 2/10 (failed to upload file: Error "Server Error")
2026/04/10 04:57:59 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:02 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 3/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:06 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:09 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 4/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:13 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:15 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:15 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 5/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:19 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:21 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:21 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 6/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:26 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:28 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 7/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:33 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:35 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 8/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:38 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:286: Retry Put of "SomeKey" to drime root 'rclone-test-tiluzik0lavo': 9/10 (failed to upload file: Error "Server Error")
2026/04/10 04:58:45 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:58:49 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:58:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms
run.go:290: Failed to put "SomeKey" to "drime root 'rclone-test-tiluzik0lavo'": failed to upload file: Error "Server Error"
2026/04/10 04:58:53 DEBUG : pacer: Reducing sleep to 10ms
=== RUN TestGitAnnexFstestBackendCases/Remove
run.go:185: Remote "drime root 'rclone-test-tiluzik0lavo'", Local "Local file system at /tmp/rclone3448640029", Modify Window "876000h0m0s"
2026/04/10 04:59:01 DEBUG : Config file has changed externally - reloading
2026/04/10 04:59:01 DEBUG : Creating backend with remote "TestDrime:rclone-test-tiluzik0lavo"
2026/04/10 04:59:06 DEBUG : Creating backend with remote "/tmp/rclone3448640029"
2026/04/10 04:59:09 DEBUG : file.txt: Need to transfer - File not found at Destination
2026/04/10 04:59:13 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:13 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 0/10
2026/04/10 04:59:16 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:18 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:18 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 1/10
2026/04/10 04:59:21 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:23 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:23 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 2/10
2026/04/10 04:59:25 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:27 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:27 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 3/10
2026/04/10 04:59:29 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:31 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:31 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 4/10
2026/04/10 04:59:33 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:36 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:36 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 5/10
gitannex_test.go:307:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:307
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1305
/home/rclone/go/src/github.com/rclone/rclone/cmd/gitannex/gitannex_test.go:1446
Error: Received unexpected error:
attempt to read line timed out: context deadline exceeded
Test: TestGitAnnexFstestBackendCases/Remove
2026/04/10 04:59:38 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:39 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:39 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:39 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 6/10
2026/04/10 04:59:41 DEBUG : pacer: Reducing sleep to 10ms
2026/04/10 04:59:43 DEBUG : pacer: low level retry 1/1 (error Error "Server Error")
2026/04/10 04:59:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/10 04:59:43 DEBUG : file.txt: Received error: failed to upload file: Error "Server Error" - low level retry 7/10
2026/04/10 04:59:43 ERROR : file.txt: Failed to copy: failed to open source object: lstat /tmp/rclone3448640029/file.txt: no such file or directory
--- FAIL: TestGitAnnexFstestBackendCases (414.34s)
--- FAIL: TestGitAnnexFstestBackendCases/TransferStoreAbsolute (46.21s)
--- FAIL: TestGitAnnexFstestBackendCases/TransferStoreRelative (37.45s)
--- FAIL: TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace (40.42s)
--- FAIL: TestGitAnnexFstestBackendCases/CheckPresentAndTransfer (41.68s)
--- FAIL: TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent (44.52s)
--- FAIL: TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey (39.45s)
--- FAIL: TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve (44.32s)
--- FAIL: TestGitAnnexFstestBackendCases/RemovePreexistingFile (78.45s)
--- FAIL: TestGitAnnexFstestBackendCases/Remove (41.84s)
FAIL
2026/04/10 04:59:43 DEBUG : drime root 'rclone-test-tiluzik0lavo': Purge remote
"./gitannex.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestGitAnnexFstestBackendCases$/^(CheckPresentAndTransfer|CheckpresentTransferCheckpresent|Remove|RemovePreexistingFile|StoreCheckpresentRetrieve|TransferAndCheckpresentWithRealisticKey|TransferStoreAbsolute|TransferStorePathWithInteriorWhitespace|TransferStoreRelative)$'" - Finished ERROR in 7m1.196558801s (try 3/5): exit status 1: Failed [TestGitAnnexFstestBackendCases/TransferStoreAbsolute TestGitAnnexFstestBackendCases/TransferStoreRelative TestGitAnnexFstestBackendCases/TransferStorePathWithInteriorWhitespace TestGitAnnexFstestBackendCases/CheckPresentAndTransfer TestGitAnnexFstestBackendCases/CheckpresentTransferCheckpresent TestGitAnnexFstestBackendCases/TransferAndCheckpresentWithRealisticKey TestGitAnnexFstestBackendCases/StoreCheckpresentRetrieve TestGitAnnexFstestBackendCases/RemovePreexistingFile TestGitAnnexFstestBackendCases/Remove]