"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestCheckSumDownload|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyURL|TestDelete|TestListDirSortedFn|TestMoveFile|TestMultithreadCopy|TestMultithreadCopyAbort|TestParseSumFile)$'" - Starting (try 2/5) 2026/04/06 03:00:27 DEBUG : Creating backend with remote "TestDrime:rclone-test-lodixeh6nesa" 2026/04/06 03:00:27 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/06 03:00:32 DEBUG : Creating backend with remote "/tmp/rclone3435883019" === RUN TestMultithreadCopy run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: failed to initiate multipart upload: Error "You have exhausted your allowed space of 20,480.0MB. Delete some files or upgrade your plan." Test: TestMultithreadCopy --- FAIL: TestMultithreadCopy (15.71s) === RUN TestMultithreadCopyAbort run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: failed to initiate multipart upload: Error "You have exhausted your allowed space of 20,480.0MB. Delete some files or upgrade your plan." Test: TestMultithreadCopyAbort --- FAIL: TestMultithreadCopyAbort (8.29s) === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:01:15 NOTICE: test.sum: improperly formatted checksum line 4 2026/04/06 03:01:15 NOTICE: test.sum: improperly formatted checksum line 5 2026/04/06 03:01:15 NOTICE: test.sum: improperly formatted checksum line 6 2026/04/06 03:01:15 NOTICE: test.sum: 2 warning(s) suppressed... 2026/04/06 03:01:29 DEBUG : test.sum: Removing old object on successful upload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-lodixeh6nesa'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." --- FAIL: TestParseSumFile (45.25s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:01:42 DEBUG : Creating backend with remote "TestDrime:rclone-test-lodixeh6nesa/data" === RUN TestCheckSumDownload/subtest1 2026/04/06 03:03:11 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-lodixeh6nesa'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." --- FAIL: TestCheckSumDownload (128.08s) --- PASS: TestCheckSumDownload/subtest1 (20.20s) === RUN TestCopyFileCompareDest run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:03:50 DEBUG : Creating backend with remote "TestDrime:rclone-test-lodixeh6nesa/dst" 2026/04/06 03:03:50 DEBUG : Config file has changed externally - reloading 2026/04/06 03:04:14 DEBUG : Creating backend with remote "TestDrime:rclone-test-lodixeh6nesa/CompareDest" 2026/04/06 03:04:30 DEBUG : one: Need to transfer - File not found at Destination 2026/04/06 03:04:44 DEBUG : one: size = 3 OK 2026/04/06 03:04:44 INFO : one: Copied (new) 2026/04/06 03:05:03 DEBUG : one: size = 5 (Local file system at /tmp/rclone3435883019) 2026/04/06 03:05:03 DEBUG : one: size = 3 (drime root 'rclone-test-lodixeh6nesa/dst') 2026/04/06 03:05:03 DEBUG : one: Sizes differ 2026/04/06 03:05:12 DEBUG : one: Removing old object on successful upload 2026/04/06 03:05:14 ERROR : one: Failed to copy: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." copy_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:220 Error: Received unexpected error: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." Test: TestCopyFileCompareDest --- FAIL: TestCopyFileCompareDest (110.84s) === RUN TestCopyFileCopyDest run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:05:41 DEBUG : Creating backend with remote "TestDrime:rclone-test-lodixeh6nesa/dst" 2026/04/06 03:06:04 DEBUG : Creating backend with remote "TestDrime:rclone-test-lodixeh6nesa/CopyDest" 2026/04/06 03:06:21 DEBUG : one: Need to transfer - File not found at Destination 2026/04/06 03:06:48 DEBUG : one: size = 3 OK 2026/04/06 03:06:48 INFO : one: Copied (new) 2026/04/06 03:07:00 DEBUG : one: size = 5 (Local file system at /tmp/rclone3435883019) 2026/04/06 03:07:00 DEBUG : one: size = 3 (drime root 'rclone-test-lodixeh6nesa/dst') 2026/04/06 03:07:00 DEBUG : one: Sizes differ 2026/04/06 03:07:13 DEBUG : one: Removing old object on successful upload 2026/04/06 03:07:17 ERROR : one: Failed to copy: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." copy_test.go:303: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:303 Error: Received unexpected error: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." Test: TestCopyFileCopyDest --- FAIL: TestCopyFileCopyDest (117.56s) === RUN TestListDirSortedFn run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:09:54 DEBUG : a.txt: Excluded (Size Filter) 2026/04/06 03:09:54 DEBUG : a.txt: Excluded 2026/04/06 03:10:03 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/04/06 03:10:03 DEBUG : sub dir/hello world2: Excluded 2026/04/06 03:10:03 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/04/06 03:10:03 DEBUG : sub dir/hello world: Excluded 2026/04/06 03:10:14 DEBUG : sub dir/ignore dir: Excluded 2026/04/06 03:10:14 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/04/06 03:10:14 DEBUG : sub dir/hello world2: Excluded 2026/04/06 03:10:14 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/04/06 03:10:14 DEBUG : sub dir/hello world: Excluded 2026/04/06 03:10:20 DEBUG : sub dir/ignore dir: Excluded --- PASS: TestListDirSortedFn (229.72s) === RUN TestDelete run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:12:00 DEBUG : Waiting for deletions to finish 2026/04/06 03:12:05 DEBUG : large: Excluded (Size Filter) 2026/04/06 03:12:05 DEBUG : large: Excluded 2026/04/06 03:12:10 INFO : medium: Deleted 2026/04/06 03:12:10 INFO : small: Deleted --- PASS: TestDelete (60.64s) === RUN TestCopyURL run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:12:55 DEBUG : filename.txt: File name found in url 2026/04/06 03:14:02 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/04/06 03:14:02 DEBUG : pacer: low level retry 1/1 (error Error "504 Gateway Timeout (504): \r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n") 2026/04/06 03:14:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/06 03:14:02 ERROR : filename.txt: Post request put error: failed to upload file: Error "504 Gateway Timeout (504): \r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n" operations_test.go:856: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:856 Error: Received unexpected error: failed to upload file: Error "504 Gateway Timeout (504): \r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n" Test: TestCopyURL 2026/04/06 03:14:05 DEBUG : pacer: Reducing sleep to 10ms --- FAIL: TestCopyURL (109.97s) === RUN TestMoveFile run.go:185: Remote "drime root 'rclone-test-lodixeh6nesa'", Local "Local file system at /tmp/rclone3435883019", Modify Window "876000h0m0s" 2026/04/06 03:14:23 DEBUG : file1: Need to transfer - File not found at Destination 2026/04/06 03:14:43 DEBUG : sub/file2: size = 14 OK 2026/04/06 03:14:43 INFO : file1: Copied (new) to: sub/file2 2026/04/06 03:14:43 INFO : file1: Deleted 2026/04/06 03:14:55 DEBUG : sub/file2: size = 14 OK 2026/04/06 03:14:55 DEBUG : file1: Sizes identical 2026/04/06 03:14:55 DEBUG : file1: Unchanged skipping 2026/04/06 03:14:55 INFO : file1: Deleted 2026/04/06 03:15:04 DEBUG : drime root 'rclone-test-lodixeh6nesa': don't need to copy/move sub/file2, it is already at target location --- PASS: TestMoveFile (76.63s) FAIL 2026/04/06 03:15:35 DEBUG : drime root 'rclone-test-lodixeh6nesa': Purge remote "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestCheckSumDownload|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyURL|TestDelete|TestListDirSortedFn|TestMoveFile|TestMultithreadCopy|TestMultithreadCopyAbort|TestParseSumFile)$'" - Finished ERROR in 15m12.50750419s (try 2/5): exit status 1: Failed [TestMultithreadCopy TestMultithreadCopyAbort TestParseSumFile TestCheckSumDownload TestCopyFileCompareDest TestCopyFileCopyDest TestCopyURL]