"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestApplyTransforms|TestCheck|TestCheckDownload|TestCheckSizeOnly|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyURLDownloadHeaders|TestCount|TestDirMove|TestListDirSorted|TestListDirSortedFn|TestListJSON|TestLsLong|TestLsWithFilesFrom|TestMaxDeleteSize|TestMoveFile|TestMoveFileBackupDir|TestMultithreadCopyAbort|TestParseSumFile|TestRcatSizeUploadHeaders|TestRemoveExisting|TestRmdirsNoLeaveRoot|TestStatJSON)$|^TestRcatSizeChecksum$/^(IgnoreChecksum|NoHashes|SizeDiffers)$'" - Starting (try 2/5) 2026/09/07 01:47:55 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego" 2026/09/07 01:47:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/07 01:47:57 DEBUG : Creating backend with remote "/tmp/rclone1399128872" === RUN TestMultithreadCopyAbort run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:48:04 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 1 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/09/07 01:48:05 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/09/07 01:48:05 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/09/07 01:48:05 DEBUG : Open with options = [RangeOption(5242880,10485759)] 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/09/07 01:48:05 DEBUG : Open with options = [RangeOption(0,5242879)] 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/09/07 01:48:05 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/09/07 01:48:06 DEBUG : Returning error reader 2026/09/07 01:48:06 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:06 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 0/10: BOOM: simulated read failure 2026/09/07 01:48:06 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:07 DEBUG : Returning error reader 2026/09/07 01:48:07 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:07 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2026/09/07 01:48:07 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:08 DEBUG : Returning error reader 2026/09/07 01:48:08 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:08 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2026/09/07 01:48:08 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:09 DEBUG : Returning error reader 2026/09/07 01:48:09 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:09 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2026/09/07 01:48:09 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:10 DEBUG : Returning error reader 2026/09/07 01:48:10 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:10 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2026/09/07 01:48:10 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:11 DEBUG : Returning error reader 2026/09/07 01:48:11 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:11 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2026/09/07 01:48:11 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:12 DEBUG : Returning error reader 2026/09/07 01:48:12 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:12 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2026/09/07 01:48:12 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:13 DEBUG : Returning error reader 2026/09/07 01:48:13 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:13 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2026/09/07 01:48:13 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:14 DEBUG : Returning error reader 2026/09/07 01:48:14 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:14 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2026/09/07 01:48:14 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:15 DEBUG : Returning error reader 2026/09/07 01:48:15 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:15 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2026/09/07 01:48:15 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/09/07 01:48:16 DEBUG : Returning error reader 2026/09/07 01:48:16 DEBUG : BOOM: simulated read failure 2026/09/07 01:48:16 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2026/09/07 01:48:16 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2026/09/07 01:48:16 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: failed to upload part 3: Put "https://drimestorage.18b804eaa6bc9759e2278f8d5367f42f.r2.cloudflarestorage.com/uploads/b54a6a42-217b-4603-a33a-cde12c342a1b/b54a6a42-217b-4603-a33a-cde12c342a1b?uploadId=ALH6CNlYw2utSsESnJZYdmO5WLZrnzv2wURMtVso3EhkDVcTfYOc6GFcqIqSWyx6r58fyLmZRZbXEuxESuFnb8inXiJ1L0g8vTQdcbTRPHQZ63F98-4pC9NJxkPB18Y37YvCvcmcjdaqHEUSMaXCPt7v--bNiZ-WEzxlhRDensDIfnfnOkBt2w8m9CZ3G4odGr0Zqu_kq5BCyYZdDKEy5zCIfOaICYlZ0mq088qPRlUc7CXA4a-LfFT5aSXdHsuF5_0YxMZ6QSeLtqZ_qdq6ZUVq9YahM2wuterF8KQwtY7DzVxHMFRXnPlPYGc8Q2gDQxqUaTQQJ0jjktP-G2c1MIU&partNumber=3&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=9dd875828a029f3dc92060a58cb00078%2F20260907%2Fauto%2Fs3%2Faws4_request&X-Amz-Date=20260907T014806Z&X-Amz-SignedHeaders=host&X-Amz-Expires=86400&X-Amz-Signature=8c2d543be7ea0410d4e3ed7d5a6bf0d90368728ac171cb70950cd75d94317cf2": BOOM: simulated read failure 2026/09/07 01:48:16 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit --- PASS: TestMultithreadCopyAbort (26.70s) === RUN TestCheck run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" === RUN TestCheck/1 === RUN TestCheck/2 === NAME TestCheck run.go:303: Failed to put "empty space" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- FAIL: TestCheck (12.93s) --- PASS: TestCheck/1 (0.51s) --- PASS: TestCheck/2 (0.80s) === RUN TestCheckDownload run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === NAME TestCheckDownload run.go:303: Failed to put "empty space" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestCheckDownload (25.78s) --- PASS: TestCheckDownload/1 (5.65s) --- PASS: TestCheckDownload/2 (6.61s) === RUN TestCheckSizeOnly run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (17.80s) --- PASS: TestCheckSizeOnly/1 (0.94s) --- PASS: TestCheckSizeOnly/2 (1.30s) --- PASS: TestCheckSizeOnly/3 (0.68s) --- PASS: TestCheckSizeOnly/4 (0.58s) --- PASS: TestCheckSizeOnly/5 (0.78s) --- PASS: TestCheckSizeOnly/6 (0.78s) --- PASS: TestCheckSizeOnly/7 (0.70s) === RUN TestParseSumFile run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:49:23 NOTICE: test.sum: improperly formatted checksum line 4 2026/09/07 01:49:23 NOTICE: test.sum: improperly formatted checksum line 5 2026/09/07 01:49:23 NOTICE: test.sum: improperly formatted checksum line 6 2026/09/07 01:49:23 NOTICE: test.sum: 2 warning(s) suppressed... 2026/09/07 01:49:25 DEBUG : test.sum: Removing old object on successful upload 2026/09/07 01:49:25 DEBUG : test.sum: Old object already deleted, safely ignoring 2026/09/07 01:49:25 NOTICE: test.sum: improperly formatted checksum line 4 2026/09/07 01:49:25 NOTICE: test.sum: improperly formatted checksum line 5 2026/09/07 01:49:25 NOTICE: test.sum: improperly formatted checksum line 6 2026/09/07 01:49:25 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (5.99s) === RUN TestCheckSumDownload run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:49:26 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/data" === RUN TestCheckSumDownload/subtest1 2026/09/07 01:49:45 DEBUG : test.sum: Removing old object on successful upload 2026/09/07 01:49:45 DEBUG : test.sum: Old object already deleted, safely ignoring === RUN TestCheckSumDownload/subtest2 2026/09/07 01:49:48 DEBUG : test.sum: Removing old object on successful upload 2026/09/07 01:49:49 DEBUG : test.sum: Old object already deleted, safely ignoring === RUN TestCheckSumDownload/subtest3 2026/09/07 01:49:53 DEBUG : test.sum: Removing old object on successful upload 2026/09/07 01:49:53 DEBUG : test.sum: Old object already deleted, safely ignoring === RUN TestCheckSumDownload/subtest4 === NAME TestCheckSumDownload run.go:303: Failed to put "test.sum" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestCheckSumDownload (59.65s) --- PASS: TestCheckSumDownload/subtest1 (3.09s) --- PASS: TestCheckSumDownload/subtest2 (1.34s) --- PASS: TestCheckSumDownload/subtest3 (2.65s) --- PASS: TestCheckSumDownload/subtest4 (6.43s) === RUN TestApplyTransforms 2026/09/07 01:50:26 DEBUG : Creating backend with remote "TestDrime:rclone-test-xagefug2mobe" 2026/09/07 01:50:26 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/07 01:50:30 DEBUG : Creating backend with remote "/tmp/rclone1233605452" run.go:198: Remote "drime root 'rclone-test-xagefug2mobe'", Local "Local file system at /tmp/rclone1233605452", Modify Window "876000h0m0s" upper checkfile vs. lower remote (without normalization) 2026/09/07 01:50:36 ERROR : hello, world!: sum not found 2026/09/07 01:50:36 ERROR : HELLO, WORLD!: file not in drime root 'rclone-test-xagefug2mobe' 2026/09/07 01:50:36 NOTICE: drime root 'rclone-test-xagefug2mobe': 1 files missing 2026/09/07 01:50:36 NOTICE: 1 hashes missing 2026/09/07 01:50:36 NOTICE: drime root 'rclone-test-xagefug2mobe': 1 differences found 2026/09/07 01:50:36 NOTICE: drime root 'rclone-test-xagefug2mobe': 2 errors while checking upper checkfile vs. lower remote (with normalization) 2026/09/07 01:50:38 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/09/07 01:50:38 NOTICE: drime root 'rclone-test-xagefug2mobe': 0 differences found 2026/09/07 01:50:38 NOTICE: drime root 'rclone-test-xagefug2mobe': 1 matching files 2026/09/07 01:50:38 DEBUG : Creating backend with remote "TestDrime:rclone-test-pasaxus1wajo" 2026/09/07 01:50:38 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/07 01:50:39 DEBUG : Creating backend with remote "/tmp/rclone586772176" run.go:198: Remote "drime root 'rclone-test-pasaxus1wajo'", Local "Local file system at /tmp/rclone586772176", Modify Window "876000h0m0s" lower checkfile vs. upper remote (without normalization) 2026/09/07 01:50:41 ERROR : HELLO, WORLD!: sum not found 2026/09/07 01:50:41 ERROR : hello, world!: file not in drime root 'rclone-test-pasaxus1wajo' 2026/09/07 01:50:41 NOTICE: drime root 'rclone-test-pasaxus1wajo': 1 files missing 2026/09/07 01:50:41 NOTICE: 1 hashes missing 2026/09/07 01:50:41 NOTICE: drime root 'rclone-test-pasaxus1wajo': 1 differences found 2026/09/07 01:50:41 NOTICE: drime root 'rclone-test-pasaxus1wajo': 2 errors while checking lower checkfile vs. upper remote (with normalization) 2026/09/07 01:50:42 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/09/07 01:50:42 NOTICE: drime root 'rclone-test-pasaxus1wajo': 0 differences found 2026/09/07 01:50:42 NOTICE: drime root 'rclone-test-pasaxus1wajo': 1 matching files 2026/09/07 01:50:42 DEBUG : Creating backend with remote "TestDrime:rclone-test-wejewem4guda" 2026/09/07 01:50:42 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/07 01:50:45 DEBUG : Creating backend with remote "/tmp/rclone3019333454" run.go:198: Remote "drime root 'rclone-test-wejewem4guda'", Local "Local file system at /tmp/rclone3019333454", Modify Window "876000h0m0s" run.go:303: Failed to put "HeLlO, wOrLd!" to "drime root 'rclone-test-wejewem4guda'": failed to upload file: Error "The file failed to upload." 2026/09/07 01:50:47 DEBUG : drime root 'rclone-test-wejewem4guda': Purge remote 2026/09/07 01:50:50 DEBUG : drime root 'rclone-test-pasaxus1wajo': Purge remote 2026/09/07 01:50:50 DEBUG : drime root 'rclone-test-xagefug2mobe': Purge remote --- FAIL: TestApplyTransforms (24.94s) === RUN TestCopyFile run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:50:52 DEBUG : file1: Need to transfer - File not found at Destination 2026/09/07 01:50:54 DEBUG : sub/file2: size = 14 OK 2026/09/07 01:50:54 INFO : file1: Copied (new) to: sub/file2 2026/09/07 01:50:54 DEBUG : sub/file2: size = 14 OK 2026/09/07 01:50:54 DEBUG : file1: Sizes identical 2026/09/07 01:50:54 DEBUG : file1: Unchanged skipping 2026/09/07 01:50:55 DEBUG : drime root 'rclone-test-coqenoz8xego': don't need to copy/move sub/file2, it is already at target location --- PASS: TestCopyFile (14.64s) === RUN TestCopyFileBackupDir run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:51:10 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/backup" 2026/09/07 01:51:15 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:51:15 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-coqenoz8xego') 2026/09/07 01:51:15 DEBUG : dst/file1: Sizes differ 2026/09/07 01:51:30 INFO : dst/file1: Moved (server-side) 2026/09/07 01:51:33 DEBUG : dst/file1: size = 14 OK 2026/09/07 01:51:33 INFO : dst/file1: Copied (new) --- PASS: TestCopyFileBackupDir (48.83s) === RUN TestCopyFileCompareDest run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:51:55 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/dst" 2026/09/07 01:51:58 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/CompareDest" 2026/09/07 01:52:03 DEBUG : one: Need to transfer - File not found at Destination 2026/09/07 01:52:11 DEBUG : one: size = 3 OK 2026/09/07 01:52:11 INFO : one: Copied (new) 2026/09/07 01:52:20 DEBUG : one: size = 5 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:52:20 DEBUG : one: size = 3 (drime root 'rclone-test-coqenoz8xego/dst') 2026/09/07 01:52:20 DEBUG : one: Sizes differ 2026/09/07 01:52:23 DEBUG : one: Removing old object on successful upload 2026/09/07 01:52:25 DEBUG : one: Old object already deleted, safely ignoring 2026/09/07 01:52:25 DEBUG : one: size = 5 OK 2026/09/07 01:52:25 INFO : one: Copied (replaced existing) 2026/09/07 01:52:34 DEBUG : dst/one: Removing old object on successful upload 2026/09/07 01:52:36 DEBUG : dst/one: Old object already deleted, safely ignoring 2026/09/07 01:52:42 DEBUG : one: size = 5 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:52:42 DEBUG : one: size = 3 (drime root 'rclone-test-coqenoz8xego/dst') 2026/09/07 01:52:42 DEBUG : one: Sizes differ 2026/09/07 01:52:43 DEBUG : one: size = 5 OK 2026/09/07 01:52:43 DEBUG : one: Sizes identical 2026/09/07 01:52:43 DEBUG : one: Destination found in --compare-dest, skipping 2026/09/07 01:52:44 DEBUG : two: Need to transfer - File not found at Destination 2026/09/07 01:52:44 DEBUG : two: size = 3 OK 2026/09/07 01:52:44 DEBUG : two: Sizes identical 2026/09/07 01:52:44 DEBUG : two: Destination found in --compare-dest, skipping 2026/09/07 01:52:44 DEBUG : two: Need to transfer - File not found at Destination 2026/09/07 01:52:44 DEBUG : two: size = 3 OK 2026/09/07 01:52:44 DEBUG : two: Sizes identical 2026/09/07 01:52:44 DEBUG : two: Destination found in --compare-dest, skipping 2026/09/07 01:52:45 DEBUG : two: Need to transfer - File not found at Destination 2026/09/07 01:52:45 DEBUG : two: size = 5 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:52:45 DEBUG : two: size = 3 (drime root 'rclone-test-coqenoz8xego/CompareDest') 2026/09/07 01:52:45 DEBUG : two: Sizes differ 2026/09/07 01:52:46 DEBUG : two: size = 5 OK 2026/09/07 01:52:46 INFO : two: Copied (new) --- PASS: TestCopyFileCompareDest (67.35s) === RUN TestCopyFileCopyDest run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:53:02 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/dst" 2026/09/07 01:53:08 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/CopyDest" 2026/09/07 01:53:08 DEBUG : one: Need to transfer - File not found at Destination 2026/09/07 01:53:09 DEBUG : one: size = 3 OK 2026/09/07 01:53:09 INFO : one: Copied (new) 2026/09/07 01:53:10 DEBUG : one: size = 5 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:53:10 DEBUG : one: size = 3 (drime root 'rclone-test-coqenoz8xego/dst') 2026/09/07 01:53:10 DEBUG : one: Sizes differ 2026/09/07 01:53:11 DEBUG : one: Removing old object on successful upload 2026/09/07 01:53:11 DEBUG : one: Old object already deleted, safely ignoring 2026/09/07 01:53:11 DEBUG : one: size = 5 OK 2026/09/07 01:53:11 INFO : one: Copied (replaced existing) 2026/09/07 01:53:18 DEBUG : dst/one: Removing old object on successful upload 2026/09/07 01:53:19 DEBUG : dst/one: Old object already deleted, safely ignoring 2026/09/07 01:53:30 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/BackupDir" 2026/09/07 01:53:35 DEBUG : one: size = 5 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:53:35 DEBUG : one: size = 3 (drime root 'rclone-test-coqenoz8xego/dst') 2026/09/07 01:53:35 DEBUG : one: Sizes differ 2026/09/07 01:53:37 DEBUG : one: size = 5 OK 2026/09/07 01:53:37 DEBUG : one: Sizes identical 2026/09/07 01:53:37 DEBUG : one: size = 5 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:53:37 DEBUG : one: size = 3 (drime root 'rclone-test-coqenoz8xego/dst') 2026/09/07 01:53:37 DEBUG : one: Sizes differ 2026/09/07 01:53:42 INFO : one: Moved (server-side) 2026/09/07 01:53:44 DEBUG : one: size = 5 OK 2026/09/07 01:53:44 INFO : one: Copied (server-side copy) 2026/09/07 01:53:44 DEBUG : one: Destination found in --copy-dest, using server-side copy run.go:303: Failed to put "CopyDest/two" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestCopyFileCopyDest (63.98s) === RUN TestListDirSorted run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" run.go:303: Failed to put "a.txt" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestListDirSorted (3.03s) === RUN TestListDirSortedFn run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" run.go:303: Failed to put "a.txt" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestListDirSortedFn (1.14s) === RUN TestListJSON run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" run.go:303: Failed to put "file1" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestListJSON (1.54s) === RUN TestStatJSON run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/DirWithTrailingSlash === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2026/09/07 01:54:17 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/notfound" --- PASS: TestStatJSON (7.61s) --- PASS: TestStatJSON/Root (0.29s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.39s) --- PASS: TestStatJSON/Dir (1.18s) --- PASS: TestStatJSON/DirWithTrailingSlash (0.12s) --- PASS: TestStatJSON/File (0.12s) --- PASS: TestStatJSON/NotFound (0.19s) --- PASS: TestStatJSON/DirFilesOnly (0.11s) --- PASS: TestStatJSON/FileFilesOnly (0.11s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.09s) --- PASS: TestStatJSON/DirDirsOnly (0.09s) --- PASS: TestStatJSON/FileDirsOnly (0.09s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.14s) --- PASS: TestStatJSON/RootNotFound (0.61s) === RUN TestLsWithFilesFrom run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:54:21 DEBUG : empty space: Excluded (FilesFrom Filter) 2026/09/07 01:54:21 DEBUG : empty space: Excluded --- PASS: TestLsWithFilesFrom (3.34s) === RUN TestLsLong run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- PASS: TestLsLong (11.51s) === RUN TestCount run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" run.go:186: removing dir "sub dir" failed - try 1/5: sleeping 1s: directory not empty --- PASS: TestCount (16.82s) === RUN TestMaxDeleteSize run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:54:58 DEBUG : Waiting for deletions to finish 2026/09/07 01:55:00 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/09/07 01:55:03 INFO : medium: Deleted 2026/09/07 01:55:03 INFO : large: Deleted --- PASS: TestMaxDeleteSize (22.87s) === RUN TestRmdirsNoLeaveRoot run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:55:21 INFO : A2: Making directory 2026/09/07 01:55:22 INFO : A1/B2: Making directory 2026/09/07 01:55:23 INFO : A1/B2/C2: Making directory 2026/09/07 01:55:23 INFO : A1/B1/C3: Making directory 2026/09/07 01:55:25 INFO : A3: Making directory 2026/09/07 01:55:26 INFO : A3/B3: Making directory 2026/09/07 01:55:27 INFO : A3/B3/C4: Making directory 2026/09/07 01:55:31 DEBUG : removing 1 level 3 directories 2026/09/07 01:55:31 INFO : A3/B3/C4: Removing directory 2026/09/07 01:55:33 DEBUG : removing 2 level 3 directories 2026/09/07 01:55:33 INFO : A1/B2/C2: Removing directory 2026/09/07 01:55:33 INFO : A1/B1/C3: Removing directory 2026/09/07 01:55:33 DEBUG : removing 2 level 2 directories 2026/09/07 01:55:33 INFO : A1/B2: Removing directory 2026/09/07 01:55:33 INFO : A3/B3: Removing directory 2026/09/07 01:55:34 DEBUG : removing 2 level 1 directories 2026/09/07 01:55:34 INFO : A3: Removing directory 2026/09/07 01:55:34 INFO : A2: Removing directory 2026/09/07 01:55:36 DEBUG : removing 1 level 3 directories 2026/09/07 01:55:36 INFO : A1/B1/C1: Removing directory 2026/09/07 01:55:37 DEBUG : removing 1 level 2 directories 2026/09/07 01:55:37 INFO : A1/B1: Removing directory 2026/09/07 01:55:37 ERROR : A1/B1: Failed to rmdir: directory not empty 2026/09/07 01:55:37 DEBUG : removing 1 level 1 directories 2026/09/07 01:55:37 INFO : A1: Removing directory 2026/09/07 01:55:37 ERROR : A1: Failed to rmdir: directory not empty 2026/09/07 01:55:37 DEBUG : removing 1 level 0 directories 2026/09/07 01:55:37 INFO : drime root 'rclone-test-coqenoz8xego': Removing directory 2026/09/07 01:55:37 ERROR : Failed to rmdir: directory not empty operations_test.go:732: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:732 Error: Received unexpected error: failed to remove directories: 3 errors: last error: directory not empty Test: TestRmdirsNoLeaveRoot --- FAIL: TestRmdirsNoLeaveRoot (24.80s) === RUN TestCopyURLDownloadHeaders run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:55:39 DEBUG : file1: size = 14 OK --- PASS: TestCopyURLDownloadHeaders (6.70s) === RUN TestMoveFile run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:55:46 DEBUG : file1: Need to transfer - File not found at Destination 2026/09/07 01:55:47 DEBUG : sub/file2: size = 14 OK 2026/09/07 01:55:47 INFO : file1: Copied (new) to: sub/file2 2026/09/07 01:55:47 INFO : file1: Deleted 2026/09/07 01:55:48 DEBUG : sub/file2: size = 14 OK 2026/09/07 01:55:48 DEBUG : file1: Sizes identical 2026/09/07 01:55:48 DEBUG : file1: Unchanged skipping 2026/09/07 01:55:48 INFO : file1: Deleted 2026/09/07 01:55:48 DEBUG : drime root 'rclone-test-coqenoz8xego': don't need to copy/move sub/file2, it is already at target location run.go:186: removing dir "sub" failed - try 1/5: sleeping 1s: directory not empty --- PASS: TestMoveFile (10.00s) === RUN TestMoveFileBackupDir run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:56:04 DEBUG : Creating backend with remote "TestDrime:rclone-test-coqenoz8xego/backup" 2026/09/07 01:56:06 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone1399128872) 2026/09/07 01:56:06 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-coqenoz8xego') 2026/09/07 01:56:06 DEBUG : dst/file1: Sizes differ 2026/09/07 01:56:12 INFO : dst/file1: Moved (server-side) 2026/09/07 01:56:12 ERROR : dst/file1: Failed to copy: failed to upload file: Error "The file failed to upload." 2026/09/07 01:56:12 ERROR : dst/file1: Not deleting source as copy failed: failed to upload file: Error "The file failed to upload." operations_test.go:1079: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1079 Error: Received unexpected error: failed to upload file: Error "The file failed to upload." Test: TestMoveFileBackupDir --- FAIL: TestMoveFileBackupDir (32.82s) === RUN TestDirMove run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" run.go:303: Failed to put "A1/B1/C1/four" to "drime root 'rclone-test-coqenoz8xego'": failed to upload file: Error "The file failed to upload." --- FAIL: TestDirMove (35.09s) === RUN TestRcatSizeUploadHeaders run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:57:04 DEBUG : potato1: size = 60 OK --- PASS: TestRcatSizeUploadHeaders (2.58s) === RUN TestRcatSizeChecksum === RUN TestRcatSizeChecksum/SizeDiffers run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:57:07 DEBUG : potato4: size = 60 (drime root 'rclone-test-coqenoz8xego') 2026/09/07 01:57:07 DEBUG : potato4: size = 59 (drime root 'rclone-test-coqenoz8xego') 2026/09/07 01:57:07 ERROR : potato4: corrupted on transfer: sizes differ src 60 vs dst(drime root 'rclone-test-coqenoz8xego') 59 2026/09/07 01:57:07 INFO : potato4: Removing failed copy === RUN TestRcatSizeChecksum/IgnoreChecksum run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:57:10 DEBUG : potato2: size = 60 OK === RUN TestRcatSizeChecksum/NoHashes run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:57:13 DEBUG : potato3: size = 60 OK fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- PASS: TestRcatSizeChecksum (15.90s) --- PASS: TestRcatSizeChecksum/SizeDiffers (2.86s) --- PASS: TestRcatSizeChecksum/IgnoreChecksum (2.95s) --- PASS: TestRcatSizeChecksum/NoHashes (10.09s) === RUN TestRemoveExisting run.go:198: Remote "drime root 'rclone-test-coqenoz8xego'", Local "Local file system at /tmp/rclone1399128872", Modify Window "876000h0m0s" 2026/09/07 01:57:32 DEBUG : sub dir/test remove existing: TEST: renaming existing object to "sub dir/test remove existing.rotuyut3" before starting 2026/09/07 01:57:34 DEBUG : sub dir/test remove existing.rotuyut3: TEST: removing renamed existing file after operation 2026/09/07 01:57:38 DEBUG : sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890123456789: TEST: renaming existing object to "sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890.hasabef4" before starting 2026/09/07 01:57:38 DEBUG : sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890.hasabef4: TEST: renaming existing back after failed operation 2026/09/07 01:57:39 DEBUG : sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890123456789: TEST: renaming existing object to "sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890.lafoful3" before starting 2026/09/07 01:57:40 DEBUG : sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890.lafoful3: TEST: removing renamed existing file after operation --- PASS: TestRemoveExisting (25.01s) FAIL 2026/09/07 01:57:47 DEBUG : drime root 'rclone-test-coqenoz8xego': Purge remote "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestApplyTransforms|TestCheck|TestCheckDownload|TestCheckSizeOnly|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyFileCopyDest|TestCopyURLDownloadHeaders|TestCount|TestDirMove|TestListDirSorted|TestListDirSortedFn|TestListJSON|TestLsLong|TestLsWithFilesFrom|TestMaxDeleteSize|TestMoveFile|TestMoveFileBackupDir|TestMultithreadCopyAbort|TestParseSumFile|TestRcatSizeUploadHeaders|TestRemoveExisting|TestRmdirsNoLeaveRoot|TestStatJSON)$|^TestRcatSizeChecksum$/^(IgnoreChecksum|NoHashes|SizeDiffers)$'" - Finished ERROR in 9m52.280798758s (try 2/5): exit status 1: Failed [TestCheck TestCheckDownload TestCheckSumDownload TestApplyTransforms TestCopyFileCopyDest TestListDirSorted TestListDirSortedFn TestListJSON TestRmdirsNoLeaveRoot TestMoveFileBackupDir TestDirMove]