"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestApplyTransforms|TestCheck|TestCheckDownload|TestCheckSizeOnly|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestMultithreadCopy|TestMultithreadCopyAbort|TestParseSumFile)$'" - Starting (try 4/5) 2026/03/29 07:03:23 DEBUG : Creating backend with remote "TestDrime:rclone-test-felirub0xuki" 2026/03/29 07:03:23 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/03/29 07:03:39 DEBUG : Creating backend with remote "/tmp/rclone3511381542" === RUN TestMultithreadCopy run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: failed to initiate multipart upload: Error "You have exhausted your allowed space of 20,480.0MB. Delete some files or upgrade your plan." Test: TestMultithreadCopy --- FAIL: TestMultithreadCopy (34.80s) === RUN TestMultithreadCopyAbort run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: failed to initiate multipart upload: Error "You have exhausted your allowed space of 20,480.0MB. Delete some files or upgrade your plan." Test: TestMultithreadCopyAbort --- FAIL: TestMultithreadCopyAbort (21.08s) === RUN TestCheck run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (130.33s) --- PASS: TestCheck/1 (5.98s) --- PASS: TestCheck/2 (6.70s) --- PASS: TestCheck/3 (4.21s) --- PASS: TestCheck/4 (3.13s) --- PASS: TestCheck/5 (3.07s) --- PASS: TestCheck/6 (3.25s) --- PASS: TestCheck/7 (3.80s) === RUN TestCheckDownload run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (140.87s) --- PASS: TestCheckDownload/1 (6.06s) --- PASS: TestCheckDownload/2 (4.43s) --- PASS: TestCheckDownload/3 (11.72s) --- PASS: TestCheckDownload/4 (8.50s) --- PASS: TestCheckDownload/5 (6.40s) --- PASS: TestCheckDownload/6 (3.44s) --- PASS: TestCheckDownload/7 (3.51s) === RUN TestCheckSizeOnly run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (85.79s) --- PASS: TestCheckSizeOnly/1 (4.36s) --- PASS: TestCheckSizeOnly/2 (3.34s) --- PASS: TestCheckSizeOnly/3 (3.12s) --- PASS: TestCheckSizeOnly/4 (4.14s) --- PASS: TestCheckSizeOnly/5 (2.92s) --- PASS: TestCheckSizeOnly/6 (1.81s) --- PASS: TestCheckSizeOnly/7 (1.90s) === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" 2026/03/29 07:10:45 NOTICE: test.sum: improperly formatted checksum line 4 2026/03/29 07:10:45 NOTICE: test.sum: improperly formatted checksum line 5 2026/03/29 07:10:45 NOTICE: test.sum: improperly formatted checksum line 6 2026/03/29 07:10:45 NOTICE: test.sum: 2 warning(s) suppressed... 2026/03/29 07:10:54 DEBUG : test.sum: Removing old object on successful upload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-felirub0xuki'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." --- FAIL: TestParseSumFile (33.55s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" 2026/03/29 07:11:06 DEBUG : Creating backend with remote "TestDrime:rclone-test-felirub0xuki/data" === RUN TestCheckSumDownload/subtest1 2026/03/29 07:12:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:12:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms === NAME TestCheckSumDownload run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 1/10 (failed to upload file: Error "Server Error") 2026/03/29 07:12:43 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:12:44 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:12:44 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 2/10 (failed to upload file: Error "Server Error") 2026/03/29 07:12:46 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:12:47 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:12:47 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 3/10 (failed to upload file: Error "Server Error") 2026/03/29 07:12:50 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:12:51 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:12:51 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 4/10 (failed to upload file: Error "Server Error") 2026/03/29 07:12:53 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:12:53 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:12:53 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 5/10 (failed to upload file: Error "Server Error") 2026/03/29 07:12:56 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:12:57 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:12:57 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 6/10 (failed to upload file: Error "Server Error") 2026/03/29 07:12:59 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:13:00 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:13:00 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 7/10 (failed to upload file: Error "Server Error") 2026/03/29 07:13:02 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:13:02 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:13:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 8/10 (failed to upload file: Error "Server Error") 2026/03/29 07:13:05 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:13:05 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:13:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-felirub0xuki': 9/10 (failed to upload file: Error "Server Error") 2026/03/29 07:13:08 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:13:08 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/03/29 07:13:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-felirub0xuki'": failed to upload file: Error "Server Error" 2026/03/29 07:13:08 DEBUG : pacer: Reducing sleep to 10ms 2026/03/29 07:13:09 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:13:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/03/29 07:13:09 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:13:09 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/03/29 07:13:10 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:13:10 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/03/29 07:13:10 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:13:10 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/03/29 07:13:10 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:13:10 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/03/29 07:13:10 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:13:10 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/03/29 07:13:11 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:13:11 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/03/29 07:13:11 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:13:11 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/03/29 07:13:13 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:13:13 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/03/29 07:13:15 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:13:15 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "data/banana" failed - try 1/3: failed to delete item: Error "Server Error" 2026/03/29 07:13:20 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:13:20 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:13:31 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:13:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:14:11 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:14:31 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:14:41 DEBUG : pacer: Reducing sleep to 2.5s 2026/03/29 07:14:46 DEBUG : pacer: Reducing sleep to 1.25s 2026/03/29 07:14:48 DEBUG : pacer: Reducing sleep to 625ms --- FAIL: TestCheckSumDownload (222.41s) --- PASS: TestCheckSumDownload/subtest1 (10.36s) === RUN TestApplyTransforms 2026/03/29 07:14:48 DEBUG : Creating backend with remote "TestDrime:rclone-test-qohelok2xeco" 2026/03/29 07:14:48 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/03/29 07:14:49 DEBUG : Creating backend with remote "/tmp/rclone463419743" run.go:185: Remote "drime root 'rclone-test-qohelok2xeco'", Local "Local file system at /tmp/rclone463419743", Modify Window "876000h0m0s" 2026/03/29 07:14:49 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:14:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/03/29 07:14:50 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:14:50 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/03/29 07:14:50 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:14:50 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/03/29 07:14:50 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:14:50 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/03/29 07:14:50 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:14:50 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/03/29 07:14:50 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:14:50 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/03/29 07:14:51 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:14:51 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/03/29 07:14:51 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:14:51 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/03/29 07:14:53 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:14:53 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/03/29 07:14:55 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:14:55 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:242: Failed to mkdir "drime root 'rclone-test-qohelok2xeco'": failed to make directory: failed to create folder: Error "Server Error" 2026/03/29 07:14:55 DEBUG : drime root 'rclone-test-qohelok2xeco': Purge remote 2026/03/29 07:15:00 DEBUG : pacer: Reducing sleep to 5.12s 2026/03/29 07:15:00 NOTICE: purge failed: directory not found --- FAIL: TestApplyTransforms (12.15s) === RUN TestCopyFile run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" 2026/03/29 07:15:00 DEBUG : pacer: Reducing sleep to 312.5ms 2026/03/29 07:15:00 DEBUG : file1: Need to transfer - File not found at Destination 2026/03/29 07:15:01 DEBUG : pacer: Reducing sleep to 156.25ms 2026/03/29 07:15:01 DEBUG : pacer: Reducing sleep to 78.125ms 2026/03/29 07:15:02 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:15:02 DEBUG : pacer: Rate limited, increasing sleep to 156.25ms 2026/03/29 07:15:02 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:15:02 DEBUG : pacer: Rate limited, increasing sleep to 312.5ms 2026/03/29 07:15:02 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:15:02 DEBUG : pacer: Rate limited, increasing sleep to 625ms 2026/03/29 07:15:02 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:15:02 DEBUG : pacer: Rate limited, increasing sleep to 1.25s 2026/03/29 07:15:03 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:15:03 DEBUG : pacer: Rate limited, increasing sleep to 2.5s 2026/03/29 07:15:04 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:15:04 DEBUG : pacer: Rate limited, increasing sleep to 5s 2026/03/29 07:15:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:15:07 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:15:12 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:15:12 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:15:22 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:15:42 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:15:42 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 0/10 2026/03/29 07:16:02 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:16:22 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:16:32 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:16:32 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:16:37 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:16:37 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:16:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:17:07 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:17:27 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:17:47 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:18:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:18:27 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:18:47 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:19:07 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:19:07 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 1/10 2026/03/29 07:19:27 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:19:47 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:19:57 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:19:57 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:20:02 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:20:02 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:20:12 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:20:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:20:52 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:21:12 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:21:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:21:52 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:22:12 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:22:32 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:22:32 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 2/10 2026/03/29 07:22:52 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:23:12 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:23:22 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:23:22 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:23:27 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:23:27 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:23:37 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:23:57 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:24:17 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:24:37 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:24:57 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:25:17 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:25:37 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:25:57 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:25:57 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 3/10 2026/03/29 07:26:17 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:26:37 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:26:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:26:47 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:26:52 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:26:52 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:27:02 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:27:22 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:27:42 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:28:02 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:28:22 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:28:42 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:29:02 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:29:22 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:29:22 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 4/10 2026/03/29 07:29:42 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:30:02 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:30:12 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:30:12 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:30:17 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:30:17 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:30:27 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:30:47 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:31:07 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:31:27 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:31:47 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:32:07 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:32:27 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:32:47 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:32:47 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 5/10 2026/03/29 07:33:08 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:33:27 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:33:37 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:33:37 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:33:43 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:33:43 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:33:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:34:13 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:34:32 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:34:52 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:35:14 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:35:33 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:35:54 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:36:14 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:36:14 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 6/10 2026/03/29 07:36:34 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:36:54 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:37:04 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:37:04 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:37:09 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:37:09 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:37:18 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:37:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:38:01 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:38:20 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:38:41 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:39:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:39:21 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:39:40 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:39:40 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 7/10 2026/03/29 07:40:01 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:40:23 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:40:34 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:40:34 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:40:42 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:40:42 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:40:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:41:15 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:41:34 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:41:53 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:42:14 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/03/29 07:42:35 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:42:57 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:43:20 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/03/29 07:43:20 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "Server Error" - low level retry 8/10 2026/03/29 07:43:41 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:44:01 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:44:26 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:44:26 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:44:53 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 07:44:53 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:45:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:45:54 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 07:45:54 DEBUG : pacer: low level retry 5/10 (error Post "https://app.drime.cloud/api/v1/folders": read tcp 65.108.87.141:45048->57.130.54.115:443: read: connection reset by peer) 2026/03/29 07:46:51 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:46:51 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:46:51 DEBUG : pacer: low level retry 7/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:47:11 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:47:11 DEBUG : pacer: low level retry 8/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:47:31 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:47:31 DEBUG : pacer: low level retry 9/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:47:51 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:47:51 DEBUG : pacer: low level retry 10/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:47:51 DEBUG : file1: Received error: failed to make directory: failed to create folder: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n" - low level retry 9/10 2026/03/29 07:47:51 ERROR : file1: Failed to copy: failed to make directory: failed to create folder: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n" copy_test.go:114: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:114 Error: Received unexpected error: failed to make directory: failed to create folder: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n" Test: TestCopyFile 2026/03/29 07:48:50 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:48:50 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:48:50 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:48:50 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:49:38 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestCopyFile (2077.37s) === RUN TestCopyFileBackupDir run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" 2026/03/29 07:50:14 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 07:50:51 DEBUG : pacer: Reducing sleep to 2.5s 2026/03/29 07:51:58 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 07:51:58 DEBUG : pacer: Rate limited, increasing sleep to 5s 2026/03/29 07:51:58 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:51:58 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:51:58 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 07:53:02 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 07:53:02 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 07:54:03 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:54:03 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): \r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n") 2026/03/29 07:55:18 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/03/29 07:57:05 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/03/29 07:58:37 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/03/29 07:58:37 DEBUG : pacer: low level retry 7/10 (error Error "503 Service Unavailable (503): \n\n\n \n \n \n 503 Service Temporarily Unavailable\n \n\n\n
\n
\n

Server Error

\n
503
\n

Service Temporarily Unavailable

\n

The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.

\n
\n

That's what you can do

\n \n
\n
\n\n") 2026/03/29 07:58:42 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/03/29 07:58:58 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/03/29 07:59:18 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:286: Retry Put of "dst/file1" to drime root 'rclone-test-felirub0xuki': 1/10 (failed to make directory: failed to create folder: Error "Server Error") 2026/03/29 07:59:37 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 07:59:57 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 08:00:08 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/03/29 08:00:08 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/03/29 08:00:12 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/03/29 08:00:12 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/03/29 08:00:22 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/03/29 08:00:43 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/03/29 08:01:02 DEBUG : pacer: Reducing sleep to 10s 2026/03/29 08:01:24 DEBUG : pacer: Reducing sleep to 5s 2026/03/29 08:01:32 DEBUG : pacer: Reducing sleep to 2.5s 2026/03/29 08:01:37 DEBUG : pacer: Reducing sleep to 1.25s 2026/03/29 08:01:40 DEBUG : pacer: Reducing sleep to 625ms 2026/03/29 08:01:40 DEBUG : Creating backend with remote "TestDrime:rclone-test-felirub0xuki/backup" 2026/03/29 08:01:41 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone3511381542) 2026/03/29 08:01:41 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-felirub0xuki') 2026/03/29 08:01:41 DEBUG : dst/file1: Sizes differ 2026/03/29 08:01:46 INFO : dst/file1: Moved (server-side) 2026/03/29 08:01:47 DEBUG : pacer: Reducing sleep to 312.5ms 2026/03/29 08:01:50 DEBUG : pacer: Reducing sleep to 156.25ms 2026/03/29 08:01:50 DEBUG : dst/file1: size = 14 OK 2026/03/29 08:01:50 INFO : dst/file1: Copied (new) 2026/03/29 08:01:51 DEBUG : pacer: Reducing sleep to 78.125ms 2026/03/29 08:01:52 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/03/29 08:01:52 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/03/29 08:01:52 DEBUG : pacer: Reducing sleep to 10ms --- PASS: TestCopyFileBackupDir (743.59s) === RUN TestCopyFileCompareDest run.go:185: Remote "drime root 'rclone-test-felirub0xuki'", Local "Local file system at /tmp/rclone3511381542", Modify Window "876000h0m0s" 2026/03/29 08:02:01 DEBUG : Creating backend with remote "TestDrime:rclone-test-felirub0xuki/dst" 2026/03/29 08:02:07 DEBUG : Creating backend with remote "TestDrime:rclone-test-felirub0xuki/CompareDest" 2026/03/29 08:02:15 DEBUG : one: Need to transfer - File not found at Destination 2026/03/29 08:02:25 DEBUG : one: size = 3 OK 2026/03/29 08:02:25 INFO : one: Copied (new) 2026/03/29 08:02:34 DEBUG : one: size = 5 (Local file system at /tmp/rclone3511381542) 2026/03/29 08:02:34 DEBUG : one: size = 3 (drime root 'rclone-test-felirub0xuki/dst') 2026/03/29 08:02:34 DEBUG : one: Sizes differ 2026/03/29 08:03:16 DEBUG : one: Removing old object on successful upload 2026/03/29 08:03:17 ERROR : one: Failed to copy: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." copy_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:220 Error: Received unexpected error: failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." Test: TestCopyFileCompareDest --- FAIL: TestCopyFileCompareDest (91.71s) FAIL 2026/03/29 08:03:33 DEBUG : drime root 'rclone-test-felirub0xuki': Purge remote "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestApplyTransforms|TestCheck|TestCheckDownload|TestCheckSizeOnly|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestMultithreadCopy|TestMultithreadCopyAbort|TestParseSumFile)$'" - Finished ERROR in 1h0m11.776176718s (try 4/5): exit status 1: Failed [TestMultithreadCopy TestMultithreadCopyAbort TestParseSumFile TestCheckSumDownload TestApplyTransforms TestCopyFile TestCopyFileCompareDest]