"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestApplyTransforms|TestCat|TestCheckSumDownload|TestCopyFile|TestCopyFileCopyDest|TestCount|TestListDirSorted|TestListDirSortedFn|TestLs|TestLsd|TestMaxDelete|TestMaxDeleteSize|TestMaxDeleteSizeLargeFile|TestMultithreadCopyAbort|TestParseSumFile|TestReadFile)$|^TestListJSON$/^(Default|DirsOnly|Metadata|Recurse)$|^TestMultithreadCopy$/^(upload=false,size=10485759,streams=2|upload=true,size=10485759,streams=2|upload=true,size=10485760,streams=2|upload=true,size=10485761,streams=2)$'" - Starting (try 4/5) 2026/02/03 07:17:50 DEBUG : Creating backend with remote "TestDrime:rclone-test-hibusuw3lifu" 2026/02/03 07:17:50 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:17:51 DEBUG : Creating backend with remote "/tmp/rclone844359235" === RUN TestMultithreadCopy run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" === RUN TestMultithreadCopy/upload=false,size=10485759,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:191 Error: Should be true Test: TestMultithreadCopy/upload=false,size=10485759,streams=2 Messages: listing wrong, want test-multithread-copy-false-10485759-2 (10485759) got fstest.go:203: Not found "test-multithread-copy-false-10485759-2" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:191 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestMultithreadCopy/upload=false,size=10485759,streams=2 Messages: 1 objects not found 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: write buffer set to 131072 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10.000Mi 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: Starting multi-thread copy with 1 chunks of size 10.000Mi with 1 parallel streams 2026/02/03 07:18:06 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi starting 2026/02/03 07:18:07 DEBUG : test-multithread-copy-false-10485759-2: writing chunk 0 2026/02/03 07:18:07 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi finished 2026/02/03 07:18:07 DEBUG : test-multithread-copy-false-10485759-2: Finished multi-thread copy with 1 parts of size 10.000Mi === RUN TestMultithreadCopy/upload=true,size=10485759,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485759,streams=2 Messages: listing wrong, want got test-multithread-copy-false-10485759-2 (10485759) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485759,streams=2 Messages: Unexpected file "test-multithread-copy-false-10485759-2" 2026/02/03 07:18:19 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: disabling buffering because source is local disk 2026/02/03 07:18:21 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 07:18:21 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/02/03 07:18:21 DEBUG : test-multithread-copy-true-10485759-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/02/03 07:18:21 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi starting 2026/02/03 07:18:21 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/02/03 07:18:22 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/02/03 07:18:22 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi finished 2026/02/03 07:18:25 DEBUG : test-multithread-copy-true-10485759-2: Finished multi-thread copy with 2 parts of size 5Mi === RUN TestMultithreadCopy/upload=true,size=10485760,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: listing wrong, want got test-multithread-copy-true-10485759-2 (10485759) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" 2026/02/03 07:18:36 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: disabling buffering because source is local disk 2026/02/03 07:18:37 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 07:18:37 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/02/03 07:18:37 DEBUG : test-multithread-copy-true-10485760-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/02/03 07:18:37 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi starting 2026/02/03 07:18:37 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/02/03 07:18:38 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi finished 2026/02/03 07:18:38 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/02/03 07:18:42 DEBUG : test-multithread-copy-true-10485760-2: Finished multi-thread copy with 2 parts of size 5Mi === RUN TestMultithreadCopy/upload=true,size=10485761,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: listing wrong, want got test-multithread-copy-true-10485760-2 (10485760) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485760-2" 2026/02/03 07:18:54 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: disabling buffering because source is local disk 2026/02/03 07:18:55 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 07:18:55 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/02/03 07:18:55 DEBUG : test-multithread-copy-true-10485761-2: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/02/03 07:18:55 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/02/03 07:18:55 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/02/03 07:18:55 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/02/03 07:18:56 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/02/03 07:18:56 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/02/03 07:18:56 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 finished 2026/02/03 07:18:59 DEBUG : test-multithread-copy-true-10485761-2: Finished multi-thread copy with 3 parts of size 5Mi 2026/02/03 07:19:03 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:19:03 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:19:04 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:19:04 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:19:04 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:19:04 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:19:05 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:19:05 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:19:05 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:19:05 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:19:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:19:06 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 07:19:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:19:07 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 07:19:07 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:19:07 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 07:19:08 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:19:08 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 07:19:11 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 07:19:11 DEBUG : pacer: Rate limited, increasing sleep to 10.24s === NAME TestMultithreadCopy run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 07:19:16 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:19:16 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 07:19:26 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:19:46 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:20:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:20:26 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:20:46 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:21:06 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:21:26 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:21:26 DEBUG : pacer: low level retry 8/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:21:46 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:22:06 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 07:22:26 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:22:46 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:23:06 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:23:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:23:46 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:24:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:24:26 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:24:47 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:25:06 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:25:27 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test-multithread-copy-true-10485761-2" failed: failed to delete item: Error "Server Error" 2026/02/03 07:25:46 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestMultithreadCopy (475.47s) --- FAIL: TestMultithreadCopy/upload=false,size=10485759,streams=2 (16.26s) --- FAIL: TestMultithreadCopy/upload=true,size=10485759,streams=2 (16.98s) --- FAIL: TestMultithreadCopy/upload=true,size=10485760,streams=2 (18.13s) --- FAIL: TestMultithreadCopy/upload=true,size=10485761,streams=2 (16.92s) === RUN TestMultithreadCopyAbort run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 07:26:07 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 07:26:16 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 07:26:21 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 07:26:26 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 07:26:26 DEBUG : pacer: Reducing sleep to 312.5ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:26:28 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 07:26:29 DEBUG : pacer: Reducing sleep to 78.125ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:26:32 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 07:26:32 DEBUG : pacer: Reducing sleep to 19.53125ms fstest.go:292: Sleeping for 7s just to make sure 2026/02/03 07:26:40 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2026/02/03 07:26:41 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:26:41 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 1 2026/02/03 07:26:41 DEBUG : test-multithread-abort: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/02/03 07:26:41 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/02/03 07:26:41 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/02/03 07:26:41 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:41 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/02/03 07:26:41 DEBUG : Open with options = [RangeOption(0,5242879)] 2026/02/03 07:26:41 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/02/03 07:26:41 DEBUG : Open with options = [RangeOption(5242880,10485759)] 2026/02/03 07:26:42 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/02/03 07:26:42 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/02/03 07:26:42 DEBUG : Returning error reader 2026/02/03 07:26:43 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:43 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 0/10: BOOM: simulated read failure 2026/02/03 07:26:43 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:44 DEBUG : Returning error reader 2026/02/03 07:26:44 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:44 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2026/02/03 07:26:44 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:45 DEBUG : Returning error reader 2026/02/03 07:26:45 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:45 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2026/02/03 07:26:45 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:46 DEBUG : Returning error reader 2026/02/03 07:26:46 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:46 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2026/02/03 07:26:46 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:47 DEBUG : Returning error reader 2026/02/03 07:26:47 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:47 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2026/02/03 07:26:47 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:48 DEBUG : Returning error reader 2026/02/03 07:26:48 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:48 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2026/02/03 07:26:48 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:49 DEBUG : Returning error reader 2026/02/03 07:26:49 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:49 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2026/02/03 07:26:49 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:50 DEBUG : Returning error reader 2026/02/03 07:26:50 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:50 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2026/02/03 07:26:50 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:51 DEBUG : Returning error reader 2026/02/03 07:26:51 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:51 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2026/02/03 07:26:51 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:52 DEBUG : Returning error reader 2026/02/03 07:26:52 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:52 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2026/02/03 07:26:52 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 07:26:53 DEBUG : Returning error reader 2026/02/03 07:26:53 DEBUG : BOOM: simulated read failure 2026/02/03 07:26:53 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2026/02/03 07:26:53 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2026/02/03 07:26:53 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: failed to upload part 3: Put "https://drimestorage.18b804eaa6bc9759e2278f8d5367f42f.r2.cloudflarestorage.com/uploads/971c7d88-9662-4776-bcb0-7f2c6d44a8dc/971c7d88-9662-4776-bcb0-7f2c6d44a8dc?uploadId=AJk8Q0o1gCEO719fLWUuTrtsHLCE92pNtJxqYwhpvgs6x3PaI6XUIK8oSb-XVuNbIgZbDZl1mdSpNPNzbusvmAGSgRujhs30KQO3jlQ0zJ3Mmm8_CwQD21AjThnq3llkgzG7kG9NvlKV3m0_YBu6A2908rzddAqyea2GifdTaTO-2Iktpz35MGYkGGFLeTTUGHAazGUDHlnbXruRdRBnJOv8Loh9O53k2INM0VJD5hRGRuZy98HXNgmUKG550nrf7QNglOMaRqme-_dRtmef6GRconhVOic7JXwH8JRuZ_0UqOozR9ls0sxhp7eh12G2lnnk0WFF7XAmcuLBXfz8Tlo&partNumber=3&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=db9b71e81fa19eaf54eb4264526ca7a8%2F20260203%2FWEUR%2Fs3%2Faws4_request&X-Amz-Date=20260203T072643Z&X-Amz-SignedHeaders=host&X-Amz-Expires=1800&X-Amz-Signature=902d54b00e9d19b00f236eb4075686d97c45148280cceeeaaccb0d649c07ae26": BOOM: simulated read failure 2026/02/03 07:26:53 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit 2026/02/03 07:26:55 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:26:55 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:26:55 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:26:55 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:26:55 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:26:55 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:26:56 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:26:56 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:26:56 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:26:56 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:26:56 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:26:56 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 07:26:57 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:26:57 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 07:26:57 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:26:57 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 07:26:59 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:26:59 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 07:27:01 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 07:27:01 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "test-multithread-abort" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 07:27:07 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:27:07 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 07:27:17 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:27:37 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:27:57 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:28:17 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:28:37 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:28:57 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:29:17 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:29:37 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:29:57 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-abort" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 07:30:17 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:30:37 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:30:57 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:31:17 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:31:37 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:31:57 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:32:17 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:32:37 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:32:57 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:33:17 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-abort" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test-multithread-abort" failed: failed to delete item: Error "Server Error" 2026/02/03 07:33:37 DEBUG : pacer: Reducing sleep to 10s --- PASS: TestMultithreadCopyAbort (470.57s) === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 07:33:57 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 07:34:09 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 07:34:12 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 07:34:16 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 07:34:16 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/03 07:34:16 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/03 07:34:16 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/03 07:34:16 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/03 07:34:17 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 07:34:20 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 07:34:20 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 07:34:20 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 07:34:21 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 07:34:21 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 07:34:21 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/03 07:34:21 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/03 07:34:21 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/03 07:34:21 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/03 07:34:21 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:34:22 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:34:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:34:22 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:34:22 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:34:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:34:23 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:34:23 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:34:23 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:34:23 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:34:23 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:34:24 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:34:24 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 07:34:24 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:34:24 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 07:34:25 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:34:25 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 07:34:26 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:34:26 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 07:34:28 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 07:34:28 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "test.sum" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 07:34:34 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:34:34 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 07:34:44 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:35:04 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:35:24 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:35:44 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:36:04 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:36:24 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:36:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:37:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:37:24 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test.sum" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 07:37:44 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:38:04 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:38:24 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:38:44 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:39:04 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:39:24 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:39:44 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:39:44 DEBUG : pacer: low level retry 7/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:40:04 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:40:24 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:40:44 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test.sum" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test.sum" failed: failed to delete item: Error "Server Error" 2026/02/03 07:41:04 DEBUG : pacer: Reducing sleep to 10s fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:41:25 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 07:41:34 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:41:34 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:41:34 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/02/03 07:41:39 DEBUG : pacer: Reducing sleep to 5s fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:41:49 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 07:41:54 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:41:54 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:41:54 DEBUG : pacer: Rate limited, increasing sleep to 5s 2026/02/03 07:41:57 DEBUG : pacer: Reducing sleep to 2.5s fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestParseSumFile Messages: listing wrong, want got test.sum (90) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestParseSumFile Messages: Unexpected file "test.sum" --- FAIL: TestParseSumFile (503.61s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 07:42:01 DEBUG : Creating backend with remote "TestDrime:rclone-test-hibusuw3lifu/data" 2026/02/03 07:42:01 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:01 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:01 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:42:02 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:42:02 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 07:42:05 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 07:42:06 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:06 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:06 DEBUG : pacer: Rate limited, increasing sleep to 1.25s 2026/02/03 07:42:07 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 07:42:08 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:08 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:08 DEBUG : pacer: Rate limited, increasing sleep to 1.25s 2026/02/03 07:42:09 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 07:42:16 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 07:42:16 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 07:42:18 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 07:42:18 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 07:42:18 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 07:42:19 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 07:42:19 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:436 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), test.sum (41) got data/banana (13), test.sum (90) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:436 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Not equal: expected: 41 actual : 90 Test: TestCheckSumDownload Messages: test.sum: size incorrect file=41 vs obj=90 === RUN TestCheckSumDownload/subtest1 2026/02/03 07:42:32 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:32 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:32 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:42:33 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:42:33 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:42:45 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:42:48 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 07:42:48 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:48 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:48 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:42:48 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:48 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:48 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:42:48 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:42:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:49 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:49 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:42:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:49 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:49 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:42:49 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:42:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:49 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:49 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:42:49 DEBUG : pacer: Reducing sleep to 40ms === RUN TestCheckSumDownload/subtest2 2026/02/03 07:42:51 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:51 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:51 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:42:51 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:42:51 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:42:51 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:42:51 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:42:58 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:42:58 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 07:42:58 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:42:58 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:42:59 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:42:59 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:42:59 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:42:59 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:42:59 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:42:59 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:42:59 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:42:59 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:42:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:42:59 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 07:43:00 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:43:00 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 07:43:01 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:43:01 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 07:43:02 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:43:02 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 07:43:04 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:04 DEBUG : pacer: low level retry 10/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:04 DEBUG : pacer: Rate limited, increasing sleep to 10.24s === NAME TestCheckSumDownload run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-hibusuw3lifu': 1/10 (failed to delete existing object: failed to delete item: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:09 DEBUG : pacer: Reducing sleep to 5.12s 2026/02/03 07:43:21 DEBUG : pacer: Reducing sleep to 2.56s 2026/02/03 07:43:21 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 07:43:25 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:25 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:25 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 07:43:27 DEBUG : pacer: Reducing sleep to 2.56s 2026/02/03 07:43:32 DEBUG : pacer: Reducing sleep to 1.28s 2026/02/03 07:43:35 DEBUG : pacer: Reducing sleep to 640ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:43:36 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:36 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:36 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 07:43:37 DEBUG : pacer: Reducing sleep to 640ms 2026/02/03 07:43:38 DEBUG : pacer: Reducing sleep to 320ms 2026/02/03 07:43:39 DEBUG : pacer: Reducing sleep to 160ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:43:41 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 07:43:41 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:43:42 DEBUG : pacer: Reducing sleep to 20ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:464 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:464 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest3 2026/02/03 07:43:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:49 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:49 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:43:49 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 07:43:52 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:43:52 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 07:43:52 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:52 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:52 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:43:52 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:52 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:52 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:43:52 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:52 DEBUG : pacer: low level retry 3/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:52 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:43:52 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:43:52 DEBUG : pacer: low level retry 4/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:43:52 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 07:43:53 DEBUG : pacer: Reducing sleep to 320ms 2026/02/03 07:43:53 DEBUG : pacer: Reducing sleep to 160ms 2026/02/03 07:43:54 DEBUG : pacer: Reducing sleep to 80ms === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:43:56 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:43:57 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:43:57 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:478 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:478 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest4 2026/02/03 07:44:10 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (123) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Not equal: expected: 123 actual : 82 Test: TestCheckSumDownload Messages: test.sum: size incorrect file=123 vs obj=82 fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest5 2026/02/03 07:44:28 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:508 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (123) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:508 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest6 2026/02/03 07:44:43 DEBUG : data/banana: Removing old object on successful upload 2026/02/03 07:44:52 DEBUG : data/potato: Removing old object on successful upload 2026/02/03 07:44:56 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Not equal: expected: 82 actual : 123 Test: TestCheckSumDownload Messages: test.sum: size incorrect file=82 vs obj=123 fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest7 2026/02/03 07:45:09 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:45:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:45:10 DEBUG : pacer: Reducing sleep to 10ms === NAME TestCheckSumDownload run.go:130: removing dir "data" failed - try 1/3: directory not empty run.go:130: removing dir "data" failed - try 2/3: directory not empty run.go:130: removing dir "data" failed - try 3/3: directory not empty run.go:133: removing dir "data" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"data"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=4) "data" } Test: TestCheckSumDownload Messages: directories --- FAIL: TestCheckSumDownload (204.98s) --- PASS: TestCheckSumDownload/subtest1 (4.02s) --- PASS: TestCheckSumDownload/subtest2 (1.78s) --- PASS: TestCheckSumDownload/subtest3 (3.28s) --- PASS: TestCheckSumDownload/subtest4 (2.63s) --- PASS: TestCheckSumDownload/subtest5 (2.17s) --- PASS: TestCheckSumDownload/subtest6 (1.72s) --- PASS: TestCheckSumDownload/subtest7 (2.38s) === RUN TestApplyTransforms 2026/02/03 07:45:26 DEBUG : Creating backend with remote "TestDrime:rclone-test-pigucix0dama" 2026/02/03 07:45:26 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:45:27 DEBUG : Creating backend with remote "/tmp/rclone1118736774" run.go:185: Remote "drime root 'rclone-test-pigucix0dama'", Local "Local file system at /tmp/rclone1118736774", Modify Window "876000h0m0s" upper checkfile vs. lower remote (without normalization) 2026/02/03 07:45:34 ERROR : HELLO, WORLD!: file not in drime root 'rclone-test-pigucix0dama' 2026/02/03 07:45:34 NOTICE: drime root 'rclone-test-pigucix0dama': 1 files missing 2026/02/03 07:45:34 NOTICE: drime root 'rclone-test-pigucix0dama': 0 differences found 2026/02/03 07:45:34 NOTICE: drime root 'rclone-test-pigucix0dama': 1 errors while checking upper checkfile vs. lower remote (with normalization) 2026/02/03 07:45:34 ERROR : hello, world!: file not in drime root 'rclone-test-pigucix0dama' 2026/02/03 07:45:34 NOTICE: drime root 'rclone-test-pigucix0dama': 1 files missing 2026/02/03 07:45:34 NOTICE: drime root 'rclone-test-pigucix0dama': 0 differences found 2026/02/03 07:45:34 NOTICE: drime root 'rclone-test-pigucix0dama': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:594 Error: Received unexpected error: file not in drime root 'rclone-test-pigucix0dama' Test: TestApplyTransforms Messages: unexpected error for upper checkfile vs. lower remote (with normalization) HELLO, WORLD! hello, world! 2026/02/03 07:45:34 DEBUG : Creating backend with remote "TestDrime:rclone-test-bibahux7nini" 2026/02/03 07:45:34 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:45:36 DEBUG : Creating backend with remote "/tmp/rclone1378479460" run.go:185: Remote "drime root 'rclone-test-bibahux7nini'", Local "Local file system at /tmp/rclone1378479460", Modify Window "876000h0m0s" lower checkfile vs. upper remote (without normalization) 2026/02/03 07:45:43 ERROR : hello, world!: file not in drime root 'rclone-test-bibahux7nini' 2026/02/03 07:45:43 NOTICE: drime root 'rclone-test-bibahux7nini': 1 files missing 2026/02/03 07:45:43 NOTICE: drime root 'rclone-test-bibahux7nini': 0 differences found 2026/02/03 07:45:43 NOTICE: drime root 'rclone-test-bibahux7nini': 1 errors while checking lower checkfile vs. upper remote (with normalization) 2026/02/03 07:45:44 ERROR : hello, world!: file not in drime root 'rclone-test-bibahux7nini' 2026/02/03 07:45:44 NOTICE: drime root 'rclone-test-bibahux7nini': 1 files missing 2026/02/03 07:45:44 NOTICE: drime root 'rclone-test-bibahux7nini': 0 differences found 2026/02/03 07:45:44 NOTICE: drime root 'rclone-test-bibahux7nini': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:595 Error: Received unexpected error: file not in drime root 'rclone-test-bibahux7nini' Test: TestApplyTransforms Messages: unexpected error for lower checkfile vs. upper remote (with normalization) hello, world! HELLO, WORLD! 2026/02/03 07:45:44 DEBUG : Creating backend with remote "TestDrime:rclone-test-dawibub8rohu" 2026/02/03 07:45:44 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:45:45 DEBUG : Creating backend with remote "/tmp/rclone3570664469" run.go:185: Remote "drime root 'rclone-test-dawibub8rohu'", Local "Local file system at /tmp/rclone3570664469", Modify Window "876000h0m0s" lower checkfile vs. upperlowermixed remote (without normalization) 2026/02/03 07:45:51 ERROR : hello, world!: file not in drime root 'rclone-test-dawibub8rohu' 2026/02/03 07:45:51 NOTICE: drime root 'rclone-test-dawibub8rohu': 1 files missing 2026/02/03 07:45:51 NOTICE: drime root 'rclone-test-dawibub8rohu': 0 differences found 2026/02/03 07:45:51 NOTICE: drime root 'rclone-test-dawibub8rohu': 1 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2026/02/03 07:45:51 ERROR : hello, world!: file not in drime root 'rclone-test-dawibub8rohu' 2026/02/03 07:45:51 NOTICE: drime root 'rclone-test-dawibub8rohu': 1 files missing 2026/02/03 07:45:51 NOTICE: drime root 'rclone-test-dawibub8rohu': 0 differences found 2026/02/03 07:45:51 NOTICE: drime root 'rclone-test-dawibub8rohu': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:596 Error: Received unexpected error: file not in drime root 'rclone-test-dawibub8rohu' Test: TestApplyTransforms Messages: unexpected error for lower checkfile vs. upperlowermixed remote (with normalization) hello, world! HeLlO, wOrLd! 2026/02/03 07:45:51 DEBUG : Creating backend with remote "TestDrime:rclone-test-qeyeqab5xawa" 2026/02/03 07:45:51 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:45:52 DEBUG : Creating backend with remote "/tmp/rclone328444685" run.go:185: Remote "drime root 'rclone-test-qeyeqab5xawa'", Local "Local file system at /tmp/rclone328444685", Modify Window "876000h0m0s" 2026/02/03 07:45:52 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:45:52 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:45:52 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:45:53 DEBUG : pacer: Reducing sleep to 10ms upperlowermixed checkfile vs. upper remote (without normalization) 2026/02/03 07:45:57 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:45:57 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:45:57 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:45:57 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:45:57 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:45:57 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:45:58 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:45:58 ERROR : HeLlO, wOrLd!: file not in drime root 'rclone-test-qeyeqab5xawa' 2026/02/03 07:45:58 NOTICE: drime root 'rclone-test-qeyeqab5xawa': 1 files missing 2026/02/03 07:45:58 NOTICE: drime root 'rclone-test-qeyeqab5xawa': 0 differences found 2026/02/03 07:45:58 NOTICE: drime root 'rclone-test-qeyeqab5xawa': 1 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2026/02/03 07:45:58 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:45:58 ERROR : hello, world!: file not in drime root 'rclone-test-qeyeqab5xawa' 2026/02/03 07:45:58 NOTICE: drime root 'rclone-test-qeyeqab5xawa': 1 files missing 2026/02/03 07:45:58 NOTICE: drime root 'rclone-test-qeyeqab5xawa': 0 differences found 2026/02/03 07:45:58 NOTICE: drime root 'rclone-test-qeyeqab5xawa': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:597 Error: Received unexpected error: file not in drime root 'rclone-test-qeyeqab5xawa' Test: TestApplyTransforms Messages: unexpected error for upperlowermixed checkfile vs. upper remote (with normalization) HeLlO, wOrLd! HELLO, WORLD! 2026/02/03 07:45:58 DEBUG : Creating backend with remote "TestDrime:rclone-test-bizopit3xavi" 2026/02/03 07:45:58 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:45:59 DEBUG : Creating backend with remote "/tmp/rclone517926098" run.go:185: Remote "drime root 'rclone-test-bizopit3xavi'", Local "Local file system at /tmp/rclone517926098", Modify Window "876000h0m0s" NFD checkfile vs. NFC remote (without normalization) 2026/02/03 07:46:04 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-bizopit3xavi' 2026/02/03 07:46:04 NOTICE: drime root 'rclone-test-bizopit3xavi': 1 files missing 2026/02/03 07:46:04 NOTICE: drime root 'rclone-test-bizopit3xavi': 0 differences found 2026/02/03 07:46:04 NOTICE: drime root 'rclone-test-bizopit3xavi': 1 errors while checking NFD checkfile vs. NFC remote (with normalization) 2026/02/03 07:46:04 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:04 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:04 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:46:04 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:04 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:04 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:46:04 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:46:04 ERROR : 測試_русский___ě_áñ: file not in drime root 'rclone-test-bizopit3xavi' 2026/02/03 07:46:04 NOTICE: drime root 'rclone-test-bizopit3xavi': 1 files missing 2026/02/03 07:46:04 NOTICE: drime root 'rclone-test-bizopit3xavi': 0 differences found 2026/02/03 07:46:04 NOTICE: drime root 'rclone-test-bizopit3xavi': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:598 Error: Received unexpected error: file not in drime root 'rclone-test-bizopit3xavi' Test: TestApplyTransforms Messages: unexpected error for NFD checkfile vs. NFC remote (with normalization) 測試_Русский___ě_áñ 測試_Русский___ě_áñ 2026/02/03 07:46:04 DEBUG : Creating backend with remote "TestDrime:rclone-test-suluqap8pogo" 2026/02/03 07:46:04 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:46:05 DEBUG : Creating backend with remote "/tmp/rclone3647371422" run.go:185: Remote "drime root 'rclone-test-suluqap8pogo'", Local "Local file system at /tmp/rclone3647371422", Modify Window "876000h0m0s" 2026/02/03 07:46:05 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:05 DEBUG : pacer: low level retry 1/1 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "測試_Русский___ě_áñ" to drime root 'rclone-test-suluqap8pogo': 1/10 (failed to upload file: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:08 DEBUG : pacer: Reducing sleep to 10ms NFC checkfile vs. NFD remote (without normalization) 2026/02/03 07:46:11 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-suluqap8pogo' 2026/02/03 07:46:11 NOTICE: drime root 'rclone-test-suluqap8pogo': 1 files missing 2026/02/03 07:46:11 NOTICE: drime root 'rclone-test-suluqap8pogo': 0 differences found 2026/02/03 07:46:11 NOTICE: drime root 'rclone-test-suluqap8pogo': 1 errors while checking NFC checkfile vs. NFD remote (with normalization) 2026/02/03 07:46:11 ERROR : 測試_русский___ě_áñ: file not in drime root 'rclone-test-suluqap8pogo' 2026/02/03 07:46:11 NOTICE: drime root 'rclone-test-suluqap8pogo': 1 files missing 2026/02/03 07:46:11 NOTICE: drime root 'rclone-test-suluqap8pogo': 0 differences found 2026/02/03 07:46:11 NOTICE: drime root 'rclone-test-suluqap8pogo': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:599 Error: Received unexpected error: file not in drime root 'rclone-test-suluqap8pogo' Test: TestApplyTransforms Messages: unexpected error for NFC checkfile vs. NFD remote (with normalization) 測試_Русский___ě_áñ 測試_Русский___ě_áñ 2026/02/03 07:46:11 DEBUG : Creating backend with remote "TestDrime:rclone-test-kefipen8weto" 2026/02/03 07:46:11 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 07:46:12 DEBUG : Creating backend with remote "/tmp/rclone698087330" run.go:185: Remote "drime root 'rclone-test-kefipen8weto'", Local "Local file system at /tmp/rclone698087330", Modify Window "876000h0m0s" 2026/02/03 07:46:12 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:12 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:46:12 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:12 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:12 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:46:12 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:12 DEBUG : pacer: Reducing sleep to 20ms run.go:242: Failed to mkdir "drime root 'rclone-test-kefipen8weto'": couldn't list files: Error "525 (525): \n\n\n\n \n\n\ndrime.cloud | 525: SSL handshake failed\n\n\n\n\n\n\n\n\n
\n
\n
\n

\n SSL handshake failed\n Error code 525\n

\n
\n Visit cloudflare.com for more information.\n
\n
2026-02-03 07:46:12 UTC
\n
\n
\n
\n
\n
\n
\n \n \n \n \n
\n You\n

\n \n Browser\n \n

\n \n Working\n \n
\n
\n
\n \n \n \n \n
\n Frankfurt\n

\n \n Cloudflare\n \n

\n \n Working\n \n
\n
\n
\n \n \n \n \n
\n app.drime.cloud\n

\n \n Host\n \n

\n \n Error\n \n
\n
\n
\n
\n\n
\n
\n
\n

What happened?

\n

Cloudflare is unable to establish an SSL connection to the origin server.

\n
\n
\n

What can I do?

\n \n

If you're a visitor of this website:

\n

Please try again in a few minutes.

\n\n

If you're the owner of this website:

\n

It appears that the SSL configuration used is not compatible with Cloudflare. This could happen for a several reasons, including no shared cipher suites. Additional troubleshooting information here.

\n
\n
\n
\n\n \n\n
\n
\n\n" 2026/02/03 07:46:12 DEBUG : drime root 'rclone-test-kefipen8weto': Purge remote 2026/02/03 07:46:12 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:12 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:46:12 NOTICE: purge failed: couldn't list files: Error "525 (525): \n\n\n\n \n\n\ndrime.cloud | 525: SSL handshake failed\n\n\n\n\n\n\n\n\n
\n
\n
\n

\n SSL handshake failed\n Error code 525\n

\n
\n Visit cloudflare.com for more information.\n
\n
2026-02-03 07:46:12 UTC
\n
\n
\n
\n
\n
\n
\n \n \n \n \n
\n You\n

\n \n Browser\n \n

\n \n Working\n \n
\n
\n
\n \n \n \n \n
\n Frankfurt\n

\n \n Cloudflare\n \n

\n \n Working\n \n
\n
\n
\n \n \n \n \n
\n app.drime.cloud\n

\n \n Host\n \n

\n \n Error\n \n
\n
\n
\n
\n\n
\n
\n
\n

What happened?

\n

Cloudflare is unable to establish an SSL connection to the origin server.

\n
\n
\n

What can I do?

\n \n

If you're a visitor of this website:

\n

Please try again in a few minutes.

\n\n

If you're the owner of this website:

\n

It appears that the SSL configuration used is not compatible with Cloudflare. This could happen for a several reasons, including no shared cipher suites. Additional troubleshooting information here.

\n
\n
\n
\n\n \n\n
\n
\n\n" 2026/02/03 07:46:12 DEBUG : drime root 'rclone-test-suluqap8pogo': Purge remote 2026/02/03 07:46:12 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:12 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:46:12 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:46:12 DEBUG : drime root 'rclone-test-bizopit3xavi': Purge remote 2026/02/03 07:46:13 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:13 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:13 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:46:13 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:13 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:13 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:46:13 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:13 DEBUG : pacer: low level retry 3/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:13 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:46:13 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:13 DEBUG : pacer: low level retry 4/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:13 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:46:13 DEBUG : pacer: Reducing sleep to 160ms 2026/02/03 07:46:13 DEBUG : drime root 'rclone-test-qeyeqab5xawa': Purge remote 2026/02/03 07:46:13 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:13 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:46:13 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:13 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:13 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:46:13 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:46:13 DEBUG : drime root 'rclone-test-dawibub8rohu': Purge remote 2026/02/03 07:46:14 DEBUG : drime root 'rclone-test-bibahux7nini': Purge remote 2026/02/03 07:46:14 DEBUG : drime root 'rclone-test-pigucix0dama': Purge remote --- FAIL: TestApplyTransforms (48.71s) === RUN TestCopyFile run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 3/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:46:15 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:46:15 DEBUG : file1: Need to transfer - File not found at Destination 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:46:15 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:46:15 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:15 DEBUG : pacer: low level retry 3/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:15 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:46:16 DEBUG : pacer: Reducing sleep to 160ms 2026/02/03 07:46:16 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:46:16 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:46:16 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:46:16 DEBUG : pacer: Reducing sleep to 160ms 2026/02/03 07:46:20 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 07:46:20 DEBUG : sub/file2: size = 14 OK 2026/02/03 07:46:20 INFO : file1: Copied (new) to: sub/file2 2026/02/03 07:46:20 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:46:21 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:46:21 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:46:21 DEBUG : sub/file2: size = 14 OK 2026/02/03 07:46:21 DEBUG : file1: Sizes identical 2026/02/03 07:46:21 DEBUG : file1: Unchanged skipping 2026/02/03 07:46:22 DEBUG : drime root 'rclone-test-hibusuw3lifu': don't need to copy/move sub/file2, it is already at target location run.go:130: removing dir "sub" failed - try 1/3: directory not empty run.go:130: removing dir "sub" failed - try 2/3: directory not empty run.go:130: removing dir "sub" failed - try 3/3: directory not empty run.go:133: removing dir "sub" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=3) "sub" } Test: TestCopyFile Messages: directories --- FAIL: TestCopyFile (24.85s) === RUN TestCopyFileCopyDest run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 07:46:39 DEBUG : Creating backend with remote "TestDrime:rclone-test-hibusuw3lifu/dst" 2026/02/03 07:46:41 DEBUG : Creating backend with remote "TestDrime:rclone-test-hibusuw3lifu/CopyDest" 2026/02/03 07:46:43 DEBUG : one: Need to transfer - File not found at Destination 2026/02/03 07:46:47 DEBUG : one: size = 3 OK 2026/02/03 07:46:47 INFO : one: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/03 07:47:02 DEBUG : one: size = 5 (Local file system at /tmp/rclone844359235) 2026/02/03 07:47:02 DEBUG : one: size = 3 (drime root 'rclone-test-hibusuw3lifu/dst') 2026/02/03 07:47:02 DEBUG : one: Sizes differ 2026/02/03 07:47:09 DEBUG : one: Removing old object on successful upload 2026/02/03 07:47:09 DEBUG : one: size = 5 OK 2026/02/03 07:47:09 INFO : one: Copied (replaced existing) 2026/02/03 07:47:17 DEBUG : dst/one: Removing old object on successful upload 2026/02/03 07:47:23 DEBUG : Creating backend with remote "TestDrime:rclone-test-hibusuw3lifu/BackupDir" 2026/02/03 07:47:25 DEBUG : one: size = 5 (Local file system at /tmp/rclone844359235) 2026/02/03 07:47:25 DEBUG : one: size = 3 (drime root 'rclone-test-hibusuw3lifu/dst') 2026/02/03 07:47:25 DEBUG : one: Sizes differ 2026/02/03 07:47:27 INFO : one: Moved (server-side) 2026/02/03 07:47:27 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:27 DEBUG : pacer: low level retry 1/1 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:27 DEBUG : one: Received error: failed to upload file: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n" - low level retry 0/10 2026/02/03 07:47:27 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:29 DEBUG : one: Removing old object on successful upload 2026/02/03 07:47:29 DEBUG : one: size = 5 OK 2026/02/03 07:47:29 INFO : one: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:47:31 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:31 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:31 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:31 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:31 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:32 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:32 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:32 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:32 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:32 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:47:34 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:34 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:35 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:35 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:35 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:35 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:35 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:35 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:47:35 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:47:35 DEBUG : pacer: Reducing sleep to 10ms fstest.go:292: Sleeping for 7s just to make sure 2026/02/03 07:47:43 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:43 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:43 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:43 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:43 DEBUG : pacer: low level retry 1/1 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:286: Retry Put of "CopyDest/two" to drime root 'rclone-test-hibusuw3lifu': 1/10 (failed to upload file: Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:45 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:47 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:47 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:47 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:47 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:47 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:47 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:47:47 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:47 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:47 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:47:47 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:47 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:47 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:47:47 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:47 DEBUG : pacer: low level retry 3/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:47 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:47:47 DEBUG : pacer: Reducing sleep to 160ms 2026/02/03 07:47:47 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 07:47:48 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:47:48 DEBUG : pacer: Reducing sleep to 20ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:47:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:49 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:49 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:47:49 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:47:49 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:49 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:49 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:49 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:47:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:49 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:49 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:47:49 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:49 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:49 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:47:49 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 07:47:49 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:47:49 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:47:50 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:333 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5) got CopyDest/one (5), CopyDest/two (3), dst/one (5) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:333 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/03 07:47:57 DEBUG : two: Need to transfer - File not found at Destination 2026/02/03 07:47:57 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:57 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:57 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:57 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:57 DEBUG : two: size = 3 OK 2026/02/03 07:47:57 DEBUG : two: Sizes identical 2026/02/03 07:47:58 DEBUG : two: size = 3 OK 2026/02/03 07:47:58 INFO : two: Copied (server-side copy) 2026/02/03 07:47:58 DEBUG : two: Destination found in --copy-dest, using server-side copy 2026/02/03 07:47:58 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:58 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:58 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:58 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:47:58 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:58 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:58 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:47:58 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:58 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:58 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:47:58 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:58 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:58 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:47:58 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:47:58 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:47:58 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:47:59 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 07:47:59 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:47:59 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:47:59 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:48:00 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:48:00 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:48:00 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:48:01 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:342 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:342 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/03 07:48:08 DEBUG : two: size = 3 OK 2026/02/03 07:48:08 DEBUG : two: Sizes identical 2026/02/03 07:48:08 DEBUG : two: Unchanged skipping fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:348 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:348 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 07:48:25 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:48:25 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:48:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:48:25 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 07:48:25 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:48:25 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:48:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:48:25 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:48:25 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:48:25 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:48:25 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 07:48:25 DEBUG : pacer: low level retry 2/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 07:48:25 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:48:25 DEBUG : pacer: Reducing sleep to 40ms 2026/02/03 07:48:25 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 07:48:25 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:353 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:353 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/03 07:48:33 DEBUG : three: Need to transfer - File not found at Destination 2026/02/03 07:48:33 DEBUG : three: size = 7 (Local file system at /tmp/rclone844359235) 2026/02/03 07:48:33 DEBUG : three: size = 5 (drime root 'rclone-test-hibusuw3lifu/CopyDest') 2026/02/03 07:48:33 DEBUG : three: Sizes differ 2026/02/03 07:48:33 DEBUG : three: Destination not found in --copy-dest 2026/02/03 07:48:35 DEBUG : three: size = 7 OK 2026/02/03 07:48:35 INFO : three: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:362 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/three (7), dst/two (3) got CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/three (7), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:362 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found run.go:130: removing dir "dst" failed - try 1/3: directory not empty run.go:130: removing dir "dst" failed - try 2/3: directory not empty run.go:130: removing dir "dst" failed - try 3/3: directory not empty run.go:133: removing dir "dst" failed: directory not empty run.go:130: removing dir "CopyDest" failed - try 1/3: directory not empty run.go:130: removing dir "CopyDest" failed - try 2/3: directory not empty run.go:130: removing dir "CopyDest" failed - try 3/3: directory not empty run.go:133: removing dir "CopyDest" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"CopyDest", "dst"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=8) "CopyDest", + (string) (len=3) "dst" } Test: TestCopyFileCopyDest Messages: directories --- FAIL: TestCopyFileCopyDest (147.75s) === RUN TestListDirSorted run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure listdirsorted_test.go:57: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:57 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:111 Error: "[CopyDest a.txt dst sub dir zend.txt]" should have 3 item(s), but has 5 Test: TestListDirSorted run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir/sub sub dir" failed: directory not empty run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:57 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:111 Error: Not equal: expected: []string{} actual : []string{"sub dir", "sub dir/sub sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=7) "sub dir", + (string) (len=19) "sub dir/sub sub dir" } Test: TestListDirSorted Messages: directories --- FAIL: TestListDirSorted (65.76s) === RUN TestListDirSortedFn run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:36 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:125 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestListDirSortedFn Messages: listing wrong, want a.txt (11), sub dir/hello world (11), sub dir/hello world2 (11), sub dir/ignore dir/.ignore (1), sub dir/ignore dir/should be ignored (9), sub dir/sub sub dir/hello world3 (11), zend.txt (5) got a.txt (11), sub dir/hello world (11), sub dir/hello world2 (11), sub dir/ignore dir/.ignore (1), sub dir/ignore dir/should be ignored (9), zend.txt (5) fstest.go:203: Not found "sub dir/sub sub dir/hello world3" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:36 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/listdirsorted_test.go:125 Error: Not equal: expected: 0 actual : 1 Test: TestListDirSortedFn Messages: 1 objects not found 2026/02/03 07:50:47 DEBUG : a.txt: Excluded (Size Filter) 2026/02/03 07:50:47 DEBUG : a.txt: Excluded 2026/02/03 07:50:48 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/03 07:50:48 DEBUG : sub dir/hello world2: Excluded 2026/02/03 07:50:48 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/03 07:50:48 DEBUG : sub dir/hello world: Excluded 2026/02/03 07:50:49 DEBUG : sub dir/ignore dir: Excluded 2026/02/03 07:50:49 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/03 07:50:49 DEBUG : sub dir/hello world2: Excluded 2026/02/03 07:50:49 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/03 07:50:49 DEBUG : sub dir/hello world: Excluded 2026/02/03 07:50:49 DEBUG : sub dir/ignore dir: Excluded run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir/sub sub dir" failed: directory not empty run.go:130: removing dir "sub dir/ignore dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir/ignore dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir", "sub dir/sub sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=7) "sub dir", + (string) (len=19) "sub dir/sub sub dir" } Test: TestListDirSortedFn Messages: directories --- FAIL: TestListDirSortedFn (61.65s) === RUN TestListJSON run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestListJSON/Default lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 2 actual : 3 Test: TestListJSON/Default Messages: Wrong number of results === RUN TestListJSON/DirsOnly lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 1 actual : 2 Test: TestListJSON/DirsOnly Messages: Wrong number of results === RUN TestListJSON/Recurse lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 3 actual : 5 Test: TestListJSON/Recurse Messages: Wrong number of results === RUN TestListJSON/Metadata lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 2 actual : 3 Test: TestListJSON/Metadata Messages: Wrong number of results === NAME TestListJSON run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty run.go:130: removing dir "sub" failed - try 1/3: directory not empty run.go:130: removing dir "sub" failed - try 2/3: directory not empty run.go:130: removing dir "sub" failed - try 3/3: directory not empty run.go:133: removing dir "sub" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub", "sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=3) "sub", + (string) (len=7) "sub dir" } Test: TestListJSON Messages: directories --- FAIL: TestListJSON (40.80s) --- FAIL: TestListJSON/Default (0.43s) --- FAIL: TestListJSON/DirsOnly (0.16s) --- FAIL: TestListJSON/Recurse (1.01s) --- FAIL: TestListJSON/Metadata (0.24s) === RUN TestLsd run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure --- PASS: TestLsd (37.10s) === RUN TestLs run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: listing wrong, want got empty space (1), potato2 (60) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: Unexpected file "empty space" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: Unexpected file "potato2" --- FAIL: TestLs (15.64s) === RUN TestCount run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestCount Messages: directories --- FAIL: TestCount (27.58s) === RUN TestMaxDelete run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/02/03 07:53:41 DEBUG : Waiting for deletions to finish 2026/02/03 07:53:41 ERROR : large: Got fatal error on delete: --max-delete threshold reached 2026/02/03 07:53:42 INFO : small: Deleted 2026/02/03 07:53:42 INFO : medium: Deleted operations_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:453 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDelete 2026/02/03 07:53:43 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:53:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 07:53:44 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:53:44 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 07:53:44 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:53:44 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 07:53:44 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:53:44 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 07:53:45 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:53:45 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 07:53:45 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:53:45 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 07:53:45 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:53:45 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 07:53:46 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:53:46 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 07:53:47 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:53:47 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 07:53:50 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 07:53:50 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 07:53:55 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:53:55 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 07:54:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:54:25 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:54:45 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:55:05 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:55:25 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:55:45 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:56:05 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:56:25 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 07:56:45 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 07:57:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 07:57:25 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 07:57:45 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 07:58:05 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 07:58:25 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 07:58:45 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 07:59:05 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 07:59:25 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 07:59:45 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:00:05 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 08:00:25 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:00:45 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:01:05 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:01:25 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:01:45 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:02:05 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:02:25 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:02:45 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:03:05 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:03:25 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 08:03:45 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:04:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:04:25 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:04:45 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:05:05 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:05:25 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:05:45 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:06:05 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:06:25 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:06:45 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 08:07:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:07:25 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:07:45 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:08:05 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:08:25 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:08:45 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:09:05 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:09:25 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:09:45 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:10:05 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "small" failed: failed to delete item: Error "Server Error" 2026/02/03 08:10:25 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 08:10:45 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 08:10:55 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 08:11:00 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 08:11:03 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 08:11:04 DEBUG : pacer: Reducing sleep to 312.5ms --- FAIL: TestMaxDelete (1068.44s) === RUN TestMaxDeleteSizeLargeFile run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 08:11:05 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 08:11:11 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 08:11:11 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 08:11:16 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 08:11:17 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 08:11:24 DEBUG : Waiting for deletions to finish 2026/02/03 08:11:24 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached 2026/02/03 08:11:25 INFO : medium: Deleted 2026/02/03 08:11:25 INFO : small: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: listing wrong, want large (100) got large (100), medium (60), small (10) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "medium" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "small" 2026/02/03 08:11:34 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:11:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 08:11:35 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:11:35 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 08:11:35 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:11:35 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 08:11:35 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:11:35 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 08:11:35 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:11:35 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 08:11:36 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:11:36 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 08:11:36 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:11:36 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 08:11:37 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:11:37 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 08:11:38 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:11:38 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 08:11:41 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 08:11:41 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 08:11:46 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:11:46 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 08:11:56 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:12:16 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:12:36 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:12:56 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:13:16 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:13:36 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:13:56 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:14:16 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:14:36 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 08:14:56 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:15:16 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:15:36 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:15:57 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:16:16 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:16:36 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:16:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:17:16 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:17:36 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:17:56 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 08:18:16 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:18:36 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:18:56 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:19:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:19:36 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:19:56 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:20:16 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:20:36 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:20:56 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:21:16 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 08:21:36 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:21:56 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:22:16 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:22:36 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:22:56 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:23:16 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:23:36 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:23:56 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:24:16 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:24:36 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 08:24:56 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:25:16 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:25:36 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:25:56 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:26:16 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:26:36 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:26:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:27:16 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:27:36 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:27:56 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "small" failed: failed to delete item: Error "Server Error" 2026/02/03 08:28:16 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 08:28:36 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 08:28:46 DEBUG : pacer: Reducing sleep to 2.5s --- FAIL: TestMaxDeleteSizeLargeFile (1062.15s) === RUN TestMaxDeleteSize run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 08:28:51 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 08:28:55 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 08:28:55 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 08:28:58 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 08:28:58 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 08:29:01 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 08:29:01 DEBUG : pacer: Reducing sleep to 19.53125ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 08:29:03 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:486 Error: Should be true Test: TestMaxDeleteSize Messages: listing wrong, want large (100), medium (60), small (10) got medium (60), small (10) fstest.go:203: Not found "large" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:486 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestMaxDeleteSize Messages: 1 objects not found 2026/02/03 08:29:09 DEBUG : Waiting for deletions to finish 2026/02/03 08:29:10 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/02/03 08:29:10 INFO : medium: Deleted 2026/02/03 08:29:10 INFO : large: Deleted operations_test.go:492: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:492 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDeleteSize 2026/02/03 08:29:11 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:29:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 08:29:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:29:11 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 08:29:11 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:29:11 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 08:29:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:29:11 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 08:29:12 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:29:12 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 08:29:12 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:29:12 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 08:29:12 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:29:12 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 08:29:13 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:29:13 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 08:29:14 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:29:14 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 08:29:17 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 08:29:17 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 08:29:22 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:29:22 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 08:29:32 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:29:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:30:12 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:30:32 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:30:52 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:31:12 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:31:32 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:31:52 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:32:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 08:32:32 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:32:52 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:33:12 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:33:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:33:52 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:34:12 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:34:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:34:52 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:35:12 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:35:32 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "large" failed: failed to delete item: Error "Server Error" 2026/02/03 08:35:52 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:36:12 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:36:33 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:36:52 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:37:12 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:37:32 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:37:52 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:38:12 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:38:32 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:38:52 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 08:39:12 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:39:32 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:39:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:40:12 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:40:32 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:40:52 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:41:12 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:41:32 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:41:52 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:42:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 08:42:32 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 08:42:52 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 08:43:12 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 08:43:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 08:43:53 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 08:44:12 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 08:44:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 08:44:52 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 08:45:12 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 08:45:32 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 08:45:52 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 08:46:12 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 08:46:23 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 08:46:27 DEBUG : pacer: Reducing sleep to 1.25s --- FAIL: TestMaxDeleteSize (1061.37s) === RUN TestReadFile run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" 2026/02/03 08:46:30 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 08:46:37 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 08:46:38 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 08:46:38 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 08:46:39 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 08:46:39 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 08:46:39 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:510 Error: Should be true Test: TestReadFile Messages: listing wrong, want got ReadFile (28) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:510 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestReadFile Messages: Unexpected file "ReadFile" --- FAIL: TestReadFile (21.60s) === RUN TestCat run.go:185: Remote "drime root 'rclone-test-hibusuw3lifu'", Local "Local file system at /tmp/rclone844359235", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCat Messages: listing wrong, want got file1 (10), file2 (9) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCat Messages: Unexpected file "file1" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCat Messages: Unexpected file "file2" --- FAIL: TestCat (33.45s) FAIL 2026/02/03 08:47:22 DEBUG : drime root 'rclone-test-hibusuw3lifu': Purge remote "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestApplyTransforms|TestCat|TestCheckSumDownload|TestCopyFile|TestCopyFileCopyDest|TestCount|TestListDirSorted|TestListDirSortedFn|TestLs|TestLsd|TestMaxDelete|TestMaxDeleteSize|TestMaxDeleteSizeLargeFile|TestMultithreadCopyAbort|TestParseSumFile|TestReadFile)$|^TestListJSON$/^(Default|DirsOnly|Metadata|Recurse)$|^TestMultithreadCopy$/^(upload=false,size=10485759,streams=2|upload=true,size=10485759,streams=2|upload=true,size=10485760,streams=2|upload=true,size=10485761,streams=2)$'" - Finished ERROR in 1h29m32.73140141s (try 4/5): exit status 1: Failed [TestMultithreadCopy/upload=false,size=10485759,streams=2 TestMultithreadCopy/upload=true,size=10485759,streams=2 TestMultithreadCopy/upload=true,size=10485760,streams=2 TestMultithreadCopy/upload=true,size=10485761,streams=2 TestParseSumFile TestCheckSumDownload TestApplyTransforms TestCopyFile TestCopyFileCopyDest TestListDirSorted TestListDirSortedFn TestListJSON/Default TestListJSON/DirsOnly TestListJSON/Recurse TestListJSON/Metadata TestLs TestCount TestMaxDelete TestMaxDeleteSizeLargeFile TestMaxDeleteSize TestReadFile TestCat]