"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestApplyTransforms|TestCat|TestCheckSizeOnly|TestCheckSumDownload|TestCopyFile|TestCopyFileCopyDest|TestCopyFileMaxTransfer|TestCount|TestDelete|TestListDirSorted|TestListDirSortedFn|TestLs|TestLsLong|TestLsWithFilesFrom|TestLsd|TestMaxDelete|TestMaxDeleteSize|TestMaxDeleteSizeLargeFile|TestMkdir|TestMultithreadCopyAbort|TestParseSumFile|TestReadFile|TestStatJSON)$|^TestListJSON$/^(Default|DirsOnly|Metadata|Recurse)$|^TestMultithreadCopy$/^(upload=false,size=10485759,streams=2|upload=false,size=10485760,streams=2|upload=true,size=10485759,streams=2|upload=true,size=10485760,streams=2|upload=true,size=10485761,streams=2)$'" - Starting (try 2/5) 2026/02/03 04:00:11 DEBUG : Creating backend with remote "TestDrime:rclone-test-sobutad7duji" 2026/02/03 04:00:11 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:00:12 DEBUG : Creating backend with remote "/tmp/rclone1917518733" === RUN TestMultithreadCopy run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" === RUN TestMultithreadCopy/upload=false,size=10485759,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:191 Error: Should be true Test: TestMultithreadCopy/upload=false,size=10485759,streams=2 Messages: listing wrong, want test-multithread-copy-false-10485759-2 (10485759) got fstest.go:203: Not found "test-multithread-copy-false-10485759-2" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:191 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestMultithreadCopy/upload=false,size=10485759,streams=2 Messages: 1 objects not found 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: write buffer set to 131072 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10.000Mi 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: Starting multi-thread copy with 1 chunks of size 10.000Mi with 1 parallel streams 2026/02/03 04:00:26 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi starting 2026/02/03 04:00:27 DEBUG : test-multithread-copy-false-10485759-2: writing chunk 0 2026/02/03 04:00:27 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi finished 2026/02/03 04:00:27 DEBUG : test-multithread-copy-false-10485759-2: Finished multi-thread copy with 1 parts of size 10.000Mi === RUN TestMultithreadCopy/upload=false,size=10485760,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: write buffer set to 131072 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10Mi 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: Starting multi-thread copy with 1 chunks of size 10Mi with 1 parallel streams 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk 1/1 (0-10485760) size 10Mi starting 2026/02/03 04:00:45 DEBUG : test-multithread-copy-false-10485760-2: writing chunk 0 2026/02/03 04:00:46 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk 1/1 (0-10485760) size 10Mi finished 2026/02/03 04:00:46 DEBUG : test-multithread-copy-false-10485760-2: Finished multi-thread copy with 1 parts of size 10Mi === RUN TestMultithreadCopy/upload=true,size=10485759,streams=2 2026/02/03 04:00:48 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: disabling buffering because source is local disk 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi starting 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi finished 2026/02/03 04:00:49 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished multithread_test.go:218: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:218 Error: Received unexpected error: multi-thread copy: failed to find object after copy: object not found Test: TestMultithreadCopy/upload=true,size=10485759,streams=2 === RUN TestMultithreadCopy/upload=true,size=10485760,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:339 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:187 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: listing wrong, want test-multithread-copy-true-10485760-2 (10485760) got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485760-2 (10485760) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:339 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:187 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" 2026/02/03 04:01:02 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: disabling buffering because source is local disk 2026/02/03 04:01:03 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 04:01:03 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/02/03 04:01:03 DEBUG : test-multithread-copy-true-10485760-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/02/03 04:01:03 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi starting 2026/02/03 04:01:03 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/02/03 04:01:04 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi finished 2026/02/03 04:01:04 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/02/03 04:01:07 DEBUG : test-multithread-copy-true-10485760-2: Finished multi-thread copy with 2 parts of size 5Mi fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:222 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: listing wrong, want test-multithread-copy-true-10485760-2 (10485760) got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485760-2 (10485760) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:222 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:223 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: listing wrong, want test-multithread-copy-true-10485760-2 (10485760) got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485760-2 (10485760) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:223 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" === RUN TestMultithreadCopy/upload=true,size=10485761,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: listing wrong, want got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485760-2 (10485760) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485760-2" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:339 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:187 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: listing wrong, want test-multithread-copy-true-10485761-2 (10485761) got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485761-2 (10485761) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:339 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:187 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" 2026/02/03 04:01:39 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: disabling buffering because source is local disk 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 finished 2026/02/03 04:01:41 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/02/03 04:01:44 DEBUG : test-multithread-copy-true-10485761-2: Finished multi-thread copy with 3 parts of size 5Mi fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:222 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: listing wrong, want test-multithread-copy-true-10485761-2 (10485761) got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485761-2 (10485761) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:222 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:223 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: listing wrong, want test-multithread-copy-true-10485761-2 (10485761) got test-multithread-copy-true-10485759-2 (10485759), test-multithread-copy-true-10485761-2 (10485761) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:223 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" 2026/02/03 04:02:02 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:02:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:02:02 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:02:02 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 04:02:02 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:02:02 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 04:02:02 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:02:02 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 04:02:03 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:02:03 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 04:02:03 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:02:03 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 04:02:03 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:02:03 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 04:02:04 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:02:04 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 04:02:05 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:02:05 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 04:02:08 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 04:02:08 DEBUG : pacer: Rate limited, increasing sleep to 10.24s === NAME TestMultithreadCopy run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 04:02:13 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:02:13 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 04:02:23 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:02:43 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:03:04 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:03:26 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:03:43 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:04:03 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:04:23 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:04:44 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:05:04 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 04:05:24 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:05:43 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:06:03 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:06:24 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:06:44 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:07:03 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:07:24 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:07:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:08:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:08:24 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test-multithread-copy-true-10485761-2" failed: failed to delete item: Error "Server Error" 2026/02/03 04:08:44 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestMultithreadCopy (511.74s) --- FAIL: TestMultithreadCopy/upload=false,size=10485759,streams=2 (14.50s) --- PASS: TestMultithreadCopy/upload=false,size=10485760,streams=2 (18.99s) --- FAIL: TestMultithreadCopy/upload=true,size=10485759,streams=2 (7.48s) --- FAIL: TestMultithreadCopy/upload=true,size=10485760,streams=2 (28.20s) --- FAIL: TestMultithreadCopy/upload=true,size=10485761,streams=2 (37.79s) === RUN TestMultithreadCopyAbort run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:09:04 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 04:09:14 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 04:09:19 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 04:09:24 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 04:09:24 DEBUG : pacer: Reducing sleep to 312.5ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:09:25 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 04:09:26 DEBUG : pacer: Reducing sleep to 78.125ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:09:28 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 04:09:28 DEBUG : pacer: Reducing sleep to 19.53125ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:305 Error: Should be true Test: TestMultithreadCopyAbort Messages: listing wrong, want test-multithread-abort (100) got fstest.go:203: Not found "test-multithread-abort" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:305 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestMultithreadCopyAbort Messages: 1 objects not found 2026/02/03 04:09:33 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2026/02/03 04:09:34 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 04:09:34 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 1 2026/02/03 04:09:34 DEBUG : test-multithread-abort: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/02/03 04:09:34 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/02/03 04:09:34 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/02/03 04:09:34 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/02/03 04:09:34 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:34 DEBUG : Open with options = [RangeOption(0,5242879)] 2026/02/03 04:09:34 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/02/03 04:09:34 DEBUG : Open with options = [RangeOption(5242880,10485759)] 2026/02/03 04:09:35 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/02/03 04:09:35 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/02/03 04:09:35 DEBUG : Returning error reader 2026/02/03 04:09:36 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:36 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 0/10: BOOM: simulated read failure 2026/02/03 04:09:36 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:37 DEBUG : Returning error reader 2026/02/03 04:09:37 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:37 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2026/02/03 04:09:37 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:38 DEBUG : Returning error reader 2026/02/03 04:09:38 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:38 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2026/02/03 04:09:38 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:39 DEBUG : Returning error reader 2026/02/03 04:09:39 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:39 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2026/02/03 04:09:39 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:40 DEBUG : Returning error reader 2026/02/03 04:09:40 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:40 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2026/02/03 04:09:40 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:41 DEBUG : Returning error reader 2026/02/03 04:09:41 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:41 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2026/02/03 04:09:41 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:42 DEBUG : Returning error reader 2026/02/03 04:09:42 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:42 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2026/02/03 04:09:42 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:43 DEBUG : Returning error reader 2026/02/03 04:09:43 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:43 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2026/02/03 04:09:43 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:44 DEBUG : Returning error reader 2026/02/03 04:09:44 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:44 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2026/02/03 04:09:44 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:45 DEBUG : Returning error reader 2026/02/03 04:09:45 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:45 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2026/02/03 04:09:45 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/03 04:09:46 DEBUG : Returning error reader 2026/02/03 04:09:46 DEBUG : BOOM: simulated read failure 2026/02/03 04:09:46 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2026/02/03 04:09:46 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2026/02/03 04:09:46 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: failed to upload part 3: Put "https://drimestorage.18b804eaa6bc9759e2278f8d5367f42f.r2.cloudflarestorage.com/uploads/80e7d8ae-b995-4f75-8a83-3963fe001715/80e7d8ae-b995-4f75-8a83-3963fe001715?uploadId=AD4waIDYEpDy4WlLZkqmS7YkXKdND-QF5BWEVmeSlcRIEa9vzlklX0a4etwe7QJ8ybAI_kn8-8X65BVhXXX9Dcf8zOExmxn1AbffPB7Zgu1fmHReM_aqdx6VlJ5YyO5FfEou_aAC3p6SYJRAiozTw4RFCdGh92OAPKDTsIxmylxkJgSawD75m9Xt6bs9V805ww0vj1t_V1CxW25Mc-r_GKc5r-nGLo0Tm6Qy61P5cenzuiEeYltD4cbdPNPUtG-oEPZNIoVZKdSRte-NE5ZpUNYwXk9hbQkwX0yxyZhD7wTZ6M_fOg0KlE1b2mL0_7YnBWVlSUJwGsMSEtIin-VrbX8&partNumber=3&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=db9b71e81fa19eaf54eb4264526ca7a8%2F20260203%2FWEUR%2Fs3%2Faws4_request&X-Amz-Date=20260203T040936Z&X-Amz-SignedHeaders=host&X-Amz-Expires=1800&X-Amz-Signature=538eac7e4acd5927a8156f2b511ca78183288736b565f5dabbc12f5c1de656f6": BOOM: simulated read failure 2026/02/03 04:09:46 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit 2026/02/03 04:09:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:09:47 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:09:48 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:09:48 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 04:09:48 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:09:48 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 04:09:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:09:48 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 04:09:48 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:09:48 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 04:09:49 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:09:49 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 04:09:49 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:09:49 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 04:09:50 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:09:50 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 04:09:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:09:51 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 04:09:54 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 04:09:54 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "test-multithread-abort" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 04:09:59 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:09:59 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 04:10:09 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:10:29 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:10:49 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:11:09 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:11:29 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:11:49 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:12:09 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:12:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:12:49 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-abort" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 04:13:09 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:13:29 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:13:49 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:14:09 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:14:29 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:14:49 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:15:09 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:15:29 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:15:49 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:16:09 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-abort" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test-multithread-abort" failed: failed to delete item: Error "Server Error" 2026/02/03 04:16:29 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestMultithreadCopyAbort (465.40s) === RUN TestCheckSizeOnly run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:16:49 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 04:17:02 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 04:17:04 DEBUG : pacer: Reducing sleep to 1.25s === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 2026/02/03 04:17:09 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 04:17:13 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 04:17:13 DEBUG : pacer: Reducing sleep to 39.0625ms === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:17:14 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 04:17:14 DEBUG : pacer: Reducing sleep to 10ms fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSizeOnly/3 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestCheckSizeOnly (85.04s) --- PASS: TestCheckSizeOnly/1 (2.56s) --- PASS: TestCheckSizeOnly/2 (1.34s) --- PASS: TestCheckSizeOnly/3 (0.21s) --- PASS: TestCheckSizeOnly/4 (0.35s) --- PASS: TestCheckSizeOnly/5 (0.30s) --- PASS: TestCheckSizeOnly/6 (0.15s) --- PASS: TestCheckSizeOnly/7 (0.30s) === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/3 (object not found) fstest.go:542: Sleeping for 1.5s for findObject eventual consistency: 2/3 (object not found) 2026/02/03 04:18:00 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/03 04:18:00 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/03 04:18:00 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/03 04:18:00 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/03 04:18:03 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 04:18:04 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/03 04:18:04 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/03 04:18:04 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/03 04:18:04 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/03 04:18:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:18:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:18:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:18:05 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 04:18:06 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:18:06 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 04:18:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:18:06 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 04:18:06 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:18:06 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 04:18:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:18:06 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 04:18:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:18:07 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 04:18:08 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:18:08 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 04:18:09 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:18:09 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 04:18:11 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 04:18:11 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "test.sum" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 04:18:16 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:18:16 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 04:18:26 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:18:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:19:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:19:26 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:19:46 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2026/02/03 04:19:46 DEBUG : pacer: low level retry 6/10 (error Error "500 Internal Server Error (500): \r\n500 Internal Server Error\r\n\r\n

500 Internal Server Error

\r\n
nginx
\r\n\r\n\r\n") 2026/02/03 04:20:06 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:20:27 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:20:46 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:21:07 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test.sum" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 04:21:27 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:21:47 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:22:06 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:22:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:22:47 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:23:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:23:27 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:23:46 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:24:06 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:24:27 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test.sum" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test.sum" failed: failed to delete item: Error "Server Error" 2026/02/03 04:24:46 DEBUG : pacer: Reducing sleep to 10s fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:25:07 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 04:25:17 DEBUG : pacer: Reducing sleep to 2.5s fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:25:22 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 04:25:24 DEBUG : pacer: Reducing sleep to 625ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestParseSumFile Messages: listing wrong, want got test.sum (90) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestParseSumFile Messages: Unexpected file "test.sum" --- FAIL: TestParseSumFile (453.79s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:25:28 DEBUG : Creating backend with remote "TestDrime:rclone-test-sobutad7duji/data" 2026/02/03 04:25:28 DEBUG : Config file has changed externally - reloading 2026/02/03 04:25:29 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 04:25:30 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 04:25:30 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 04:25:30 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 04:25:33 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 04:25:33 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 04:25:36 DEBUG : test.sum: Removing old object on successful upload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestCheckSumDownload/subtest1 2026/02/03 04:25:55 DEBUG : test.sum: Removing old object on successful upload === RUN TestCheckSumDownload/subtest2 2026/02/03 04:26:00 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 04:26:00 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:26:00 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:26:01 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:26:01 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 04:26:01 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:26:01 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 04:26:01 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:26:01 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 04:26:02 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:26:02 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 04:26:02 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:26:02 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 04:26:03 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:26:03 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 04:26:03 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:26:03 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 04:26:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:26:04 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 04:26:07 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 04:26:07 DEBUG : pacer: Rate limited, increasing sleep to 10.24s === NAME TestCheckSumDownload run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-sobutad7duji': 1/10 (failed to delete existing object: failed to delete item: Error "Server Error") 2026/02/03 04:26:12 DEBUG : pacer: Reducing sleep to 5.12s 2026/02/03 04:26:25 DEBUG : pacer: Reducing sleep to 2.56s 2026/02/03 04:26:25 DEBUG : test.sum: Removing old object on successful upload 2026/02/03 04:26:28 DEBUG : pacer: Reducing sleep to 1.28s 2026/02/03 04:26:30 DEBUG : pacer: Reducing sleep to 640ms 2026/02/03 04:26:31 DEBUG : pacer: Reducing sleep to 320ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:26:33 DEBUG : pacer: Reducing sleep to 160ms 2026/02/03 04:26:33 DEBUG : pacer: Reducing sleep to 80ms 2026/02/03 04:26:33 DEBUG : pacer: Reducing sleep to 40ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/03 04:26:36 DEBUG : pacer: Reducing sleep to 20ms 2026/02/03 04:26:36 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:464 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:464 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest3 2026/02/03 04:26:45 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:478 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:478 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest4 2026/02/03 04:26:59 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (123) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Not equal: expected: 123 actual : 82 Test: TestCheckSumDownload Messages: test.sum: size incorrect file=123 vs obj=82 fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest5 2026/02/03 04:27:13 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:508 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (123) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:508 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest6 2026/02/03 04:27:31 DEBUG : data/banana: Removing old object on successful upload 2026/02/03 04:27:35 DEBUG : data/potato: Removing old object on successful upload 2026/02/03 04:27:39 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Not equal: expected: 82 actual : 123 Test: TestCheckSumDownload Messages: test.sum: size incorrect file=82 vs obj=123 fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest7 2026/02/03 04:27:52 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:27:52 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:27:52 DEBUG : pacer: Reducing sleep to 10ms === NAME TestCheckSumDownload run.go:130: removing dir "data" failed - try 1/3: directory not empty run.go:130: removing dir "data" failed - try 2/3: directory not empty run.go:130: removing dir "data" failed - try 3/3: directory not empty run.go:133: removing dir "data" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"data"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=4) "data" } Test: TestCheckSumDownload Messages: directories --- FAIL: TestCheckSumDownload (158.73s) --- PASS: TestCheckSumDownload/subtest1 (1.71s) --- PASS: TestCheckSumDownload/subtest2 (1.40s) --- PASS: TestCheckSumDownload/subtest3 (1.63s) --- PASS: TestCheckSumDownload/subtest4 (1.82s) --- PASS: TestCheckSumDownload/subtest5 (1.97s) --- PASS: TestCheckSumDownload/subtest6 (1.72s) --- PASS: TestCheckSumDownload/subtest7 (1.88s) === RUN TestApplyTransforms 2026/02/03 04:28:07 DEBUG : Creating backend with remote "TestDrime:rclone-test-pefeviw5zowe" 2026/02/03 04:28:07 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:08 DEBUG : Creating backend with remote "/tmp/rclone4182452365" run.go:185: Remote "drime root 'rclone-test-pefeviw5zowe'", Local "Local file system at /tmp/rclone4182452365", Modify Window "876000h0m0s" upper checkfile vs. lower remote (without normalization) 2026/02/03 04:28:13 ERROR : HELLO, WORLD!: file not in drime root 'rclone-test-pefeviw5zowe' 2026/02/03 04:28:13 NOTICE: drime root 'rclone-test-pefeviw5zowe': 1 files missing 2026/02/03 04:28:13 NOTICE: drime root 'rclone-test-pefeviw5zowe': 0 differences found 2026/02/03 04:28:13 NOTICE: drime root 'rclone-test-pefeviw5zowe': 1 errors while checking upper checkfile vs. lower remote (with normalization) 2026/02/03 04:28:14 ERROR : hello, world!: file not in drime root 'rclone-test-pefeviw5zowe' 2026/02/03 04:28:14 NOTICE: drime root 'rclone-test-pefeviw5zowe': 1 files missing 2026/02/03 04:28:14 NOTICE: drime root 'rclone-test-pefeviw5zowe': 0 differences found 2026/02/03 04:28:14 NOTICE: drime root 'rclone-test-pefeviw5zowe': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:594 Error: Received unexpected error: file not in drime root 'rclone-test-pefeviw5zowe' Test: TestApplyTransforms Messages: unexpected error for upper checkfile vs. lower remote (with normalization) HELLO, WORLD! hello, world! 2026/02/03 04:28:14 DEBUG : Creating backend with remote "TestDrime:rclone-test-xadicel3joho" 2026/02/03 04:28:14 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:14 DEBUG : Creating backend with remote "/tmp/rclone112698949" run.go:185: Remote "drime root 'rclone-test-xadicel3joho'", Local "Local file system at /tmp/rclone112698949", Modify Window "876000h0m0s" lower checkfile vs. upper remote (without normalization) 2026/02/03 04:28:19 ERROR : hello, world!: file not in drime root 'rclone-test-xadicel3joho' 2026/02/03 04:28:19 NOTICE: drime root 'rclone-test-xadicel3joho': 1 files missing 2026/02/03 04:28:19 NOTICE: drime root 'rclone-test-xadicel3joho': 0 differences found 2026/02/03 04:28:19 NOTICE: drime root 'rclone-test-xadicel3joho': 1 errors while checking lower checkfile vs. upper remote (with normalization) 2026/02/03 04:28:19 ERROR : hello, world!: file not in drime root 'rclone-test-xadicel3joho' 2026/02/03 04:28:19 NOTICE: drime root 'rclone-test-xadicel3joho': 1 files missing 2026/02/03 04:28:19 NOTICE: drime root 'rclone-test-xadicel3joho': 0 differences found 2026/02/03 04:28:19 NOTICE: drime root 'rclone-test-xadicel3joho': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:595 Error: Received unexpected error: file not in drime root 'rclone-test-xadicel3joho' Test: TestApplyTransforms Messages: unexpected error for lower checkfile vs. upper remote (with normalization) hello, world! HELLO, WORLD! 2026/02/03 04:28:19 DEBUG : Creating backend with remote "TestDrime:rclone-test-rifukok9luba" 2026/02/03 04:28:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:20 DEBUG : Creating backend with remote "/tmp/rclone466960363" run.go:185: Remote "drime root 'rclone-test-rifukok9luba'", Local "Local file system at /tmp/rclone466960363", Modify Window "876000h0m0s" lower checkfile vs. upperlowermixed remote (without normalization) 2026/02/03 04:28:24 ERROR : hello, world!: file not in drime root 'rclone-test-rifukok9luba' 2026/02/03 04:28:24 NOTICE: drime root 'rclone-test-rifukok9luba': 1 files missing 2026/02/03 04:28:24 NOTICE: drime root 'rclone-test-rifukok9luba': 0 differences found 2026/02/03 04:28:24 NOTICE: drime root 'rclone-test-rifukok9luba': 1 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2026/02/03 04:28:24 ERROR : hello, world!: file not in drime root 'rclone-test-rifukok9luba' 2026/02/03 04:28:24 NOTICE: drime root 'rclone-test-rifukok9luba': 1 files missing 2026/02/03 04:28:24 NOTICE: drime root 'rclone-test-rifukok9luba': 0 differences found 2026/02/03 04:28:24 NOTICE: drime root 'rclone-test-rifukok9luba': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:596 Error: Received unexpected error: file not in drime root 'rclone-test-rifukok9luba' Test: TestApplyTransforms Messages: unexpected error for lower checkfile vs. upperlowermixed remote (with normalization) hello, world! HeLlO, wOrLd! 2026/02/03 04:28:24 DEBUG : Creating backend with remote "TestDrime:rclone-test-vakonuf5xaye" 2026/02/03 04:28:24 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:25 DEBUG : Creating backend with remote "/tmp/rclone2900311654" run.go:185: Remote "drime root 'rclone-test-vakonuf5xaye'", Local "Local file system at /tmp/rclone2900311654", Modify Window "876000h0m0s" upperlowermixed checkfile vs. upper remote (without normalization) 2026/02/03 04:28:30 ERROR : HeLlO, wOrLd!: file not in drime root 'rclone-test-vakonuf5xaye' 2026/02/03 04:28:30 NOTICE: drime root 'rclone-test-vakonuf5xaye': 1 files missing 2026/02/03 04:28:30 NOTICE: drime root 'rclone-test-vakonuf5xaye': 0 differences found 2026/02/03 04:28:30 NOTICE: drime root 'rclone-test-vakonuf5xaye': 1 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2026/02/03 04:28:30 ERROR : hello, world!: file not in drime root 'rclone-test-vakonuf5xaye' 2026/02/03 04:28:30 NOTICE: drime root 'rclone-test-vakonuf5xaye': 1 files missing 2026/02/03 04:28:30 NOTICE: drime root 'rclone-test-vakonuf5xaye': 0 differences found 2026/02/03 04:28:30 NOTICE: drime root 'rclone-test-vakonuf5xaye': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:597 Error: Received unexpected error: file not in drime root 'rclone-test-vakonuf5xaye' Test: TestApplyTransforms Messages: unexpected error for upperlowermixed checkfile vs. upper remote (with normalization) HeLlO, wOrLd! HELLO, WORLD! 2026/02/03 04:28:30 DEBUG : Creating backend with remote "TestDrime:rclone-test-hufepik7veme" 2026/02/03 04:28:30 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:31 DEBUG : Creating backend with remote "/tmp/rclone797835422" run.go:185: Remote "drime root 'rclone-test-hufepik7veme'", Local "Local file system at /tmp/rclone797835422", Modify Window "876000h0m0s" NFD checkfile vs. NFC remote (without normalization) 2026/02/03 04:28:37 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-hufepik7veme' 2026/02/03 04:28:37 NOTICE: drime root 'rclone-test-hufepik7veme': 1 files missing 2026/02/03 04:28:37 NOTICE: drime root 'rclone-test-hufepik7veme': 0 differences found 2026/02/03 04:28:37 NOTICE: drime root 'rclone-test-hufepik7veme': 1 errors while checking NFD checkfile vs. NFC remote (with normalization) 2026/02/03 04:28:38 ERROR : 測試_русский___ě_áñ: file not in drime root 'rclone-test-hufepik7veme' 2026/02/03 04:28:38 NOTICE: drime root 'rclone-test-hufepik7veme': 1 files missing 2026/02/03 04:28:38 NOTICE: drime root 'rclone-test-hufepik7veme': 0 differences found 2026/02/03 04:28:38 NOTICE: drime root 'rclone-test-hufepik7veme': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:598 Error: Received unexpected error: file not in drime root 'rclone-test-hufepik7veme' Test: TestApplyTransforms Messages: unexpected error for NFD checkfile vs. NFC remote (with normalization) 測試_Русский___ě_áñ 測試_Русский___ě_áñ 2026/02/03 04:28:38 DEBUG : Creating backend with remote "TestDrime:rclone-test-meziror5liba" 2026/02/03 04:28:38 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:38 DEBUG : Creating backend with remote "/tmp/rclone4292809391" run.go:185: Remote "drime root 'rclone-test-meziror5liba'", Local "Local file system at /tmp/rclone4292809391", Modify Window "876000h0m0s" NFC checkfile vs. NFD remote (without normalization) 2026/02/03 04:28:42 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-meziror5liba' 2026/02/03 04:28:42 NOTICE: drime root 'rclone-test-meziror5liba': 1 files missing 2026/02/03 04:28:42 NOTICE: drime root 'rclone-test-meziror5liba': 0 differences found 2026/02/03 04:28:42 NOTICE: drime root 'rclone-test-meziror5liba': 1 errors while checking NFC checkfile vs. NFD remote (with normalization) 2026/02/03 04:28:42 ERROR : 測試_русский___ě_áñ: file not in drime root 'rclone-test-meziror5liba' 2026/02/03 04:28:42 NOTICE: drime root 'rclone-test-meziror5liba': 1 files missing 2026/02/03 04:28:42 NOTICE: drime root 'rclone-test-meziror5liba': 0 differences found 2026/02/03 04:28:42 NOTICE: drime root 'rclone-test-meziror5liba': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:599 Error: Received unexpected error: file not in drime root 'rclone-test-meziror5liba' Test: TestApplyTransforms Messages: unexpected error for NFC checkfile vs. NFD remote (with normalization) 測試_Русский___ě_áñ 測試_Русский___ě_áñ 2026/02/03 04:28:42 DEBUG : Creating backend with remote "TestDrime:rclone-test-sawibih3faca" 2026/02/03 04:28:42 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:43 DEBUG : Creating backend with remote "/tmp/rclone3885824238" run.go:185: Remote "drime root 'rclone-test-sawibih3faca'", Local "Local file system at /tmp/rclone3885824238", Modify Window "876000h0m0s" NFDx2 checkfile vs. both remote (without normalization) 2026/02/03 04:28:48 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-sawibih3faca' 2026/02/03 04:28:48 NOTICE: drime root 'rclone-test-sawibih3faca': 1 files missing 2026/02/03 04:28:48 NOTICE: drime root 'rclone-test-sawibih3faca': 0 differences found 2026/02/03 04:28:48 NOTICE: drime root 'rclone-test-sawibih3faca': 1 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2026/02/03 04:28:48 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-sawibih3faca' 2026/02/03 04:28:48 NOTICE: drime root 'rclone-test-sawibih3faca': 1 files missing 2026/02/03 04:28:48 NOTICE: drime root 'rclone-test-sawibih3faca': 0 differences found 2026/02/03 04:28:48 NOTICE: drime root 'rclone-test-sawibih3faca': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:600 Error: Received unexpected error: file not in drime root 'rclone-test-sawibih3faca' Test: TestApplyTransforms Messages: unexpected error for NFDx2 checkfile vs. both remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/03 04:28:48 DEBUG : Creating backend with remote "TestDrime:rclone-test-lozazin5xoho" 2026/02/03 04:28:48 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:49 DEBUG : Creating backend with remote "/tmp/rclone806334212" run.go:185: Remote "drime root 'rclone-test-lozazin5xoho'", Local "Local file system at /tmp/rclone806334212", Modify Window "876000h0m0s" NFCx2 checkfile vs. both remote (without normalization) 2026/02/03 04:28:57 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-lozazin5xoho' 2026/02/03 04:28:57 NOTICE: drime root 'rclone-test-lozazin5xoho': 1 files missing 2026/02/03 04:28:57 NOTICE: drime root 'rclone-test-lozazin5xoho': 0 differences found 2026/02/03 04:28:57 NOTICE: drime root 'rclone-test-lozazin5xoho': 1 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2026/02/03 04:28:57 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-lozazin5xoho' 2026/02/03 04:28:57 NOTICE: drime root 'rclone-test-lozazin5xoho': 1 files missing 2026/02/03 04:28:57 NOTICE: drime root 'rclone-test-lozazin5xoho': 0 differences found 2026/02/03 04:28:57 NOTICE: drime root 'rclone-test-lozazin5xoho': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:601 Error: Received unexpected error: file not in drime root 'rclone-test-lozazin5xoho' Test: TestApplyTransforms Messages: unexpected error for NFCx2 checkfile vs. both remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/03 04:28:57 DEBUG : Creating backend with remote "TestDrime:rclone-test-nuyehel8wuwi" 2026/02/03 04:28:57 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:28:58 DEBUG : Creating backend with remote "/tmp/rclone3695209221" run.go:185: Remote "drime root 'rclone-test-nuyehel8wuwi'", Local "Local file system at /tmp/rclone3695209221", Modify Window "876000h0m0s" both checkfile vs. NFDx2 remote (without normalization) 2026/02/03 04:29:01 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-nuyehel8wuwi' 2026/02/03 04:29:01 NOTICE: drime root 'rclone-test-nuyehel8wuwi': 1 files missing 2026/02/03 04:29:01 NOTICE: drime root 'rclone-test-nuyehel8wuwi': 0 differences found 2026/02/03 04:29:01 NOTICE: drime root 'rclone-test-nuyehel8wuwi': 1 errors while checking both checkfile vs. NFDx2 remote (with normalization) 2026/02/03 04:29:01 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-nuyehel8wuwi' 2026/02/03 04:29:01 NOTICE: drime root 'rclone-test-nuyehel8wuwi': 1 files missing 2026/02/03 04:29:01 NOTICE: drime root 'rclone-test-nuyehel8wuwi': 0 differences found 2026/02/03 04:29:01 NOTICE: drime root 'rclone-test-nuyehel8wuwi': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:602 Error: Received unexpected error: file not in drime root 'rclone-test-nuyehel8wuwi' Test: TestApplyTransforms Messages: unexpected error for both checkfile vs. NFDx2 remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/03 04:29:01 DEBUG : Creating backend with remote "TestDrime:rclone-test-fuzezah5gisa" 2026/02/03 04:29:01 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/03 04:29:02 DEBUG : Creating backend with remote "/tmp/rclone539338131" run.go:185: Remote "drime root 'rclone-test-fuzezah5gisa'", Local "Local file system at /tmp/rclone539338131", Modify Window "876000h0m0s" both checkfile vs. NFCx2 remote (without normalization) 2026/02/03 04:29:06 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-fuzezah5gisa' 2026/02/03 04:29:06 NOTICE: drime root 'rclone-test-fuzezah5gisa': 1 files missing 2026/02/03 04:29:06 NOTICE: drime root 'rclone-test-fuzezah5gisa': 0 differences found 2026/02/03 04:29:06 NOTICE: drime root 'rclone-test-fuzezah5gisa': 1 errors while checking both checkfile vs. NFCx2 remote (with normalization) 2026/02/03 04:29:06 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-fuzezah5gisa' 2026/02/03 04:29:06 NOTICE: drime root 'rclone-test-fuzezah5gisa': 1 files missing 2026/02/03 04:29:06 NOTICE: drime root 'rclone-test-fuzezah5gisa': 0 differences found 2026/02/03 04:29:06 NOTICE: drime root 'rclone-test-fuzezah5gisa': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:603 Error: Received unexpected error: file not in drime root 'rclone-test-fuzezah5gisa' Test: TestApplyTransforms Messages: unexpected error for both checkfile vs. NFCx2 remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/03 04:29:06 DEBUG : drime root 'rclone-test-fuzezah5gisa': Purge remote 2026/02/03 04:29:06 DEBUG : drime root 'rclone-test-nuyehel8wuwi': Purge remote 2026/02/03 04:29:07 DEBUG : drime root 'rclone-test-lozazin5xoho': Purge remote 2026/02/03 04:29:07 DEBUG : drime root 'rclone-test-sawibih3faca': Purge remote 2026/02/03 04:29:08 DEBUG : drime root 'rclone-test-meziror5liba': Purge remote 2026/02/03 04:29:08 DEBUG : drime root 'rclone-test-hufepik7veme': Purge remote 2026/02/03 04:29:08 DEBUG : drime root 'rclone-test-vakonuf5xaye': Purge remote 2026/02/03 04:29:08 DEBUG : drime root 'rclone-test-rifukok9luba': Purge remote 2026/02/03 04:29:09 DEBUG : drime root 'rclone-test-xadicel3joho': Purge remote 2026/02/03 04:29:09 DEBUG : drime root 'rclone-test-pefeviw5zowe': Purge remote --- FAIL: TestApplyTransforms (62.92s) === RUN TestCopyFile run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:29:10 DEBUG : file1: Need to transfer - File not found at Destination 2026/02/03 04:29:13 DEBUG : sub/file2: size = 14 OK 2026/02/03 04:29:13 INFO : file1: Copied (new) to: sub/file2 2026/02/03 04:29:14 DEBUG : sub/file2: size = 14 OK 2026/02/03 04:29:14 DEBUG : file1: Sizes identical 2026/02/03 04:29:14 DEBUG : file1: Unchanged skipping 2026/02/03 04:29:15 DEBUG : drime root 'rclone-test-sobutad7duji': don't need to copy/move sub/file2, it is already at target location run.go:130: removing dir "sub" failed - try 1/3: directory not empty run.go:130: removing dir "sub" failed - try 2/3: directory not empty run.go:130: removing dir "sub" failed - try 3/3: directory not empty run.go:133: removing dir "sub" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=3) "sub" } Test: TestCopyFile Messages: directories --- FAIL: TestCopyFile (20.77s) === RUN TestCopyFileCopyDest run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:29:30 DEBUG : Creating backend with remote "TestDrime:rclone-test-sobutad7duji/dst" 2026/02/03 04:29:32 DEBUG : Creating backend with remote "TestDrime:rclone-test-sobutad7duji/CopyDest" 2026/02/03 04:29:33 DEBUG : one: Need to transfer - File not found at Destination 2026/02/03 04:29:36 DEBUG : one: size = 3 OK 2026/02/03 04:29:36 INFO : one: Copied (new) 2026/02/03 04:29:38 DEBUG : one: size = 5 (Local file system at /tmp/rclone1917518733) 2026/02/03 04:29:38 DEBUG : one: size = 3 (drime root 'rclone-test-sobutad7duji/dst') 2026/02/03 04:29:38 DEBUG : one: Sizes differ 2026/02/03 04:29:45 DEBUG : one: Removing old object on successful upload 2026/02/03 04:29:46 DEBUG : one: size = 5 OK 2026/02/03 04:29:46 INFO : one: Copied (replaced existing) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/02/03 04:29:56 DEBUG : dst/one: Removing old object on successful upload 2026/02/03 04:30:01 DEBUG : Creating backend with remote "TestDrime:rclone-test-sobutad7duji/BackupDir" 2026/02/03 04:30:02 DEBUG : one: size = 5 (Local file system at /tmp/rclone1917518733) 2026/02/03 04:30:02 DEBUG : one: size = 3 (drime root 'rclone-test-sobutad7duji/dst') 2026/02/03 04:30:02 DEBUG : one: Sizes differ 2026/02/03 04:30:04 INFO : one: Moved (server-side) 2026/02/03 04:30:07 DEBUG : one: Removing old object on successful upload 2026/02/03 04:30:07 DEBUG : one: size = 5 OK 2026/02/03 04:30:07 INFO : one: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:333 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5) got CopyDest/one (5), CopyDest/two (3), dst/one (5) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:333 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/03 04:30:35 DEBUG : two: Need to transfer - File not found at Destination 2026/02/03 04:30:36 DEBUG : two: size = 3 OK 2026/02/03 04:30:36 DEBUG : two: Sizes identical 2026/02/03 04:30:37 DEBUG : two: size = 3 OK 2026/02/03 04:30:37 INFO : two: Copied (server-side copy) 2026/02/03 04:30:37 DEBUG : two: Destination found in --copy-dest, using server-side copy fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:342 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:342 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/03 04:30:47 DEBUG : two: size = 3 OK 2026/02/03 04:30:47 DEBUG : two: Sizes identical 2026/02/03 04:30:47 DEBUG : two: Unchanged skipping fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:348 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:348 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:353 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:353 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/03 04:31:09 DEBUG : three: Need to transfer - File not found at Destination 2026/02/03 04:31:10 DEBUG : three: size = 7 (Local file system at /tmp/rclone1917518733) 2026/02/03 04:31:10 DEBUG : three: size = 5 (drime root 'rclone-test-sobutad7duji/CopyDest') 2026/02/03 04:31:10 DEBUG : three: Sizes differ 2026/02/03 04:31:10 DEBUG : three: Destination not found in --copy-dest 2026/02/03 04:31:12 DEBUG : three: size = 7 OK 2026/02/03 04:31:12 INFO : three: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:362 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/three (7), dst/two (3) got CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/three (7), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:362 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found --- FAIL: TestCopyFileCopyDest (115.33s) === RUN TestCopyFileMaxTransfer run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:31:26 DEBUG : TestCopyFileMaxTransfer/file1: Need to transfer - File not found at Destination 2026/02/03 04:31:35 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/02/03 04:31:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:31:35 DEBUG : TestCopyFileMaxTransfer/file1: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/02/03 04:31:36 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 04:31:37 DEBUG : TestCopyFileMaxTransfer/file1: Removing old object on successful upload 2026/02/03 04:31:37 DEBUG : TestCopyFileMaxTransfer/file1: size = 14 OK 2026/02/03 04:31:37 INFO : TestCopyFileMaxTransfer/file1: Copied (new) 2026/02/03 04:31:38 DEBUG : TestCopyFileMaxTransfer/file2: Need to transfer - File not found at Destination 2026/02/03 04:31:38 ERROR : TestCopyFileMaxTransfer/file2: Failed to copy: failed to upload file: Post "https://app.drime.cloud/api/v1/uploads": failed to copy data: max transfer limit reached as set by --max-transfer 2026/02/03 04:31:39 DEBUG : TestCopyFileMaxTransfer/file3: Need to transfer - File not found at Destination 2026/02/03 04:31:40 DEBUG : TestCopyFileMaxTransfer/file4: Need to transfer - File not found at Destination 2026/02/03 04:31:41 DEBUG : TestCopyFileMaxTransfer/file4: size = 2062 OK 2026/02/03 04:31:41 INFO : TestCopyFileMaxTransfer/file4: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure run.go:130: removing dir "TestCopyFileMaxTransfer" failed - try 1/3: directory not empty run.go:130: removing dir "TestCopyFileMaxTransfer" failed - try 2/3: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"TestCopyFileMaxTransfer"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=23) "TestCopyFileMaxTransfer" } Test: TestCopyFileMaxTransfer Messages: directories --- FAIL: TestCopyFileMaxTransfer (41.33s) === RUN TestListDirSorted run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:32:38 DEBUG : a.txt: Excluded (Size Filter) 2026/02/03 04:32:38 DEBUG : a.txt: Excluded 2026/02/03 04:32:39 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/03 04:32:39 DEBUG : sub dir/hello world2: Excluded 2026/02/03 04:32:39 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/03 04:32:39 DEBUG : sub dir/hello world: Excluded 2026/02/03 04:32:40 DEBUG : sub dir/ignore dir: Excluded 2026/02/03 04:32:40 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/03 04:32:40 DEBUG : sub dir/hello world2: Excluded 2026/02/03 04:32:40 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/03 04:32:40 DEBUG : sub dir/hello world: Excluded 2026/02/03 04:32:40 DEBUG : sub dir/ignore dir: Excluded run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir/sub sub dir" failed: directory not empty run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir", "sub dir/sub sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=7) "sub dir", + (string) (len=19) "sub dir/sub sub dir" } Test: TestListDirSorted Messages: directories --- FAIL: TestListDirSorted (55.77s) === RUN TestListDirSortedFn run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/03 04:33:44 DEBUG : a.txt: Excluded (Size Filter) 2026/02/03 04:33:44 DEBUG : a.txt: Excluded 2026/02/03 04:33:44 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/03 04:33:44 DEBUG : sub dir/hello world2: Excluded 2026/02/03 04:33:44 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/03 04:33:44 DEBUG : sub dir/hello world: Excluded 2026/02/03 04:33:45 DEBUG : sub dir/ignore dir: Excluded 2026/02/03 04:33:45 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/03 04:33:45 DEBUG : sub dir/hello world2: Excluded 2026/02/03 04:33:45 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/03 04:33:45 DEBUG : sub dir/hello world: Excluded 2026/02/03 04:33:45 DEBUG : sub dir/ignore dir: Excluded run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir/sub sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir/sub sub dir" failed: directory not empty run.go:130: removing dir "sub dir/ignore dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir", "sub dir/sub sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=7) "sub dir", + (string) (len=19) "sub dir/sub sub dir" } Test: TestListDirSortedFn Messages: directories --- FAIL: TestListDirSortedFn (67.32s) === RUN TestListJSON run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestListJSON/Default lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 2 actual : 3 Test: TestListJSON/Default Messages: Wrong number of results === RUN TestListJSON/DirsOnly lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 1 actual : 2 Test: TestListJSON/DirsOnly Messages: Wrong number of results === RUN TestListJSON/Recurse lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 3 actual : 5 Test: TestListJSON/Recurse Messages: Wrong number of results === RUN TestListJSON/Metadata lsjson_test.go:202: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/lsjson_test.go:202 Error: Not equal: expected: 2 actual : 3 Test: TestListJSON/Metadata Messages: Wrong number of results === NAME TestListJSON run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestListJSON Messages: directories --- FAIL: TestListJSON (36.87s) --- FAIL: TestListJSON/Default (0.25s) --- FAIL: TestListJSON/DirsOnly (0.42s) --- FAIL: TestListJSON/Recurse (0.67s) --- FAIL: TestListJSON/Metadata (0.46s) === RUN TestStatJSON run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/DirWithTrailingSlash === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2026/02/03 04:35:02 DEBUG : Creating backend with remote "TestDrime:rclone-test-sobutad7duji/notfound" 2026/02/03 04:35:02 DEBUG : Config file has changed externally - reloading === NAME TestStatJSON run.go:130: removing dir "sub" failed - try 1/3: directory not empty --- PASS: TestStatJSON (21.27s) --- PASS: TestStatJSON/Root (0.16s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.24s) --- PASS: TestStatJSON/Dir (0.43s) --- PASS: TestStatJSON/DirWithTrailingSlash (0.47s) --- PASS: TestStatJSON/File (0.45s) --- PASS: TestStatJSON/NotFound (0.69s) --- PASS: TestStatJSON/DirFilesOnly (0.26s) --- PASS: TestStatJSON/FileFilesOnly (0.34s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.30s) --- PASS: TestStatJSON/DirDirsOnly (0.56s) --- PASS: TestStatJSON/FileDirsOnly (0.37s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.19s) --- PASS: TestStatJSON/RootNotFound (1.73s) === RUN TestMkdir run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:35:08 INFO : drime root 'rclone-test-sobutad7duji': Making directory 2026/02/03 04:35:08 INFO : drime root 'rclone-test-sobutad7duji': Making directory --- PASS: TestMkdir (0.70s) === RUN TestLsd run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:81 Error: Should be true Test: TestLsd Messages: listing wrong, want sub dir/hello world (11) got fstest.go:203: Not found "sub dir/hello world" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:81 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestLsd Messages: 1 objects not found run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLsd Messages: listing wrong, want got sub dir/hello world (11) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLsd Messages: Unexpected file "sub dir/hello world" fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestLsd Messages: directories --- FAIL: TestLsd (26.97s) === RUN TestLs run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: listing wrong, want got empty space (1), potato2 (60) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: Unexpected file "empty space" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: Unexpected file "potato2" fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestLs Messages: directories --- FAIL: TestLs (22.85s) === RUN TestLsWithFilesFrom run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/02/03 04:36:18 DEBUG : empty space: Excluded (FilesFrom Filter) 2026/02/03 04:36:18 DEBUG : empty space: Excluded fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure --- PASS: TestLsWithFilesFrom (31.00s) === RUN TestLsLong run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLsLong Messages: listing wrong, want got empty space (1), potato2 (60) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLsLong Messages: Unexpected file "empty space" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLsLong Messages: Unexpected file "potato2" --- FAIL: TestLsLong (13.40s) === RUN TestCount run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestCount Messages: directories --- FAIL: TestCount (29.89s) === RUN TestDelete run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:419 Error: Should be true Test: TestDelete Messages: listing wrong, want large (100), medium (60), small (10) got medium (60), small (10) fstest.go:203: Not found "large" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:419 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestDelete Messages: 1 objects not found 2026/02/03 04:37:35 DEBUG : Waiting for deletions to finish 2026/02/03 04:37:36 DEBUG : large: Excluded (Size Filter) 2026/02/03 04:37:36 DEBUG : large: Excluded 2026/02/03 04:37:36 INFO : medium: Deleted 2026/02/03 04:37:36 INFO : small: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:423 Error: Should be true Test: TestDelete Messages: listing wrong, want large (100) got large (100), medium (60), small (10) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:423 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestDelete Messages: Unexpected file "medium" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:423 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestDelete Messages: Unexpected file "small" 2026/02/03 04:37:46 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:37:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:37:47 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:37:47 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 04:37:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:37:47 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 04:37:47 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:37:47 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 04:37:47 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:37:47 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 04:37:48 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:37:48 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 04:37:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:37:48 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 04:37:48 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:37:48 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 04:37:50 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:37:50 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 04:37:52 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 04:37:52 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 04:37:58 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:37:58 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 04:38:08 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:38:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:38:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:39:08 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:39:28 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:39:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:40:08 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:40:28 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:40:48 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 04:41:08 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:41:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:41:48 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:42:08 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:42:28 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:42:48 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:43:08 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:43:28 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:43:48 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:44:08 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 04:44:28 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:44:48 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:45:08 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:45:28 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:45:48 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:46:08 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:46:28 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:46:48 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:47:08 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:47:28 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 04:47:48 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:48:08 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:48:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:48:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:49:08 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:49:28 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:49:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:50:08 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:50:28 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:50:48 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 04:51:08 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:51:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:51:48 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:52:08 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:52:28 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:52:48 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:53:08 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:53:28 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:53:48 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:54:08 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "small" failed: failed to delete item: Error "Server Error" 2026/02/03 04:54:28 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 04:54:48 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 04:54:58 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 04:55:03 DEBUG : pacer: Reducing sleep to 1.25s --- FAIL: TestDelete (1069.67s) === RUN TestMaxDelete run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 04:55:05 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 04:55:09 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 04:55:09 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 04:55:13 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 04:55:14 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 04:55:15 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 04:55:16 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:447 Error: Should be true Test: TestMaxDelete Messages: listing wrong, want large (100), medium (60), small (10) got medium (60), small (10) fstest.go:203: Not found "large" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:447 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestMaxDelete Messages: 1 objects not found 2026/02/03 04:55:24 DEBUG : Waiting for deletions to finish 2026/02/03 04:55:25 ERROR : small: Got fatal error on delete: --max-delete threshold reached 2026/02/03 04:55:25 INFO : medium: Deleted 2026/02/03 04:55:25 INFO : large: Deleted operations_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:453 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDelete 2026/02/03 04:55:26 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:55:26 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 04:55:26 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:55:26 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 04:55:26 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:55:26 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 04:55:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:55:26 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 04:55:27 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:55:27 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 04:55:27 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:55:27 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 04:55:28 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:55:28 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 04:55:28 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:55:28 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 04:55:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:55:29 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 04:55:32 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 04:55:32 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 04:55:37 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:55:37 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 04:55:47 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:56:07 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:56:27 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 04:56:47 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 04:57:07 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 04:57:28 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 04:57:47 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 04:58:07 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 04:58:27 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 04:58:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 04:59:07 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 04:59:27 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 04:59:47 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:00:07 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:00:28 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:00:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:01:07 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:01:27 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:01:47 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "large" failed: failed to delete item: Error "Server Error" 2026/02/03 05:02:07 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:02:27 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:02:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:03:07 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:03:28 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:03:47 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:04:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:04:27 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:04:47 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:05:08 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 05:05:28 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:05:48 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:06:07 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:06:28 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:06:48 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:07:07 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:07:27 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:07:48 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:08:07 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:08:28 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 05:08:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:09:07 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:09:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:09:47 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:10:07 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:10:27 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:10:47 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:11:08 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:11:28 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:11:47 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 05:12:07 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 05:12:28 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 05:12:37 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 05:12:42 DEBUG : pacer: Reducing sleep to 1.25s --- FAIL: TestMaxDelete (1059.47s) === RUN TestMaxDeleteSizeLargeFile run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 05:12:45 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 05:12:49 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 05:12:50 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 05:12:51 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 05:12:52 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 05:12:54 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 05:12:55 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 05:12:55 DEBUG : Waiting for deletions to finish 2026/02/03 05:12:55 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached 2026/02/03 05:12:55 INFO : medium: Deleted 2026/02/03 05:12:55 INFO : small: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: listing wrong, want large (100) got large (100), medium (60), small (10) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "medium" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "small" 2026/02/03 05:13:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:13:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 05:13:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:13:05 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 05:13:05 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:13:05 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 05:13:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:13:06 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 05:13:06 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:13:06 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 05:13:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:13:06 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 05:13:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:13:07 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 05:13:07 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:13:07 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 05:13:08 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:13:08 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 05:13:11 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 05:13:11 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 05:13:16 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:13:16 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 05:13:26 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:13:46 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:14:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:14:26 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:14:46 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:15:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:15:26 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:15:46 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:16:06 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 05:16:26 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:16:46 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:17:06 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:17:27 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:17:46 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:18:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:18:26 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:18:46 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:19:06 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:19:26 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 05:19:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:20:06 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:20:26 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:20:46 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:21:06 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:21:26 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:21:46 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:22:06 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:22:26 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:22:47 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 05:23:06 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:23:26 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:23:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:24:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:24:27 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:24:46 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:25:06 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:25:26 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:25:46 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:26:06 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 05:26:26 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:26:46 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:27:06 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:27:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:27:47 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:28:07 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:28:26 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:28:46 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:29:06 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:29:26 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "small" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "small" failed: failed to delete item: Error "Server Error" 2026/02/03 05:29:47 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 05:30:06 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 05:30:16 DEBUG : pacer: Reducing sleep to 2.5s --- FAIL: TestMaxDeleteSizeLargeFile (1054.08s) === RUN TestMaxDeleteSize run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 05:30:22 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/03 05:30:27 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 05:30:27 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 05:30:31 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 05:30:31 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 05:30:36 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 05:30:36 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 05:30:36 DEBUG : Waiting for deletions to finish 2026/02/03 05:30:36 DEBUG : pacer: Reducing sleep to 10ms 2026/02/03 05:30:36 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/02/03 05:30:36 INFO : medium: Deleted 2026/02/03 05:30:36 INFO : large: Deleted operations_test.go:492: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:492 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDeleteSize 2026/02/03 05:30:37 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:30:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/03 05:30:37 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:30:37 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/03 05:30:37 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:30:37 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/03 05:30:38 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:30:38 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/03 05:30:38 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:30:38 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/03 05:30:38 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:30:38 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/03 05:30:39 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:30:39 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/03 05:30:40 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:30:40 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/03 05:30:41 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:30:41 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/03 05:30:43 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/03 05:30:43 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 05:30:48 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:30:48 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/03 05:30:59 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:31:19 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:31:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:31:59 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:32:19 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:32:39 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:32:59 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:33:19 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:33:39 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 05:33:59 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:34:19 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:34:39 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:34:59 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:35:19 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:35:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:35:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:36:19 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:36:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:36:59 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "large" failed: failed to delete item: Error "Server Error" 2026/02/03 05:37:19 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:37:39 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:37:59 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:38:19 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:38:39 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:38:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:39:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:39:39 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:39:59 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:40:19 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/03 05:40:39 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:40:59 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:41:19 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:41:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:41:59 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:42:19 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:42:39 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:42:59 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:43:19 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:43:39 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/03 05:43:59 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/03 05:44:19 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/03 05:44:39 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/03 05:44:59 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/03 05:45:19 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/03 05:45:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/03 05:45:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/03 05:46:19 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/03 05:46:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/03 05:46:59 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/03 05:47:19 DEBUG : pacer: Reducing sleep to 10s 2026/02/03 05:47:39 DEBUG : pacer: Reducing sleep to 5s 2026/02/03 05:47:49 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/03 05:47:54 DEBUG : pacer: Reducing sleep to 1.25s --- FAIL: TestMaxDeleteSize (1057.72s) === RUN TestReadFile run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" 2026/02/03 05:47:56 DEBUG : pacer: Reducing sleep to 625ms 2026/02/03 05:48:02 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/03 05:48:02 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/03 05:48:03 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/03 05:48:03 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/03 05:48:03 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/03 05:48:04 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:510 Error: Should be true Test: TestReadFile Messages: listing wrong, want got ReadFile (28) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:510 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestReadFile Messages: Unexpected file "ReadFile" --- FAIL: TestReadFile (18.95s) === RUN TestCat run.go:185: Remote "drime root 'rclone-test-sobutad7duji'", Local "Local file system at /tmp/rclone1917518733", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCat Messages: listing wrong, want got file1 (10), file2 (9) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCat Messages: Unexpected file "file1" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCat Messages: Unexpected file "file2" --- FAIL: TestCat (33.61s) FAIL 2026/02/03 05:48:47 DEBUG : drime root 'rclone-test-sobutad7duji': Purge remote "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose -test.run '^(TestApplyTransforms|TestCat|TestCheckSizeOnly|TestCheckSumDownload|TestCopyFile|TestCopyFileCopyDest|TestCopyFileMaxTransfer|TestCount|TestDelete|TestListDirSorted|TestListDirSortedFn|TestLs|TestLsLong|TestLsWithFilesFrom|TestLsd|TestMaxDelete|TestMaxDeleteSize|TestMaxDeleteSizeLargeFile|TestMkdir|TestMultithreadCopyAbort|TestParseSumFile|TestReadFile|TestStatJSON)$|^TestListJSON$/^(Default|DirsOnly|Metadata|Recurse)$|^TestMultithreadCopy$/^(upload=false,size=10485759,streams=2|upload=false,size=10485760,streams=2|upload=true,size=10485759,streams=2|upload=true,size=10485760,streams=2|upload=true,size=10485761,streams=2)$'" - Finished ERROR in 1h48m36.603376306s (try 2/5): exit status 1: Failed [TestMultithreadCopy/upload=false,size=10485759,streams=2 TestMultithreadCopy/upload=true,size=10485759,streams=2 TestMultithreadCopy/upload=true,size=10485760,streams=2 TestMultithreadCopy/upload=true,size=10485761,streams=2 TestMultithreadCopyAbort TestParseSumFile TestCheckSumDownload TestApplyTransforms TestCopyFile TestCopyFileCopyDest TestCopyFileMaxTransfer TestListDirSorted TestListDirSortedFn TestListJSON/Default TestListJSON/DirsOnly TestListJSON/Recurse TestListJSON/Metadata TestLsd TestLs TestLsLong TestCount TestDelete TestMaxDelete TestMaxDeleteSizeLargeFile TestMaxDeleteSize TestReadFile TestCat]