"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose" - Starting (try 1/5) 2026/02/04 04:18:19 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza" 2026/02/04 04:18:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:18:19 DEBUG : Creating backend with remote "/tmp/rclone4055517313" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" === RUN TestMultithreadCopy/upload=false,size=10485759,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: write buffer set to 131072 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10.000Mi 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: Starting multi-thread copy with 1 chunks of size 10.000Mi with 1 parallel streams 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi starting 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: writing chunk 0 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi finished 2026/02/04 04:18:41 DEBUG : test-multithread-copy-false-10485759-2: Finished multi-thread copy with 1 parts of size 10.000Mi === RUN TestMultithreadCopy/upload=false,size=10485760,streams=2 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: write buffer set to 131072 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10Mi 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: Starting multi-thread copy with 1 chunks of size 10Mi with 1 parallel streams 2026/02/04 04:18:49 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk 1/1 (0-10485760) size 10Mi starting 2026/02/04 04:18:50 DEBUG : test-multithread-copy-false-10485760-2: writing chunk 0 2026/02/04 04:18:50 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk 1/1 (0-10485760) size 10Mi finished 2026/02/04 04:18:50 DEBUG : test-multithread-copy-false-10485760-2: Finished multi-thread copy with 1 parts of size 10Mi === RUN TestMultithreadCopy/upload=false,size=10485761,streams=2 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: write buffer set to 131072 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10.000Mi 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: Starting multi-thread copy with 1 chunks of size 10.000Mi with 1 parallel streams 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: chunk 1/1 (0-10485761) size 10.000Mi starting 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: writing chunk 0 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: chunk 1/1 (0-10485761) size 10.000Mi finished 2026/02/04 04:19:01 DEBUG : test-multithread-copy-false-10485761-2: Finished multi-thread copy with 1 parts of size 10.000Mi === RUN TestMultithreadCopy/upload=true,size=10485759,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485759,streams=2 Messages: listing wrong, want got test-multithread-copy-false-10485761-2 (10485761) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485759,streams=2 Messages: Unexpected file "test-multithread-copy-false-10485761-2" 2026/02/04 04:19:12 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: disabling buffering because source is local disk 2026/02/04 04:19:13 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/04 04:19:13 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/02/04 04:19:13 DEBUG : test-multithread-copy-true-10485759-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/02/04 04:19:13 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi starting 2026/02/04 04:19:13 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/02/04 04:19:14 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/02/04 04:19:14 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi finished 2026/02/04 04:19:18 DEBUG : test-multithread-copy-true-10485759-2: Finished multi-thread copy with 2 parts of size 5Mi === RUN TestMultithreadCopy/upload=true,size=10485760,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: listing wrong, want got test-multithread-copy-true-10485759-2 (10485759) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485760,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485759-2" 2026/02/04 04:19:29 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: disabling buffering because source is local disk 2026/02/04 04:19:30 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/04 04:19:30 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/02/04 04:19:30 DEBUG : test-multithread-copy-true-10485760-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/02/04 04:19:30 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi starting 2026/02/04 04:19:30 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/02/04 04:19:31 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/02/04 04:19:31 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi finished 2026/02/04 04:19:33 DEBUG : test-multithread-copy-true-10485760-2: Finished multi-thread copy with 2 parts of size 5Mi === RUN TestMultithreadCopy/upload=true,size=10485761,streams=2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: listing wrong, want got test-multithread-copy-true-10485760-2 (10485760) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMultithreadCopy/upload=true,size=10485761,streams=2 Messages: Unexpected file "test-multithread-copy-true-10485760-2" 2026/02/04 04:19:44 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: disabling buffering because source is local disk 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 finished 2026/02/04 04:19:45 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/02/04 04:19:46 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/02/04 04:19:50 DEBUG : test-multithread-copy-true-10485761-2: Finished multi-thread copy with 3 parts of size 5Mi 2026/02/04 04:19:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:19:51 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 04:19:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:19:51 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 04:19:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:19:52 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 04:19:52 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:19:52 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 04:19:52 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:19:52 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 04:19:52 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:19:52 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 04:19:53 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:19:53 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 04:19:53 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:19:53 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 04:19:55 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:19:55 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 04:19:57 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 04:19:57 DEBUG : pacer: Rate limited, increasing sleep to 10.24s === NAME TestMultithreadCopy run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 04:20:02 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:20:02 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 04:20:13 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:20:32 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:20:53 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:21:13 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:21:33 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:21:53 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:22:13 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:22:33 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:22:53 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 04:23:13 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:23:33 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:23:53 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:24:13 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:24:33 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:24:53 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:25:13 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:25:33 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:25:53 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:26:13 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test-multithread-copy-true-10485761-2" failed: failed to delete item: Error "Server Error" 2026/02/04 04:26:33 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestMultithreadCopy (493.22s) --- PASS: TestMultithreadCopy/upload=false,size=10485759,streams=2 (21.78s) --- PASS: TestMultithreadCopy/upload=false,size=10485760,streams=2 (8.69s) --- PASS: TestMultithreadCopy/upload=false,size=10485761,streams=2 (11.22s) --- FAIL: TestMultithreadCopy/upload=true,size=10485759,streams=2 (17.04s) --- FAIL: TestMultithreadCopy/upload=true,size=10485760,streams=2 (15.39s) --- FAIL: TestMultithreadCopy/upload=true,size=10485761,streams=2 (15.63s) === RUN TestMultithreadCopyAbort run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:26:53 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 04:27:03 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/04 04:27:08 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/04 04:27:19 DEBUG : pacer: Reducing sleep to 625ms 2026/02/04 04:27:19 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/04 04:27:20 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2026/02/04 04:27:21 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/04 04:27:21 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 1 2026/02/04 04:27:21 DEBUG : test-multithread-abort: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/02/04 04:27:21 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/02/04 04:27:21 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/02/04 04:27:21 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:21 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/02/04 04:27:21 DEBUG : Open with options = [RangeOption(0,5242879)] 2026/02/04 04:27:21 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/02/04 04:27:21 DEBUG : Open with options = [RangeOption(5242880,10485759)] 2026/02/04 04:27:21 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/04 04:27:21 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/04 04:27:21 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/04 04:27:21 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/02/04 04:27:22 DEBUG : pacer: Reducing sleep to 10ms 2026/02/04 04:27:22 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/02/04 04:27:22 DEBUG : Returning error reader 2026/02/04 04:27:22 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:22 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 0/10: BOOM: simulated read failure 2026/02/04 04:27:22 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:23 DEBUG : Returning error reader 2026/02/04 04:27:23 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:23 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2026/02/04 04:27:23 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:24 DEBUG : Returning error reader 2026/02/04 04:27:24 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:24 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2026/02/04 04:27:24 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:25 DEBUG : Returning error reader 2026/02/04 04:27:25 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:25 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2026/02/04 04:27:25 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:26 DEBUG : Returning error reader 2026/02/04 04:27:26 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:26 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2026/02/04 04:27:26 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:27 DEBUG : Returning error reader 2026/02/04 04:27:27 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:27 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2026/02/04 04:27:27 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:28 DEBUG : Returning error reader 2026/02/04 04:27:28 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:28 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2026/02/04 04:27:28 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:29 DEBUG : Returning error reader 2026/02/04 04:27:29 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:29 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2026/02/04 04:27:29 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:30 DEBUG : Returning error reader 2026/02/04 04:27:30 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:30 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2026/02/04 04:27:30 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:31 DEBUG : Returning error reader 2026/02/04 04:27:31 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:31 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2026/02/04 04:27:31 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/02/04 04:27:32 DEBUG : Returning error reader 2026/02/04 04:27:32 DEBUG : BOOM: simulated read failure 2026/02/04 04:27:32 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2026/02/04 04:27:32 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2026/02/04 04:27:32 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: failed to upload part 3: Put "https://drimestorage.18b804eaa6bc9759e2278f8d5367f42f.r2.cloudflarestorage.com/uploads/f6a4922b-0e5c-4967-8825-b647f140db0f/f6a4922b-0e5c-4967-8825-b647f140db0f?uploadId=AL_1AX6jI5u7TOa99TBth7TbS4sbdQNl-Su8xyx_NhjGcRK6LhYY7J-EdnKHNqQ_sia94WzfQWBzLwZ9qtSZ6US9Dzz3ij2j0jEZn8j_fmEl0-Fa5dt9XONFD5L1F-HP2djQqMvpo3sZEbhuFJtj_d50WXWPdonyHU5ppivY6Tkwo8jgX7jwd9XJvDepV6iCJBM5UiiViPTQBNZ5RfliGRdAiquCYzB9NFrPZNez_aghooSbMexZAW7TgC_FqDQo9iS--UXNg1y2KcO33E_gsQlauqnyNFEWAHBF3_nF_E8AVzHhHegTwg7r06H3LTsoM5W4Ewj1CKHMdFzD4bEEUp4&partNumber=3&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=db9b71e81fa19eaf54eb4264526ca7a8%2F20260204%2FWEUR%2Fs3%2Faws4_request&X-Amz-Date=20260204T042722Z&X-Amz-SignedHeaders=host&X-Amz-Expires=1800&X-Amz-Signature=6d9bba239fb45ec5c52ad4a7780bd5aaaca0449ea20b88d21bf7ce0ac6e53961": BOOM: simulated read failure 2026/02/04 04:27:32 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit 2026/02/04 04:27:34 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:27:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 04:27:34 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:27:34 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 04:27:34 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:27:34 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 04:27:35 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:27:35 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 04:27:35 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:27:35 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 04:27:35 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:27:35 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 04:27:35 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:27:35 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 04:27:36 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:27:36 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 04:27:38 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:27:38 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 04:27:40 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 04:27:40 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "test-multithread-abort" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 04:27:45 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:27:45 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 04:27:55 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:28:15 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:28:35 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:28:55 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:29:16 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:29:36 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:29:55 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:30:16 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:30:35 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-abort" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 04:30:55 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:31:16 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:31:36 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:31:56 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:32:16 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:32:36 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:32:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:33:16 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:33:36 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:33:56 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test-multithread-abort" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test-multithread-abort" failed: failed to delete item: Error "Server Error" 2026/02/04 04:34:16 DEBUG : pacer: Reducing sleep to 10s --- PASS: TestMultithreadCopyAbort (462.84s) === RUN TestSizeDiffers 2026/02/04 04:34:16 DEBUG : a: size = 0 OK 2026/02/04 04:34:16 DEBUG : a: size = 1 (memory) 2026/02/04 04:34:16 DEBUG : a: size = 2 (memory) --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2026/02/04 04:34:16 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/ReadAt 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/Normal/Seek 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2026/02/04 04:34:16 DEBUG : potato: Seek from 10 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 10 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/ReadAt 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithRangeOption/Seek 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 2 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2026/02/04 04:34:16 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/ReadAt 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithSeekOption/Seek 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 2 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2026/02/04 04:34:16 DEBUG : potato: Seek from 8 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 8 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2026/02/04 04:34:16 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/04 04:34:16 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/ReadAt 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/UnknownSize/Seek 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/04 04:34:16 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/04 04:34:16 DEBUG : potato: Seek from 5 to 2 2026/02/04 04:34:16 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2026/02/04 04:34:16 DEBUG : potato: Seek from 9 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 9 to 0 2026/02/04 04:34:16 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/ReadAt (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/ReadAt (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/ReadAt (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/ReadAt (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:34:36 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 04:34:47 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/04 04:34:51 DEBUG : pacer: Reducing sleep to 1.25s === RUN TestCheck/1 === RUN TestCheck/2 2026/02/04 04:34:55 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/04 04:34:59 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/04 04:34:59 DEBUG : pacer: Reducing sleep to 39.0625ms === NAME TestCheck fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:35:00 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/04 04:35:00 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === NAME TestCheck fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestCheck/6 === RUN TestCheck/7 === NAME TestCheck fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestCheck (84.00s) --- PASS: TestCheck/1 (2.26s) --- PASS: TestCheck/2 (1.17s) --- PASS: TestCheck/3 (0.23s) --- PASS: TestCheck/4 (0.22s) --- PASS: TestCheck/5 (0.24s) --- PASS: TestCheck/6 (0.28s) --- PASS: TestCheck/7 (0.22s) === RUN TestCheckFsError 2026/02/04 04:35:40 DEBUG : Creating backend with remote "nonexistent" 2026/02/04 04:35:40 DEBUG : Config file has changed externally - reloading 2026/02/04 04:35:40 DEBUG : Creating backend with remote "nonexistent" 2026/02/04 04:35:40 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2026/02/04 04:35:40 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2026/02/04 04:35:40 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 0 differences found 2026/02/04 04:35:40 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === NAME TestCheckDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:122 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:204 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckDownload Messages: listing wrong, want empty space (1), rutabaga (8) got rutabaga (8) fstest.go:203: Not found "empty space" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:122 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:204 Error: Not equal: expected: 0 actual : 1 Test: TestCheckDownload Messages: 1 objects not found === RUN TestCheckDownload/3 === NAME TestCheckDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 === NAME TestCheckDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCheckDownload Messages: listing wrong, want got empty space (1), potato2 (60), remotepotato (60), rutabaga (8) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCheckDownload Messages: Unexpected file "empty space" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCheckDownload Messages: Unexpected file "potato2" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCheckDownload Messages: Unexpected file "remotepotato" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestCheckDownload Messages: Unexpected file "rutabaga" --- FAIL: TestCheckDownload (59.17s) --- PASS: TestCheckDownload/1 (0.83s) --- PASS: TestCheckDownload/2 (0.63s) --- PASS: TestCheckDownload/3 (1.19s) --- PASS: TestCheckDownload/4 (0.76s) --- PASS: TestCheckDownload/5 (0.69s) --- PASS: TestCheckDownload/6 (0.63s) --- PASS: TestCheckDownload/7 (0.60s) === RUN TestCheckSizeOnly run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:99 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:181 Error: Should be true Test: TestCheckSizeOnly Messages: listing wrong, want rutabaga (8) got fstest.go:203: Not found "rutabaga" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:99 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:181 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:212 Error: Not equal: expected: 0 actual : 1 Test: TestCheckSizeOnly Messages: 1 objects not found === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:122 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:181 Error: Should be true Test: TestCheckSizeOnly Messages: listing wrong, want empty space (1), rutabaga (8) got rutabaga (8) fstest.go:203: Not found "empty space" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:122 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:181 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:212 Error: Not equal: expected: 0 actual : 1 Test: TestCheckSizeOnly Messages: 1 objects not found === RUN TestCheckSizeOnly/3 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- FAIL: TestCheckSizeOnly (63.47s) --- PASS: TestCheckSizeOnly/1 (1.06s) --- PASS: TestCheckSizeOnly/2 (0.24s) --- PASS: TestCheckSizeOnly/3 (0.69s) --- PASS: TestCheckSizeOnly/4 (0.28s) --- PASS: TestCheckSizeOnly/5 (0.24s) --- PASS: TestCheckSizeOnly/6 (0.31s) --- PASS: TestCheckSizeOnly/7 (0.33s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:37:47 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/04 04:37:47 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/04 04:37:47 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/04 04:37:47 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/04 04:37:53 DEBUG : test.sum: Removing old object on successful upload 2026/02/04 04:37:54 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/04 04:37:54 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/04 04:37:54 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/04 04:37:54 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/04 04:37:54 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:37:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 04:37:54 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:37:54 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 04:37:55 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:37:55 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 04:37:55 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:37:55 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 04:37:55 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:37:55 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 04:37:55 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:37:55 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 04:37:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:37:56 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 04:37:56 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:37:56 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 04:37:58 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:37:58 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 04:38:00 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 04:38:00 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "test.sum" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 04:38:06 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:38:06 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 04:38:16 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:38:36 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:38:56 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:39:16 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:39:36 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:39:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:40:16 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:40:36 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:40:56 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test.sum" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 04:41:16 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:41:36 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:41:56 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:42:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:42:36 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:42:56 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:43:16 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:43:36 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:43:56 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:44:16 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "test.sum" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "test.sum" failed: failed to delete item: Error "Server Error" 2026/02/04 04:44:36 DEBUG : pacer: Reducing sleep to 10s fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:44:56 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 04:45:06 DEBUG : pacer: Reducing sleep to 2.5s fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:45:11 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/04 04:45:13 DEBUG : pacer: Reducing sleep to 625ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestParseSumFile Messages: listing wrong, want got test.sum (90) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestParseSumFile Messages: Unexpected file "test.sum" --- FAIL: TestParseSumFile (455.15s) === RUN TestCheckSum run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:45:17 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/data" 2026/02/04 04:45:17 DEBUG : Config file has changed externally - reloading check_test.go:350: drime root 'rclone-test-niyaxaf7reza/data' lacks md5, skipping 2026/02/04 04:45:20 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/04 04:45:20 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/04 04:45:20 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/04 04:45:21 DEBUG : pacer: Reducing sleep to 39.0625ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:45:22 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/04 04:45:23 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1156 /usr/local/go/src/testing/testing.go:1139 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:537 Error: Should be true Test: TestCheckSum Messages: listing wrong, want got test.sum (90) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1156 /usr/local/go/src/testing/testing.go:1139 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:537 Error: Should be true Test: TestCheckSum Messages: Unexpected file "test.sum" --- FAIL: TestCheckSum (11.84s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:45:29 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/data" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure === RUN TestCheckSumDownload/subtest1 2026/02/04 04:45:59 DEBUG : test.sum: Removing old object on successful upload === RUN TestCheckSumDownload/subtest2 2026/02/04 04:46:04 DEBUG : test.sum: Removing old object on successful upload 2026/02/04 04:46:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:46:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 04:46:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:46:05 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 04:46:05 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:46:05 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 04:46:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:46:06 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 04:46:06 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:46:06 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 04:46:07 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:46:07 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 04:46:07 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:46:07 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 04:46:08 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:46:08 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 04:46:09 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:46:09 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 04:46:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 04:46:12 DEBUG : pacer: Rate limited, increasing sleep to 10.24s === NAME TestCheckSumDownload run.go:286: Retry Put of "test.sum" to drime root 'rclone-test-niyaxaf7reza': 1/10 (failed to delete existing object: failed to delete item: Error "Server Error") 2026/02/04 04:46:17 DEBUG : pacer: Reducing sleep to 5.12s 2026/02/04 04:46:31 DEBUG : pacer: Reducing sleep to 2.56s 2026/02/04 04:46:31 DEBUG : test.sum: Removing old object on successful upload 2026/02/04 04:46:32 DEBUG : pacer: Reducing sleep to 1.28s 2026/02/04 04:46:34 DEBUG : pacer: Reducing sleep to 640ms 2026/02/04 04:46:36 DEBUG : pacer: Reducing sleep to 320ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:46:37 DEBUG : pacer: Reducing sleep to 160ms 2026/02/04 04:46:38 DEBUG : pacer: Reducing sleep to 80ms 2026/02/04 04:46:38 DEBUG : pacer: Reducing sleep to 40ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:46:40 DEBUG : pacer: Reducing sleep to 20ms 2026/02/04 04:46:40 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:464 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:464 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest3 2026/02/04 04:46:53 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:478 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (41), test.sum (82) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:478 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest4 2026/02/04 04:47:11 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (123) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:493 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest5 2026/02/04 04:47:29 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:508 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (123) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:508 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest6 2026/02/04 04:47:45 DEBUG : data/banana: Removing old object on successful upload 2026/02/04 04:47:54 DEBUG : data/potato: Removing old object on successful upload 2026/02/04 04:47:58 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCheckSumDownload Messages: listing wrong, want data/banana (13), data/potato (15), test.sum (82) got data/banana (13), data/potato (15), test.sum (123), test.sum (41) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Not equal: expected: 82 actual : 123 Test: TestCheckSumDownload Messages: test.sum: size incorrect file=82 vs obj=123 fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:525 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSumDownload Messages: Unexpected file "test.sum" === RUN TestCheckSumDownload/subtest7 2026/02/04 04:48:11 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:48:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 04:48:12 DEBUG : pacer: Reducing sleep to 10ms === NAME TestCheckSumDownload run.go:130: removing dir "data" failed - try 1/3: directory not empty run.go:130: removing dir "data" failed - try 2/3: directory not empty run.go:130: removing dir "data" failed - try 3/3: directory not empty run.go:133: removing dir "data" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"data"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=4) "data" } Test: TestCheckSumDownload Messages: directories --- FAIL: TestCheckSumDownload (176.72s) --- PASS: TestCheckSumDownload/subtest1 (2.16s) --- PASS: TestCheckSumDownload/subtest2 (1.53s) --- PASS: TestCheckSumDownload/subtest3 (1.81s) --- PASS: TestCheckSumDownload/subtest4 (1.91s) --- PASS: TestCheckSumDownload/subtest5 (1.95s) --- PASS: TestCheckSumDownload/subtest6 (2.14s) --- PASS: TestCheckSumDownload/subtest7 (2.18s) === RUN TestApplyTransforms 2026/02/04 04:48:26 DEBUG : Creating backend with remote "TestDrime:rclone-test-vunukon3juga" 2026/02/04 04:48:26 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:48:27 DEBUG : Creating backend with remote "/tmp/rclone166734113" run.go:185: Remote "drime root 'rclone-test-vunukon3juga'", Local "Local file system at /tmp/rclone166734113", Modify Window "876000h0m0s" upper checkfile vs. lower remote (without normalization) 2026/02/04 04:48:37 ERROR : HELLO, WORLD!: file not in drime root 'rclone-test-vunukon3juga' 2026/02/04 04:48:37 NOTICE: drime root 'rclone-test-vunukon3juga': 1 files missing 2026/02/04 04:48:37 NOTICE: drime root 'rclone-test-vunukon3juga': 0 differences found 2026/02/04 04:48:37 NOTICE: drime root 'rclone-test-vunukon3juga': 1 errors while checking upper checkfile vs. lower remote (with normalization) 2026/02/04 04:48:37 ERROR : hello, world!: file not in drime root 'rclone-test-vunukon3juga' 2026/02/04 04:48:37 NOTICE: drime root 'rclone-test-vunukon3juga': 1 files missing 2026/02/04 04:48:37 NOTICE: drime root 'rclone-test-vunukon3juga': 0 differences found 2026/02/04 04:48:37 NOTICE: drime root 'rclone-test-vunukon3juga': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:594 Error: Received unexpected error: file not in drime root 'rclone-test-vunukon3juga' Test: TestApplyTransforms Messages: unexpected error for upper checkfile vs. lower remote (with normalization) HELLO, WORLD! hello, world! 2026/02/04 04:48:37 DEBUG : Creating backend with remote "TestDrime:rclone-test-fuponil4nuda" 2026/02/04 04:48:37 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:48:38 DEBUG : Creating backend with remote "/tmp/rclone594102604" run.go:185: Remote "drime root 'rclone-test-fuponil4nuda'", Local "Local file system at /tmp/rclone594102604", Modify Window "876000h0m0s" lower checkfile vs. upper remote (without normalization) 2026/02/04 04:48:43 ERROR : hello, world!: file not in drime root 'rclone-test-fuponil4nuda' 2026/02/04 04:48:43 NOTICE: drime root 'rclone-test-fuponil4nuda': 1 files missing 2026/02/04 04:48:43 NOTICE: drime root 'rclone-test-fuponil4nuda': 0 differences found 2026/02/04 04:48:43 NOTICE: drime root 'rclone-test-fuponil4nuda': 1 errors while checking lower checkfile vs. upper remote (with normalization) 2026/02/04 04:48:43 ERROR : hello, world!: file not in drime root 'rclone-test-fuponil4nuda' 2026/02/04 04:48:43 NOTICE: drime root 'rclone-test-fuponil4nuda': 1 files missing 2026/02/04 04:48:43 NOTICE: drime root 'rclone-test-fuponil4nuda': 0 differences found 2026/02/04 04:48:43 NOTICE: drime root 'rclone-test-fuponil4nuda': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:595 Error: Received unexpected error: file not in drime root 'rclone-test-fuponil4nuda' Test: TestApplyTransforms Messages: unexpected error for lower checkfile vs. upper remote (with normalization) hello, world! HELLO, WORLD! 2026/02/04 04:48:43 DEBUG : Creating backend with remote "TestDrime:rclone-test-mufolok5vaci" 2026/02/04 04:48:43 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:48:44 DEBUG : Creating backend with remote "/tmp/rclone1709565637" run.go:185: Remote "drime root 'rclone-test-mufolok5vaci'", Local "Local file system at /tmp/rclone1709565637", Modify Window "876000h0m0s" lower checkfile vs. upperlowermixed remote (without normalization) 2026/02/04 04:48:48 ERROR : hello, world!: file not in drime root 'rclone-test-mufolok5vaci' 2026/02/04 04:48:48 NOTICE: drime root 'rclone-test-mufolok5vaci': 1 files missing 2026/02/04 04:48:48 NOTICE: drime root 'rclone-test-mufolok5vaci': 0 differences found 2026/02/04 04:48:48 NOTICE: drime root 'rclone-test-mufolok5vaci': 1 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2026/02/04 04:48:48 ERROR : hello, world!: file not in drime root 'rclone-test-mufolok5vaci' 2026/02/04 04:48:48 NOTICE: drime root 'rclone-test-mufolok5vaci': 1 files missing 2026/02/04 04:48:48 NOTICE: drime root 'rclone-test-mufolok5vaci': 0 differences found 2026/02/04 04:48:48 NOTICE: drime root 'rclone-test-mufolok5vaci': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:596 Error: Received unexpected error: file not in drime root 'rclone-test-mufolok5vaci' Test: TestApplyTransforms Messages: unexpected error for lower checkfile vs. upperlowermixed remote (with normalization) hello, world! HeLlO, wOrLd! 2026/02/04 04:48:48 DEBUG : Creating backend with remote "TestDrime:rclone-test-deziyir3talu" 2026/02/04 04:48:48 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:48:49 DEBUG : Creating backend with remote "/tmp/rclone296083260" run.go:185: Remote "drime root 'rclone-test-deziyir3talu'", Local "Local file system at /tmp/rclone296083260", Modify Window "876000h0m0s" upperlowermixed checkfile vs. upper remote (without normalization) 2026/02/04 04:48:59 ERROR : HeLlO, wOrLd!: file not in drime root 'rclone-test-deziyir3talu' 2026/02/04 04:48:59 NOTICE: drime root 'rclone-test-deziyir3talu': 1 files missing 2026/02/04 04:48:59 NOTICE: drime root 'rclone-test-deziyir3talu': 0 differences found 2026/02/04 04:48:59 NOTICE: drime root 'rclone-test-deziyir3talu': 1 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2026/02/04 04:49:00 ERROR : hello, world!: file not in drime root 'rclone-test-deziyir3talu' 2026/02/04 04:49:00 NOTICE: drime root 'rclone-test-deziyir3talu': 1 files missing 2026/02/04 04:49:00 NOTICE: drime root 'rclone-test-deziyir3talu': 0 differences found 2026/02/04 04:49:00 NOTICE: drime root 'rclone-test-deziyir3talu': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:597 Error: Received unexpected error: file not in drime root 'rclone-test-deziyir3talu' Test: TestApplyTransforms Messages: unexpected error for upperlowermixed checkfile vs. upper remote (with normalization) HeLlO, wOrLd! HELLO, WORLD! 2026/02/04 04:49:00 DEBUG : Creating backend with remote "TestDrime:rclone-test-wivekos5fagi" 2026/02/04 04:49:00 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:49:01 DEBUG : Creating backend with remote "/tmp/rclone3274279333" run.go:185: Remote "drime root 'rclone-test-wivekos5fagi'", Local "Local file system at /tmp/rclone3274279333", Modify Window "876000h0m0s" NFD checkfile vs. NFC remote (without normalization) 2026/02/04 04:49:05 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-wivekos5fagi' 2026/02/04 04:49:05 NOTICE: drime root 'rclone-test-wivekos5fagi': 1 files missing 2026/02/04 04:49:05 NOTICE: drime root 'rclone-test-wivekos5fagi': 0 differences found 2026/02/04 04:49:05 NOTICE: drime root 'rclone-test-wivekos5fagi': 1 errors while checking NFD checkfile vs. NFC remote (with normalization) 2026/02/04 04:49:06 ERROR : 測試_русский___ě_áñ: file not in drime root 'rclone-test-wivekos5fagi' 2026/02/04 04:49:06 NOTICE: drime root 'rclone-test-wivekos5fagi': 1 files missing 2026/02/04 04:49:06 NOTICE: drime root 'rclone-test-wivekos5fagi': 0 differences found 2026/02/04 04:49:06 NOTICE: drime root 'rclone-test-wivekos5fagi': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:598 Error: Received unexpected error: file not in drime root 'rclone-test-wivekos5fagi' Test: TestApplyTransforms Messages: unexpected error for NFD checkfile vs. NFC remote (with normalization) 測試_Русский___ě_áñ 測試_Русский___ě_áñ 2026/02/04 04:49:06 DEBUG : Creating backend with remote "TestDrime:rclone-test-sotumoj6jofe" 2026/02/04 04:49:06 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:49:06 DEBUG : Creating backend with remote "/tmp/rclone4066777917" run.go:185: Remote "drime root 'rclone-test-sotumoj6jofe'", Local "Local file system at /tmp/rclone4066777917", Modify Window "876000h0m0s" NFC checkfile vs. NFD remote (without normalization) 2026/02/04 04:49:14 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-sotumoj6jofe' 2026/02/04 04:49:14 NOTICE: drime root 'rclone-test-sotumoj6jofe': 1 files missing 2026/02/04 04:49:14 NOTICE: drime root 'rclone-test-sotumoj6jofe': 0 differences found 2026/02/04 04:49:14 NOTICE: drime root 'rclone-test-sotumoj6jofe': 1 errors while checking NFC checkfile vs. NFD remote (with normalization) 2026/02/04 04:49:14 ERROR : 測試_русский___ě_áñ: file not in drime root 'rclone-test-sotumoj6jofe' 2026/02/04 04:49:14 NOTICE: drime root 'rclone-test-sotumoj6jofe': 1 files missing 2026/02/04 04:49:14 NOTICE: drime root 'rclone-test-sotumoj6jofe': 0 differences found 2026/02/04 04:49:14 NOTICE: drime root 'rclone-test-sotumoj6jofe': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:599 Error: Received unexpected error: file not in drime root 'rclone-test-sotumoj6jofe' Test: TestApplyTransforms Messages: unexpected error for NFC checkfile vs. NFD remote (with normalization) 測試_Русский___ě_áñ 測試_Русский___ě_áñ 2026/02/04 04:49:14 DEBUG : Creating backend with remote "TestDrime:rclone-test-zuyujop4zumu" 2026/02/04 04:49:14 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:49:15 DEBUG : Creating backend with remote "/tmp/rclone105805249" run.go:185: Remote "drime root 'rclone-test-zuyujop4zumu'", Local "Local file system at /tmp/rclone105805249", Modify Window "876000h0m0s" NFDx2 checkfile vs. both remote (without normalization) 2026/02/04 04:49:21 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-zuyujop4zumu' 2026/02/04 04:49:21 NOTICE: drime root 'rclone-test-zuyujop4zumu': 1 files missing 2026/02/04 04:49:21 NOTICE: drime root 'rclone-test-zuyujop4zumu': 0 differences found 2026/02/04 04:49:21 NOTICE: drime root 'rclone-test-zuyujop4zumu': 1 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2026/02/04 04:49:21 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-zuyujop4zumu' 2026/02/04 04:49:21 NOTICE: drime root 'rclone-test-zuyujop4zumu': 1 files missing 2026/02/04 04:49:21 NOTICE: drime root 'rclone-test-zuyujop4zumu': 0 differences found 2026/02/04 04:49:21 NOTICE: drime root 'rclone-test-zuyujop4zumu': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:600 Error: Received unexpected error: file not in drime root 'rclone-test-zuyujop4zumu' Test: TestApplyTransforms Messages: unexpected error for NFDx2 checkfile vs. both remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/04 04:49:21 DEBUG : Creating backend with remote "TestDrime:rclone-test-cokumoz1baqe" 2026/02/04 04:49:21 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:49:22 DEBUG : Creating backend with remote "/tmp/rclone3866710448" run.go:185: Remote "drime root 'rclone-test-cokumoz1baqe'", Local "Local file system at /tmp/rclone3866710448", Modify Window "876000h0m0s" NFCx2 checkfile vs. both remote (without normalization) 2026/02/04 04:49:27 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-cokumoz1baqe' 2026/02/04 04:49:27 NOTICE: drime root 'rclone-test-cokumoz1baqe': 1 files missing 2026/02/04 04:49:27 NOTICE: drime root 'rclone-test-cokumoz1baqe': 0 differences found 2026/02/04 04:49:27 NOTICE: drime root 'rclone-test-cokumoz1baqe': 1 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2026/02/04 04:49:27 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-cokumoz1baqe' 2026/02/04 04:49:27 NOTICE: drime root 'rclone-test-cokumoz1baqe': 1 files missing 2026/02/04 04:49:27 NOTICE: drime root 'rclone-test-cokumoz1baqe': 0 differences found 2026/02/04 04:49:27 NOTICE: drime root 'rclone-test-cokumoz1baqe': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:601 Error: Received unexpected error: file not in drime root 'rclone-test-cokumoz1baqe' Test: TestApplyTransforms Messages: unexpected error for NFCx2 checkfile vs. both remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/04 04:49:27 DEBUG : Creating backend with remote "TestDrime:rclone-test-menoxaz0dubo" 2026/02/04 04:49:27 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:49:28 DEBUG : Creating backend with remote "/tmp/rclone833252335" run.go:185: Remote "drime root 'rclone-test-menoxaz0dubo'", Local "Local file system at /tmp/rclone833252335", Modify Window "876000h0m0s" both checkfile vs. NFDx2 remote (without normalization) 2026/02/04 04:49:36 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-menoxaz0dubo' 2026/02/04 04:49:36 NOTICE: drime root 'rclone-test-menoxaz0dubo': 1 files missing 2026/02/04 04:49:36 NOTICE: drime root 'rclone-test-menoxaz0dubo': 0 differences found 2026/02/04 04:49:36 NOTICE: drime root 'rclone-test-menoxaz0dubo': 1 errors while checking both checkfile vs. NFDx2 remote (with normalization) 2026/02/04 04:49:36 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-menoxaz0dubo' 2026/02/04 04:49:36 NOTICE: drime root 'rclone-test-menoxaz0dubo': 1 files missing 2026/02/04 04:49:36 NOTICE: drime root 'rclone-test-menoxaz0dubo': 0 differences found 2026/02/04 04:49:36 NOTICE: drime root 'rclone-test-menoxaz0dubo': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:602 Error: Received unexpected error: file not in drime root 'rclone-test-menoxaz0dubo' Test: TestApplyTransforms Messages: unexpected error for both checkfile vs. NFDx2 remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/04 04:49:36 DEBUG : Creating backend with remote "TestDrime:rclone-test-zatisec1qiwe" 2026/02/04 04:49:36 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 04:49:36 DEBUG : Creating backend with remote "/tmp/rclone1131271248" run.go:185: Remote "drime root 'rclone-test-zatisec1qiwe'", Local "Local file system at /tmp/rclone1131271248", Modify Window "876000h0m0s" both checkfile vs. NFCx2 remote (without normalization) 2026/02/04 04:49:42 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-zatisec1qiwe' 2026/02/04 04:49:42 NOTICE: drime root 'rclone-test-zatisec1qiwe': 1 files missing 2026/02/04 04:49:42 NOTICE: drime root 'rclone-test-zatisec1qiwe': 0 differences found 2026/02/04 04:49:42 NOTICE: drime root 'rclone-test-zatisec1qiwe': 1 errors while checking both checkfile vs. NFCx2 remote (with normalization) 2026/02/04 04:49:43 ERROR : 測試_русский___ě_áñ測試_русский___ě_áñ: file not in drime root 'rclone-test-zatisec1qiwe' 2026/02/04 04:49:43 NOTICE: drime root 'rclone-test-zatisec1qiwe': 1 files missing 2026/02/04 04:49:43 NOTICE: drime root 'rclone-test-zatisec1qiwe': 0 differences found 2026/02/04 04:49:43 NOTICE: drime root 'rclone-test-zatisec1qiwe': 1 errors while checking check_test.go:591: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:591 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:603 Error: Received unexpected error: file not in drime root 'rclone-test-zatisec1qiwe' Test: TestApplyTransforms Messages: unexpected error for both checkfile vs. NFCx2 remote (with normalization) 測試_Русский___ě_áñ測試_Русский___ě_áñ 測試_Русский___ě_áñ測試_Русский___ě_áñ 2026/02/04 04:49:43 DEBUG : drime root 'rclone-test-zatisec1qiwe': Purge remote 2026/02/04 04:49:44 DEBUG : drime root 'rclone-test-menoxaz0dubo': Purge remote 2026/02/04 04:49:44 DEBUG : drime root 'rclone-test-cokumoz1baqe': Purge remote 2026/02/04 04:49:44 DEBUG : drime root 'rclone-test-zuyujop4zumu': Purge remote 2026/02/04 04:49:45 DEBUG : drime root 'rclone-test-sotumoj6jofe': Purge remote 2026/02/04 04:49:45 DEBUG : drime root 'rclone-test-wivekos5fagi': Purge remote 2026/02/04 04:49:46 DEBUG : drime root 'rclone-test-deziyir3talu': Purge remote 2026/02/04 04:49:46 DEBUG : drime root 'rclone-test-mufolok5vaci': Purge remote 2026/02/04 04:49:46 DEBUG : drime root 'rclone-test-fuponil4nuda': Purge remote 2026/02/04 04:49:47 DEBUG : drime root 'rclone-test-vunukon3juga': Purge remote --- FAIL: TestApplyTransforms (81.52s) === RUN TestTruncateString --- PASS: TestTruncateString (0.00s) === RUN TestCopyFile run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:49:48 DEBUG : file1: Need to transfer - File not found at Destination 2026/02/04 04:49:54 DEBUG : sub/file2: size = 14 OK 2026/02/04 04:49:54 INFO : file1: Copied (new) to: sub/file2 2026/02/04 04:49:56 DEBUG : sub/file2: size = 14 OK 2026/02/04 04:49:56 DEBUG : file1: Sizes identical 2026/02/04 04:49:56 DEBUG : file1: Unchanged skipping 2026/02/04 04:49:56 DEBUG : drime root 'rclone-test-niyaxaf7reza': don't need to copy/move sub/file2, it is already at target location run.go:130: removing dir "sub" failed - try 1/3: directory not empty run.go:130: removing dir "sub" failed - try 2/3: directory not empty run.go:130: removing dir "sub" failed - try 3/3: directory not empty run.go:133: removing dir "sub" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=3) "sub" } Test: TestCopyFile Messages: directories --- FAIL: TestCopyFile (24.53s) === RUN TestCopyLongFile run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" copy_test.go:154: Test only runs on local fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- SKIP: TestCopyLongFile (9.67s) === RUN TestCopyFileBackupDir run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/02/04 04:50:34 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/backup" 2026/02/04 04:50:35 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone4055517313) 2026/02/04 04:50:35 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-niyaxaf7reza') 2026/02/04 04:50:35 DEBUG : dst/file1: Sizes differ 2026/02/04 04:50:37 INFO : dst/file1: Moved (server-side) 2026/02/04 04:50:43 DEBUG : dst/file1: Removing old object on successful upload 2026/02/04 04:50:44 DEBUG : dst/file1: size = 14 OK 2026/02/04 04:50:44 INFO : dst/file1: Copied (new) 2026/02/04 04:50:46 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:50:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 04:50:46 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:50:46 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 04:50:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:50:47 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 04:50:47 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:50:47 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 04:50:48 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:50:48 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 04:50:48 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:50:48 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 04:50:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:50:48 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 04:50:49 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:50:49 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 04:50:50 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:50:50 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 04:50:53 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 04:50:53 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "backup/dst/file1" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 04:50:58 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:50:58 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 04:51:08 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:51:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:51:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:52:08 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:52:29 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:52:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:53:09 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:53:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:53:49 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "backup/dst/file1" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 04:54:09 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 04:54:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 04:54:49 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 04:55:09 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 04:55:29 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 04:55:49 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 04:56:09 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 04:56:29 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 04:56:49 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 04:57:09 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "backup/dst/file1" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "backup/dst/file1" failed: failed to delete item: Error "Server Error" 2026/02/04 04:57:29 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 04:57:49 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 04:57:59 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/04 04:58:04 DEBUG : pacer: Reducing sleep to 1.25s 2026/02/04 04:58:06 DEBUG : pacer: Reducing sleep to 625ms 2026/02/04 04:58:08 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/04 04:58:08 DEBUG : pacer: Reducing sleep to 156.25ms --- PASS: TestCopyFileBackupDir (466.26s) === RUN TestCopyFileCompareDest run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 04:58:08 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/dst" 2026/02/04 04:58:08 DEBUG : Config file has changed externally - reloading 2026/02/04 04:58:10 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/CompareDest" 2026/02/04 04:58:11 DEBUG : one: Need to transfer - File not found at Destination 2026/02/04 04:58:16 DEBUG : one: size = 3 OK 2026/02/04 04:58:16 INFO : one: Copied (new) 2026/02/04 04:58:17 DEBUG : pacer: Reducing sleep to 78.125ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/04 04:58:18 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/04 04:58:19 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/04 04:58:20 DEBUG : pacer: Reducing sleep to 10ms fstest.go:292: Sleeping for 6s just to make sure 2026/02/04 04:58:28 DEBUG : one: size = 5 (Local file system at /tmp/rclone4055517313) 2026/02/04 04:58:28 DEBUG : one: size = 3 (drime root 'rclone-test-niyaxaf7reza/dst') 2026/02/04 04:58:28 DEBUG : one: Sizes differ 2026/02/04 04:58:36 DEBUG : one: Removing old object on successful upload 2026/02/04 04:58:36 DEBUG : one: size = 5 OK 2026/02/04 04:58:36 INFO : one: Copied (replaced existing) 2026/02/04 04:58:44 DEBUG : dst/one: Removing old object on successful upload 2026/02/04 04:58:50 DEBUG : one: size = 5 (Local file system at /tmp/rclone4055517313) 2026/02/04 04:58:50 DEBUG : one: size = 3 (drime root 'rclone-test-niyaxaf7reza/dst') 2026/02/04 04:58:50 DEBUG : one: Sizes differ 2026/02/04 04:58:52 DEBUG : one: Removing old object on successful upload 2026/02/04 04:58:52 DEBUG : one: size = 5 OK 2026/02/04 04:58:52 INFO : one: Copied (replaced existing) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:242 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want CompareDest/one (5), CompareDest/two (3), dst/one (3) got CompareDest/one (5), CompareDest/two (3), dst/one (5) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:242 Error: Not equal: expected: 3 actual : 5 Test: TestCopyFileCompareDest Messages: dst/one: size incorrect file=3 vs obj=5 2026/02/04 04:59:10 DEBUG : two: Need to transfer - File not found at Destination 2026/02/04 04:59:12 DEBUG : two: size = 3 OK 2026/02/04 04:59:12 DEBUG : two: Sizes identical 2026/02/04 04:59:12 DEBUG : two: Destination found in --compare-dest, skipping fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:248 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want CompareDest/one (5), CompareDest/two (3), dst/one (3) got CompareDest/one (5), CompareDest/two (3), dst/one (5) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:248 Error: Not equal: expected: 3 actual : 5 Test: TestCopyFileCompareDest Messages: dst/one: size incorrect file=3 vs obj=5 2026/02/04 04:59:24 DEBUG : two: Need to transfer - File not found at Destination 2026/02/04 04:59:25 DEBUG : two: size = 3 OK 2026/02/04 04:59:25 DEBUG : two: Sizes identical 2026/02/04 04:59:25 DEBUG : two: Destination found in --compare-dest, skipping fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:254 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want CompareDest/one (5), CompareDest/two (3), dst/one (3) got CompareDest/one (5), CompareDest/two (3), dst/one (5) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:254 Error: Not equal: expected: 3 actual : 5 Test: TestCopyFileCompareDest Messages: dst/one: size incorrect file=3 vs obj=5 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:258 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want CompareDest/one (5), CompareDest/two (3), dst/one (3) got CompareDest/one (5), CompareDest/two (3), dst/one (5) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:258 Error: Not equal: expected: 3 actual : 5 Test: TestCopyFileCompareDest Messages: dst/one: size incorrect file=3 vs obj=5 2026/02/04 04:59:47 DEBUG : two: Need to transfer - File not found at Destination 2026/02/04 04:59:47 DEBUG : two: size = 5 (Local file system at /tmp/rclone4055517313) 2026/02/04 04:59:47 DEBUG : two: size = 3 (drime root 'rclone-test-niyaxaf7reza/CompareDest') 2026/02/04 04:59:47 DEBUG : two: Sizes differ 2026/02/04 04:59:50 DEBUG : two: size = 5 OK 2026/02/04 04:59:50 INFO : two: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:267 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want CompareDest/one (5), CompareDest/two (3), dst/one (3), dst/two (5) got CompareDest/one (5), CompareDest/two (3), dst/one (5) fstest.go:150: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:150 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:195 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:267 Error: Not equal: expected: 3 actual : 5 Test: TestCopyFileCompareDest Messages: dst/one: size incorrect file=3 vs obj=5 fstest.go:203: Not found "dst/two" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:267 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCompareDest Messages: 1 objects not found run.go:130: removing dir "dst" failed - try 1/3: directory not empty run.go:130: removing dir "dst" failed - try 2/3: directory not empty run.go:130: removing dir "dst" failed - try 3/3: directory not empty run.go:133: removing dir "dst" failed: directory not empty run.go:130: removing dir "CompareDest" failed - try 1/3: directory not empty run.go:130: removing dir "CompareDest" failed - try 2/3: directory not empty run.go:130: removing dir "CompareDest" failed - try 3/3: directory not empty run.go:133: removing dir "CompareDest" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"CompareDest", "dst"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=11) "CompareDest", + (string) (len=3) "dst" } Test: TestCopyFileCompareDest Messages: directories --- FAIL: TestCopyFileCompareDest (136.08s) === RUN TestCopyFileCopyDest run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:00:24 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/dst" 2026/02/04 05:00:25 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/CopyDest" 2026/02/04 05:00:26 DEBUG : one: Need to transfer - File not found at Destination 2026/02/04 05:00:30 DEBUG : one: size = 3 OK 2026/02/04 05:00:30 INFO : one: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/04 05:00:45 DEBUG : one: size = 5 (Local file system at /tmp/rclone4055517313) 2026/02/04 05:00:45 DEBUG : one: size = 3 (drime root 'rclone-test-niyaxaf7reza/dst') 2026/02/04 05:00:45 DEBUG : one: Sizes differ 2026/02/04 05:00:55 DEBUG : one: Removing old object on successful upload 2026/02/04 05:00:55 DEBUG : one: size = 5 OK 2026/02/04 05:00:55 INFO : one: Copied (replaced existing) 2026/02/04 05:01:01 DEBUG : dst/one: Removing old object on successful upload 2026/02/04 05:01:17 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/BackupDir" 2026/02/04 05:01:19 DEBUG : one: size = 5 (Local file system at /tmp/rclone4055517313) 2026/02/04 05:01:19 DEBUG : one: size = 3 (drime root 'rclone-test-niyaxaf7reza/dst') 2026/02/04 05:01:19 DEBUG : one: Sizes differ 2026/02/04 05:01:20 DEBUG : one: size = 5 OK 2026/02/04 05:01:20 DEBUG : one: Sizes identical 2026/02/04 05:01:20 DEBUG : one: size = 5 (Local file system at /tmp/rclone4055517313) 2026/02/04 05:01:20 DEBUG : one: size = 3 (drime root 'rclone-test-niyaxaf7reza/dst') 2026/02/04 05:01:20 DEBUG : one: Sizes differ 2026/02/04 05:01:21 INFO : one: Moved (server-side) 2026/02/04 05:01:22 DEBUG : one: Server side copy: removing existing object after successful copy 2026/02/04 05:01:23 DEBUG : one: size = 5 OK 2026/02/04 05:01:23 INFO : one: Copied (server-side copy) 2026/02/04 05:01:23 DEBUG : one: Destination found in --copy-dest, using server-side copy fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:333 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5) got CopyDest/one (5), CopyDest/two (3), dst/one (5) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:333 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/04 05:01:55 DEBUG : two: Need to transfer - File not found at Destination 2026/02/04 05:01:56 DEBUG : two: size = 3 OK 2026/02/04 05:01:56 DEBUG : two: Sizes identical 2026/02/04 05:01:56 DEBUG : two: size = 3 OK 2026/02/04 05:01:56 INFO : two: Copied (server-side copy) 2026/02/04 05:01:56 DEBUG : two: Destination found in --copy-dest, using server-side copy fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:342 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:342 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/04 05:02:07 DEBUG : two: size = 3 OK 2026/02/04 05:02:07 DEBUG : two: Sizes identical 2026/02/04 05:02:07 DEBUG : two: Unchanged skipping fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:348 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:348 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:353 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/two (3) got CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:353 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found 2026/02/04 05:02:37 DEBUG : three: Need to transfer - File not found at Destination 2026/02/04 05:02:37 DEBUG : three: size = 7 (Local file system at /tmp/rclone4055517313) 2026/02/04 05:02:37 DEBUG : three: size = 5 (drime root 'rclone-test-niyaxaf7reza/CopyDest') 2026/02/04 05:02:37 DEBUG : three: Sizes differ 2026/02/04 05:02:37 DEBUG : three: Destination not found in --copy-dest 2026/02/04 05:02:42 DEBUG : three: size = 7 OK 2026/02/04 05:02:42 INFO : three: Copied (new) fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:362 Error: Should be true Test: TestCopyFileCopyDest Messages: listing wrong, want BackupDir/one (3), CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/three (7), dst/two (3) got CopyDest/one (5), CopyDest/three (5), CopyDest/two (3), dst/one (5), dst/three (7), dst/two (3) fstest.go:203: Not found "BackupDir/one" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:362 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileCopyDest Messages: 1 objects not found run.go:130: removing dir "CopyDest" failed - try 1/3: directory not empty run.go:130: removing dir "CopyDest" failed - try 2/3: directory not empty run.go:130: removing dir "CopyDest" failed - try 3/3: directory not empty run.go:133: removing dir "CopyDest" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"CopyDest"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=8) "CopyDest" } Test: TestCopyFileCopyDest Messages: directories --- FAIL: TestCopyFileCopyDest (172.29s) === RUN TestCopyInplace run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" copy_test.go:371: Partial uploads not supported fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- SKIP: TestCopyInplace (9.91s) === RUN TestCopyLongFileName run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" copy_test.go:404: Partial uploads not supported --- SKIP: TestCopyLongFileName (0.51s) === RUN TestCopyLongFileNameCollision run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" copy_test.go:437: Partial uploads not supported --- SKIP: TestCopyLongFileNameCollision (0.51s) === RUN TestCopyFileMaxTransfer run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:03:27 DEBUG : TestCopyFileMaxTransfer/file1: Need to transfer - File not found at Destination 2026/02/04 05:03:32 DEBUG : TestCopyFileMaxTransfer/file1: size = 14 OK 2026/02/04 05:03:32 INFO : TestCopyFileMaxTransfer/file1: Copied (new) 2026/02/04 05:03:32 DEBUG : TestCopyFileMaxTransfer/file2: Need to transfer - File not found at Destination 2026/02/04 05:03:33 ERROR : TestCopyFileMaxTransfer/file2: Failed to copy: failed to upload file: Post "https://app.drime.cloud/api/v1/uploads": failed to copy data: max transfer limit reached as set by --max-transfer 2026/02/04 05:03:33 DEBUG : TestCopyFileMaxTransfer/file3: Need to transfer - File not found at Destination 2026/02/04 05:03:34 DEBUG : TestCopyFileMaxTransfer/file4: Need to transfer - File not found at Destination 2026/02/04 05:03:44 DEBUG : TestCopyFileMaxTransfer/file4: size = 2062 OK 2026/02/04 05:03:44 INFO : TestCopyFileMaxTransfer/file4: Copied (new) run.go:130: removing dir "TestCopyFileMaxTransfer" failed - try 1/3: directory not empty run.go:130: removing dir "TestCopyFileMaxTransfer" failed - try 2/3: directory not empty run.go:130: removing dir "TestCopyFileMaxTransfer" failed - try 3/3: directory not empty run.go:133: removing dir "TestCopyFileMaxTransfer" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"TestCopyFileMaxTransfer"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=23) "TestCopyFileMaxTransfer" } Test: TestCopyFileMaxTransfer Messages: directories --- FAIL: TestCopyFileMaxTransfer (31.88s) === RUN TestDeduplicateInteractive run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure --- SKIP: TestDeduplicateInteractive (15.25s) === RUN TestDeduplicateSkip run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSkip (0.98s) === RUN TestDeduplicateSizeOnly run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSizeOnly (0.81s) === RUN TestDeduplicateFirst run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateFirst (0.66s) === RUN TestDeduplicateNewest run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateNewest (0.73s) === RUN TestDeduplicateNewestByHash run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:36: Can't run this test without a hash --- SKIP: TestDeduplicateNewestByHash (0.58s) === RUN TestDeduplicateOldest run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateOldest (0.72s) === RUN TestDeduplicateLargest run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateLargest (0.65s) === RUN TestDeduplicateSmallest run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSmallest (1.29s) === RUN TestDeduplicateRename run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateRename (1.05s) === RUN TestMergeDirs run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" dedupe_test.go:256: Can't merge directories --- SKIP: TestMergeDirs (1.09s) === RUN TestListDirSorted run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:05:12 DEBUG : a.txt: Excluded (Size Filter) 2026/02/04 05:05:12 DEBUG : a.txt: Excluded 2026/02/04 05:05:12 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/04 05:05:12 DEBUG : sub dir/hello world2: Excluded 2026/02/04 05:05:12 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/04 05:05:12 DEBUG : sub dir/hello world: Excluded 2026/02/04 05:05:13 DEBUG : sub dir/ignore dir: Excluded 2026/02/04 05:05:13 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/04 05:05:13 DEBUG : sub dir/hello world2: Excluded 2026/02/04 05:05:13 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/04 05:05:13 DEBUG : sub dir/hello world: Excluded 2026/02/04 05:05:14 DEBUG : sub dir/ignore dir: Excluded run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty --- PASS: TestListDirSorted (62.06s) === RUN TestListDirSortedFn run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:06:33 DEBUG : a.txt: Excluded (Size Filter) 2026/02/04 05:06:33 DEBUG : a.txt: Excluded 2026/02/04 05:06:35 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/04 05:06:35 DEBUG : sub dir/hello world2: Excluded 2026/02/04 05:06:35 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/04 05:06:35 DEBUG : sub dir/hello world: Excluded 2026/02/04 05:06:36 DEBUG : sub dir/ignore dir: Excluded 2026/02/04 05:06:36 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/02/04 05:06:36 DEBUG : sub dir/hello world2: Excluded 2026/02/04 05:06:36 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/02/04 05:06:36 DEBUG : sub dir/hello world: Excluded 2026/02/04 05:06:36 DEBUG : sub dir/ignore dir: Excluded --- PASS: TestListDirSortedFn (86.95s) === RUN TestListJSON run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" === RUN TestListJSON/Default === RUN TestListJSON/FilesOnly === RUN TestListJSON/DirsOnly === RUN TestListJSON/Recurse === RUN TestListJSON/SubDir === RUN TestListJSON/NoModTime === RUN TestListJSON/NoMimeType === RUN TestListJSON/ShowHash === RUN TestListJSON/HashTypes 2026/02/04 05:07:16 ERROR : file1: Failed to read hash: hash type not supported === RUN TestListJSON/Metadata === NAME TestListJSON run.go:130: removing dir "sub" failed - try 1/3: directory not empty run.go:130: removing dir "sub" failed - try 2/3: directory not empty --- PASS: TestListJSON (30.93s) --- PASS: TestListJSON/Default (0.45s) --- PASS: TestListJSON/FilesOnly (0.41s) --- PASS: TestListJSON/DirsOnly (0.25s) --- PASS: TestListJSON/Recurse (0.66s) --- PASS: TestListJSON/SubDir (0.44s) --- PASS: TestListJSON/NoModTime (0.59s) --- PASS: TestListJSON/NoMimeType (0.50s) --- PASS: TestListJSON/ShowHash (0.38s) --- PASS: TestListJSON/HashTypes (0.65s) --- PASS: TestListJSON/Metadata (0.53s) === RUN TestStatJSON run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/DirWithTrailingSlash === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2026/02/04 05:07:40 DEBUG : Creating backend with remote "TestDrime:rclone-test-niyaxaf7reza/notfound" 2026/02/04 05:07:40 DEBUG : Config file has changed externally - reloading === NAME TestStatJSON run.go:130: removing dir "sub" failed - try 1/3: directory not empty --- PASS: TestStatJSON (25.44s) --- PASS: TestStatJSON/Root (0.24s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.24s) --- PASS: TestStatJSON/Dir (0.71s) --- PASS: TestStatJSON/DirWithTrailingSlash (0.27s) --- PASS: TestStatJSON/File (0.43s) --- PASS: TestStatJSON/NotFound (0.56s) --- PASS: TestStatJSON/DirFilesOnly (0.31s) --- PASS: TestStatJSON/FileFilesOnly (0.34s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.39s) --- PASS: TestStatJSON/DirDirsOnly (0.57s) --- PASS: TestStatJSON/FileDirsOnly (0.32s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.30s) --- PASS: TestStatJSON/RootNotFound (2.65s) === RUN TestMkdir run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:07:48 INFO : drime root 'rclone-test-niyaxaf7reza': Making directory 2026/02/04 05:07:49 INFO : drime root 'rclone-test-niyaxaf7reza': Making directory --- PASS: TestMkdir (1.15s) === RUN TestLsd run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestLsd Messages: directories --- FAIL: TestLsd (25.28s) === RUN TestLs run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: listing wrong, want got empty space (1), potato2 (60) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: Unexpected file "empty space" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestLs Messages: Unexpected file "potato2" fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestLs Messages: directories --- FAIL: TestLs (21.83s) === RUN TestLsWithFilesFrom run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/02/04 05:08:53 DEBUG : empty space: Excluded (FilesFrom Filter) 2026/02/04 05:08:53 DEBUG : empty space: Excluded fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure --- PASS: TestLsWithFilesFrom (29.94s) === RUN TestLsLong run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestLsLong (33.83s) === RUN TestHashSums run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:186 Error: Should be true Test: TestHashSums Messages: listing wrong, want empty space (1), potato2 (60) got potato2 (60) fstest.go:203: Not found "empty space" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:186 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestHashSums Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestHashSums Messages: listing wrong, want got empty space (1), potato2 (60) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestHashSums Messages: Unexpected file "empty space" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestHashSums Messages: Unexpected file "potato2" --- FAIL: TestHashSums (28.10s) === RUN TestHashSumsWithErrors 2026/02/04 05:10:08 DEBUG : Creating backend with remote ":memory:" 2026/02/04 05:10:08 ERROR : file1: hash unsupported: hash type not supported --- PASS: TestHashSumsWithErrors (0.00s) === RUN TestHashStream 2026/02/04 05:10:08 DEBUG : Creating md5 hash of 0 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating md5 hash of 0 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating md5 hash of 12 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating md5 hash of 12 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating sha1 hash of 12 bytes read from input stream 2026/02/04 05:10:08 DEBUG : Creating sha1 hash of 12 bytes read from input stream --- PASS: TestHashStream (0.00s) === RUN TestSuffixName --- PASS: TestSuffixName (0.00s) === RUN TestCount run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:10:14 DEBUG : potato2: Removing old object on successful upload 2026/02/04 05:10:14 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:10:14 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 05:10:14 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:10:14 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 05:10:14 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:10:14 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 05:10:15 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:10:15 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 05:10:15 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:10:15 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 05:10:15 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:10:15 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 05:10:16 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:10:16 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 05:10:16 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:10:16 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 05:10:18 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:10:18 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 05:10:20 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 05:10:20 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:286: Retry Put of "potato2" to drime root 'rclone-test-niyaxaf7reza': 1/10 (failed to delete existing object: failed to delete item: Error "Server Error") 2026/02/04 05:10:25 DEBUG : pacer: Reducing sleep to 5.12s 2026/02/04 05:10:40 DEBUG : pacer: Reducing sleep to 2.56s 2026/02/04 05:10:40 DEBUG : potato2: Removing old object on successful upload 2026/02/04 05:10:41 DEBUG : pacer: Reducing sleep to 1.28s 2026/02/04 05:10:43 DEBUG : pacer: Reducing sleep to 640ms 2026/02/04 05:10:49 DEBUG : pacer: Reducing sleep to 320ms 2026/02/04 05:10:50 DEBUG : pacer: Reducing sleep to 160ms 2026/02/04 05:10:50 DEBUG : pacer: Reducing sleep to 80ms 2026/02/04 05:10:51 DEBUG : pacer: Reducing sleep to 40ms 2026/02/04 05:10:54 DEBUG : pacer: Reducing sleep to 20ms 2026/02/04 05:10:55 DEBUG : pacer: Reducing sleep to 10ms run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty run.go:130: removing dir "sub dir" failed - try 2/3: directory not empty run.go:130: removing dir "sub dir" failed - try 3/3: directory not empty run.go:133: removing dir "sub dir" failed: directory not empty fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestCount Messages: directories --- FAIL: TestCount (62.55s) === RUN TestDelete run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:419 Error: Should be true Test: TestDelete Messages: listing wrong, want large (100), medium (60), small (10) got medium (60), small (10) fstest.go:203: Not found "large" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:419 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestDelete Messages: 1 objects not found 2026/02/04 05:11:41 DEBUG : Waiting for deletions to finish 2026/02/04 05:11:42 DEBUG : large: Excluded (Size Filter) 2026/02/04 05:11:42 DEBUG : large: Excluded 2026/02/04 05:11:42 INFO : small: Deleted 2026/02/04 05:11:42 INFO : medium: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:423 Error: Should be true Test: TestDelete Messages: listing wrong, want large (100) got large (100), medium (60), small (10) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:423 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestDelete Messages: Unexpected file "medium" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:423 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestDelete Messages: Unexpected file "small" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestDelete Messages: listing wrong, want got large (100) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Should be true Test: TestDelete Messages: Unexpected file "large" fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 Error: Not equal: expected: []string{} actual : []string{"sub dir"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) { +([]string) (len=1) { + (string) (len=7) "sub dir" } Test: TestDelete Messages: directories --- FAIL: TestDelete (51.99s) === RUN TestMaxDelete run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/04 05:12:38 DEBUG : Waiting for deletions to finish 2026/02/04 05:12:39 ERROR : small: Got fatal error on delete: --max-delete threshold reached 2026/02/04 05:12:39 INFO : medium: Deleted 2026/02/04 05:12:40 INFO : large: Deleted operations_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:453 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDelete 2026/02/04 05:12:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:12:41 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 05:12:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:12:41 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 05:12:42 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:12:42 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 05:12:42 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:12:42 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 05:12:43 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:12:43 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 05:12:43 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:12:43 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 05:12:43 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:12:43 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 05:12:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:12:44 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 05:12:46 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:12:46 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 05:12:48 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 05:12:48 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 05:12:53 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:12:53 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 05:13:03 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:13:24 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:13:43 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:14:03 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:14:23 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:14:44 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:15:03 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:15:23 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:15:43 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 05:16:03 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:16:23 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:16:43 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:17:03 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:17:24 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:17:43 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:18:03 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:18:23 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:18:43 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:19:03 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "large" failed: failed to delete item: Error "Server Error" 2026/02/04 05:19:23 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:19:43 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:20:04 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:20:23 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:20:43 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:21:03 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:21:23 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:21:43 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:22:03 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:22:23 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 05:22:43 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:23:03 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:23:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:23:43 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:24:03 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:24:23 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:24:44 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:25:03 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:25:24 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:25:44 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 05:26:03 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:26:24 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:26:43 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:27:03 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:27:23 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:27:44 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:28:03 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:28:23 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:28:43 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:29:03 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/04 05:29:24 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 05:29:43 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 05:29:53 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/04 05:29:58 DEBUG : pacer: Reducing sleep to 1.25s --- FAIL: TestMaxDelete (1075.17s) === RUN TestMaxDeleteSizeLargeFile run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:30:01 DEBUG : pacer: Reducing sleep to 625ms 2026/02/04 05:30:10 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/04 05:30:10 DEBUG : pacer: Reducing sleep to 156.25ms 2026/02/04 05:30:15 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/04 05:30:16 DEBUG : pacer: Reducing sleep to 39.0625ms 2026/02/04 05:30:26 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/04 05:30:26 DEBUG : pacer: Reducing sleep to 10ms 2026/02/04 05:30:26 DEBUG : Waiting for deletions to finish 2026/02/04 05:30:26 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached 2026/02/04 05:30:27 INFO : small: Deleted 2026/02/04 05:30:27 INFO : medium: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: listing wrong, want large (100) got large (100), medium (60), small (10) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "medium" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:472 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "small" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:473 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: listing wrong, want got large (100) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:473 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestMaxDeleteSizeLargeFile Messages: Unexpected file "large" --- FAIL: TestMaxDeleteSizeLargeFile (50.32s) === RUN TestMaxDeleteSize run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/04 05:31:27 DEBUG : Waiting for deletions to finish 2026/02/04 05:31:27 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/02/04 05:31:28 INFO : medium: Deleted 2026/02/04 05:31:28 INFO : large: Deleted operations_test.go:492: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:492 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDeleteSize 2026/02/04 05:31:29 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:31:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 05:31:30 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:31:30 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 05:31:30 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:31:30 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 05:31:30 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:31:30 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 05:31:30 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:31:30 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 05:31:31 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:31:31 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 05:31:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:31:31 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 05:31:32 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:31:32 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 05:31:33 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:31:33 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 05:31:35 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 05:31:35 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 05:31:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:31:41 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 05:31:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:32:11 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:32:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:32:51 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:33:11 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:33:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:33:51 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:34:11 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:34:31 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 05:34:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:35:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:35:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:35:51 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:36:11 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:36:31 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:36:51 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:37:11 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:37:31 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:37:51 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "large" failed: failed to delete item: Error "Server Error" 2026/02/04 05:38:11 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:38:31 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:38:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:39:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:39:31 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:39:51 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:40:11 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:40:31 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:40:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:41:11 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 05:41:31 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:41:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:42:11 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:42:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:42:51 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:43:11 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:43:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:43:51 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:44:11 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:44:31 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 05:44:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:45:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:45:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:45:51 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:46:11 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:46:31 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:46:51 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:47:11 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:47:31 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:47:51 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing file "medium" failed: failed to delete item: Error "Server Error" 2026/02/04 05:48:11 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 05:48:31 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 05:48:41 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/04 05:48:46 DEBUG : pacer: Reducing sleep to 1.25s --- FAIL: TestMaxDeleteSize (1077.39s) === RUN TestReadFile run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:48:48 DEBUG : pacer: Reducing sleep to 625ms 2026/02/04 05:48:55 DEBUG : pacer: Reducing sleep to 312.5ms 2026/02/04 05:48:55 DEBUG : pacer: Reducing sleep to 156.25ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache 2026/02/04 05:48:56 DEBUG : pacer: Reducing sleep to 78.125ms 2026/02/04 05:48:57 DEBUG : pacer: Reducing sleep to 39.0625ms fstest.go:292: Sleeping for 6s just to make sure 2026/02/04 05:49:03 DEBUG : pacer: Reducing sleep to 19.53125ms 2026/02/04 05:49:04 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure --- PASS: TestReadFile (31.04s) === RUN TestRetry 2026/02/04 05:49:17 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 1/5 2026/02/04 05:49:17 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 2/5 2026/02/04 05:49:17 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/02/04 05:49:17 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/02/04 05:49:17 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/02/04 05:49:17 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/02/04 05:49:17 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms --- PASS: TestRetry (0.05s) === RUN TestCat run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:545 Error: Should be true Test: TestCat Messages: listing wrong, want file1 (10), file2 (9) got file1 (10) fstest.go:203: Not found "file2" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:345 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:545 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Not equal: expected: 0 actual : 1 Test: TestCat Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure --- FAIL: TestCat (33.28s) === RUN TestPurge 2026/02/04 05:49:50 DEBUG : Creating backend with remote "TestDrime:rclone-test-canawum6pipu" 2026/02/04 05:49:50 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/04 05:49:51 DEBUG : Creating backend with remote "/tmp/rclone67465450" run.go:185: Remote "drime root 'rclone-test-canawum6pipu'", Local "Local file system at /tmp/rclone67465450", Modify Window "876000h0m0s" 2026/02/04 05:50:02 INFO : A2: Making directory 2026/02/04 05:50:02 INFO : A1/B2: Making directory 2026/02/04 05:50:03 INFO : A1/B2/C2: Making directory 2026/02/04 05:50:03 INFO : A1/B1/C3: Making directory 2026/02/04 05:50:04 INFO : A3: Making directory 2026/02/04 05:50:05 INFO : A3/B3: Making directory 2026/02/04 05:50:06 INFO : A3/B3/C4: Making directory fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:590 Error: Should be true Test: TestPurge Messages: listing wrong, want A1/B1/C1/one (3), A1/two (3) got A1/B1/C1/one (3) fstest.go:203: Not found "A1/two" fstest.go:206: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:206 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:310 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:590 Error: Not equal: expected: 0 actual : 1 Test: TestPurge Messages: 1 objects not found fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:301: Flushing the directory cache fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:633 Error: Should be true Test: TestPurge Messages: listing wrong, want got A1/two (3) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:633 Error: Should be true Test: TestPurge Messages: Unexpected file "A1/two" fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:633 Error: Not equal: expected: []string{} actual : []string{"A1", "A1/B2", "A1/B2/C2", "A2", "A3", "A3/B3", "A3/B3/C4"} Diff: --- Expected +++ Actual @@ -1,2 +1,9 @@ -([]string) { +([]string) (len=7) { + (string) (len=2) "A1", + (string) (len=5) "A1/B2", + (string) (len=8) "A1/B2/C2", + (string) (len=2) "A2", + (string) (len=2) "A3", + (string) (len=5) "A3/B3", + (string) (len=8) "A3/B3/C4" } Test: TestPurge Messages: directories 2026/02/04 05:50:37 DEBUG : drime root 'rclone-test-canawum6pipu': Purge remote 2026/02/04 05:50:37 NOTICE: purge failed: directory not found --- FAIL: TestPurge (46.80s) === RUN TestRmdirsNoLeaveRoot run.go:185: Remote "drime root 'rclone-test-niyaxaf7reza'", Local "Local file system at /tmp/rclone4055517313", Modify Window "876000h0m0s" 2026/02/04 05:50:46 INFO : A2: Making directory 2026/02/04 05:50:47 INFO : A1/B2: Making directory 2026/02/04 05:50:47 INFO : A1/B2/C2: Making directory 2026/02/04 05:50:48 INFO : A1/B1/C3: Making directory 2026/02/04 05:50:49 INFO : A3: Making directory 2026/02/04 05:50:50 INFO : A3/B3: Making directory 2026/02/04 05:50:50 INFO : A3/B3/C4: Making directory fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 7s just to make sure 2026/02/04 05:51:11 DEBUG : removing 1 level 3 directories 2026/02/04 05:51:11 INFO : A3/B3/C4: Removing directory 2026/02/04 05:51:14 DEBUG : removing 2 level 3 directories 2026/02/04 05:51:14 INFO : A1/B2/C2: Removing directory 2026/02/04 05:51:14 INFO : A1/B1/C3: Removing directory 2026/02/04 05:51:15 DEBUG : removing 2 level 2 directories 2026/02/04 05:51:15 INFO : A3/B3: Removing directory 2026/02/04 05:51:15 INFO : A1/B2: Removing directory 2026/02/04 05:51:15 ERROR : A1/B2: Failed to rmdir: directory not empty 2026/02/04 05:51:16 DEBUG : removing 2 level 1 directories 2026/02/04 05:51:16 INFO : A3: Removing directory 2026/02/04 05:51:16 INFO : A2: Removing directory 2026/02/04 05:51:16 ERROR : A3: Failed to rmdir: directory not empty operations_test.go:705: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 Error: Received unexpected error: failed to remove directories: 2 errors: last error: directory not empty Test: TestRmdirsNoLeaveRoot 2026/02/04 05:51:19 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:51:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/04 05:51:19 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:51:19 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/04 05:51:20 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:51:20 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/04 05:51:20 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:51:20 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/04 05:51:20 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:51:20 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/04 05:51:20 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:51:20 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/04 05:51:21 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:51:21 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/04 05:51:21 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:51:21 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/02/04 05:51:23 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:51:23 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/02/04 05:51:25 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/02/04 05:51:25 DEBUG : pacer: Rate limited, increasing sleep to 10.24s run.go:130: removing dir "A3/B3" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 05:51:30 DEBUG : pacer: Reducing sleep to 5.12s 2026/02/04 05:51:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:51:41 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/02/04 05:51:46 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:51:46 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 05:51:56 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:52:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:52:36 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:52:56 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:53:16 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:53:36 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:53:56 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:54:16 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A3/B3" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 05:54:36 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 05:54:56 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:54:56 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 05:55:06 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:55:26 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:55:46 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:56:06 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:56:26 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:56:46 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 05:57:06 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 05:57:26 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 05:57:46 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A3/B3" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing dir "A3/B3" failed: failed to delete item: Error "Server Error" 2026/02/04 05:58:06 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 05:58:26 DEBUG : pacer: Reducing sleep to 5s 2026/02/04 05:58:37 DEBUG : pacer: Reducing sleep to 2.5s 2026/02/04 05:58:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 05:58:41 DEBUG : pacer: Rate limited, increasing sleep to 5s 2026/02/04 05:58:44 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 05:58:44 DEBUG : pacer: Rate limited, increasing sleep to 10s 2026/02/04 05:58:49 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 05:58:49 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 05:58:59 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 05:59:19 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 05:59:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 05:59:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 06:00:19 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 06:00:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 06:00:59 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A2" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 06:01:19 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 06:01:39 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 06:01:39 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 06:01:49 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 06:02:09 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 06:02:29 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 06:02:49 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 06:03:09 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 06:03:29 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 06:03:49 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 06:04:09 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 06:04:29 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A2" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 06:04:49 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 06:05:09 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 06:05:09 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 06:05:19 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 06:05:39 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 06:05:59 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 06:06:19 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 06:06:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 06:06:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 06:07:20 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 06:07:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 06:07:59 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A2" failed - try 3/3: failed to delete item: Error "Server Error" run.go:133: removing dir "A2" failed: failed to delete item: Error "Server Error" 2026/02/04 06:08:19 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 06:08:40 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 06:08:40 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 06:08:50 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 06:09:09 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 06:09:29 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 06:09:49 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 06:10:10 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 06:10:29 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 06:10:49 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 06:11:09 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 06:11:29 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A1/B2/C2" failed - try 1/3: failed to delete item: Error "Server Error" 2026/02/04 06:11:49 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 06:12:10 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 06:12:10 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 06:12:19 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 06:12:40 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 06:13:00 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 06:13:20 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 06:13:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 06:14:00 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 06:14:19 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 06:14:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/02/04 06:15:00 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") run.go:130: removing dir "A1/B2/C2" failed - try 2/3: failed to delete item: Error "Server Error" 2026/02/04 06:15:19 DEBUG : pacer: Reducing sleep to 10s 2026/02/04 06:15:40 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/02/04 06:15:40 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/02/04 06:15:49 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/02/04 06:16:09 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/02/04 06:16:30 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/02/04 06:16:50 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/02/04 06:17:10 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/02/04 06:17:30 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/02/04 06:17:50 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/02/04 06:18:10 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") panic: test timed out after 2h0m0s running tests: TestRmdirsNoLeaveRoot (27m42s) goroutine 10404 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 27 minutes]: testing.(*T).Run(0xc000a7a1c0, {0x29883bd?, 0xc000787ad8?}, 0x2ad8798) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc000a7a1c0) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc000a7a1c0, 0xc000787c18) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc000a7c030, {0x44a3d80, 0x6f, 0x6f}, {0x849500?, 0x44df3c0?, 0x44bb600?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc000769cc0) /usr/local/go/src/testing/testing.go:2142 +0x64a github.com/rclone/rclone/fstest.TestMain(0xc000769cc0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:74 +0xa6 github.com/rclone/rclone/fs/operations_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:61 main.main() _testmain.go:269 +0xa9 goroutine 3313 [chan receive, 90 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 20 [syscall, 120 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 21 [chan receive, 120 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 9818 [chan receive]: github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc00038aea0, 0x0) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:162 +0x26 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc00038aea0, 0xc0008be380, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:215 +0xb2 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc00038aea0, 0xc0008be380) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:235 +0x93 github.com/rclone/rclone/backend/drime.(*Fs).deleteObject(0xc0005ba000, {0x2e7a9d8, 0x44dee20}, {0xc000597610, 0x9}) /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:703 +0x1eb github.com/rclone/rclone/backend/drime.(*Fs).purgeCheck(0xc0005ba000, {0x2e7a9d8, 0x44dee20}, {0xc000597678, 0x8}, 0x1) /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:744 +0x156 github.com/rclone/rclone/backend/drime.(*Fs).Rmdir(0x4?, {0x2e7a9d8?, 0x44dee20?}, {0xc000597678?, 0xc00048ce00?}) /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:757 +0x28 github.com/rclone/rclone/fstest.newRunIndividual.func1.2() /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:174 +0x30 github.com/rclone/rclone/fstest.retry(0xc000c4dc00, {0xc0006b8048, 0x17}, 0xc00006b920) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:126 +0xde github.com/rclone/rclone/fstest.newRunIndividual.func1() /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 +0x271 github.com/rclone/rclone/fstest.(*Run).Finalise(0xc000386540) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 +0x1c testing.(*common).Cleanup.func1() /usr/local/go/src/testing/testing.go:1211 +0x106 testing.(*common).runCleanup(0xc000c4dc00, 0xc00048ce00?) /usr/local/go/src/testing/testing.go:1445 +0xea testing.tRunner.func2() /usr/local/go/src/testing/testing.go:1786 +0x25 runtime.Goexit() /usr/local/go/src/runtime/panic.go:636 +0x5e testing.(*common).FailNow(0xc000c4dc00) /usr/local/go/src/testing/testing.go:1041 +0x4a github.com/stretchr/testify/require.NoError({0x2e64790, 0xc000c4dc00}, {0x2e50aa0, 0xc000519b80}, {0x0, 0x0, 0x0}) /home/rclone/go/pkg/mod/github.com/stretchr/testify@v1.11.1/require/require.go:1401 +0xca github.com/rclone/rclone/fs/operations_test.TestRmdirsNoLeaveRoot(0xc000c4dc00) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 +0xaa7 testing.tRunner(0xc000c4dc00, 0x2ad8798) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 3548 [chan receive, 89 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 3218 [chan receive, 90 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 2246 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 2204 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 124 [chan receive, 119 minutes]: github.com/rclone/rclone/lib/atexit.Register.func1.1() /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:45 +0x29 created by github.com/rclone/rclone/lib/atexit.Register.func1 in goroutine 55 /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:44 +0x68 goroutine 3748 [chan receive, 88 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 1582 [chan receive (nil chan), 102 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1572 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 3433 [chan receive, 89 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 3818 [chan receive, 88 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 9306 [chan receive, 29 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 9305 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 3625 [chan receive, 89 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 1226 [chan receive (nil chan), 104 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 944 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 4018 [IO wait]: internal/poll.runtime_pollWait(0x7eb538c97f30, 0x72) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc0008b0a00?, 0xc000035300?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc0008b0a00, {0xc000035300, 0x1300, 0x1300}) /usr/local/go/src/internal/poll/fd_unix.go:165 +0x27a net.(*netFD).Read(0xc0008b0a00, {0xc000035300?, 0x12fb?, 0xc000446980?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc00008a5f8, {0xc000035300?, 0xc000035300?, 0x5?}) /usr/local/go/src/net/net.go:194 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc0004e1530, {0xc000035300?, 0x7eb4f004c008?, 0x7eb539033108?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x29 crypto/tls.(*atLeastReader).Read(0xc0004e0af8, {0xc000035300?, 0x12fb?, 0x4?}) /usr/local/go/src/crypto/tls/conn.go:809 +0x3b bytes.(*Buffer).ReadFrom(0xc0006ab438, {0x2e523a0, 0xc0004e0af8}) /usr/local/go/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc0006ab188, {0x7eb4ea78bad8, 0xc0004e1530}, 0x4426d4?) /usr/local/go/src/crypto/tls/conn.go:831 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc0006ab188, 0x0) /usr/local/go/src/crypto/tls/conn.go:629 +0x3cf crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:591 crypto/tls.(*Conn).Read(0xc0006ab188, {0xc000683000, 0x1000, 0xc000273ca0?}) /usr/local/go/src/crypto/tls/conn.go:1385 +0x145 bufio.(*Reader).Read(0xc000925aa0, {0xc0008b2120, 0x9, 0x4423d50?}) /usr/local/go/src/bufio/bufio.go:245 +0x197 io.ReadAtLeast({0x2e50740, 0xc000925aa0}, {0xc0008b2120, 0x9, 0x9}, 0x9) /usr/local/go/src/io/io.go:335 +0x91 io.ReadFull(...) /usr/local/go/src/io/io.go:354 net/http.http2readFrameHeader({0xc0008b2120, 0x9, 0xc0003e4c30?}, {0x2e50740?, 0xc000925aa0?}) /usr/local/go/src/net/http/h2_bundle.go:1805 +0x65 net/http.(*http2Framer).ReadFrame(0xc0008b20e0) /usr/local/go/src/net/http/h2_bundle.go:2072 +0x7d net/http.(*http2clientConnReadLoop).run(0xc000273fa8) /usr/local/go/src/net/http/h2_bundle.go:9933 +0xda net/http.(*http2ClientConn).readLoop(0xc000c4c1c0) /usr/local/go/src/net/http/h2_bundle.go:9812 +0x79 created by net/http.(*http2Transport).newClientConn in goroutine 3937 /usr/local/go/src/net/http/h2_bundle.go:8334 +0xde5 goroutine 1388 [chan receive (nil chan), 103 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1379 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1965 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1955 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1281 [chan receive (nil chan), 103 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1271 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 2235 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 2113 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 2116 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 2058 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1794 [chan receive (nil chan), 102 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1784 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1186 [chan receive (nil chan), 104 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1144 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1477 [chan receive (nil chan), 103 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1467 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1088 [chan receive (nil chan), 104 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1078 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1825 [chan receive (nil chan), 102 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1815 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 2013 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 2003 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1366 [chan receive (nil chan), 103 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1324 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1724 [chan receive (nil chan), 102 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1714 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1126 [chan receive (nil chan), 104 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1116 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 10400 [sleep]: time.Sleep(0x4a817c800) /usr/local/go/src/runtime/time.go:338 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0xc000801760?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:170 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 9818 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:169 +0xf6 goroutine 2188 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 2178 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1337 [chan receive (nil chan), 103 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1311 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1533 [chan receive (nil chan), 103 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1523 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 3511 [chan receive, 89 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 3717 [chan receive, 89 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 2071 [chan receive (nil chan), 101 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1949 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 1552 [chan receive (nil chan), 102 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1542 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:255 +0x378 goroutine 3232 [chan receive, 90 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 3201 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose" - Finished ERROR in 2h0m0.652972022s (try 1/5): exit status 2: Failed [TestMultithreadCopy/upload=true,size=10485759,streams=2 TestMultithreadCopy/upload=true,size=10485760,streams=2 TestMultithreadCopy/upload=true,size=10485761,streams=2 TestCheckDownload TestCheckSizeOnly TestParseSumFile TestCheckSum TestCheckSumDownload TestApplyTransforms TestCopyFile TestCopyFileCompareDest TestCopyFileCopyDest TestCopyFileMaxTransfer TestLsd TestLs TestHashSums TestCount TestDelete TestMaxDelete TestMaxDeleteSizeLargeFile TestMaxDeleteSize TestCat TestPurge]