"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose" - Starting (try 5/5) 2026/04/30 06:06:09 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini" 2026/04/30 06:06:09 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:07:09 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f445bdf7e1ac4ec\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f445bdf7e1ac4ec\",\"timestamp\":\"2026-04-30T06:07:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}") 2026/04/30 06:07:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/30 06:08:10 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f445d572910c4ec\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f445d572910c4ec\",\"timestamp\":\"2026-04-30T06:08:10Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}") 2026/04/30 06:08:10 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/04/30 06:09:05 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/04/30 06:09:05 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/04/30 06:10:06 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f44602ace58c4ec\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f44602ace58c4ec\",\"timestamp\":\"2026-04-30T06:10:06Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}") 2026/04/30 06:10:06 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/04/30 06:11:06 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f4461a45874c4ec\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f4461a45874c4ec\",\"timestamp\":\"2026-04-30T06:11:06Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}") 2026/04/30 06:11:06 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/04/30 06:11:51 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/04/30 06:11:51 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/04/30 06:11:52 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/04/30 06:11:52 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/04/30 06:11:52 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/04/30 06:11:52 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/30 06:11:53 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/04/30 06:11:53 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/04/30 06:11:56 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/04/30 06:11:56 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/04/30 06:12:01 DEBUG : pacer: Reducing sleep to 5.12s 2026/04/30 06:12:01 DEBUG : Creating backend with remote "/tmp/rclone214006230" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:12:12 DEBUG : pacer: Reducing sleep to 2.56s 2026/04/30 06:12:17 DEBUG : pacer: Reducing sleep to 1.28s 2026/04/30 06:12:19 DEBUG : pacer: Reducing sleep to 640ms 2026/04/30 06:12:21 DEBUG : pacer: Reducing sleep to 320ms === RUN TestMultithreadCopy/upload=false,size=10485759,streams=2 2026/04/30 06:12:21 DEBUG : pacer: Reducing sleep to 160ms 2026/04/30 06:12:22 DEBUG : pacer: Reducing sleep to 80ms 2026/04/30 06:12:23 DEBUG : pacer: Reducing sleep to 40ms 2026/04/30 06:12:23 DEBUG : pacer: Reducing sleep to 20ms 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: write buffer set to 131072 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10.000Mi 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: Starting multi-thread copy with 1 chunks of size 10.000Mi with 1 parallel streams 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi starting 2026/04/30 06:12:23 DEBUG : pacer: Reducing sleep to 10ms 2026/04/30 06:12:23 DEBUG : test-multithread-copy-false-10485759-2: writing chunk 0 2026/04/30 06:12:24 DEBUG : test-multithread-copy-false-10485759-2: multi-thread copy: chunk 1/1 (0-10485759) size 10.000Mi finished 2026/04/30 06:12:24 DEBUG : test-multithread-copy-false-10485759-2: Finished multi-thread copy with 1 parts of size 10.000Mi === RUN TestMultithreadCopy/upload=false,size=10485760,streams=2 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: write buffer set to 131072 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10Mi 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: Starting multi-thread copy with 1 chunks of size 10Mi with 1 parallel streams 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk 1/1 (0-10485760) size 10Mi starting 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: writing chunk 0 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: multi-thread copy: chunk 1/1 (0-10485760) size 10Mi finished 2026/04/30 06:12:27 DEBUG : test-multithread-copy-false-10485760-2: Finished multi-thread copy with 1 parts of size 10Mi === RUN TestMultithreadCopy/upload=false,size=10485761,streams=2 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: write buffer set to 131072 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: chunk size 64Mi was bigger than source file size 10.000Mi 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: Starting multi-thread copy with 1 chunks of size 10.000Mi with 1 parallel streams 2026/04/30 06:12:30 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: chunk 1/1 (0-10485761) size 10.000Mi starting 2026/04/30 06:12:31 DEBUG : test-multithread-copy-false-10485761-2: writing chunk 0 2026/04/30 06:12:31 DEBUG : test-multithread-copy-false-10485761-2: multi-thread copy: chunk 1/1 (0-10485761) size 10.000Mi finished 2026/04/30 06:12:31 DEBUG : test-multithread-copy-false-10485761-2: Finished multi-thread copy with 1 parts of size 10.000Mi === RUN TestMultithreadCopy/upload=true,size=10485759,streams=2 2026/04/30 06:12:32 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: disabling buffering because source is local disk 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi starting 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 2/2 (5242880-10485759) size 5.000Mi finished 2026/04/30 06:12:33 DEBUG : test-multithread-copy-true-10485759-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/04/30 06:12:34 DEBUG : test-multithread-copy-true-10485759-2: Finished multi-thread copy with 2 parts of size 5Mi === RUN TestMultithreadCopy/upload=true,size=10485760,streams=2 2026/04/30 06:12:36 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: disabling buffering because source is local disk 2026/04/30 06:12:36 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/04/30 06:12:36 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2026/04/30 06:12:36 DEBUG : test-multithread-copy-true-10485760-2: Starting multi-thread copy with 2 chunks of size 5Mi with 2 parallel streams 2026/04/30 06:12:36 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi starting 2026/04/30 06:12:36 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi starting 2026/04/30 06:12:37 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 1/2 (0-5242880) size 5Mi finished 2026/04/30 06:12:37 DEBUG : test-multithread-copy-true-10485760-2: multi-thread copy: chunk 2/2 (5242880-10485760) size 5Mi finished 2026/04/30 06:12:38 DEBUG : test-multithread-copy-true-10485760-2: Finished multi-thread copy with 2 parts of size 5Mi === RUN TestMultithreadCopy/upload=true,size=10485761,streams=2 2026/04/30 06:12:39 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: disabling buffering because source is local disk 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 finished 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/04/30 06:12:40 DEBUG : test-multithread-copy-true-10485761-2: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/04/30 06:12:41 DEBUG : test-multithread-copy-true-10485761-2: Finished multi-thread copy with 3 parts of size 5Mi === NAME TestMultithreadCopy run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test-multithread-copy-true-10485761-2" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "test-multithread-copy-true-10485761-2" failed: failed to delete item: Error "The selected entry ids is invalid." --- PASS: TestMultithreadCopy (44.68s) --- PASS: TestMultithreadCopy/upload=false,size=10485759,streams=2 (3.78s) --- PASS: TestMultithreadCopy/upload=false,size=10485760,streams=2 (3.69s) --- PASS: TestMultithreadCopy/upload=false,size=10485761,streams=2 (3.42s) --- PASS: TestMultithreadCopy/upload=true,size=10485759,streams=2 (3.62s) --- PASS: TestMultithreadCopy/upload=true,size=10485760,streams=2 (3.54s) --- PASS: TestMultithreadCopy/upload=true,size=10485761,streams=2 (3.43s) === RUN TestMultithreadCopyAbort run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:12:48 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2026/04/30 06:12:49 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 1 2026/04/30 06:12:49 DEBUG : test-multithread-abort: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2026/04/30 06:12:49 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 5Mi with 3 parallel streams 2026/04/30 06:12:49 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (10485760-10485761) size 1 starting 2026/04/30 06:12:49 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:49 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi starting 2026/04/30 06:12:49 DEBUG : Open with options = [RangeOption(0,5242879)] 2026/04/30 06:12:49 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi starting 2026/04/30 06:12:49 DEBUG : Open with options = [RangeOption(5242880,10485759)] 2026/04/30 06:12:49 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (5242880-10485760) size 5Mi finished 2026/04/30 06:12:50 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-5242880) size 5Mi finished 2026/04/30 06:12:50 DEBUG : Returning error reader 2026/04/30 06:12:50 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:50 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 0/10: BOOM: simulated read failure 2026/04/30 06:12:50 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:51 DEBUG : Returning error reader 2026/04/30 06:12:51 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:51 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2026/04/30 06:12:51 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:52 DEBUG : Returning error reader 2026/04/30 06:12:52 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:52 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2026/04/30 06:12:52 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:53 DEBUG : Returning error reader 2026/04/30 06:12:53 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:53 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2026/04/30 06:12:53 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:54 DEBUG : Returning error reader 2026/04/30 06:12:54 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:54 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2026/04/30 06:12:54 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:55 DEBUG : Returning error reader 2026/04/30 06:12:55 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:55 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2026/04/30 06:12:55 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:56 DEBUG : Returning error reader 2026/04/30 06:12:56 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:56 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2026/04/30 06:12:56 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:57 DEBUG : Returning error reader 2026/04/30 06:12:57 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:57 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2026/04/30 06:12:57 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:58 DEBUG : Returning error reader 2026/04/30 06:12:58 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:58 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2026/04/30 06:12:58 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:12:59 DEBUG : Returning error reader 2026/04/30 06:12:59 DEBUG : BOOM: simulated read failure 2026/04/30 06:12:59 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2026/04/30 06:12:59 DEBUG : Open with options = [RangeOption(10485760,10485760)] 2026/04/30 06:13:00 DEBUG : Returning error reader 2026/04/30 06:13:00 DEBUG : BOOM: simulated read failure 2026/04/30 06:13:00 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2026/04/30 06:13:00 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2026/04/30 06:13:00 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: failed to upload part 3: Put "https://18b804eaa6bc9759e2278f8d5367f42f.r2.cloudflarestorage.com/drimestorage/uploads/de0a3d12-eae6-4f4a-85bc-e9c22b29d1b6/de0a3d12-eae6-4f4a-85bc-e9c22b29d1b6?uploadId=AOoOfyy_URBKVpXkgmxsv420xLedlCfH3sCPakON-Jm0K7aE28nVRQz2fbte9slRqFh0mdEFArU8gH7vmIkctaAXcovWUs-8bXxa6CaaUmKU8cHRfjgaaBK_AqaEP-aLn0ohsb4OfOeAvsQF4KBtS013am95AiY3V8dy85vDx4l0wnrS8RmB4_bK449xRe6iZ8e1iEsjBF0uTINMfh7QJLXMyJ_Xfj0GAy5yIrie5PZ7DxDmURg0hgWLG7J-VzsUhE_AvZcPo4krBpqxWgnS3nxymBgfPA8yOwoAmmSVPHH8ut5zJT67UJYAHXqClX4CJTVEGmm2g4Xa3WEI8uwm38E&partNumber=3&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=6a6ba1504e777c9aad0cd55f765be59c%2F20260430%2Fauto%2Fs3%2Faws4_request&X-Amz-Date=20260430T061250Z&X-Amz-SignedHeaders=host&X-Amz-Expires=86400&X-Amz-Signature=5845316de9dade5a3caea7988c6738328d5faa7a7fd75d73934873248a34ed13": BOOM: simulated read failure 2026/04/30 06:13:00 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit run.go:130: removing file "test-multithread-abort" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test-multithread-abort" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "test-multithread-abort" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "test-multithread-abort" failed: failed to delete item: Error "The selected entry ids is invalid." --- PASS: TestMultithreadCopyAbort (18.95s) === RUN TestSizeDiffers 2026/04/30 06:13:05 DEBUG : a: size = 0 OK 2026/04/30 06:13:05 DEBUG : a: size = 1 (memory) 2026/04/30 06:13:05 DEBUG : a: size = 2 (memory) --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2026/04/30 06:13:05 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/ReadAt 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/Normal/Seek 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2026/04/30 06:13:05 DEBUG : potato: Seek from 10 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 10 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/ReadAt 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithRangeOption/Seek 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 2 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2026/04/30 06:13:05 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/ReadAt 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithSeekOption/Seek 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 2 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2026/04/30 06:13:05 DEBUG : potato: Seek from 8 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 8 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2026/04/30 06:13:05 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/04/30 06:13:05 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/ReadAt 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/UnknownSize/Seek 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/04/30 06:13:05 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/04/30 06:13:05 DEBUG : potato: Seek from 5 to 2 2026/04/30 06:13:05 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2026/04/30 06:13:05 DEBUG : potato: Seek from 9 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 9 to 0 2026/04/30 06:13:05 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/ReadAt (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/ReadAt (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/ReadAt (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/ReadAt (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (14.62s) --- PASS: TestCheck/1 (0.22s) --- PASS: TestCheck/2 (0.19s) --- PASS: TestCheck/3 (0.20s) --- PASS: TestCheck/4 (0.23s) --- PASS: TestCheck/5 (0.19s) --- PASS: TestCheck/6 (0.20s) --- PASS: TestCheck/7 (0.20s) === RUN TestCheckFsError 2026/04/30 06:13:20 DEBUG : Creating backend with remote "nonexistent" 2026/04/30 06:13:20 DEBUG : Creating backend with remote "nonexistent" 2026/04/30 06:13:20 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2026/04/30 06:13:20 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2026/04/30 06:13:20 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 0 differences found 2026/04/30 06:13:20 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === NAME TestCheckDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === NAME TestCheckDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (31.92s) --- PASS: TestCheckDownload/1 (0.70s) --- PASS: TestCheckDownload/2 (0.55s) --- PASS: TestCheckDownload/3 (0.62s) --- PASS: TestCheckDownload/4 (0.57s) --- PASS: TestCheckDownload/5 (0.55s) --- PASS: TestCheckDownload/6 (0.56s) --- PASS: TestCheckDownload/7 (0.56s) === RUN TestCheckSizeOnly run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (6.85s) --- PASS: TestCheckSizeOnly/1 (0.21s) --- PASS: TestCheckSizeOnly/2 (0.19s) --- PASS: TestCheckSizeOnly/3 (0.21s) --- PASS: TestCheckSizeOnly/4 (0.18s) --- PASS: TestCheckSizeOnly/5 (0.21s) --- PASS: TestCheckSizeOnly/6 (0.20s) --- PASS: TestCheckSizeOnly/7 (0.18s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/3 (object not found) 2026/04/30 06:14:01 NOTICE: test.sum: improperly formatted checksum line 4 2026/04/30 06:14:01 NOTICE: test.sum: improperly formatted checksum line 5 2026/04/30 06:14:01 NOTICE: test.sum: improperly formatted checksum line 6 2026/04/30 06:14:01 NOTICE: test.sum: 2 warning(s) suppressed... 2026/04/30 06:14:02 DEBUG : test.sum: Removing old object on successful upload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-zubezac7hini'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- FAIL: TestParseSumFile (11.91s) === RUN TestCheckSum run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:14:10 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/data" check_test.go:350: drime root 'rclone-test-zubezac7hini/data' lacks md5, skipping --- SKIP: TestCheckSum (1.47s) === RUN TestCheckSumDownload run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:14:12 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/data" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSumDownload/subtest1 2026/04/30 06:14:26 DEBUG : test.sum: Removing old object on successful upload === NAME TestCheckSumDownload run.go:290: Failed to put "test.sum" to "drime root 'rclone-test-zubezac7hini'": failed to delete existing object: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing dir "data" failed - try 1/3: directory not empty --- FAIL: TestCheckSumDownload (17.75s) --- PASS: TestCheckSumDownload/subtest1 (1.61s) === RUN TestApplyTransforms 2026/04/30 06:14:29 DEBUG : Creating backend with remote "TestDrime:rclone-test-pijayuz3raro" 2026/04/30 06:14:29 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:30 DEBUG : Creating backend with remote "/tmp/rclone3255584185" run.go:185: Remote "drime root 'rclone-test-pijayuz3raro'", Local "Local file system at /tmp/rclone3255584185", Modify Window "876000h0m0s" upper checkfile vs. lower remote (without normalization) 2026/04/30 06:14:32 ERROR : HELLO, WORLD!: file not in drime root 'rclone-test-pijayuz3raro' 2026/04/30 06:14:32 NOTICE: drime root 'rclone-test-pijayuz3raro': 1 files missing 2026/04/30 06:14:32 NOTICE: drime root 'rclone-test-pijayuz3raro': 0 differences found 2026/04/30 06:14:32 NOTICE: drime root 'rclone-test-pijayuz3raro': 1 errors while checking upper checkfile vs. lower remote (with normalization) 2026/04/30 06:14:32 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:32 NOTICE: drime root 'rclone-test-pijayuz3raro': 0 differences found 2026/04/30 06:14:32 NOTICE: drime root 'rclone-test-pijayuz3raro': 1 matching files 2026/04/30 06:14:32 DEBUG : Creating backend with remote "TestDrime:rclone-test-cojaquv7puno" 2026/04/30 06:14:32 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:33 DEBUG : Creating backend with remote "/tmp/rclone2885711179" run.go:185: Remote "drime root 'rclone-test-cojaquv7puno'", Local "Local file system at /tmp/rclone2885711179", Modify Window "876000h0m0s" lower checkfile vs. upper remote (without normalization) 2026/04/30 06:14:35 ERROR : HELLO, WORLD!: sum not found 2026/04/30 06:14:35 ERROR : hello, world!: file not in drime root 'rclone-test-cojaquv7puno' 2026/04/30 06:14:35 NOTICE: drime root 'rclone-test-cojaquv7puno': 1 files missing 2026/04/30 06:14:35 NOTICE: 1 hashes missing 2026/04/30 06:14:35 NOTICE: drime root 'rclone-test-cojaquv7puno': 1 differences found 2026/04/30 06:14:35 NOTICE: drime root 'rclone-test-cojaquv7puno': 2 errors while checking lower checkfile vs. upper remote (with normalization) 2026/04/30 06:14:35 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:35 NOTICE: drime root 'rclone-test-cojaquv7puno': 0 differences found 2026/04/30 06:14:35 NOTICE: drime root 'rclone-test-cojaquv7puno': 1 matching files 2026/04/30 06:14:35 DEBUG : Creating backend with remote "TestDrime:rclone-test-vahejow8quse" 2026/04/30 06:14:35 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:36 DEBUG : Creating backend with remote "/tmp/rclone1554353175" run.go:185: Remote "drime root 'rclone-test-vahejow8quse'", Local "Local file system at /tmp/rclone1554353175", Modify Window "876000h0m0s" lower checkfile vs. upperlowermixed remote (without normalization) 2026/04/30 06:14:38 ERROR : hello, world!: file not in drime root 'rclone-test-vahejow8quse' 2026/04/30 06:14:38 NOTICE: drime root 'rclone-test-vahejow8quse': 1 files missing 2026/04/30 06:14:38 NOTICE: drime root 'rclone-test-vahejow8quse': 0 differences found 2026/04/30 06:14:38 NOTICE: drime root 'rclone-test-vahejow8quse': 1 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2026/04/30 06:14:38 DEBUG : HeLlO, wOrLd!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:38 NOTICE: drime root 'rclone-test-vahejow8quse': 0 differences found 2026/04/30 06:14:38 NOTICE: drime root 'rclone-test-vahejow8quse': 1 matching files 2026/04/30 06:14:38 DEBUG : Creating backend with remote "TestDrime:rclone-test-koquxim5japo" 2026/04/30 06:14:38 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:39 DEBUG : Creating backend with remote "/tmp/rclone3478164862" run.go:185: Remote "drime root 'rclone-test-koquxim5japo'", Local "Local file system at /tmp/rclone3478164862", Modify Window "876000h0m0s" upperlowermixed checkfile vs. upper remote (without normalization) 2026/04/30 06:14:41 ERROR : HELLO, WORLD!: sum not found 2026/04/30 06:14:41 ERROR : HeLlO, wOrLd!: file not in drime root 'rclone-test-koquxim5japo' 2026/04/30 06:14:41 NOTICE: drime root 'rclone-test-koquxim5japo': 1 files missing 2026/04/30 06:14:41 NOTICE: 1 hashes missing 2026/04/30 06:14:41 NOTICE: drime root 'rclone-test-koquxim5japo': 1 differences found 2026/04/30 06:14:41 NOTICE: drime root 'rclone-test-koquxim5japo': 2 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2026/04/30 06:14:41 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:41 NOTICE: drime root 'rclone-test-koquxim5japo': 0 differences found 2026/04/30 06:14:41 NOTICE: drime root 'rclone-test-koquxim5japo': 1 matching files 2026/04/30 06:14:41 DEBUG : Creating backend with remote "TestDrime:rclone-test-wucerah4xiqo" 2026/04/30 06:14:41 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:42 DEBUG : Creating backend with remote "/tmp/rclone231924263" run.go:185: Remote "drime root 'rclone-test-wucerah4xiqo'", Local "Local file system at /tmp/rclone231924263", Modify Window "876000h0m0s" NFD checkfile vs. NFC remote (without normalization) 2026/04/30 06:14:44 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-wucerah4xiqo' 2026/04/30 06:14:44 NOTICE: drime root 'rclone-test-wucerah4xiqo': 1 files missing 2026/04/30 06:14:44 NOTICE: drime root 'rclone-test-wucerah4xiqo': 0 differences found 2026/04/30 06:14:44 NOTICE: drime root 'rclone-test-wucerah4xiqo': 1 errors while checking NFD checkfile vs. NFC remote (with normalization) 2026/04/30 06:14:45 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:45 NOTICE: drime root 'rclone-test-wucerah4xiqo': 0 differences found 2026/04/30 06:14:45 NOTICE: drime root 'rclone-test-wucerah4xiqo': 1 matching files 2026/04/30 06:14:45 DEBUG : Creating backend with remote "TestDrime:rclone-test-zosixin1xexa" 2026/04/30 06:14:45 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:45 DEBUG : Creating backend with remote "/tmp/rclone2403492906" run.go:185: Remote "drime root 'rclone-test-zosixin1xexa'", Local "Local file system at /tmp/rclone2403492906", Modify Window "876000h0m0s" NFC checkfile vs. NFD remote (without normalization) 2026/04/30 06:14:47 ERROR : 測試_Русский___ě_áñ: file not in drime root 'rclone-test-zosixin1xexa' 2026/04/30 06:14:47 NOTICE: drime root 'rclone-test-zosixin1xexa': 1 files missing 2026/04/30 06:14:47 NOTICE: drime root 'rclone-test-zosixin1xexa': 0 differences found 2026/04/30 06:14:47 NOTICE: drime root 'rclone-test-zosixin1xexa': 1 errors while checking NFC checkfile vs. NFD remote (with normalization) 2026/04/30 06:14:48 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:48 NOTICE: drime root 'rclone-test-zosixin1xexa': 0 differences found 2026/04/30 06:14:48 NOTICE: drime root 'rclone-test-zosixin1xexa': 1 matching files 2026/04/30 06:14:48 DEBUG : Creating backend with remote "TestDrime:rclone-test-wuginig1meco" 2026/04/30 06:14:48 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:48 DEBUG : Creating backend with remote "/tmp/rclone1645630859" run.go:185: Remote "drime root 'rclone-test-wuginig1meco'", Local "Local file system at /tmp/rclone1645630859", Modify Window "876000h0m0s" NFDx2 checkfile vs. both remote (without normalization) 2026/04/30 06:14:50 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-wuginig1meco' 2026/04/30 06:14:50 NOTICE: drime root 'rclone-test-wuginig1meco': 1 files missing 2026/04/30 06:14:50 NOTICE: drime root 'rclone-test-wuginig1meco': 0 differences found 2026/04/30 06:14:50 NOTICE: drime root 'rclone-test-wuginig1meco': 1 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2026/04/30 06:14:51 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:51 NOTICE: drime root 'rclone-test-wuginig1meco': 0 differences found 2026/04/30 06:14:51 NOTICE: drime root 'rclone-test-wuginig1meco': 1 matching files 2026/04/30 06:14:51 DEBUG : Creating backend with remote "TestDrime:rclone-test-hurawek9nesu" 2026/04/30 06:14:51 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:52 DEBUG : Creating backend with remote "/tmp/rclone3823727" run.go:185: Remote "drime root 'rclone-test-hurawek9nesu'", Local "Local file system at /tmp/rclone3823727", Modify Window "876000h0m0s" NFCx2 checkfile vs. both remote (without normalization) 2026/04/30 06:14:53 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-hurawek9nesu' 2026/04/30 06:14:53 NOTICE: drime root 'rclone-test-hurawek9nesu': 1 files missing 2026/04/30 06:14:53 NOTICE: drime root 'rclone-test-hurawek9nesu': 0 differences found 2026/04/30 06:14:53 NOTICE: drime root 'rclone-test-hurawek9nesu': 1 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2026/04/30 06:14:54 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:54 NOTICE: drime root 'rclone-test-hurawek9nesu': 0 differences found 2026/04/30 06:14:54 NOTICE: drime root 'rclone-test-hurawek9nesu': 1 matching files 2026/04/30 06:14:54 DEBUG : Creating backend with remote "TestDrime:rclone-test-xavebuv2mede" 2026/04/30 06:14:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:55 DEBUG : Creating backend with remote "/tmp/rclone194080545" run.go:185: Remote "drime root 'rclone-test-xavebuv2mede'", Local "Local file system at /tmp/rclone194080545", Modify Window "876000h0m0s" both checkfile vs. NFDx2 remote (without normalization) 2026/04/30 06:14:56 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-xavebuv2mede' 2026/04/30 06:14:56 NOTICE: drime root 'rclone-test-xavebuv2mede': 1 files missing 2026/04/30 06:14:56 NOTICE: drime root 'rclone-test-xavebuv2mede': 0 differences found 2026/04/30 06:14:56 NOTICE: drime root 'rclone-test-xavebuv2mede': 1 errors while checking both checkfile vs. NFDx2 remote (with normalization) 2026/04/30 06:14:57 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:14:57 NOTICE: drime root 'rclone-test-xavebuv2mede': 0 differences found 2026/04/30 06:14:57 NOTICE: drime root 'rclone-test-xavebuv2mede': 1 matching files 2026/04/30 06:14:57 DEBUG : Creating backend with remote "TestDrime:rclone-test-tevireq9pami" 2026/04/30 06:14:57 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:14:58 DEBUG : Creating backend with remote "/tmp/rclone2676128529" run.go:185: Remote "drime root 'rclone-test-tevireq9pami'", Local "Local file system at /tmp/rclone2676128529", Modify Window "876000h0m0s" both checkfile vs. NFCx2 remote (without normalization) 2026/04/30 06:15:00 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2026/04/30 06:15:00 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in drime root 'rclone-test-tevireq9pami' 2026/04/30 06:15:00 NOTICE: drime root 'rclone-test-tevireq9pami': 1 files missing 2026/04/30 06:15:00 NOTICE: 1 hashes missing 2026/04/30 06:15:00 NOTICE: drime root 'rclone-test-tevireq9pami': 1 differences found 2026/04/30 06:15:00 NOTICE: drime root 'rclone-test-tevireq9pami': 2 errors while checking both checkfile vs. NFCx2 remote (with normalization) 2026/04/30 06:15:01 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/04/30 06:15:01 NOTICE: drime root 'rclone-test-tevireq9pami': 0 differences found 2026/04/30 06:15:01 NOTICE: drime root 'rclone-test-tevireq9pami': 1 matching files 2026/04/30 06:15:01 DEBUG : drime root 'rclone-test-tevireq9pami': Purge remote 2026/04/30 06:15:01 DEBUG : drime root 'rclone-test-xavebuv2mede': Purge remote 2026/04/30 06:15:01 DEBUG : drime root 'rclone-test-hurawek9nesu': Purge remote 2026/04/30 06:15:01 DEBUG : drime root 'rclone-test-wuginig1meco': Purge remote 2026/04/30 06:15:01 DEBUG : drime root 'rclone-test-zosixin1xexa': Purge remote 2026/04/30 06:15:02 DEBUG : drime root 'rclone-test-wucerah4xiqo': Purge remote 2026/04/30 06:15:02 DEBUG : drime root 'rclone-test-koquxim5japo': Purge remote 2026/04/30 06:15:02 DEBUG : drime root 'rclone-test-vahejow8quse': Purge remote 2026/04/30 06:15:02 DEBUG : drime root 'rclone-test-cojaquv7puno': Purge remote 2026/04/30 06:15:03 DEBUG : drime root 'rclone-test-pijayuz3raro': Purge remote --- PASS: TestApplyTransforms (33.49s) === RUN TestTruncateString --- PASS: TestTruncateString (0.00s) === RUN TestCopyFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:15:03 DEBUG : file1: Need to transfer - File not found at Destination 2026/04/30 06:15:04 DEBUG : sub/file2: size = 14 OK 2026/04/30 06:15:04 INFO : file1: Copied (new) to: sub/file2 2026/04/30 06:15:05 DEBUG : sub/file2: size = 14 OK 2026/04/30 06:15:05 DEBUG : file1: Sizes identical 2026/04/30 06:15:05 DEBUG : file1: Unchanged skipping 2026/04/30 06:15:05 DEBUG : drime root 'rclone-test-zubezac7hini': don't need to copy/move sub/file2, it is already at target location run.go:130: removing dir "sub" failed - try 1/3: directory not empty --- PASS: TestCopyFile (5.28s) === RUN TestCopyLongFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" copy_test.go:154: Test only runs on local --- SKIP: TestCopyLongFile (0.50s) === RUN TestCopyFileBackupDir run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:15:11 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/backup" 2026/04/30 06:15:12 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone214006230) 2026/04/30 06:15:12 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-zubezac7hini') 2026/04/30 06:15:12 DEBUG : dst/file1: Sizes differ 2026/04/30 06:15:14 INFO : dst/file1: Moved (server-side) 2026/04/30 06:15:15 DEBUG : dst/file1: size = 14 OK 2026/04/30 06:15:15 INFO : dst/file1: Copied (new) --- PASS: TestCopyFileBackupDir (9.30s) === RUN TestCopyFileCompareDest run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:15:18 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/dst" 2026/04/30 06:15:19 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/CompareDest" 2026/04/30 06:15:20 DEBUG : one: Need to transfer - File not found at Destination 2026/04/30 06:15:21 DEBUG : one: size = 3 OK 2026/04/30 06:15:21 INFO : one: Copied (new) 2026/04/30 06:15:23 DEBUG : one: size = 5 (Local file system at /tmp/rclone214006230) 2026/04/30 06:15:23 DEBUG : one: size = 3 (drime root 'rclone-test-zubezac7hini/dst') 2026/04/30 06:15:23 DEBUG : one: Sizes differ 2026/04/30 06:15:23 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/30 06:15:23 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/30 06:15:24 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:24 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/04/30 06:15:24 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/30 06:15:24 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:24 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/04/30 06:15:24 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/30 06:15:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:25 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/04/30 06:15:25 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/30 06:15:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:25 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/04/30 06:15:25 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/30 06:15:25 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:25 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/04/30 06:15:25 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/30 06:15:26 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:26 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/04/30 06:15:26 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/30 06:15:27 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:27 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/30 06:15:27 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/30 06:15:28 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:28 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/04/30 06:15:28 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/30 06:15:30 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:30 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/04/30 06:15:30 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/30 06:15:30 ERROR : one: Failed to copy: failed to upload file: Error "Server Error" copy_test.go:220: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:220 Error: Received unexpected error: failed to upload file: Error "Server Error" Test: TestCopyFileCompareDest run.go:130: removing dir "dst" failed - try 1/3: directory not empty --- FAIL: TestCopyFileCompareDest (14.82s) === RUN TestCopyFileCopyDest run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:15:33 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/dst" 2026/04/30 06:15:34 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/CopyDest" 2026/04/30 06:15:35 DEBUG : one: Need to transfer - File not found at Destination 2026/04/30 06:15:37 DEBUG : one: size = 3 OK 2026/04/30 06:15:37 INFO : one: Copied (new) 2026/04/30 06:15:38 DEBUG : one: size = 5 (Local file system at /tmp/rclone214006230) 2026/04/30 06:15:38 DEBUG : one: size = 3 (drime root 'rclone-test-zubezac7hini/dst') 2026/04/30 06:15:38 DEBUG : one: Sizes differ 2026/04/30 06:15:38 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/04/30 06:15:38 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 0/10 2026/04/30 06:15:39 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:39 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/04/30 06:15:39 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 1/10 2026/04/30 06:15:39 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:39 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/04/30 06:15:39 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 2/10 2026/04/30 06:15:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:40 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/04/30 06:15:40 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 3/10 2026/04/30 06:15:40 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:40 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/04/30 06:15:40 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 4/10 2026/04/30 06:15:41 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:41 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/04/30 06:15:41 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 5/10 2026/04/30 06:15:41 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:41 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/04/30 06:15:41 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 6/10 2026/04/30 06:15:42 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:42 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/04/30 06:15:42 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 7/10 2026/04/30 06:15:43 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:43 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/04/30 06:15:43 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 8/10 2026/04/30 06:15:45 DEBUG : pacer: low level retry 1/1 (error Error "Server Error") 2026/04/30 06:15:45 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/04/30 06:15:45 DEBUG : one: Received error: failed to upload file: Error "Server Error" - low level retry 9/10 2026/04/30 06:15:45 ERROR : one: Failed to copy: failed to upload file: Error "Server Error" copy_test.go:303: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:303 Error: Received unexpected error: failed to upload file: Error "Server Error" Test: TestCopyFileCopyDest run.go:130: removing dir "dst" failed - try 1/3: directory not empty --- FAIL: TestCopyFileCopyDest (15.14s) === RUN TestCopyInplace run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" copy_test.go:371: Partial uploads not supported --- SKIP: TestCopyInplace (0.36s) === RUN TestCopyLongFileName run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" copy_test.go:404: Partial uploads not supported --- SKIP: TestCopyLongFileName (0.39s) === RUN TestCopyLongFileNameCollision run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" copy_test.go:437: Partial uploads not supported --- SKIP: TestCopyLongFileNameCollision (0.42s) === RUN TestCopyFileMaxTransfer run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:15:49 DEBUG : TestCopyFileMaxTransfer/file1: Need to transfer - File not found at Destination 2026/04/30 06:15:51 DEBUG : TestCopyFileMaxTransfer/file1: size = 14 OK 2026/04/30 06:15:51 INFO : TestCopyFileMaxTransfer/file1: Copied (new) 2026/04/30 06:15:51 DEBUG : TestCopyFileMaxTransfer/file2: Need to transfer - File not found at Destination 2026/04/30 06:15:52 ERROR : TestCopyFileMaxTransfer/file2: Failed to copy: failed to upload file: Post "https://app.drime.cloud/api/v1/uploads": failed to copy data: max transfer limit reached as set by --max-transfer 2026/04/30 06:15:52 DEBUG : TestCopyFileMaxTransfer/file3: Need to transfer - File not found at Destination 2026/04/30 06:15:53 DEBUG : TestCopyFileMaxTransfer/file4: Need to transfer - File not found at Destination 2026/04/30 06:15:54 DEBUG : TestCopyFileMaxTransfer/file4: size = 2062 OK 2026/04/30 06:15:54 INFO : TestCopyFileMaxTransfer/file4: Copied (new) --- PASS: TestCopyFileMaxTransfer (6.30s) === RUN TestDeduplicateInteractive run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateInteractive (0.39s) === RUN TestDeduplicateSkip run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSkip (0.39s) === RUN TestDeduplicateSizeOnly run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSizeOnly (0.43s) === RUN TestDeduplicateFirst run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateFirst (0.40s) === RUN TestDeduplicateNewest run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateNewest (0.36s) === RUN TestDeduplicateNewestByHash run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:36: Can't run this test without a hash --- SKIP: TestDeduplicateNewestByHash (0.41s) === RUN TestDeduplicateOldest run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateOldest (0.39s) === RUN TestDeduplicateLargest run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateLargest (0.37s) === RUN TestDeduplicateSmallest run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSmallest (0.41s) === RUN TestDeduplicateRename run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateRename (0.35s) === RUN TestMergeDirs run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" dedupe_test.go:256: Can't merge directories --- SKIP: TestMergeDirs (0.43s) === RUN TestListDirSorted run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:16:08 DEBUG : a.txt: Excluded (Size Filter) 2026/04/30 06:16:08 DEBUG : a.txt: Excluded 2026/04/30 06:16:08 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/04/30 06:16:08 DEBUG : sub dir/hello world: Excluded 2026/04/30 06:16:08 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/04/30 06:16:08 DEBUG : sub dir/hello world2: Excluded 2026/04/30 06:16:09 DEBUG : sub dir/ignore dir: Excluded 2026/04/30 06:16:09 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/04/30 06:16:09 DEBUG : sub dir/hello world: Excluded 2026/04/30 06:16:09 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/04/30 06:16:09 DEBUG : sub dir/hello world2: Excluded 2026/04/30 06:16:09 DEBUG : sub dir/ignore dir: Excluded run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty --- PASS: TestListDirSorted (14.41s) === RUN TestListDirSortedFn run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:16:22 DEBUG : a.txt: Excluded (Size Filter) 2026/04/30 06:16:22 DEBUG : a.txt: Excluded 2026/04/30 06:16:23 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/04/30 06:16:23 DEBUG : sub dir/hello world: Excluded 2026/04/30 06:16:23 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/04/30 06:16:23 DEBUG : sub dir/hello world2: Excluded 2026/04/30 06:16:23 DEBUG : sub dir/ignore dir: Excluded 2026/04/30 06:16:23 DEBUG : sub dir/hello world: Excluded (Size Filter) 2026/04/30 06:16:23 DEBUG : sub dir/hello world: Excluded 2026/04/30 06:16:23 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2026/04/30 06:16:23 DEBUG : sub dir/hello world2: Excluded 2026/04/30 06:16:23 DEBUG : sub dir/ignore dir: Excluded run.go:130: removing dir "sub dir/sub sub dir" failed - try 1/3: directory not empty --- PASS: TestListDirSortedFn (14.59s) === RUN TestListJSON run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" === RUN TestListJSON/Default === RUN TestListJSON/FilesOnly === RUN TestListJSON/DirsOnly === RUN TestListJSON/Recurse === RUN TestListJSON/SubDir === RUN TestListJSON/NoModTime === RUN TestListJSON/NoMimeType === RUN TestListJSON/ShowHash === RUN TestListJSON/HashTypes 2026/04/30 06:16:33 ERROR : file1: Failed to read hash: hash type not supported === RUN TestListJSON/Metadata === NAME TestListJSON run.go:130: removing dir "sub" failed - try 1/3: directory not empty --- PASS: TestListJSON (7.24s) --- PASS: TestListJSON/Default (0.18s) --- PASS: TestListJSON/FilesOnly (0.23s) --- PASS: TestListJSON/DirsOnly (0.18s) --- PASS: TestListJSON/Recurse (0.39s) --- PASS: TestListJSON/SubDir (0.22s) --- PASS: TestListJSON/NoModTime (0.22s) --- PASS: TestListJSON/NoMimeType (0.17s) --- PASS: TestListJSON/ShowHash (0.18s) --- PASS: TestListJSON/HashTypes (0.18s) --- PASS: TestListJSON/Metadata (0.19s) === RUN TestStatJSON run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/DirWithTrailingSlash === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2026/04/30 06:16:42 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/notfound" === NAME TestStatJSON run.go:130: removing dir "sub" failed - try 1/3: directory not empty --- PASS: TestStatJSON (9.90s) --- PASS: TestStatJSON/Root (0.62s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.24s) --- PASS: TestStatJSON/Dir (0.54s) --- PASS: TestStatJSON/DirWithTrailingSlash (0.19s) --- PASS: TestStatJSON/File (0.18s) --- PASS: TestStatJSON/NotFound (0.42s) --- PASS: TestStatJSON/DirFilesOnly (0.20s) --- PASS: TestStatJSON/FileFilesOnly (0.18s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.22s) --- PASS: TestStatJSON/DirDirsOnly (0.28s) --- PASS: TestStatJSON/FileDirsOnly (0.23s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.19s) --- PASS: TestStatJSON/RootNotFound (1.19s) === RUN TestMkdir run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:16:46 INFO : drime root 'rclone-test-zubezac7hini': Making directory 2026/04/30 06:16:46 INFO : drime root 'rclone-test-zubezac7hini': Making directory --- PASS: TestMkdir (0.57s) === RUN TestLsd run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestLsd (3.12s) === RUN TestLs run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestLs (2.85s) === RUN TestLsWithFilesFrom run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/30 06:17:02 DEBUG : empty space: Excluded (FilesFrom Filter) 2026/04/30 06:17:02 DEBUG : empty space: Excluded --- PASS: TestLsWithFilesFrom (11.08s) === RUN TestLsLong run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestLsLong (2.73s) === RUN TestHashSums run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestHashSums (9.96s) === RUN TestHashSumsWithErrors 2026/04/30 06:17:16 DEBUG : Creating backend with remote ":memory:" 2026/04/30 06:17:16 ERROR : file1: hash unsupported: hash type not supported --- PASS: TestHashSumsWithErrors (0.00s) === RUN TestHashStream 2026/04/30 06:17:16 DEBUG : Creating md5 hash of 0 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating md5 hash of 0 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating md5 hash of 12 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating md5 hash of 12 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating sha1 hash of 12 bytes read from input stream 2026/04/30 06:17:16 DEBUG : Creating sha1 hash of 12 bytes read from input stream --- PASS: TestHashStream (0.00s) === RUN TestSuffixName --- PASS: TestSuffixName (0.00s) === RUN TestCount run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestCount (5.12s) === RUN TestDelete run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/30 06:17:31 DEBUG : Waiting for deletions to finish 2026/04/30 06:17:32 DEBUG : large: Excluded (Size Filter) 2026/04/30 06:17:32 DEBUG : large: Excluded 2026/04/30 06:17:32 INFO : medium: Deleted 2026/04/30 06:17:32 INFO : small: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestDelete (26.04s) === RUN TestMaxDelete run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/30 06:17:57 DEBUG : Waiting for deletions to finish 2026/04/30 06:17:58 ERROR : small: Got fatal error on delete: --max-delete threshold reached 2026/04/30 06:17:58 INFO : large: Deleted 2026/04/30 06:17:58 INFO : medium: Deleted operations_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:453 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDelete run.go:130: removing file "large" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "large" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "large" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "large" failed: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 1/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 2/3: failed to delete item: Error "The selected entry ids is invalid." run.go:130: removing file "medium" failed - try 3/3: failed to delete item: Error "The selected entry ids is invalid." run.go:133: removing file "medium" failed: failed to delete item: Error "The selected entry ids is invalid." --- FAIL: TestMaxDelete (18.74s) === RUN TestMaxDeleteSizeLargeFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:18:09 DEBUG : Waiting for deletions to finish 2026/04/30 06:18:09 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached 2026/04/30 06:18:09 INFO : medium: Deleted 2026/04/30 06:18:09 INFO : small: Deleted fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestMaxDeleteSizeLargeFile (19.16s) === RUN TestMaxDeleteSize run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:18:28 DEBUG : Waiting for deletions to finish 2026/04/30 06:18:28 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/04/30 06:18:28 INFO : large: Deleted 2026/04/30 06:18:28 INFO : medium: Deleted operations_test.go:492: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:492 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDeleteSize fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- FAIL: TestMaxDeleteSize (11.75s) === RUN TestReadFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestReadFile (2.74s) === RUN TestRetry 2026/04/30 06:18:40 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 1/5 2026/04/30 06:18:40 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 2/5 2026/04/30 06:18:40 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/04/30 06:18:40 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/04/30 06:18:40 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/04/30 06:18:40 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms 2026/04/30 06:18:40 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG: trying again in 10ms --- PASS: TestRetry (0.05s) === RUN TestCat run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestCat (14.31s) === RUN TestPurge 2026/04/30 06:18:54 DEBUG : Creating backend with remote "TestDrime:rclone-test-raxedal9lumu" 2026/04/30 06:18:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/30 06:18:55 DEBUG : Creating backend with remote "/tmp/rclone704530802" run.go:185: Remote "drime root 'rclone-test-raxedal9lumu'", Local "Local file system at /tmp/rclone704530802", Modify Window "876000h0m0s" 2026/04/30 06:18:57 INFO : A2: Making directory 2026/04/30 06:18:58 INFO : A1/B2: Making directory 2026/04/30 06:18:58 INFO : A1/B2/C2: Making directory 2026/04/30 06:18:59 INFO : A1/B1/C3: Making directory 2026/04/30 06:18:59 INFO : A3: Making directory 2026/04/30 06:19:00 INFO : A3/B3: Making directory 2026/04/30 06:19:00 INFO : A3/B3/C4: Making directory fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/30 06:19:13 ERROR : error listing: directory not found 2026/04/30 06:19:13 DEBUG : drime root 'rclone-test-raxedal9lumu': Purge remote 2026/04/30 06:19:13 NOTICE: purge failed: directory not found --- PASS: TestPurge (18.68s) === RUN TestRmdirsNoLeaveRoot run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:19:15 INFO : A2: Making directory 2026/04/30 06:19:15 INFO : A1/B2: Making directory 2026/04/30 06:19:16 INFO : A1/B2/C2: Making directory 2026/04/30 06:19:16 INFO : A1/B1/C3: Making directory 2026/04/30 06:19:17 INFO : A3: Making directory 2026/04/30 06:19:17 INFO : A3/B3: Making directory 2026/04/30 06:19:18 INFO : A3/B3/C4: Making directory 2026/04/30 06:19:21 DEBUG : removing 1 level 3 directories 2026/04/30 06:19:21 INFO : A3/B3/C4: Removing directory 2026/04/30 06:19:23 DEBUG : removing 2 level 3 directories 2026/04/30 06:19:23 INFO : A1/B2/C2: Removing directory 2026/04/30 06:19:23 INFO : A1/B1/C3: Removing directory 2026/04/30 06:19:23 DEBUG : removing 2 level 2 directories 2026/04/30 06:19:23 INFO : A3/B3: Removing directory 2026/04/30 06:19:23 INFO : A1/B2: Removing directory 2026/04/30 06:19:24 DEBUG : removing 2 level 1 directories 2026/04/30 06:19:24 INFO : A3: Removing directory 2026/04/30 06:19:24 INFO : A2: Removing directory 2026/04/30 06:19:27 DEBUG : removing 1 level 3 directories 2026/04/30 06:19:27 INFO : A1/B1/C1: Removing directory 2026/04/30 06:19:28 DEBUG : removing 1 level 2 directories 2026/04/30 06:19:28 INFO : A1/B1: Removing directory 2026/04/30 06:19:28 ERROR : A1/B1: Failed to rmdir: directory not empty operations_test.go:728: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:728 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestRmdirsNoLeaveRoot run.go:130: removing dir "A1" failed - try 1/3: directory not empty --- FAIL: TestRmdirsNoLeaveRoot (17.96s) === RUN TestRmdirsLeaveRoot run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:19:31 INFO : A1: Making directory 2026/04/30 06:19:31 INFO : A1/B1: Making directory 2026/04/30 06:19:32 INFO : A1/B1/C1: Making directory 2026/04/30 06:19:34 DEBUG : removing 1 level 3 directories 2026/04/30 06:19:34 INFO : A1/B1/C1: Removing directory 2026/04/30 06:19:34 DEBUG : removing 1 level 2 directories 2026/04/30 06:19:34 INFO : A1/B1: Removing directory --- PASS: TestRmdirsLeaveRoot (5.20s) === RUN TestRmdirsWithFilter run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:19:36 INFO : A1: Making directory 2026/04/30 06:19:37 INFO : A1/B1: Making directory 2026/04/30 06:19:37 INFO : A1/B1/C1: Making directory 2026/04/30 06:19:39 DEBUG : removing 1 level 3 directories 2026/04/30 06:19:39 INFO : A1/B1/C1: Removing directory 2026/04/30 06:19:39 DEBUG : removing 1 level 2 directories 2026/04/30 06:19:39 INFO : A1/B1: Removing directory --- PASS: TestRmdirsWithFilter (5.23s) === RUN TestCopyURL run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:19:43 DEBUG : filename.txt: File name found in url 2026/04/30 06:19:43 DEBUG : headerfilename.txt: filename found in Content-Disposition header. fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestCopyURL (13.09s) === RUN TestCopyURLDownloadHeaders run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestCopyURLDownloadHeaders (9.05s) === RUN TestCopyURLToWriter --- PASS: TestCopyURLToWriter (0.00s) === RUN TestMoveFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:04 DEBUG : file1: Need to transfer - File not found at Destination 2026/04/30 06:20:05 DEBUG : sub/file2: size = 14 OK 2026/04/30 06:20:05 INFO : file1: Copied (new) to: sub/file2 2026/04/30 06:20:05 INFO : file1: Deleted 2026/04/30 06:20:05 DEBUG : sub/file2: size = 14 OK 2026/04/30 06:20:05 DEBUG : file1: Sizes identical 2026/04/30 06:20:05 DEBUG : file1: Unchanged skipping 2026/04/30 06:20:05 INFO : file1: Deleted 2026/04/30 06:20:06 DEBUG : drime root 'rclone-test-zubezac7hini': don't need to copy/move sub/file2, it is already at target location run.go:130: removing dir "sub" failed - try 1/3: directory not empty --- PASS: TestMoveFile (5.32s) === RUN TestMoveFileWithIgnoreExisting run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:09 DEBUG : file1: Need to transfer - File not found at Destination 2026/04/30 06:20:10 DEBUG : file1: size = 14 OK 2026/04/30 06:20:10 INFO : file1: Copied (new) 2026/04/30 06:20:10 INFO : file1: Deleted 2026/04/30 06:20:10 DEBUG : file1: Destination exists, skipping 2026/04/30 06:20:10 DEBUG : file1: Not removing source file as destination file exists and --ignore-existing is set --- PASS: TestMoveFileWithIgnoreExisting (2.18s) === RUN TestCaseInsensitiveMoveFile run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestCaseInsensitiveMoveFile (0.39s) === RUN TestCaseInsensitiveMoveFileDryRun run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestCaseInsensitiveMoveFileDryRun (0.43s) === RUN TestMoveFileBackupDir run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:14 DEBUG : Creating backend with remote "TestDrime:rclone-test-zubezac7hini/backup" 2026/04/30 06:20:15 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone214006230) 2026/04/30 06:20:15 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-zubezac7hini') 2026/04/30 06:20:15 DEBUG : dst/file1: Sizes differ 2026/04/30 06:20:17 INFO : dst/file1: Moved (server-side) 2026/04/30 06:20:18 DEBUG : dst/file1: size = 14 OK 2026/04/30 06:20:18 INFO : dst/file1: Copied (new) 2026/04/30 06:20:18 INFO : dst/file1: Deleted --- PASS: TestMoveFileBackupDir (9.39s) === RUN TestSameConfig --- PASS: TestSameConfig (0.00s) === RUN TestSame --- PASS: TestSame (0.00s) === RUN TestOverlappingFilterCheckWithoutFilter --- PASS: TestOverlappingFilterCheckWithoutFilter (0.00s) === RUN TestOverlappingFilterCheckWithFilter --- PASS: TestOverlappingFilterCheckWithFilter (0.00s) === RUN TestListFormat --- PASS: TestListFormat (0.00s) === RUN TestDirMove run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:27 INFO : A1/B2: Making directory 2026/04/30 06:20:27 INFO : A1/B1/C3: Making directory operations_test.go:1411: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1411 Error: Received unexpected error: Move rename leaf: failed to patch item "name" to A2: Error "520 (520): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-520/\",\"title\":\"Error 520: Web server is returning an unknown error\",\"status\":520,\"detail\":\"The origin web server sent a response that Cloudflare could not parse. This may indicate the origin returned an empty response, malformed HTTP headers, or an otherwise invalid response.\",\"instance\":\"9f4470db1dc0c4ec\",\"error_code\":520,\"error_name\":\"unknown_origin_error\",\"error_category\":\"origin\",\"ray_id\":\"9f4470db1dc0c4ec\",\"timestamp\":\"2026-04-30T06:20:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check the origin server error logs and submit them to Cloudflare support.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}" Test: TestDirMove --- FAIL: TestDirMove (12.41s) === RUN TestGetFsInfo run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" --- PASS: TestGetFsInfo (0.36s) === RUN TestRcat === RUN TestRcat/withChecksum=false,ignoreChecksum=false run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:34 DEBUG : drime root 'rclone-test-zubezac7hini': File to upload is small (34 bytes), uploading instead of streaming 2026/04/30 06:20:35 DEBUG : no_checksum_small_file_from_pipe: size = 34 OK 2026/04/30 06:20:35 NOTICE: drime root 'rclone-test-zubezac7hini': --checksum is in use but the source and destination have no hashes in common; falling back to --size-only 2026/04/30 06:20:35 DEBUG : no_checksum_small_file_from_pipe: Size of src and dst objects identical 2026/04/30 06:20:35 NOTICE: drime root 'rclone-test-zubezac7hini': Streaming uploads using chunk size 5Mi will have maximum file size of 48.828Gi 2026/04/30 06:20:35 DEBUG : no_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2026/04/30 06:20:37 DEBUG : no_checksum_big_file_from_pipe: size = 102401 OK 2026/04/30 06:20:37 DEBUG : no_checksum_big_file_from_pipe: Size of src and dst objects identical fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestRcat/withChecksum=true,ignoreChecksum=false run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:45 DEBUG : drime root 'rclone-test-zubezac7hini': File to upload is small (34 bytes), uploading instead of streaming 2026/04/30 06:20:46 DEBUG : with_checksum_small_file_from_pipe: size = 34 OK 2026/04/30 06:20:46 DEBUG : with_checksum_small_file_from_pipe: Size of src and dst objects identical 2026/04/30 06:20:46 DEBUG : with_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2026/04/30 06:20:47 DEBUG : with_checksum_big_file_from_pipe: size = 102401 OK 2026/04/30 06:20:47 DEBUG : with_checksum_big_file_from_pipe: Size of src and dst objects identical fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestRcat/withChecksum=false,ignoreChecksum=true run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:20:56 DEBUG : drime root 'rclone-test-zubezac7hini': File to upload is small (34 bytes), uploading instead of streaming 2026/04/30 06:20:57 DEBUG : ignore_checksum_small_file_from_pipe: size = 34 OK 2026/04/30 06:20:57 DEBUG : ignore_checksum_small_file_from_pipe: Sizes identical 2026/04/30 06:20:57 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2026/04/30 06:20:58 DEBUG : ignore_checksum_big_file_from_pipe: size = 102401 OK 2026/04/30 06:20:58 DEBUG : ignore_checksum_big_file_from_pipe: Sizes identical fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure === RUN TestRcat/withChecksum=true,ignoreChecksum=true run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:21:07 DEBUG : drime root 'rclone-test-zubezac7hini': File to upload is small (34 bytes), uploading instead of streaming 2026/04/30 06:21:08 DEBUG : ignore_checksum_small_file_from_pipe: size = 34 OK 2026/04/30 06:21:08 DEBUG : ignore_checksum_small_file_from_pipe: Size of src and dst objects identical 2026/04/30 06:21:09 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2026/04/30 06:21:09 DEBUG : ignore_checksum_big_file_from_pipe: size = 102401 OK 2026/04/30 06:21:09 DEBUG : ignore_checksum_big_file_from_pipe: Size of src and dst objects identical fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestRcat (44.41s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (11.13s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=false (10.98s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=true (10.90s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=true (11.40s) === RUN TestRcatMetadata run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1563: Skipping as destination doesn't support user metadata --- SKIP: TestRcatMetadata (0.38s) === RUN TestRcatSize run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" 2026/04/30 06:21:19 DEBUG : drime root 'rclone-test-zubezac7hini': File to upload is small (60 bytes), uploading instead of streaming 2026/04/30 06:21:20 DEBUG : potato2: size = 60 OK 2026/04/30 06:21:20 DEBUG : potato2: Size of src and dst objects identical fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestRcatSize (17.30s) === RUN TestRcatSizeMetadata run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1644: Skipping as destination doesn't support user metadata --- SKIP: TestRcatSizeMetadata (0.45s) === RUN TestRcatSizeUploadHeaders run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestRcatSizeUploadHeaders (8.66s) === RUN TestTouchDir run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1735: Skipping test as remote does not support modtime --- SKIP: TestTouchDir (0.37s) === RUN TestMkdirMetadata run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1773: Skipping test as remote does not support MkdirMetadata --- SKIP: TestMkdirMetadata (0.39s) === RUN TestMkdirModTime run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1792: Skipping test as remote does not support DirSetModTime or MkdirMetadata --- SKIP: TestMkdirModTime (0.38s) === RUN TestCopyDirMetadata run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1813: Skipping test as remote does not support WriteDirMetadata or MkdirMetadata --- SKIP: TestCopyDirMetadata (0.49s) === RUN TestSetDirModTime run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1849: Skipping test as remote does not support DirSetModTime or WriteDirSetModTime --- SKIP: TestSetDirModTime (0.37s) === RUN TestDirsEqual run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" operations_test.go:1893: Skipping test as remote does not support WriteDirMetadata or MkdirMetadata --- SKIP: TestDirsEqual (0.36s) === RUN TestRemoveExisting run.go:185: Remote "drime root 'rclone-test-zubezac7hini'", Local "Local file system at /tmp/rclone214006230", Modify Window "876000h0m0s" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure 2026/04/30 06:21:59 DEBUG : sub dir/test remove existing: TEST: renaming existing object to "sub dir/test remove existing.buqitet3" before starting operations_test.go:1981: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1981 Error: Not equal: expected: *fmt.wrapError(&fmt.wrapError{msg:"TEST: failed to rename existing file: Move rename leaf: failed to patch item \"name\" to test remove existing.buqitet3: Error \"520 (520): {\\\"type\\\":\\\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-520/\\\",\\\"title\\\":\\\"Error 520: Web server is returning an unknown error\\\",\\\"status\\\":520,\\\"detail\\\":\\\"The origin web server sent a response that Cloudflare could not parse. This may indicate the origin returned an empty response, malformed HTTP headers, or an otherwise invalid response.\\\",\\\"instance\\\":\\\"9f44730c9bedc4ec\\\",\\\"error_code\\\":520,\\\"error_name\\\":\\\"unknown_origin_error\\\",\\\"error_category\\\":\\\"origin\\\",\\\"ray_id\\\":\\\"9f44730c9bedc4ec\\\",\\\"timestamp\\\":\\\"2026-04-30T06:21:59Z\\\",\\\"zone\\\":\\\"app.drime.cloud\\\",\\\"cloudflare_error\\\":true,\\\"retryable\\\":true,\\\"retry_after\\\":60,\\\"owner_action_required\\\":true,\\\"what_you_should_do\\\":\\\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check the origin server error logs and submit them to Cloudflare support.\\\",\\\"footer\\\":\\\"This error was generated by Cloudflare on behalf of the website owner.\\\"}\"", err:(*fmt.wrapError)(0x339fb95b5600)}) actual : () Test: TestRemoveExisting operations_test.go:1989: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1989 Error: " 11 sub dir/test remove existing\n 21 sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890123456789\n" should not contain " 11 sub dir/test remove existing\n" Test: TestRemoveExisting operations_test.go:1990: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1990 Error: " 11 sub dir/test remove existing\n 21 sub dir/test remove existing with long name 123456789012345678901234567890123456789012345678901234567890123456789\n" does not contain " 11 sub dir/test remove existing." Test: TestRemoveExisting run.go:130: removing dir "sub dir" failed - try 1/3: directory not empty --- FAIL: TestRemoveExisting (14.25s) panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked] [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x2199184] goroutine 7365 [running]: testing.tRunner.func1.2({0x252f5c0, 0x45f9ab0}) /usr/local/go/src/testing/testing.go:1974 +0x232 testing.tRunner.func1() /usr/local/go/src/testing/testing.go:1977 +0x349 panic({0x252f5c0?, 0x45f9ab0?}) /usr/local/go/src/runtime/panic.go:860 +0x13a github.com/rclone/rclone/fs/operations_test.TestRemoveExisting(0x339fb90a4248) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1993 +0x8c4 testing.tRunner(0x339fb90a4248, 0x2bb8c30) /usr/local/go/src/testing/testing.go:2036 +0xea created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:2101 +0x4c5 "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose" - Finished ERROR in 15m52.57344212s (try 5/5): exit status 2: Failed [TestParseSumFile TestCheckSumDownload TestCopyFileCompareDest TestCopyFileCopyDest TestMaxDelete TestMaxDeleteSize TestRmdirsNoLeaveRoot TestDirMove TestRemoveExisting]