"./operations.test -test.v -test.timeout 1h0m0s -remote 'TestAzureBlob,directory_markers:' -verbose -fast-list" - Starting (try 1/5) 2025/02/13 18:53:46 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune" 2025/02/13 18:53:46 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:53:46 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:53:46 DEBUG : Azure container rclone-test-docetur0dune: Using directory markers 2025/02/13 18:53:46 DEBUG : Creating backend with remote "/tmp/rclone1152752433" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:53:46 DEBUG : chunksize-probe: Multipart upload session started for 25 parts of size 4Mi 2025/02/13 18:53:46 DEBUG : chunksize-probe: open chunk writer: started multipart upload 2025/02/13 18:53:46 DEBUG : chunksize-probe: multipart upload aborted (did nothing - see issue #5583) === RUN TestMultithreadCopy/upload=false,size=8388607,streams=2 2025/02/13 18:53:46 DEBUG : test-multithread-copy-false-8388607-2: Multipart upload session started for 2 parts of size 4Mi 2025/02/13 18:53:46 DEBUG : test-multithread-copy-false-8388607-2: open chunk writer: started multipart upload 2025/02/13 18:53:46 DEBUG : test-multithread-copy-false-8388607-2: multipart upload: starting chunk 0 size 4Mi offset 0/8.000Mi 2025/02/13 18:53:46 DEBUG : test-multithread-copy-false-8388607-2: multipart upload: starting chunk 1 size 4.000Mi offset 4Mi/8.000Mi 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multipart upload wrote chunk 2 with 4194303 bytes 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multipart upload finished 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: write buffer set to 131072 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: chunk size 64Mi was bigger than source file size 8.000Mi 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: Starting multi-thread copy with 1 chunks of size 8.000Mi with 1 parallel streams 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: chunk 1/1 (0-8388607) size 8.000Mi starting 2025/02/13 18:53:47 DEBUG : test-multithread-copy-false-8388607-2: writing chunk 0 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: chunk 1/1 (0-8388607) size 8.000Mi finished 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388607-2: Finished multi-thread copy with 1 parts of size 8.000Mi === RUN TestMultithreadCopy/upload=false,size=8388608,streams=2 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388608-2: Multipart upload session started for 2 parts of size 4Mi 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388608-2: open chunk writer: started multipart upload 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388608-2: multipart upload: starting chunk 0 size 4Mi offset 0/8Mi 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388608-2: multipart upload: starting chunk 1 size 4Mi offset 4Mi/8Mi 2025/02/13 18:53:48 DEBUG : test-multithread-copy-false-8388608-2: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multipart upload wrote chunk 2 with 4194304 bytes 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multipart upload finished 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: write buffer set to 131072 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: chunk size 64Mi was bigger than source file size 8Mi 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: Starting multi-thread copy with 1 chunks of size 8Mi with 1 parallel streams 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: chunk 1/1 (0-8388608) size 8Mi starting 2025/02/13 18:53:49 DEBUG : test-multithread-copy-false-8388608-2: writing chunk 0 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: chunk 1/1 (0-8388608) size 8Mi finished 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388608-2: Finished multi-thread copy with 1 parts of size 8Mi === RUN TestMultithreadCopy/upload=false,size=8388609,streams=2 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: Multipart upload session started for 3 parts of size 4Mi 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: open chunk writer: started multipart upload 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload: starting chunk 0 size 4Mi offset 0/8.000Mi 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload: starting chunk 2 size 1 offset 8Mi/8.000Mi 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload: starting chunk 1 size 4Mi offset 4Mi/8.000Mi 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload wrote chunk 3 with 1 bytes 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload wrote chunk 2 with 4194304 bytes 2025/02/13 18:53:50 DEBUG : test-multithread-copy-false-8388609-2: multipart upload finished 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: write buffer set to 131072 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: chunk size 64Mi was bigger than source file size 8.000Mi 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: Starting multi-thread copy with 1 chunks of size 8.000Mi with 1 parallel streams 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: chunk 1/1 (0-8388609) size 8.000Mi starting 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: writing chunk 0 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: chunk 1/1 (0-8388609) size 8.000Mi finished 2025/02/13 18:53:51 DEBUG : test-multithread-copy-false-8388609-2: Finished multi-thread copy with 1 parts of size 8.000Mi === RUN TestMultithreadCopy/upload=true,size=8388607,streams=2 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: disabling buffering because source is local disk 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: Multipart upload session started for 2 parts of size 4Mi 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: open chunk writer: started multipart upload 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 2 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: number of streams 16 was bigger than number of chunks 2 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: Starting multi-thread copy with 2 chunks of size 4Mi with 2 parallel streams 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 2/2 (4194304-8388607) size 4.000Mi starting 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi starting 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: Seek from 4194304 to 0 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: Seek from 4194303 to 0 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi finished 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multipart upload wrote chunk 2 with 4194303 bytes 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 2/2 (4194304-8388607) size 4.000Mi finished 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: multipart upload finished 2025/02/13 18:53:52 DEBUG : test-multithread-copy-true-8388607-2: Finished multi-thread copy with 2 parts of size 4Mi === RUN TestMultithreadCopy/upload=true,size=8388608,streams=2 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: disabling buffering because source is local disk 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: Multipart upload session started for 2 parts of size 4Mi 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: open chunk writer: started multipart upload 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 2 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: number of streams 16 was bigger than number of chunks 2 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: Starting multi-thread copy with 2 chunks of size 4Mi with 2 parallel streams 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 2/2 (4194304-8388608) size 4Mi starting 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi starting 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: Seek from 4194304 to 0 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: Seek from 4194304 to 0 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi finished 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multipart upload wrote chunk 2 with 4194304 bytes 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 2/2 (4194304-8388608) size 4Mi finished 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: multipart upload finished 2025/02/13 18:53:54 DEBUG : test-multithread-copy-true-8388608-2: Finished multi-thread copy with 2 parts of size 4Mi === RUN TestMultithreadCopy/upload=true,size=8388609,streams=2 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: disabling buffering because source is local disk 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: Multipart upload session started for 3 parts of size 4Mi 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: open chunk writer: started multipart upload 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 2 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: number of streams 16 was bigger than number of chunks 3 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: Starting multi-thread copy with 3 chunks of size 4Mi with 3 parallel streams 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 3/3 (8388608-8388609) size 1 starting 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: Seek from 1 to 0 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi starting 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi starting 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: Seek from 4194304 to 0 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: Seek from 4194304 to 0 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multipart upload wrote chunk 3 with 1 bytes 2025/02/13 18:53:55 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 3/3 (8388608-8388609) size 1 finished 2025/02/13 18:53:56 DEBUG : test-multithread-copy-true-8388609-2: multipart upload wrote chunk 2 with 4194304 bytes 2025/02/13 18:53:56 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi finished 2025/02/13 18:53:56 DEBUG : test-multithread-copy-true-8388609-2: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:56 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi finished 2025/02/13 18:53:56 DEBUG : test-multithread-copy-true-8388609-2: multipart upload finished 2025/02/13 18:53:56 DEBUG : test-multithread-copy-true-8388609-2: Finished multi-thread copy with 3 parts of size 4Mi --- PASS: TestMultithreadCopy (10.31s) --- PASS: TestMultithreadCopy/upload=false,size=8388607,streams=2 (2.03s) --- PASS: TestMultithreadCopy/upload=false,size=8388608,streams=2 (1.86s) --- PASS: TestMultithreadCopy/upload=false,size=8388609,streams=2 (1.46s) --- PASS: TestMultithreadCopy/upload=true,size=8388607,streams=2 (1.52s) --- PASS: TestMultithreadCopy/upload=true,size=8388608,streams=2 (1.58s) --- PASS: TestMultithreadCopy/upload=true,size=8388609,streams=2 (1.59s) === RUN TestMultithreadCopyAbort run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:53:56 DEBUG : chunksize-probe: Multipart upload session started for 25 parts of size 4Mi 2025/02/13 18:53:56 DEBUG : chunksize-probe: open chunk writer: started multipart upload 2025/02/13 18:53:56 DEBUG : chunksize-probe: multipart upload aborted (did nothing - see issue #5583) 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2025/02/13 18:53:57 DEBUG : test-multithread-abort: Multipart upload session started for 3 parts of size 4Mi 2025/02/13 18:53:57 DEBUG : test-multithread-abort: open chunk writer: started multipart upload 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 1 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: number of streams 16 was bigger than number of chunks 3 2025/02/13 18:53:57 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 4Mi with 3 parallel streams 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (8388608-8388609) size 1 starting 2025/02/13 18:53:57 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi starting 2025/02/13 18:53:57 DEBUG : Open with options = [RangeOption(0,4194303)] 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi starting 2025/02/13 18:53:57 DEBUG : Open with options = [RangeOption(4194304,8388607)] 2025/02/13 18:53:57 DEBUG : test-multithread-abort: Seek from 4194304 to 0 2025/02/13 18:53:57 DEBUG : Open with options = [RangeOption(4194304,8388607)] 2025/02/13 18:53:57 DEBUG : test-multithread-abort: Seek from 4194304 to 0 2025/02/13 18:53:57 DEBUG : Open with options = [RangeOption(0,4194303)] 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multipart upload wrote chunk 2 with 4194304 bytes 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi finished 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multipart upload wrote chunk 1 with 4194304 bytes 2025/02/13 18:53:57 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi finished 2025/02/13 18:53:58 DEBUG : Returning error reader 2025/02/13 18:53:58 DEBUG : BOOM: simulated read failure 2025/02/13 18:53:58 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2025/02/13 18:53:58 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:53:59 DEBUG : Returning error reader 2025/02/13 18:53:59 DEBUG : BOOM: simulated read failure 2025/02/13 18:53:59 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2025/02/13 18:53:59 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:00 DEBUG : Returning error reader 2025/02/13 18:54:00 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:00 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2025/02/13 18:54:00 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:01 DEBUG : Returning error reader 2025/02/13 18:54:01 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:01 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2025/02/13 18:54:01 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:02 DEBUG : Returning error reader 2025/02/13 18:54:02 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:02 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2025/02/13 18:54:02 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:03 DEBUG : Returning error reader 2025/02/13 18:54:03 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:03 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2025/02/13 18:54:03 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:04 DEBUG : Returning error reader 2025/02/13 18:54:04 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:04 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2025/02/13 18:54:04 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:05 DEBUG : Returning error reader 2025/02/13 18:54:05 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:05 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2025/02/13 18:54:05 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:06 DEBUG : Returning error reader 2025/02/13 18:54:06 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:06 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2025/02/13 18:54:06 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2025/02/13 18:54:07 DEBUG : Returning error reader 2025/02/13 18:54:07 DEBUG : BOOM: simulated read failure 2025/02/13 18:54:07 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2025/02/13 18:54:07 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2025/02/13 18:54:07 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: BOOM: simulated read failure 2025/02/13 18:54:07 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit 2025/02/13 18:54:07 DEBUG : test-multithread-abort: multipart upload aborted (did nothing - see issue #5583) --- PASS: TestMultithreadCopyAbort (10.99s) === RUN TestSizeDiffers --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2025/02/13 18:54:07 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/Seek 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2025/02/13 18:54:07 DEBUG : potato: Seek from 10 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 10 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/Seek 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Seek from 5 to 2 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2025/02/13 18:54:07 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/Seek 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Seek from 5 to 2 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2025/02/13 18:54:07 DEBUG : potato: Seek from 8 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 8 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2025/02/13 18:54:07 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/02/13 18:54:07 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/Seek 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/02/13 18:54:07 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/02/13 18:54:07 DEBUG : potato: Seek from 5 to 2 2025/02/13 18:54:07 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2025/02/13 18:54:07 DEBUG : potato: Seek from 9 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 9 to 0 2025/02/13 18:54:07 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (1.19s) --- PASS: TestCheck/1 (0.04s) --- PASS: TestCheck/2 (0.04s) --- PASS: TestCheck/3 (0.04s) --- PASS: TestCheck/4 (0.07s) --- PASS: TestCheck/5 (0.07s) --- PASS: TestCheck/6 (0.07s) --- PASS: TestCheck/7 (0.07s) === RUN TestCheckFsError 2025/02/13 18:54:08 DEBUG : Creating backend with remote "nonexistent" 2025/02/13 18:54:08 DEBUG : Creating backend with remote "nonexistent" 2025/02/13 18:54:08 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2025/02/13 18:54:08 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2025/02/13 18:54:08 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 differences found 2025/02/13 18:54:08 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (1.45s) --- PASS: TestCheckDownload/1 (0.07s) --- PASS: TestCheckDownload/2 (0.07s) --- PASS: TestCheckDownload/3 (0.07s) --- PASS: TestCheckDownload/4 (0.11s) --- PASS: TestCheckDownload/5 (0.11s) --- PASS: TestCheckDownload/6 (0.11s) --- PASS: TestCheckDownload/7 (0.11s) === RUN TestCheckSizeOnly run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (1.22s) --- PASS: TestCheckSizeOnly/1 (0.04s) --- PASS: TestCheckSizeOnly/2 (0.04s) --- PASS: TestCheckSizeOnly/3 (0.04s) --- PASS: TestCheckSizeOnly/4 (0.07s) --- PASS: TestCheckSizeOnly/5 (0.07s) --- PASS: TestCheckSizeOnly/6 (0.07s) --- PASS: TestCheckSizeOnly/7 (0.07s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:11 NOTICE: test.sum: improperly formatted checksum line 4 2025/02/13 18:54:11 NOTICE: test.sum: improperly formatted checksum line 5 2025/02/13 18:54:11 NOTICE: test.sum: improperly formatted checksum line 6 2025/02/13 18:54:11 NOTICE: test.sum: 2 warning(s) suppressed... 2025/02/13 18:54:11 NOTICE: test.sum: improperly formatted checksum line 4 2025/02/13 18:54:11 NOTICE: test.sum: improperly formatted checksum line 5 2025/02/13 18:54:11 NOTICE: test.sum: improperly formatted checksum line 6 2025/02/13 18:54:11 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (0.42s) === RUN TestCheckSum run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:11 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/data" 2025/02/13 18:54:11 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:11 DEBUG : Azure container rclone-test-docetur0dune path data: Using directory markers 2025/02/13 18:54:11 DEBUG : data/: Creating directory marker === RUN TestCheckSum/subtest1 === RUN TestCheckSum/subtest2 === RUN TestCheckSum/subtest3 === RUN TestCheckSum/subtest4 === RUN TestCheckSum/subtest5 === RUN TestCheckSum/subtest6 === RUN TestCheckSum/subtest7 2025/02/13 18:54:14 DEBUG : data/: Removing directory marker --- PASS: TestCheckSum (2.88s) --- PASS: TestCheckSum/subtest1 (0.11s) --- PASS: TestCheckSum/subtest2 (0.15s) --- PASS: TestCheckSum/subtest3 (0.15s) --- PASS: TestCheckSum/subtest4 (0.15s) --- PASS: TestCheckSum/subtest5 (0.15s) --- PASS: TestCheckSum/subtest6 (0.15s) --- PASS: TestCheckSum/subtest7 (0.15s) === RUN TestCheckSumDownload run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:14 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/data" 2025/02/13 18:54:14 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:14 DEBUG : Azure container rclone-test-docetur0dune path data: Using directory markers 2025/02/13 18:54:14 DEBUG : data/: Creating directory marker === RUN TestCheckSumDownload/subtest1 === RUN TestCheckSumDownload/subtest2 === RUN TestCheckSumDownload/subtest3 === RUN TestCheckSumDownload/subtest4 === RUN TestCheckSumDownload/subtest5 === RUN TestCheckSumDownload/subtest6 === RUN TestCheckSumDownload/subtest7 2025/02/13 18:54:17 DEBUG : data/: Removing directory marker --- PASS: TestCheckSumDownload (3.17s) --- PASS: TestCheckSumDownload/subtest1 (0.15s) --- PASS: TestCheckSumDownload/subtest2 (0.19s) --- PASS: TestCheckSumDownload/subtest3 (0.19s) --- PASS: TestCheckSumDownload/subtest4 (0.19s) --- PASS: TestCheckSumDownload/subtest5 (0.19s) --- PASS: TestCheckSumDownload/subtest6 (0.19s) --- PASS: TestCheckSumDownload/subtest7 (0.19s) === RUN TestApplyTransforms 2025/02/13 18:54:17 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-bahapus9keye" 2025/02/13 18:54:17 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:17 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:17 DEBUG : Azure container rclone-test-bahapus9keye: Using directory markers 2025/02/13 18:54:17 DEBUG : Creating backend with remote "/tmp/rclone3362877636" run.go:180: Remote "Azure container rclone-test-bahapus9keye", Local "Local file system at /tmp/rclone3362877636", Modify Window "1ns" upper checkfile vs. lower remote (without normalization) 2025/02/13 18:54:18 ERROR : hello, world!: sum not found 2025/02/13 18:54:18 ERROR : HELLO, WORLD!: file not in Azure container rclone-test-bahapus9keye 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-bahapus9keye: 1 files missing 2025/02/13 18:54:18 NOTICE: 1 hashes missing 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-bahapus9keye: 2 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-bahapus9keye: 2 errors while checking upper checkfile vs. lower remote (with normalization) 2025/02/13 18:54:18 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-bahapus9keye: 0 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-bahapus9keye: 1 matching files 2025/02/13 18:54:18 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-pinopez5topi" 2025/02/13 18:54:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:18 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:18 DEBUG : Azure container rclone-test-pinopez5topi: Using directory markers 2025/02/13 18:54:18 DEBUG : Creating backend with remote "/tmp/rclone3749285696" run.go:180: Remote "Azure container rclone-test-pinopez5topi", Local "Local file system at /tmp/rclone3749285696", Modify Window "1ns" lower checkfile vs. upper remote (without normalization) 2025/02/13 18:54:18 ERROR : HELLO, WORLD!: sum not found 2025/02/13 18:54:18 ERROR : hello, world!: file not in Azure container rclone-test-pinopez5topi 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-pinopez5topi: 1 files missing 2025/02/13 18:54:18 NOTICE: 1 hashes missing 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-pinopez5topi: 2 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-pinopez5topi: 2 errors while checking lower checkfile vs. upper remote (with normalization) 2025/02/13 18:54:18 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-pinopez5topi: 0 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-pinopez5topi: 1 matching files 2025/02/13 18:54:18 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-yomokof6teru" 2025/02/13 18:54:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:18 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:18 DEBUG : Azure container rclone-test-yomokof6teru: Using directory markers 2025/02/13 18:54:18 DEBUG : Creating backend with remote "/tmp/rclone126620756" run.go:180: Remote "Azure container rclone-test-yomokof6teru", Local "Local file system at /tmp/rclone126620756", Modify Window "1ns" lower checkfile vs. upperlowermixed remote (without normalization) 2025/02/13 18:54:18 ERROR : HeLlO, wOrLd!: sum not found 2025/02/13 18:54:18 ERROR : hello, world!: file not in Azure container rclone-test-yomokof6teru 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-yomokof6teru: 1 files missing 2025/02/13 18:54:18 NOTICE: 1 hashes missing 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-yomokof6teru: 2 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-yomokof6teru: 2 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2025/02/13 18:54:18 DEBUG : HeLlO, wOrLd!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-yomokof6teru: 0 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-yomokof6teru: 1 matching files 2025/02/13 18:54:18 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-kofunig4zuke" 2025/02/13 18:54:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:18 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:18 DEBUG : Azure container rclone-test-kofunig4zuke: Using directory markers 2025/02/13 18:54:18 DEBUG : Creating backend with remote "/tmp/rclone1107956808" run.go:180: Remote "Azure container rclone-test-kofunig4zuke", Local "Local file system at /tmp/rclone1107956808", Modify Window "1ns" upperlowermixed checkfile vs. upper remote (without normalization) 2025/02/13 18:54:18 ERROR : HELLO, WORLD!: sum not found 2025/02/13 18:54:18 ERROR : HeLlO, wOrLd!: file not in Azure container rclone-test-kofunig4zuke 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-kofunig4zuke: 1 files missing 2025/02/13 18:54:18 NOTICE: 1 hashes missing 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-kofunig4zuke: 2 differences found 2025/02/13 18:54:18 NOTICE: Azure container rclone-test-kofunig4zuke: 2 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2025/02/13 18:54:19 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-kofunig4zuke: 0 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-kofunig4zuke: 1 matching files 2025/02/13 18:54:19 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-teyapac4zuya" 2025/02/13 18:54:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:19 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:19 DEBUG : Azure container rclone-test-teyapac4zuya: Using directory markers 2025/02/13 18:54:19 DEBUG : Creating backend with remote "/tmp/rclone1259465609" run.go:180: Remote "Azure container rclone-test-teyapac4zuya", Local "Local file system at /tmp/rclone1259465609", Modify Window "1ns" NFD checkfile vs. NFC remote (without normalization) 2025/02/13 18:54:19 ERROR : 測試_Русский___ě_áñ: sum not found 2025/02/13 18:54:19 ERROR : 測試_Русский___ě_áñ: file not in Azure container rclone-test-teyapac4zuya 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-teyapac4zuya: 1 files missing 2025/02/13 18:54:19 NOTICE: 1 hashes missing 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-teyapac4zuya: 2 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-teyapac4zuya: 2 errors while checking NFD checkfile vs. NFC remote (with normalization) 2025/02/13 18:54:19 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-teyapac4zuya: 0 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-teyapac4zuya: 1 matching files 2025/02/13 18:54:19 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-gikukih6qero" 2025/02/13 18:54:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:19 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:19 DEBUG : Azure container rclone-test-gikukih6qero: Using directory markers 2025/02/13 18:54:19 DEBUG : Creating backend with remote "/tmp/rclone2849097924" run.go:180: Remote "Azure container rclone-test-gikukih6qero", Local "Local file system at /tmp/rclone2849097924", Modify Window "1ns" NFC checkfile vs. NFD remote (without normalization) 2025/02/13 18:54:19 ERROR : 測試_Русский___ě_áñ: sum not found 2025/02/13 18:54:19 ERROR : 測試_Русский___ě_áñ: file not in Azure container rclone-test-gikukih6qero 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-gikukih6qero: 1 files missing 2025/02/13 18:54:19 NOTICE: 1 hashes missing 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-gikukih6qero: 2 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-gikukih6qero: 2 errors while checking NFC checkfile vs. NFD remote (with normalization) 2025/02/13 18:54:19 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-gikukih6qero: 0 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-gikukih6qero: 1 matching files 2025/02/13 18:54:19 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-wecuqiv1nece" 2025/02/13 18:54:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:19 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:19 DEBUG : Azure container rclone-test-wecuqiv1nece: Using directory markers 2025/02/13 18:54:19 DEBUG : Creating backend with remote "/tmp/rclone3239608009" run.go:180: Remote "Azure container rclone-test-wecuqiv1nece", Local "Local file system at /tmp/rclone3239608009", Modify Window "1ns" NFDx2 checkfile vs. both remote (without normalization) 2025/02/13 18:54:19 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/02/13 18:54:19 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-wecuqiv1nece 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-wecuqiv1nece: 1 files missing 2025/02/13 18:54:19 NOTICE: 1 hashes missing 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-wecuqiv1nece: 2 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-wecuqiv1nece: 2 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2025/02/13 18:54:19 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-wecuqiv1nece: 0 differences found 2025/02/13 18:54:19 NOTICE: Azure container rclone-test-wecuqiv1nece: 1 matching files 2025/02/13 18:54:19 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-nobedel3zibi" 2025/02/13 18:54:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:19 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:19 DEBUG : Azure container rclone-test-nobedel3zibi: Using directory markers 2025/02/13 18:54:19 DEBUG : Creating backend with remote "/tmp/rclone1088034816" run.go:180: Remote "Azure container rclone-test-nobedel3zibi", Local "Local file system at /tmp/rclone1088034816", Modify Window "1ns" NFCx2 checkfile vs. both remote (without normalization) 2025/02/13 18:54:20 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/02/13 18:54:20 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-nobedel3zibi 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-nobedel3zibi: 1 files missing 2025/02/13 18:54:20 NOTICE: 1 hashes missing 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-nobedel3zibi: 2 differences found 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-nobedel3zibi: 2 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2025/02/13 18:54:20 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-nobedel3zibi: 0 differences found 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-nobedel3zibi: 1 matching files 2025/02/13 18:54:20 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-gaxigob0quse" 2025/02/13 18:54:20 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:20 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:20 DEBUG : Azure container rclone-test-gaxigob0quse: Using directory markers 2025/02/13 18:54:20 DEBUG : Creating backend with remote "/tmp/rclone2323042649" run.go:180: Remote "Azure container rclone-test-gaxigob0quse", Local "Local file system at /tmp/rclone2323042649", Modify Window "1ns" both checkfile vs. NFDx2 remote (without normalization) 2025/02/13 18:54:20 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/02/13 18:54:20 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-gaxigob0quse 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gaxigob0quse: 1 files missing 2025/02/13 18:54:20 NOTICE: 1 hashes missing 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gaxigob0quse: 2 differences found 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gaxigob0quse: 2 errors while checking both checkfile vs. NFDx2 remote (with normalization) 2025/02/13 18:54:20 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gaxigob0quse: 0 differences found 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gaxigob0quse: 1 matching files 2025/02/13 18:54:20 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-gejanef9yovi" 2025/02/13 18:54:20 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:20 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:20 DEBUG : Azure container rclone-test-gejanef9yovi: Using directory markers 2025/02/13 18:54:20 DEBUG : Creating backend with remote "/tmp/rclone1728823024" run.go:180: Remote "Azure container rclone-test-gejanef9yovi", Local "Local file system at /tmp/rclone1728823024", Modify Window "1ns" both checkfile vs. NFCx2 remote (without normalization) 2025/02/13 18:54:20 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/02/13 18:54:20 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-gejanef9yovi 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gejanef9yovi: 1 files missing 2025/02/13 18:54:20 NOTICE: 1 hashes missing 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gejanef9yovi: 2 differences found 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gejanef9yovi: 2 errors while checking both checkfile vs. NFCx2 remote (with normalization) 2025/02/13 18:54:20 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gejanef9yovi: 0 differences found 2025/02/13 18:54:20 NOTICE: Azure container rclone-test-gejanef9yovi: 1 matching files 2025/02/13 18:54:20 DEBUG : Azure container rclone-test-gejanef9yovi: Purge remote 2025/02/13 18:54:20 DEBUG : Azure container rclone-test-gaxigob0quse: Purge remote 2025/02/13 18:54:20 DEBUG : Azure container rclone-test-nobedel3zibi: Purge remote 2025/02/13 18:54:20 DEBUG : Azure container rclone-test-wecuqiv1nece: Purge remote 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-gikukih6qero: Purge remote 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-teyapac4zuya: Purge remote 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-kofunig4zuke: Purge remote 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-yomokof6teru: Purge remote 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-pinopez5topi: Purge remote 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-bahapus9keye: Purge remote --- PASS: TestApplyTransforms (3.60s) === RUN TestTruncateString --- PASS: TestTruncateString (0.00s) === RUN TestCopyFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:21 DEBUG : file1: Need to transfer - File not found at Destination 2025/02/13 18:54:21 DEBUG : sub/: Creating directory marker 2025/02/13 18:54:21 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/02/13 18:54:21 INFO : file1: Copied (new) to: sub/file2 2025/02/13 18:54:21 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:21 DEBUG : file1: Unchanged skipping 2025/02/13 18:54:21 DEBUG : Azure container rclone-test-docetur0dune: don't need to copy/move sub/file2, it is already at target location 2025/02/13 18:54:21 DEBUG : sub/: Removing directory marker --- PASS: TestCopyFile (0.51s) === RUN TestCopyLongFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" copy_test.go:153: Test only runs on local --- SKIP: TestCopyLongFile (0.08s) === RUN TestCopyFileBackupDir run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:22 DEBUG : dst/: Creating directory marker 2025/02/13 18:54:22 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/backup" 2025/02/13 18:54:22 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:22 DEBUG : Azure container rclone-test-docetur0dune path backup: Using directory markers 2025/02/13 18:54:22 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-docetur0dune/backup" to be canonical "TestAzureBlob{juk_h}:rclone-test-docetur0dune/backup" 2025/02/13 18:54:22 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2025/02/13 18:54:22 DEBUG : dst/: Creating directory marker 2025/02/13 18:54:22 DEBUG : dst/file1: md5 = 05164b153084ba910184c26e561a7c18 OK 2025/02/13 18:54:22 INFO : dst/file1: Copied (server-side copy) 2025/02/13 18:54:22 INFO : dst/file1: Deleted 2025/02/13 18:54:22 DEBUG : dst/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/02/13 18:54:22 INFO : dst/file1: Copied (new) 2025/02/13 18:54:23 DEBUG : dst/: Removing directory marker 2025/02/13 18:54:23 DEBUG : backup/dst/: Removing directory marker 2025/02/13 18:54:23 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 1/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dffee762-701e-001e-7f48-7e5025000000 Time:2025-02-13T18:54:23.1391016Z -------------------------------------------------------------------------------- 2025/02/13 18:54:24 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 2/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dffee876-701e-001e-6348-7e5025000000 Time:2025-02-13T18:54:24.1786561Z -------------------------------------------------------------------------------- 2025/02/13 18:54:25 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 3/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dffee96a-701e-001e-3548-7e5025000000 Time:2025-02-13T18:54:25.2176901Z -------------------------------------------------------------------------------- run.go:128: removing dir "backup" failed: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dffee96a-701e-001e-3548-7e5025000000 Time:2025-02-13T18:54:25.2176901Z -------------------------------------------------------------------------------- --- PASS: TestCopyFileBackupDir (4.14s) === RUN TestCopyFileCompareDest run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:26 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/dst" 2025/02/13 18:54:26 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:26 DEBUG : Azure container rclone-test-docetur0dune path dst: Using directory markers 2025/02/13 18:54:26 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:26 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:26 DEBUG : Azure container rclone-test-docetur0dune path CompareDest: Using directory markers 2025/02/13 18:54:26 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" to be canonical "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:26 DEBUG : one: Need to transfer - File not found at Destination 2025/02/13 18:54:26 DEBUG : /: Creating directory marker 2025/02/13 18:54:26 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/02/13 18:54:26 INFO : one: Copied (new) 2025/02/13 18:54:26 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:26 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/02/13 18:54:26 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/02/13 18:54:26 INFO : one: Copied (replaced existing) 2025/02/13 18:54:27 DEBUG : CompareDest/: Creating directory marker 2025/02/13 18:54:27 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:27 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/02/13 18:54:27 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:27 DEBUG : one: Destination found in --compare-dest, skipping 2025/02/13 18:54:27 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:27 DEBUG : two: Need to transfer - File not found at Destination 2025/02/13 18:54:27 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:27 DEBUG : two: Destination found in --compare-dest, skipping 2025/02/13 18:54:27 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:27 DEBUG : two: Need to transfer - File not found at Destination 2025/02/13 18:54:27 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:27 DEBUG : two: Destination found in --compare-dest, skipping 2025/02/13 18:54:28 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CompareDest" 2025/02/13 18:54:28 DEBUG : two: Need to transfer - File not found at Destination 2025/02/13 18:54:28 DEBUG : two: Sizes differ (src 5 vs dst 3) 2025/02/13 18:54:28 DEBUG : two: md5 = 2379e4ce8c3380e996ab0509f17069ad OK 2025/02/13 18:54:28 INFO : two: Copied (new) 2025/02/13 18:54:28 DEBUG : dst/: Removing directory marker 2025/02/13 18:54:28 DEBUG : CompareDest/: Removing directory marker --- PASS: TestCopyFileCompareDest (2.35s) === RUN TestCopyFileCopyDest run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:28 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/dst" 2025/02/13 18:54:28 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:28 DEBUG : Azure container rclone-test-docetur0dune path dst: Using directory markers 2025/02/13 18:54:28 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:28 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:28 DEBUG : Azure container rclone-test-docetur0dune path CopyDest: Using directory markers 2025/02/13 18:54:28 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" to be canonical "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:28 DEBUG : one: Need to transfer - File not found at Destination 2025/02/13 18:54:28 DEBUG : /: Creating directory marker 2025/02/13 18:54:28 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/02/13 18:54:28 INFO : one: Copied (new) 2025/02/13 18:54:29 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:29 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/02/13 18:54:29 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/02/13 18:54:29 INFO : one: Copied (replaced existing) 2025/02/13 18:54:29 DEBUG : CopyDest/: Creating directory marker 2025/02/13 18:54:29 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/BackupDir" 2025/02/13 18:54:29 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:29 DEBUG : Azure container rclone-test-docetur0dune path BackupDir: Using directory markers 2025/02/13 18:54:29 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-docetur0dune/BackupDir" to be canonical "TestAzureBlob{juk_h}:rclone-test-docetur0dune/BackupDir" 2025/02/13 18:54:29 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:29 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/02/13 18:54:29 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:29 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/02/13 18:54:29 DEBUG : /: Creating directory marker 2025/02/13 18:54:29 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/02/13 18:54:29 INFO : one: Copied (server-side copy) 2025/02/13 18:54:30 INFO : one: Deleted 2025/02/13 18:54:30 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/02/13 18:54:30 INFO : one: Copied (server-side copy) 2025/02/13 18:54:30 DEBUG : one: Destination found in --copy-dest, using server-side copy 2025/02/13 18:54:30 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:30 DEBUG : two: Need to transfer - File not found at Destination 2025/02/13 18:54:30 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:30 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/02/13 18:54:30 INFO : two: Copied (server-side copy) 2025/02/13 18:54:30 DEBUG : two: Destination found in --copy-dest, using server-side copy 2025/02/13 18:54:30 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:30 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:54:30 DEBUG : two: Unchanged skipping 2025/02/13 18:54:31 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-docetur0dune/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-docetur0dune/CopyDest" 2025/02/13 18:54:31 DEBUG : three: Need to transfer - File not found at Destination 2025/02/13 18:54:31 DEBUG : three: Sizes differ (src 7 vs dst 5) 2025/02/13 18:54:31 DEBUG : three: Destination not found in --copy-dest 2025/02/13 18:54:31 DEBUG : three: md5 = 1bccb9dccb3e9f6a3f9d2a8bdb54b7f5 OK 2025/02/13 18:54:31 INFO : three: Copied (new) 2025/02/13 18:54:31 DEBUG : dst/: Removing directory marker 2025/02/13 18:54:31 DEBUG : CopyDest/: Removing directory marker 2025/02/13 18:54:31 DEBUG : BackupDir/: Removing directory marker --- PASS: TestCopyFileCopyDest (3.15s) === RUN TestCopyInplace run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" copy_test.go:370: Partial uploads not supported --- SKIP: TestCopyInplace (0.08s) === RUN TestCopyLongFileName run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" copy_test.go:403: Partial uploads not supported --- SKIP: TestCopyLongFileName (0.08s) === RUN TestCopyFileMaxTransfer run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:31 DEBUG : TestCopyFileMaxTransfer/file1: Need to transfer - File not found at Destination 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/: Creating directory marker 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/02/13 18:54:32 INFO : TestCopyFileMaxTransfer/file1: Copied (new) 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/file2: Need to transfer - File not found at Destination 2025/02/13 18:54:32 ERROR : TestCopyFileMaxTransfer/file2: Failed to copy: single part upload read failed: max transfer limit reached as set by --max-transfer 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/file3: Need to transfer - File not found at Destination 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/file4: Need to transfer - File not found at Destination 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/file4: md5 = 4f2ed8c4130e1a9e294bf240bb1ce85d OK 2025/02/13 18:54:32 INFO : TestCopyFileMaxTransfer/file4: Copied (new) 2025/02/13 18:54:32 DEBUG : TestCopyFileMaxTransfer/: Removing directory marker --- PASS: TestCopyFileMaxTransfer (0.93s) === RUN TestDeduplicateInteractive run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateInteractive (0.08s) === RUN TestDeduplicateSkip run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSkip (0.08s) === RUN TestDeduplicateSizeOnly run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSizeOnly (0.08s) === RUN TestDeduplicateFirst run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateFirst (0.08s) === RUN TestDeduplicateNewest run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateNewest (0.08s) === RUN TestDeduplicateNewestByHash run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:33 DEBUG : also/: Creating directory marker 2025/02/13 18:54:33 INFO : Azure container rclone-test-docetur0dune: Looking for duplicate md5 hashes using newest mode. 2025/02/13 18:54:33 NOTICE: 7841d4a14278611853fb241d8e048356: Found 3 files with duplicate md5 hashes 2025/02/13 18:54:33 INFO : one: Deleted 2025/02/13 18:54:33 INFO : also/one: Deleted 2025/02/13 18:54:33 NOTICE: 7841d4a14278611853fb241d8e048356: Deleted 2 extra copies 2025/02/13 18:54:34 DEBUG : also/: Removing directory marker --- PASS: TestDeduplicateNewestByHash (0.92s) === RUN TestDeduplicateOldest run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateOldest (0.08s) === RUN TestDeduplicateLargest run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateLargest (0.08s) === RUN TestDeduplicateSmallest run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSmallest (0.08s) === RUN TestDeduplicateRename run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateRename (0.08s) === RUN TestMergeDirs run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" dedupe_test.go:256: Can't merge directories --- SKIP: TestMergeDirs (0.08s) === RUN TestListDirSorted run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:34 DEBUG : sub dir/: Creating directory marker 2025/02/13 18:54:35 DEBUG : sub dir/ignore dir/: Creating directory marker 2025/02/13 18:54:35 DEBUG : sub dir/sub sub dir/: Creating directory marker 2025/02/13 18:54:35 DEBUG : a.txt: Excluded (Size Filter) 2025/02/13 18:54:35 DEBUG : a.txt: Excluded 2025/02/13 18:54:35 DEBUG : sub dir/hello world: Excluded (Size Filter) 2025/02/13 18:54:35 DEBUG : sub dir/hello world: Excluded 2025/02/13 18:54:35 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2025/02/13 18:54:35 DEBUG : sub dir/hello world2: Excluded 2025/02/13 18:54:35 DEBUG : sub dir/hello world: Excluded (Size Filter) 2025/02/13 18:54:35 DEBUG : sub dir/hello world: Excluded 2025/02/13 18:54:35 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2025/02/13 18:54:35 DEBUG : sub dir/hello world2: Excluded 2025/02/13 18:54:35 DEBUG : sub dir/ignore dir: Excluded 2025/02/13 18:54:36 DEBUG : sub dir/ignore dir: Excluded 2025/02/13 18:54:36 DEBUG : sub dir/sub sub dir/: Removing directory marker 2025/02/13 18:54:36 DEBUG : sub dir/ignore dir/: Removing directory marker 2025/02/13 18:54:36 DEBUG : sub dir/: Removing directory marker --- PASS: TestListDirSorted (2.12s) === RUN TestListJSON run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:36 DEBUG : sub/: Creating directory marker === RUN TestListJSON/Default === RUN TestListJSON/FilesOnly === RUN TestListJSON/DirsOnly === RUN TestListJSON/Recurse === RUN TestListJSON/SubDir === RUN TestListJSON/NoModTime === RUN TestListJSON/NoMimeType === RUN TestListJSON/ShowHash === RUN TestListJSON/HashTypes === RUN TestListJSON/Metadata 2025/02/13 18:54:37 DEBUG : sub/: Removing directory marker --- PASS: TestListJSON (0.97s) --- PASS: TestListJSON/Default (0.04s) --- PASS: TestListJSON/FilesOnly (0.04s) --- PASS: TestListJSON/DirsOnly (0.04s) --- PASS: TestListJSON/Recurse (0.07s) --- PASS: TestListJSON/SubDir (0.04s) --- PASS: TestListJSON/NoModTime (0.04s) --- PASS: TestListJSON/NoMimeType (0.04s) --- PASS: TestListJSON/ShowHash (0.04s) --- PASS: TestListJSON/HashTypes (0.04s) --- PASS: TestListJSON/Metadata (0.04s) === RUN TestStatJSON run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:37 DEBUG : sub/: Creating directory marker === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/DirWithTrailingSlash === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2025/02/13 18:54:38 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/notfound" 2025/02/13 18:54:38 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:38 DEBUG : Azure container rclone-test-docetur0dune path notfound: Using directory markers 2025/02/13 18:54:38 DEBUG : sub/: Removing directory marker --- PASS: TestStatJSON (1.20s) --- PASS: TestStatJSON/Root (0.04s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.04s) --- PASS: TestStatJSON/Dir (0.08s) --- PASS: TestStatJSON/DirWithTrailingSlash (0.04s) --- PASS: TestStatJSON/File (0.04s) --- PASS: TestStatJSON/NotFound (0.08s) --- PASS: TestStatJSON/DirFilesOnly (0.04s) --- PASS: TestStatJSON/FileFilesOnly (0.04s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.04s) --- PASS: TestStatJSON/DirDirsOnly (0.04s) --- PASS: TestStatJSON/FileDirsOnly (0.04s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.04s) --- PASS: TestStatJSON/RootNotFound (0.11s) === RUN TestMkdir run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:38 INFO : Azure container rclone-test-docetur0dune: Making directory 2025/02/13 18:54:38 INFO : Azure container rclone-test-docetur0dune: Making directory --- PASS: TestMkdir (0.11s) === RUN TestLsd run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:38 DEBUG : sub dir/: Creating directory marker 2025/02/13 18:54:39 DEBUG : sub dir/: Removing directory marker --- PASS: TestLsd (0.39s) === RUN TestLs run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestLs (0.39s) === RUN TestLsWithFilesFrom run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:39 DEBUG : empty space: Excluded (FilesFrom Filter) --- PASS: TestLsWithFilesFrom (0.43s) === RUN TestLsLong run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestLsLong (0.36s) === RUN TestHashSums run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" === RUN TestHashSums/Md5 === RUN TestHashSums/Md5Download --- PASS: TestHashSums (0.45s) --- PASS: TestHashSums/Md5 (0.04s) --- PASS: TestHashSums/Md5Download (0.08s) === RUN TestHashSumsWithErrors 2025/02/13 18:54:40 DEBUG : Creating backend with remote ":memory:" 2025/02/13 18:54:40 ERROR : file1: hash unsupported: hash type not supported --- PASS: TestHashSumsWithErrors (0.00s) === RUN TestHashStream 2025/02/13 18:54:40 DEBUG : Creating md5 hash of 0 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating md5 hash of 0 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating md5 hash of 12 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating md5 hash of 12 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating sha1 hash of 12 bytes read from input stream 2025/02/13 18:54:40 DEBUG : Creating sha1 hash of 12 bytes read from input stream --- PASS: TestHashStream (0.00s) === RUN TestSuffixName --- PASS: TestSuffixName (0.00s) === RUN TestCount run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:41 DEBUG : sub dir/: Creating directory marker 2025/02/13 18:54:41 DEBUG : sub dir/: Removing directory marker --- PASS: TestCount (0.70s) === RUN TestDelete run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:41 DEBUG : Waiting for deletions to finish 2025/02/13 18:54:42 DEBUG : large: Excluded (Size Filter) 2025/02/13 18:54:42 INFO : small: Deleted 2025/02/13 18:54:42 INFO : medium: Deleted --- PASS: TestDelete (0.58s) === RUN TestMaxDelete run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:42 DEBUG : Waiting for deletions to finish 2025/02/13 18:54:42 ERROR : small: Got fatal error on delete: --max-delete threshold reached 2025/02/13 18:54:42 INFO : medium: Deleted 2025/02/13 18:54:42 INFO : large: Deleted --- PASS: TestMaxDelete (0.65s) === RUN TestMaxDeleteSizeLargeFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:43 DEBUG : Waiting for deletions to finish 2025/02/13 18:54:43 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached 2025/02/13 18:54:43 INFO : small: Deleted 2025/02/13 18:54:43 INFO : medium: Deleted --- PASS: TestMaxDeleteSizeLargeFile (0.66s) === RUN TestMaxDeleteSize run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:43 DEBUG : Waiting for deletions to finish 2025/02/13 18:54:43 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2025/02/13 18:54:44 INFO : medium: Deleted 2025/02/13 18:54:44 INFO : large: Deleted --- PASS: TestMaxDeleteSize (0.66s) === RUN TestReadFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestReadFile (0.39s) === RUN TestRetry 2025/02/13 18:54:44 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 1/5 2025/02/13 18:54:44 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 2/5 2025/02/13 18:54:44 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2025/02/13 18:54:44 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2025/02/13 18:54:44 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2025/02/13 18:54:44 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2025/02/13 18:54:44 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG --- PASS: TestRetry (0.05s) === RUN TestCat run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestCat (0.94s) === RUN TestPurge 2025/02/13 18:54:45 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-wiyanol5cibi" 2025/02/13 18:54:45 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/13 18:54:45 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:54:45 DEBUG : Azure container rclone-test-wiyanol5cibi: Using directory markers 2025/02/13 18:54:45 DEBUG : Creating backend with remote "/tmp/rclone3766474637" run.go:180: Remote "Azure container rclone-test-wiyanol5cibi", Local "Local file system at /tmp/rclone3766474637", Modify Window "1ns" 2025/02/13 18:54:45 DEBUG : A1/B1/C1/: Creating directory marker 2025/02/13 18:54:45 DEBUG : A1/B1/: Creating directory marker 2025/02/13 18:54:45 DEBUG : A1/: Creating directory marker 2025/02/13 18:54:45 INFO : A2: Making directory 2025/02/13 18:54:46 DEBUG : A2/: Creating directory marker 2025/02/13 18:54:46 INFO : A1/B2: Making directory 2025/02/13 18:54:46 DEBUG : A1/B2/: Creating directory marker 2025/02/13 18:54:46 INFO : A1/B2/C2: Making directory 2025/02/13 18:54:46 DEBUG : A1/B2/C2/: Creating directory marker 2025/02/13 18:54:46 INFO : A1/B1/C3: Making directory 2025/02/13 18:54:46 DEBUG : A1/B1/C3/: Creating directory marker 2025/02/13 18:54:46 INFO : A3: Making directory 2025/02/13 18:54:46 DEBUG : A3/: Creating directory marker 2025/02/13 18:54:46 INFO : A3/B3: Making directory 2025/02/13 18:54:46 DEBUG : A3/B3/: Creating directory marker 2025/02/13 18:54:46 INFO : A3/B3/C4: Making directory 2025/02/13 18:54:46 DEBUG : A3/B3/C4/: Creating directory marker 2025/02/13 18:54:46 DEBUG : Waiting for deletions to finish 2025/02/13 18:54:47 INFO : A1/B1/C1/one: Deleted 2025/02/13 18:54:47 DEBUG : removing 2 level 3 directories 2025/02/13 18:54:47 INFO : A1/B1/C3: Removing directory 2025/02/13 18:54:47 DEBUG : A1/B1/C3/: Removing directory marker 2025/02/13 18:54:47 INFO : A1/B1/C1: Removing directory 2025/02/13 18:54:47 DEBUG : A1/B1/C1/: Removing directory marker 2025/02/13 18:54:47 DEBUG : removing 1 level 2 directories 2025/02/13 18:54:47 INFO : A1/B1: Removing directory 2025/02/13 18:54:47 DEBUG : A1/B1/: Removing directory marker 2025/02/13 18:54:47 DEBUG : Azure container rclone-test-wiyanol5cibi: Purge remote 2025/02/13 18:54:47 NOTICE: purge failed: bucket already deleted --- PASS: TestPurge (1.71s) === RUN TestRmdirsNoLeaveRoot run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:47 DEBUG : A1/B1/C1/: Creating directory marker 2025/02/13 18:54:47 DEBUG : A1/B1/: Creating directory marker 2025/02/13 18:54:47 DEBUG : A1/: Creating directory marker 2025/02/13 18:54:47 INFO : A2: Making directory 2025/02/13 18:54:47 DEBUG : A2/: Creating directory marker 2025/02/13 18:54:47 INFO : A1/B2: Making directory 2025/02/13 18:54:47 DEBUG : A1/B2/: Creating directory marker 2025/02/13 18:54:47 INFO : A1/B2/C2: Making directory 2025/02/13 18:54:47 DEBUG : A1/B2/C2/: Creating directory marker 2025/02/13 18:54:47 INFO : A1/B1/C3: Making directory 2025/02/13 18:54:47 DEBUG : A1/B1/C3/: Creating directory marker 2025/02/13 18:54:48 INFO : A3: Making directory 2025/02/13 18:54:48 DEBUG : A3/: Creating directory marker 2025/02/13 18:54:48 INFO : A3/B3: Making directory 2025/02/13 18:54:48 DEBUG : A3/B3/: Creating directory marker 2025/02/13 18:54:48 INFO : A3/B3/C4: Making directory 2025/02/13 18:54:48 DEBUG : A3/B3/C4/: Creating directory marker 2025/02/13 18:54:48 DEBUG : removing 1 level 3 directories 2025/02/13 18:54:48 INFO : A3/B3/C4: Removing directory 2025/02/13 18:54:48 DEBUG : A3/B3/C4/: Removing directory marker 2025/02/13 18:54:48 DEBUG : removing 2 level 3 directories 2025/02/13 18:54:48 INFO : A1/B2/C2: Removing directory 2025/02/13 18:54:48 DEBUG : A1/B2/C2/: Removing directory marker 2025/02/13 18:54:48 INFO : A1/B1/C3: Removing directory 2025/02/13 18:54:48 DEBUG : A1/B1/C3/: Removing directory marker 2025/02/13 18:54:48 DEBUG : removing 2 level 2 directories 2025/02/13 18:54:48 INFO : A3/B3: Removing directory 2025/02/13 18:54:48 DEBUG : A3/B3/: Removing directory marker 2025/02/13 18:54:48 INFO : A1/B2: Removing directory 2025/02/13 18:54:48 DEBUG : A1/B2/: Removing directory marker 2025/02/13 18:54:48 DEBUG : removing 2 level 1 directories 2025/02/13 18:54:48 INFO : A3: Removing directory 2025/02/13 18:54:48 DEBUG : A3/: Removing directory marker 2025/02/13 18:54:48 INFO : A2: Removing directory 2025/02/13 18:54:48 DEBUG : A2/: Removing directory marker 2025/02/13 18:54:49 DEBUG : removing 1 level 3 directories 2025/02/13 18:54:49 INFO : A1/B1/C1: Removing directory 2025/02/13 18:54:49 DEBUG : A1/B1/C1/: Removing directory marker 2025/02/13 18:54:49 DEBUG : removing 1 level 2 directories 2025/02/13 18:54:49 INFO : A1/B1: Removing directory 2025/02/13 18:54:49 DEBUG : A1/B1/: Removing directory marker 2025/02/13 18:54:49 DEBUG : removing 1 level 1 directories 2025/02/13 18:54:49 INFO : A1: Removing directory 2025/02/13 18:54:49 DEBUG : A1/: Removing directory marker 2025/02/13 18:54:49 DEBUG : removing 1 level 0 directories 2025/02/13 18:54:49 INFO : Azure container rclone-test-docetur0dune: Removing directory --- PASS: TestRmdirsNoLeaveRoot (2.04s) === RUN TestRmdirsLeaveRoot run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:54:55 DEBUG : pacer: low level retry 1/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff0899-701e-001e-0248-7e5025000000 Time:2025-02-13T18:54:49.3820074Z -------------------------------------------------------------------------------- ) 2025/02/13 18:54:55 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2025/02/13 18:55:01 DEBUG : pacer: low level retry 2/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff0f0a-701e-001e-3748-7e5025000000 Time:2025-02-13T18:54:55.4251208Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:01 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/02/13 18:55:07 DEBUG : pacer: low level retry 3/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff151a-701e-001e-2448-7e5025000000 Time:2025-02-13T18:55:01.4720598Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:07 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/02/13 18:55:13 DEBUG : pacer: low level retry 4/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff1b1d-701e-001e-6d48-7e5025000000 Time:2025-02-13T18:55:07.5182419Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:13 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/02/13 18:55:19 DEBUG : pacer: low level retry 5/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff2302-701e-001e-1248-7e5025000000 Time:2025-02-13T18:55:13.5659339Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:19 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/02/13 18:55:25 DEBUG : pacer: low level retry 6/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff289e-701e-001e-5f48-7e5025000000 Time:2025-02-13T18:55:19.6101629Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:25 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/02/13 18:55:31 DEBUG : pacer: low level retry 7/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff2ed4-701e-001e-7448-7e5025000000 Time:2025-02-13T18:55:25.6539362Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:31 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/02/13 18:55:37 DEBUG : pacer: low level retry 8/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff346e-701e-001e-4c48-7e5025000000 Time:2025-02-13T18:55:31.6992029Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:37 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/02/13 18:55:43 DEBUG : pacer: low level retry 9/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff39b4-701e-001e-4148-7e5025000000 Time:2025-02-13T18:55:37.7450706Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:43 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2025/02/13 18:55:49 DEBUG : pacer: low level retry 10/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff3f28-701e-001e-6248-7e5025000000 Time:2025-02-13T18:55:43.7887394Z -------------------------------------------------------------------------------- ) 2025/02/13 18:55:49 DEBUG : pacer: Rate limited, increasing sleep to 5.12s run.go:237: Failed to mkdir "Azure container rclone-test-docetur0dune": PUT https://rclone.blob.core.windows.net/rclone-test-docetur0dune -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:dfff3f28-701e-001e-6248-7e5025000000 Time:2025-02-13T18:55:43.7887394Z -------------------------------------------------------------------------------- --- FAIL: TestRmdirsLeaveRoot (60.45s) === RUN TestRmdirsWithFilter run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:55:49 DEBUG : pacer: Reducing sleep to 2.56s 2025/02/13 18:55:49 INFO : A1: Making directory 2025/02/13 18:55:54 DEBUG : pacer: Reducing sleep to 1.28s 2025/02/13 18:55:54 DEBUG : A1/: Creating directory marker 2025/02/13 18:55:57 DEBUG : pacer: Reducing sleep to 640ms 2025/02/13 18:55:57 INFO : A1/B1: Making directory 2025/02/13 18:55:58 DEBUG : pacer: Reducing sleep to 320ms 2025/02/13 18:55:58 DEBUG : A1/B1/: Creating directory marker 2025/02/13 18:55:59 DEBUG : pacer: Reducing sleep to 160ms 2025/02/13 18:55:59 DEBUG : pacer: Reducing sleep to 80ms 2025/02/13 18:55:59 INFO : A1/B1/C1: Making directory 2025/02/13 18:55:59 DEBUG : pacer: Reducing sleep to 40ms 2025/02/13 18:55:59 DEBUG : A1/B1/C1/: Creating directory marker 2025/02/13 18:56:00 DEBUG : pacer: Reducing sleep to 20ms 2025/02/13 18:56:00 DEBUG : pacer: Reducing sleep to 10ms 2025/02/13 18:56:00 DEBUG : pacer: Reducing sleep to 0s 2025/02/13 18:56:00 DEBUG : removing 1 level 3 directories 2025/02/13 18:56:00 INFO : A1/B1/C1: Removing directory 2025/02/13 18:56:00 DEBUG : A1/B1/C1/: Removing directory marker 2025/02/13 18:56:00 DEBUG : removing 1 level 2 directories 2025/02/13 18:56:00 INFO : A1/B1: Removing directory 2025/02/13 18:56:00 DEBUG : A1/B1/: Removing directory marker 2025/02/13 18:56:00 DEBUG : A1/: Removing directory marker --- PASS: TestRmdirsWithFilter (10.62s) === RUN TestCopyURL run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:00 DEBUG : filename.txt: File name found in url 2025/02/13 18:56:00 DEBUG : headerfilename.txt: filename found in Content-Disposition header. --- PASS: TestCopyURL (0.78s) === RUN TestCopyURLToWriter --- PASS: TestCopyURLToWriter (0.00s) === RUN TestMoveFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:01 DEBUG : file1: Need to transfer - File not found at Destination 2025/02/13 18:56:01 DEBUG : sub/: Creating directory marker 2025/02/13 18:56:01 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/02/13 18:56:01 INFO : file1: Copied (new) to: sub/file2 2025/02/13 18:56:01 INFO : file1: Deleted 2025/02/13 18:56:01 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:56:01 DEBUG : file1: Unchanged skipping 2025/02/13 18:56:01 INFO : file1: Deleted 2025/02/13 18:56:01 DEBUG : Azure container rclone-test-docetur0dune: don't need to copy/move sub/file2, it is already at target location 2025/02/13 18:56:01 DEBUG : sub/: Removing directory marker --- PASS: TestMoveFile (0.51s) === RUN TestMoveFileWithIgnoreExisting run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:01 DEBUG : file1: Need to transfer - File not found at Destination 2025/02/13 18:56:01 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/02/13 18:56:01 INFO : file1: Copied (new) 2025/02/13 18:56:01 INFO : file1: Deleted 2025/02/13 18:56:01 DEBUG : file1: Destination exists, skipping 2025/02/13 18:56:01 DEBUG : file1: Not removing source file as destination file exists and --ignore-existing is set --- PASS: TestMoveFileWithIgnoreExisting (0.35s) === RUN TestCaseInsensitiveMoveFile run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestCaseInsensitiveMoveFile (0.07s) === RUN TestCaseInsensitiveMoveFileDryRun run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestCaseInsensitiveMoveFileDryRun (0.07s) === RUN TestMoveFileBackupDir run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:02 DEBUG : dst/: Creating directory marker 2025/02/13 18:56:02 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-docetur0dune/backup" 2025/02/13 18:56:02 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2025/02/13 18:56:02 DEBUG : Azure container rclone-test-docetur0dune path backup: Using directory markers 2025/02/13 18:56:02 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-docetur0dune/backup" to be canonical "TestAzureBlob{juk_h}:rclone-test-docetur0dune/backup" 2025/02/13 18:56:02 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2025/02/13 18:56:02 DEBUG : dst/: Creating directory marker 2025/02/13 18:56:02 DEBUG : dst/file1: md5 = 05164b153084ba910184c26e561a7c18 OK 2025/02/13 18:56:02 INFO : dst/file1: Copied (server-side copy) 2025/02/13 18:56:02 INFO : dst/file1: Deleted 2025/02/13 18:56:03 DEBUG : dst/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/02/13 18:56:03 INFO : dst/file1: Copied (new) 2025/02/13 18:56:03 INFO : dst/file1: Deleted 2025/02/13 18:56:03 DEBUG : dst/: Removing directory marker 2025/02/13 18:56:03 DEBUG : backup/dst/: Removing directory marker 2025/02/13 18:56:03 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 1/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dfff5dbb-701e-001e-6e48-7e5025000000 Time:2025-02-13T18:56:03.3769923Z -------------------------------------------------------------------------------- 2025/02/13 18:56:04 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 2/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dfff5f64-701e-001e-5b48-7e5025000000 Time:2025-02-13T18:56:04.4149625Z -------------------------------------------------------------------------------- 2025/02/13 18:56:05 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 3/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dfff610e-701e-001e-5848-7e5025000000 Time:2025-02-13T18:56:05.4537580Z -------------------------------------------------------------------------------- run.go:128: removing dir "backup" failed: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-docetur0dune/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:dfff610e-701e-001e-5848-7e5025000000 Time:2025-02-13T18:56:05.4537580Z -------------------------------------------------------------------------------- --- PASS: TestMoveFileBackupDir (4.30s) === RUN TestSameConfig --- PASS: TestSameConfig (0.00s) === RUN TestSame --- PASS: TestSame (0.00s) === RUN TestOverlappingFilterCheckWithoutFilter --- PASS: TestOverlappingFilterCheckWithoutFilter (0.00s) === RUN TestOverlappingFilterCheckWithFilter --- PASS: TestOverlappingFilterCheckWithFilter (0.00s) === RUN TestListFormat --- PASS: TestListFormat (0.00s) === RUN TestDirMove run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:06 DEBUG : A1/: Creating directory marker 2025/02/13 18:56:06 DEBUG : A1/B1/: Creating directory marker 2025/02/13 18:56:07 DEBUG : A1/B1/C1/: Creating directory marker 2025/02/13 18:56:07 DEBUG : A1/B1/C2/: Creating directory marker 2025/02/13 18:56:07 INFO : A1/B2: Making directory 2025/02/13 18:56:07 DEBUG : A1/B2/: Creating directory marker 2025/02/13 18:56:07 INFO : A1/B1/C3: Making directory 2025/02/13 18:56:07 DEBUG : A1/B1/C3/: Creating directory marker 2025/02/13 18:56:07 DEBUG : A2/: Creating directory marker 2025/02/13 18:56:07 DEBUG : A2/B1/: Creating directory marker 2025/02/13 18:56:07 DEBUG : A2/B1/C1/: Creating directory marker 2025/02/13 18:56:08 DEBUG : A2/B1/C2/: Creating directory marker 2025/02/13 18:56:08 DEBUG : A2/B1/C3/: Creating directory marker 2025/02/13 18:56:08 DEBUG : A2/B2/: Creating directory marker 2025/02/13 18:56:08 DEBUG : A1/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/02/13 18:56:08 INFO : A1/B1/C1/four: Copied (server-side copy) to: A2/B1/C1/four 2025/02/13 18:56:08 DEBUG : A1/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/02/13 18:56:08 INFO : A1/one: Copied (server-side copy) to: A2/one 2025/02/13 18:56:08 DEBUG : A1/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/02/13 18:56:08 INFO : A1/B1/C2/five: Copied (server-side copy) to: A2/B1/C2/five 2025/02/13 18:56:08 DEBUG : A1/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/02/13 18:56:08 INFO : A1/B1/three: Copied (server-side copy) to: A2/B1/three 2025/02/13 18:56:08 DEBUG : A1/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/02/13 18:56:08 INFO : A1/two: Copied (server-side copy) to: A2/two 2025/02/13 18:56:08 INFO : A1/B1/C1/four: Deleted 2025/02/13 18:56:08 INFO : A1/one: Deleted 2025/02/13 18:56:08 INFO : A1/B1/C2/five: Deleted 2025/02/13 18:56:08 INFO : A1/B1/three: Deleted 2025/02/13 18:56:08 INFO : A1/two: Deleted 2025/02/13 18:56:08 DEBUG : A1/B2/: Removing directory marker 2025/02/13 18:56:08 DEBUG : A1/B1/C3/: Removing directory marker 2025/02/13 18:56:08 DEBUG : A1/B1/C2/: Removing directory marker 2025/02/13 18:56:08 DEBUG : A1/B1/C1/: Removing directory marker 2025/02/13 18:56:08 DEBUG : A1/B1/: Removing directory marker 2025/02/13 18:56:08 DEBUG : A1/: Removing directory marker 2025/02/13 18:56:09 DEBUG : A3/: Creating directory marker 2025/02/13 18:56:09 DEBUG : A3/B1/: Creating directory marker 2025/02/13 18:56:09 DEBUG : A3/B1/C1/: Creating directory marker 2025/02/13 18:56:09 DEBUG : A3/B1/C2/: Creating directory marker 2025/02/13 18:56:09 DEBUG : A3/B1/C3/: Creating directory marker 2025/02/13 18:56:09 DEBUG : A3/B2/: Creating directory marker 2025/02/13 18:56:09 DEBUG : A2/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/02/13 18:56:09 INFO : A2/B1/three: Copied (server-side copy) to: A3/B1/three 2025/02/13 18:56:09 DEBUG : A2/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/02/13 18:56:09 INFO : A2/two: Copied (server-side copy) to: A3/two 2025/02/13 18:56:09 DEBUG : A2/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/02/13 18:56:09 INFO : A2/B1/C2/five: Copied (server-side copy) to: A3/B1/C2/five 2025/02/13 18:56:09 DEBUG : A2/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/02/13 18:56:09 INFO : A2/B1/C1/four: Copied (server-side copy) to: A3/B1/C1/four 2025/02/13 18:56:09 DEBUG : A2/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/02/13 18:56:09 INFO : A2/one: Copied (server-side copy) to: A3/one 2025/02/13 18:56:09 INFO : A2/B1/three: Deleted 2025/02/13 18:56:09 INFO : A2/two: Deleted 2025/02/13 18:56:09 INFO : A2/B1/C2/five: Deleted 2025/02/13 18:56:09 INFO : A2/B1/C1/four: Deleted 2025/02/13 18:56:09 INFO : A2/one: Deleted 2025/02/13 18:56:09 DEBUG : A2/B2/: Removing directory marker 2025/02/13 18:56:10 DEBUG : A2/B1/C3/: Removing directory marker 2025/02/13 18:56:10 DEBUG : A2/B1/C2/: Removing directory marker 2025/02/13 18:56:10 DEBUG : A2/B1/C1/: Removing directory marker 2025/02/13 18:56:10 DEBUG : A2/B1/: Removing directory marker 2025/02/13 18:56:10 DEBUG : A2/: Removing directory marker 2025/02/13 18:56:10 INFO : Azure container rclone-test-docetur0dune: Can't DirMove - falling back to file moves: can't move directory - incompatible remotes 2025/02/13 18:56:10 DEBUG : A4/: Creating directory marker 2025/02/13 18:56:10 DEBUG : A4/B1/: Creating directory marker 2025/02/13 18:56:10 DEBUG : A4/B1/C1/: Creating directory marker 2025/02/13 18:56:10 DEBUG : A4/B1/C2/: Creating directory marker 2025/02/13 18:56:10 DEBUG : A4/B1/C3/: Creating directory marker 2025/02/13 18:56:10 DEBUG : A4/B2/: Creating directory marker 2025/02/13 18:56:11 DEBUG : A3/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/02/13 18:56:11 INFO : A3/B1/C1/four: Copied (server-side copy) to: A4/B1/C1/four 2025/02/13 18:56:11 DEBUG : A3/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/02/13 18:56:11 INFO : A3/B1/three: Copied (server-side copy) to: A4/B1/three 2025/02/13 18:56:11 DEBUG : A3/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/02/13 18:56:11 DEBUG : A3/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/02/13 18:56:11 INFO : A3/B1/C2/five: Copied (server-side copy) to: A4/B1/C2/five 2025/02/13 18:56:11 INFO : A3/two: Copied (server-side copy) to: A4/two 2025/02/13 18:56:11 DEBUG : A3/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/02/13 18:56:11 INFO : A3/one: Copied (server-side copy) to: A4/one 2025/02/13 18:56:11 INFO : A3/B1/C1/four: Deleted 2025/02/13 18:56:11 INFO : A3/B1/three: Deleted 2025/02/13 18:56:11 INFO : A3/two: Deleted 2025/02/13 18:56:11 INFO : A3/B1/C2/five: Deleted 2025/02/13 18:56:11 INFO : A3/one: Deleted 2025/02/13 18:56:11 DEBUG : A3/B2/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A3/B1/C3/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A3/B1/C2/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A3/B1/C1/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A3/B1/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A3/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A4/B2/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A4/B1/C3/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A4/B1/C2/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A4/B1/C1/: Removing directory marker 2025/02/13 18:56:11 DEBUG : A4/B1/: Removing directory marker 2025/02/13 18:56:12 DEBUG : A4/: Removing directory marker --- PASS: TestDirMove (5.57s) === RUN TestGetFsInfo run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" --- PASS: TestGetFsInfo (0.08s) === RUN TestRcat === RUN TestRcat/withChecksum=false,ignoreChecksum=false run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:12 DEBUG : Azure container rclone-test-docetur0dune: File to upload is small (34 bytes), uploading instead of streaming 2025/02/13 18:56:12 DEBUG : no_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2025/02/13 18:56:12 DEBUG : no_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical 2025/02/13 18:56:12 NOTICE: Azure container rclone-test-docetur0dune: Streaming uploads using chunk size 4Mi will have maximum file size of 195.312Gi 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: multipart upload finished 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2025/02/13 18:56:12 DEBUG : no_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=true,ignoreChecksum=false run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:12 DEBUG : Azure container rclone-test-docetur0dune: File to upload is small (34 bytes), uploading instead of streaming 2025/02/13 18:56:12 DEBUG : with_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2025/02/13 18:56:12 DEBUG : with_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: multipart upload finished 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2025/02/13 18:56:12 DEBUG : with_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=false,ignoreChecksum=true run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:13 DEBUG : Azure container rclone-test-docetur0dune: File to upload is small (34 bytes), uploading instead of streaming 2025/02/13 18:56:13 DEBUG : ignore_checksum_small_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload finished 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) === RUN TestRcat/withChecksum=true,ignoreChecksum=true run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:13 DEBUG : Azure container rclone-test-docetur0dune: File to upload is small (34 bytes), uploading instead of streaming 2025/02/13 18:56:13 DEBUG : ignore_checksum_small_file_from_pipe: Src hash empty - aborting Dst hash check 2025/02/13 18:56:13 DEBUG : ignore_checksum_small_file_from_pipe: Size of src and dst objects identical 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload finished 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: Src hash empty - aborting Dst hash check 2025/02/13 18:56:13 DEBUG : ignore_checksum_big_file_from_pipe: Size of src and dst objects identical --- PASS: TestRcat (1.85s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (0.54s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=false (0.44s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=true (0.43s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=true (0.44s) === RUN TestRcatMetadata run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1532: Skipping as destination doesn't support user metadata --- SKIP: TestRcatMetadata (0.08s) === RUN TestRcatSize run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:14 DEBUG : Azure container rclone-test-docetur0dune: File to upload is small (60 bytes), uploading instead of streaming 2025/02/13 18:56:14 DEBUG : potato2: md5 = d6548b156ea68a4e003e786df99eee76 OK 2025/02/13 18:56:14 DEBUG : potato2: Size and md5 of src and dst objects identical --- PASS: TestRcatSize (0.35s) === RUN TestRcatSizeMetadata run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1613: Skipping as destination doesn't support user metadata --- SKIP: TestRcatSizeMetadata (0.08s) === RUN TestTouchDir run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" 2025/02/13 18:56:14 DEBUG : sub dir/: Creating directory marker 2025/02/13 18:56:14 DEBUG : Azure container rclone-test-docetur0dune: Touching "empty space" 2025/02/13 18:56:15 DEBUG : Azure container rclone-test-docetur0dune: Touching "potato2" 2025/02/13 18:56:15 DEBUG : Azure container rclone-test-docetur0dune: Touching "sub dir/potato3" 2025/02/13 18:56:15 DEBUG : sub dir/: Removing directory marker --- PASS: TestTouchDir (0.93s) === RUN TestMkdirMetadata run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1703: Skipping test as remote does not support MkdirMetadata --- SKIP: TestMkdirMetadata (0.08s) === RUN TestMkdirModTime run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1722: Skipping test as remote does not support DirSetModTime or MkdirMetadata --- SKIP: TestMkdirModTime (0.08s) === RUN TestCopyDirMetadata run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1743: Skipping test as remote does not support WriteDirMetadata or MkdirMetadata --- SKIP: TestCopyDirMetadata (0.08s) === RUN TestSetDirModTime run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1779: Skipping test as remote does not support DirSetModTime or WriteDirSetModTime --- SKIP: TestSetDirModTime (0.08s) === RUN TestDirsEqual run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1823: Skipping test as remote does not support WriteDirMetadata or MkdirMetadata --- SKIP: TestDirsEqual (0.08s) === RUN TestRemoveExisting run.go:180: Remote "Azure container rclone-test-docetur0dune", Local "Local file system at /tmp/rclone1152752433", Modify Window "1ns" operations_test.go:1892: Skipping as remote can't Move --- SKIP: TestRemoveExisting (0.08s) === RUN TestRcAbout rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcAbout (0.00s) === RUN TestRcCleanup rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCleanup (0.00s) === RUN TestRcCopyfile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCopyfile (0.00s) === RUN TestRcCopyurl rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCopyurl (0.00s) === RUN TestRcDelete rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcDelete (0.00s) === RUN TestRcDeletefile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcDeletefile (0.00s) === RUN TestRcList rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcList (0.00s) === RUN TestRcStat rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcStat (0.00s) === RUN TestRcSetTier rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcSetTier (0.00s) === RUN TestRcSetTierFile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcSetTierFile (0.00s) === RUN TestRcMkdir rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcMkdir (0.00s) === RUN TestRcMovefile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcMovefile (0.00s) === RUN TestRcPurge rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcPurge (0.00s) === RUN TestRcRmdir rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcRmdir (0.00s) === RUN TestRcRmdirs rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcRmdirs (0.00s) === RUN TestRcSize rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcSize (0.00s) === RUN TestRcPublicLink rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcPublicLink (0.00s) === RUN TestRcFsInfo rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcFsInfo (0.00s) === RUN TestUploadFile rc_test.go:30: Skipping test on non local remote --- SKIP: TestUploadFile (0.00s) === RUN TestRcCommand rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCommand (0.00s) === RUN TestRcDu rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcDu (0.00s) === RUN TestRcCheck rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCheck (0.00s) === RUN TestRcHashsum rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcHashsum (0.00s) === RUN TestRcHashsumFile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcHashsumFile (0.00s) FAIL 2025/02/13 18:56:15 DEBUG : Azure container rclone-test-docetur0dune: Purge remote "./operations.test -test.v -test.timeout 1h0m0s -remote 'TestAzureBlob,directory_markers:' -verbose -fast-list" - Finished ERROR in 2m29.699438634s (try 1/5): exit status 1: Failed [TestRmdirsLeaveRoot]