"./operations.test -test.v -test.timeout 1h0m0s -remote 'TestAzureBlob,directory_markers:' -verbose" - Starting (try 1/5) 2024/11/08 03:07:22 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya" 2024/11/08 03:07:22 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:22 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:22 DEBUG : Azure container rclone-test-saqused2liya: Using directory markers 2024/11/08 03:07:22 DEBUG : Creating backend with remote "/tmp/rclone2254323519" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:22 DEBUG : chunksize-probe: Multipart upload session started for 25 parts of size 4Mi 2024/11/08 03:07:22 DEBUG : chunksize-probe: open chunk writer: started multipart upload 2024/11/08 03:07:22 DEBUG : chunksize-probe: multipart upload aborted (did nothing - see issue #5583) === RUN TestMultithreadCopy/upload=false,size=8388607,streams=2 2024/11/08 03:07:22 DEBUG : test-multithread-copy-false-8388607-2: Multipart upload session started for 2 parts of size 4Mi 2024/11/08 03:07:22 DEBUG : test-multithread-copy-false-8388607-2: open chunk writer: started multipart upload 2024/11/08 03:07:22 DEBUG : test-multithread-copy-false-8388607-2: multipart upload: starting chunk 0 size 4Mi offset 0/8.000Mi 2024/11/08 03:07:22 DEBUG : test-multithread-copy-false-8388607-2: multipart upload: starting chunk 1 size 4.000Mi offset 4Mi/8.000Mi 2024/11/08 03:07:22 DEBUG : test-multithread-copy-false-8388607-2: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multipart upload wrote chunk 2 with 4194303 bytes 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multipart upload finished 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: write buffer set to 131072 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: chunk size 64Mi was bigger than source file size 8.000Mi 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: Starting multi-thread copy with 1 chunks of size 8.000Mi with 1 parallel streams 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: chunk 1/1 (0-8388607) size 8.000Mi starting 2024/11/08 03:07:23 DEBUG : test-multithread-copy-false-8388607-2: writing chunk 0 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388607-2: multi-thread copy: chunk 1/1 (0-8388607) size 8.000Mi finished 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388607-2: Finished multi-thread copy with 1 parts of size 8.000Mi === RUN TestMultithreadCopy/upload=false,size=8388608,streams=2 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: Multipart upload session started for 2 parts of size 4Mi 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: open chunk writer: started multipart upload 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: multipart upload: starting chunk 0 size 4Mi offset 0/8Mi 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: multipart upload: starting chunk 1 size 4Mi offset 4Mi/8Mi 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: multipart upload wrote chunk 2 with 4194304 bytes 2024/11/08 03:07:24 DEBUG : test-multithread-copy-false-8388608-2: multipart upload finished 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: write buffer set to 131072 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: chunk size 64Mi was bigger than source file size 8Mi 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: Starting multi-thread copy with 1 chunks of size 8Mi with 1 parallel streams 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: chunk 1/1 (0-8388608) size 8Mi starting 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: writing chunk 0 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: multi-thread copy: chunk 1/1 (0-8388608) size 8Mi finished 2024/11/08 03:07:25 DEBUG : test-multithread-copy-false-8388608-2: Finished multi-thread copy with 1 parts of size 8Mi === RUN TestMultithreadCopy/upload=false,size=8388609,streams=2 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: Multipart upload session started for 3 parts of size 4Mi 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: open chunk writer: started multipart upload 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload: starting chunk 0 size 4Mi offset 0/8.000Mi 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload: starting chunk 2 size 1 offset 8Mi/8.000Mi 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload: starting chunk 1 size 4Mi offset 4Mi/8.000Mi 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload wrote chunk 3 with 1 bytes 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload wrote chunk 2 with 4194304 bytes 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:26 DEBUG : test-multithread-copy-false-8388609-2: multipart upload finished 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: write buffer set to 131072 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: chunk size 64Mi was bigger than source file size 8.000Mi 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: number of streams 4 was bigger than number of chunks 1 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: Starting multi-thread copy with 1 chunks of size 8.000Mi with 1 parallel streams 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: chunk 1/1 (0-8388609) size 8.000Mi starting 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: writing chunk 0 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: multi-thread copy: chunk 1/1 (0-8388609) size 8.000Mi finished 2024/11/08 03:07:27 DEBUG : test-multithread-copy-false-8388609-2: Finished multi-thread copy with 1 parts of size 8.000Mi === RUN TestMultithreadCopy/upload=true,size=8388607,streams=2 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: disabling buffering because source is local disk 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: Multipart upload session started for 2 parts of size 4Mi 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: open chunk writer: started multipart upload 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 2 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: number of streams 16 was bigger than number of chunks 2 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: Starting multi-thread copy with 2 chunks of size 4Mi with 2 parallel streams 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 2/2 (4194304-8388607) size 4.000Mi starting 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi starting 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: Seek from 4194304 to 0 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: Seek from 4194303 to 0 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi finished 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multipart upload wrote chunk 2 with 4194303 bytes 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multi-thread copy: chunk 2/2 (4194304-8388607) size 4.000Mi finished 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: multipart upload finished 2024/11/08 03:07:28 DEBUG : test-multithread-copy-true-8388607-2: Finished multi-thread copy with 2 parts of size 4Mi === RUN TestMultithreadCopy/upload=true,size=8388608,streams=2 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: disabling buffering because source is local disk 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: Multipart upload session started for 2 parts of size 4Mi 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: open chunk writer: started multipart upload 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 2 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: number of streams 16 was bigger than number of chunks 2 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: Starting multi-thread copy with 2 chunks of size 4Mi with 2 parallel streams 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 2/2 (4194304-8388608) size 4Mi starting 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi starting 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: Seek from 4194304 to 0 2024/11/08 03:07:29 DEBUG : test-multithread-copy-true-8388608-2: Seek from 4194304 to 0 2024/11/08 03:07:30 DEBUG : test-multithread-copy-true-8388608-2: multipart upload wrote chunk 2 with 4194304 bytes 2024/11/08 03:07:30 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 2/2 (4194304-8388608) size 4Mi finished 2024/11/08 03:07:30 DEBUG : test-multithread-copy-true-8388608-2: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:30 DEBUG : test-multithread-copy-true-8388608-2: multi-thread copy: chunk 1/2 (0-4194304) size 4Mi finished 2024/11/08 03:07:30 DEBUG : test-multithread-copy-true-8388608-2: multipart upload finished 2024/11/08 03:07:30 DEBUG : test-multithread-copy-true-8388608-2: Finished multi-thread copy with 2 parts of size 4Mi === RUN TestMultithreadCopy/upload=true,size=8388609,streams=2 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: disabling buffering because source is local disk 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: Multipart upload session started for 3 parts of size 4Mi 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: open chunk writer: started multipart upload 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 2 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: number of streams 16 was bigger than number of chunks 3 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: Starting multi-thread copy with 3 chunks of size 4Mi with 3 parallel streams 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 3/3 (8388608-8388609) size 1 starting 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi starting 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi starting 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: Seek from 1 to 0 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: Seek from 4194304 to 0 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: Seek from 4194304 to 0 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multipart upload wrote chunk 3 with 1 bytes 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 3/3 (8388608-8388609) size 1 finished 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi finished 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multipart upload wrote chunk 2 with 4194304 bytes 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi finished 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: multipart upload finished 2024/11/08 03:07:31 DEBUG : test-multithread-copy-true-8388609-2: Finished multi-thread copy with 3 parts of size 4Mi --- PASS: TestMultithreadCopy (10.02s) --- PASS: TestMultithreadCopy/upload=false,size=8388607,streams=2 (2.04s) --- PASS: TestMultithreadCopy/upload=false,size=8388608,streams=2 (1.84s) --- PASS: TestMultithreadCopy/upload=false,size=8388609,streams=2 (1.43s) --- PASS: TestMultithreadCopy/upload=true,size=8388607,streams=2 (1.43s) --- PASS: TestMultithreadCopy/upload=true,size=8388608,streams=2 (1.45s) --- PASS: TestMultithreadCopy/upload=true,size=8388609,streams=2 (1.46s) === RUN TestMultithreadCopyAbort run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:32 DEBUG : chunksize-probe: Multipart upload session started for 25 parts of size 4Mi 2024/11/08 03:07:32 DEBUG : chunksize-probe: open chunk writer: started multipart upload 2024/11/08 03:07:32 DEBUG : chunksize-probe: multipart upload aborted (did nothing - see issue #5583) 2024/11/08 03:07:32 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk 2024/11/08 03:07:32 DEBUG : test-multithread-abort: Multipart upload session started for 3 parts of size 4Mi 2024/11/08 03:07:32 DEBUG : test-multithread-abort: open chunk writer: started multipart upload 2024/11/08 03:07:32 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 16 instead of --multi-thread-streams 1 2024/11/08 03:07:32 DEBUG : test-multithread-abort: multi-thread copy: number of streams 16 was bigger than number of chunks 3 2024/11/08 03:07:32 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 4Mi with 3 parallel streams 2024/11/08 03:07:32 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (8388608-8388609) size 1 starting 2024/11/08 03:07:32 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:32 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi starting 2024/11/08 03:07:32 DEBUG : Open with options = [RangeOption(4194304,8388607)] 2024/11/08 03:07:32 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi starting 2024/11/08 03:07:32 DEBUG : Open with options = [RangeOption(0,4194303)] 2024/11/08 03:07:32 DEBUG : test-multithread-abort: Seek from 4194304 to 0 2024/11/08 03:07:32 DEBUG : Open with options = [RangeOption(0,4194303)] 2024/11/08 03:07:32 DEBUG : test-multithread-abort: Seek from 4194304 to 0 2024/11/08 03:07:32 DEBUG : Open with options = [RangeOption(4194304,8388607)] 2024/11/08 03:07:33 DEBUG : test-multithread-abort: multipart upload wrote chunk 1 with 4194304 bytes 2024/11/08 03:07:33 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-4194304) size 4Mi finished 2024/11/08 03:07:33 DEBUG : test-multithread-abort: multipart upload wrote chunk 2 with 4194304 bytes 2024/11/08 03:07:33 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (4194304-8388608) size 4Mi finished 2024/11/08 03:07:33 DEBUG : Returning error reader 2024/11/08 03:07:33 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:33 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 1/10: BOOM: simulated read failure 2024/11/08 03:07:33 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:34 DEBUG : Returning error reader 2024/11/08 03:07:34 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:34 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 2/10: BOOM: simulated read failure 2024/11/08 03:07:34 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:35 DEBUG : Returning error reader 2024/11/08 03:07:35 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:35 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 3/10: BOOM: simulated read failure 2024/11/08 03:07:35 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:36 DEBUG : Returning error reader 2024/11/08 03:07:36 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:36 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 4/10: BOOM: simulated read failure 2024/11/08 03:07:36 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:37 DEBUG : Returning error reader 2024/11/08 03:07:37 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:37 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 5/10: BOOM: simulated read failure 2024/11/08 03:07:37 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:38 DEBUG : Returning error reader 2024/11/08 03:07:38 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:38 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 6/10: BOOM: simulated read failure 2024/11/08 03:07:38 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:39 DEBUG : Returning error reader 2024/11/08 03:07:39 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:39 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 7/10: BOOM: simulated read failure 2024/11/08 03:07:39 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:40 DEBUG : Returning error reader 2024/11/08 03:07:40 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:40 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 8/10: BOOM: simulated read failure 2024/11/08 03:07:40 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:41 DEBUG : Returning error reader 2024/11/08 03:07:41 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:41 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 9/10: BOOM: simulated read failure 2024/11/08 03:07:41 DEBUG : Open with options = [RangeOption(8388608,8388608)] 2024/11/08 03:07:42 DEBUG : Returning error reader 2024/11/08 03:07:42 DEBUG : BOOM: simulated read failure 2024/11/08 03:07:42 DEBUG : test-multithread-abort: Reopening on read failure after offset 0 bytes: retry 10/10: BOOM: simulated read failure 2024/11/08 03:07:42 DEBUG : test-multithread-abort: Reopen failed after offset 0 bytes read: failed to reopen: too many retries 2024/11/08 03:07:42 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 failed: multi-thread copy: failed to write chunk: BOOM: simulated read failure 2024/11/08 03:07:42 DEBUG : test-multithread-abort: multi-thread copy: cancelling transfer on exit 2024/11/08 03:07:42 DEBUG : test-multithread-abort: multipart upload aborted (did nothing - see issue #5583) --- PASS: TestMultithreadCopyAbort (10.89s) === RUN TestSizeDiffers --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2024/11/08 03:07:43 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/Seek 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2024/11/08 03:07:43 DEBUG : potato: Seek from 10 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 10 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/Seek 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Seek from 5 to 2 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2024/11/08 03:07:43 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/Seek 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Seek from 5 to 2 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2024/11/08 03:07:43 DEBUG : potato: Seek from 8 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 8 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2024/11/08 03:07:43 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2024/11/08 03:07:43 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/Seek 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2024/11/08 03:07:43 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2024/11/08 03:07:43 DEBUG : potato: Seek from 5 to 2 2024/11/08 03:07:43 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2024/11/08 03:07:43 DEBUG : potato: Seek from 9 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 9 to 0 2024/11/08 03:07:43 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (1.24s) --- PASS: TestCheck/1 (0.04s) --- PASS: TestCheck/2 (0.04s) --- PASS: TestCheck/3 (0.04s) --- PASS: TestCheck/4 (0.08s) --- PASS: TestCheck/5 (0.07s) --- PASS: TestCheck/6 (0.08s) --- PASS: TestCheck/7 (0.07s) === RUN TestCheckFsError 2024/11/08 03:07:44 DEBUG : Creating backend with remote "nonexistent" 2024/11/08 03:07:44 DEBUG : Creating backend with remote "nonexistent" 2024/11/08 03:07:44 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2024/11/08 03:07:44 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2024/11/08 03:07:44 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 differences found 2024/11/08 03:07:44 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (1.49s) --- PASS: TestCheckDownload/1 (0.08s) --- PASS: TestCheckDownload/2 (0.08s) --- PASS: TestCheckDownload/3 (0.08s) --- PASS: TestCheckDownload/4 (0.11s) --- PASS: TestCheckDownload/5 (0.11s) --- PASS: TestCheckDownload/6 (0.11s) --- PASS: TestCheckDownload/7 (0.11s) === RUN TestCheckSizeOnly run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (1.22s) --- PASS: TestCheckSizeOnly/1 (0.04s) --- PASS: TestCheckSizeOnly/2 (0.04s) --- PASS: TestCheckSizeOnly/3 (0.04s) --- PASS: TestCheckSizeOnly/4 (0.07s) --- PASS: TestCheckSizeOnly/5 (0.07s) --- PASS: TestCheckSizeOnly/6 (0.07s) --- PASS: TestCheckSizeOnly/7 (0.07s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:47 NOTICE: test.sum: improperly formatted checksum line 4 2024/11/08 03:07:47 NOTICE: test.sum: improperly formatted checksum line 5 2024/11/08 03:07:47 NOTICE: test.sum: improperly formatted checksum line 6 2024/11/08 03:07:47 NOTICE: test.sum: 2 warning(s) suppressed... 2024/11/08 03:07:47 NOTICE: test.sum: improperly formatted checksum line 4 2024/11/08 03:07:47 NOTICE: test.sum: improperly formatted checksum line 5 2024/11/08 03:07:47 NOTICE: test.sum: improperly formatted checksum line 6 2024/11/08 03:07:47 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (0.42s) === RUN TestCheckSum run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:47 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/data" 2024/11/08 03:07:47 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:47 DEBUG : Azure container rclone-test-saqused2liya path data: Using directory markers 2024/11/08 03:07:47 DEBUG : data/: Creating directory marker === RUN TestCheckSum/subtest1 === RUN TestCheckSum/subtest2 === RUN TestCheckSum/subtest3 === RUN TestCheckSum/subtest4 === RUN TestCheckSum/subtest5 === RUN TestCheckSum/subtest6 === RUN TestCheckSum/subtest7 2024/11/08 03:07:50 DEBUG : data/: Removing directory marker --- PASS: TestCheckSum (2.87s) --- PASS: TestCheckSum/subtest1 (0.11s) --- PASS: TestCheckSum/subtest2 (0.15s) --- PASS: TestCheckSum/subtest3 (0.15s) --- PASS: TestCheckSum/subtest4 (0.15s) --- PASS: TestCheckSum/subtest5 (0.15s) --- PASS: TestCheckSum/subtest6 (0.15s) --- PASS: TestCheckSum/subtest7 (0.15s) === RUN TestCheckSumDownload run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:50 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/data" 2024/11/08 03:07:50 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:50 DEBUG : Azure container rclone-test-saqused2liya path data: Using directory markers 2024/11/08 03:07:50 DEBUG : data/: Creating directory marker === RUN TestCheckSumDownload/subtest1 === RUN TestCheckSumDownload/subtest2 === RUN TestCheckSumDownload/subtest3 === RUN TestCheckSumDownload/subtest4 === RUN TestCheckSumDownload/subtest5 === RUN TestCheckSumDownload/subtest6 === RUN TestCheckSumDownload/subtest7 2024/11/08 03:07:53 DEBUG : data/: Removing directory marker --- PASS: TestCheckSumDownload (3.19s) --- PASS: TestCheckSumDownload/subtest1 (0.15s) --- PASS: TestCheckSumDownload/subtest2 (0.19s) --- PASS: TestCheckSumDownload/subtest3 (0.19s) --- PASS: TestCheckSumDownload/subtest4 (0.19s) --- PASS: TestCheckSumDownload/subtest5 (0.19s) --- PASS: TestCheckSumDownload/subtest6 (0.19s) --- PASS: TestCheckSumDownload/subtest7 (0.19s) === RUN TestApplyTransforms 2024/11/08 03:07:53 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-xezayap4yoke" 2024/11/08 03:07:53 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:53 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:53 DEBUG : Azure container rclone-test-xezayap4yoke: Using directory markers 2024/11/08 03:07:53 DEBUG : Creating backend with remote "/tmp/rclone808944822" run.go:180: Remote "Azure container rclone-test-xezayap4yoke", Local "Local file system at /tmp/rclone808944822", Modify Window "1ns" upper checkfile vs. lower remote (without normalization) 2024/11/08 03:07:53 ERROR : hello, world!: sum not found 2024/11/08 03:07:53 ERROR : HELLO, WORLD!: file not in Azure container rclone-test-xezayap4yoke 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-xezayap4yoke: 1 files missing 2024/11/08 03:07:53 NOTICE: 1 hashes missing 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-xezayap4yoke: 2 differences found 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-xezayap4yoke: 2 errors while checking upper checkfile vs. lower remote (with normalization) 2024/11/08 03:07:53 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-xezayap4yoke: 0 differences found 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-xezayap4yoke: 1 matching files 2024/11/08 03:07:53 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-sisomex3beni" 2024/11/08 03:07:53 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:53 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:53 DEBUG : Azure container rclone-test-sisomex3beni: Using directory markers 2024/11/08 03:07:53 DEBUG : Creating backend with remote "/tmp/rclone3421853024" run.go:180: Remote "Azure container rclone-test-sisomex3beni", Local "Local file system at /tmp/rclone3421853024", Modify Window "1ns" lower checkfile vs. upper remote (without normalization) 2024/11/08 03:07:53 ERROR : HELLO, WORLD!: sum not found 2024/11/08 03:07:53 ERROR : hello, world!: file not in Azure container rclone-test-sisomex3beni 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-sisomex3beni: 1 files missing 2024/11/08 03:07:53 NOTICE: 1 hashes missing 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-sisomex3beni: 2 differences found 2024/11/08 03:07:53 NOTICE: Azure container rclone-test-sisomex3beni: 2 errors while checking lower checkfile vs. upper remote (with normalization) 2024/11/08 03:07:54 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-sisomex3beni: 0 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-sisomex3beni: 1 matching files 2024/11/08 03:07:54 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-bumayis3jano" 2024/11/08 03:07:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:54 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:54 DEBUG : Azure container rclone-test-bumayis3jano: Using directory markers 2024/11/08 03:07:54 DEBUG : Creating backend with remote "/tmp/rclone1222971768" run.go:180: Remote "Azure container rclone-test-bumayis3jano", Local "Local file system at /tmp/rclone1222971768", Modify Window "1ns" lower checkfile vs. upperlowermixed remote (without normalization) 2024/11/08 03:07:54 ERROR : HeLlO, wOrLd!: sum not found 2024/11/08 03:07:54 ERROR : hello, world!: file not in Azure container rclone-test-bumayis3jano 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-bumayis3jano: 1 files missing 2024/11/08 03:07:54 NOTICE: 1 hashes missing 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-bumayis3jano: 2 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-bumayis3jano: 2 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2024/11/08 03:07:54 DEBUG : HeLlO, wOrLd!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-bumayis3jano: 0 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-bumayis3jano: 1 matching files 2024/11/08 03:07:54 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-gelelir4qace" 2024/11/08 03:07:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:54 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:54 DEBUG : Azure container rclone-test-gelelir4qace: Using directory markers 2024/11/08 03:07:54 DEBUG : Creating backend with remote "/tmp/rclone1968342231" run.go:180: Remote "Azure container rclone-test-gelelir4qace", Local "Local file system at /tmp/rclone1968342231", Modify Window "1ns" upperlowermixed checkfile vs. upper remote (without normalization) 2024/11/08 03:07:54 ERROR : HELLO, WORLD!: sum not found 2024/11/08 03:07:54 ERROR : HeLlO, wOrLd!: file not in Azure container rclone-test-gelelir4qace 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-gelelir4qace: 1 files missing 2024/11/08 03:07:54 NOTICE: 1 hashes missing 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-gelelir4qace: 2 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-gelelir4qace: 2 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2024/11/08 03:07:54 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-gelelir4qace: 0 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-gelelir4qace: 1 matching files 2024/11/08 03:07:54 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-cijodum2cayu" 2024/11/08 03:07:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:54 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:54 DEBUG : Azure container rclone-test-cijodum2cayu: Using directory markers 2024/11/08 03:07:54 DEBUG : Creating backend with remote "/tmp/rclone662335176" run.go:180: Remote "Azure container rclone-test-cijodum2cayu", Local "Local file system at /tmp/rclone662335176", Modify Window "1ns" NFD checkfile vs. NFC remote (without normalization) 2024/11/08 03:07:54 ERROR : 測試_Русский___ě_áñ: sum not found 2024/11/08 03:07:54 ERROR : 測試_Русский___ě_áñ: file not in Azure container rclone-test-cijodum2cayu 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-cijodum2cayu: 1 files missing 2024/11/08 03:07:54 NOTICE: 1 hashes missing 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-cijodum2cayu: 2 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-cijodum2cayu: 2 errors while checking NFD checkfile vs. NFC remote (with normalization) 2024/11/08 03:07:54 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-cijodum2cayu: 0 differences found 2024/11/08 03:07:54 NOTICE: Azure container rclone-test-cijodum2cayu: 1 matching files 2024/11/08 03:07:54 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-xezafod1zesa" 2024/11/08 03:07:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:54 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:54 DEBUG : Azure container rclone-test-xezafod1zesa: Using directory markers 2024/11/08 03:07:54 DEBUG : Creating backend with remote "/tmp/rclone976726242" run.go:180: Remote "Azure container rclone-test-xezafod1zesa", Local "Local file system at /tmp/rclone976726242", Modify Window "1ns" NFC checkfile vs. NFD remote (without normalization) 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ: sum not found 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ: file not in Azure container rclone-test-xezafod1zesa 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-xezafod1zesa: 1 files missing 2024/11/08 03:07:55 NOTICE: 1 hashes missing 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-xezafod1zesa: 2 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-xezafod1zesa: 2 errors while checking NFC checkfile vs. NFD remote (with normalization) 2024/11/08 03:07:55 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-xezafod1zesa: 0 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-xezafod1zesa: 1 matching files 2024/11/08 03:07:55 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-doxetuv1xexu" 2024/11/08 03:07:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:55 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:55 DEBUG : Azure container rclone-test-doxetuv1xexu: Using directory markers 2024/11/08 03:07:55 DEBUG : Creating backend with remote "/tmp/rclone488557822" run.go:180: Remote "Azure container rclone-test-doxetuv1xexu", Local "Local file system at /tmp/rclone488557822", Modify Window "1ns" NFDx2 checkfile vs. both remote (without normalization) 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-doxetuv1xexu 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-doxetuv1xexu: 1 files missing 2024/11/08 03:07:55 NOTICE: 1 hashes missing 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-doxetuv1xexu: 2 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-doxetuv1xexu: 2 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2024/11/08 03:07:55 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-doxetuv1xexu: 0 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-doxetuv1xexu: 1 matching files 2024/11/08 03:07:55 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-yonodak3goki" 2024/11/08 03:07:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:55 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:55 DEBUG : Azure container rclone-test-yonodak3goki: Using directory markers 2024/11/08 03:07:55 DEBUG : Creating backend with remote "/tmp/rclone2624133427" run.go:180: Remote "Azure container rclone-test-yonodak3goki", Local "Local file system at /tmp/rclone2624133427", Modify Window "1ns" NFCx2 checkfile vs. both remote (without normalization) 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-yonodak3goki 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-yonodak3goki: 1 files missing 2024/11/08 03:07:55 NOTICE: 1 hashes missing 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-yonodak3goki: 2 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-yonodak3goki: 2 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2024/11/08 03:07:55 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-yonodak3goki: 0 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-yonodak3goki: 1 matching files 2024/11/08 03:07:55 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-wezuwud8zopu" 2024/11/08 03:07:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:55 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:55 DEBUG : Azure container rclone-test-wezuwud8zopu: Using directory markers 2024/11/08 03:07:55 DEBUG : Creating backend with remote "/tmp/rclone654996122" run.go:180: Remote "Azure container rclone-test-wezuwud8zopu", Local "Local file system at /tmp/rclone654996122", Modify Window "1ns" both checkfile vs. NFDx2 remote (without normalization) 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2024/11/08 03:07:55 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-wezuwud8zopu 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-wezuwud8zopu: 1 files missing 2024/11/08 03:07:55 NOTICE: 1 hashes missing 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-wezuwud8zopu: 2 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-wezuwud8zopu: 2 errors while checking both checkfile vs. NFDx2 remote (with normalization) 2024/11/08 03:07:55 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-wezuwud8zopu: 0 differences found 2024/11/08 03:07:55 NOTICE: Azure container rclone-test-wezuwud8zopu: 1 matching files 2024/11/08 03:07:55 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-nogupis6jubo" 2024/11/08 03:07:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:07:55 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:55 DEBUG : Azure container rclone-test-nogupis6jubo: Using directory markers 2024/11/08 03:07:55 DEBUG : Creating backend with remote "/tmp/rclone650044980" run.go:180: Remote "Azure container rclone-test-nogupis6jubo", Local "Local file system at /tmp/rclone650044980", Modify Window "1ns" both checkfile vs. NFCx2 remote (without normalization) 2024/11/08 03:07:56 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2024/11/08 03:07:56 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in Azure container rclone-test-nogupis6jubo 2024/11/08 03:07:56 NOTICE: Azure container rclone-test-nogupis6jubo: 1 files missing 2024/11/08 03:07:56 NOTICE: 1 hashes missing 2024/11/08 03:07:56 NOTICE: Azure container rclone-test-nogupis6jubo: 2 differences found 2024/11/08 03:07:56 NOTICE: Azure container rclone-test-nogupis6jubo: 2 errors while checking both checkfile vs. NFCx2 remote (with normalization) 2024/11/08 03:07:56 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2024/11/08 03:07:56 NOTICE: Azure container rclone-test-nogupis6jubo: 0 differences found 2024/11/08 03:07:56 NOTICE: Azure container rclone-test-nogupis6jubo: 1 matching files 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-nogupis6jubo: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-wezuwud8zopu: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-yonodak3goki: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-doxetuv1xexu: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-xezafod1zesa: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-cijodum2cayu: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-gelelir4qace: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-bumayis3jano: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-sisomex3beni: Purge remote 2024/11/08 03:07:56 DEBUG : Azure container rclone-test-xezayap4yoke: Purge remote --- PASS: TestApplyTransforms (3.58s) === RUN TestTruncateString --- PASS: TestTruncateString (0.00s) === RUN TestCopyFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:57 DEBUG : file1: Need to transfer - File not found at Destination 2024/11/08 03:07:57 DEBUG : sub/: Creating directory marker 2024/11/08 03:07:57 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/11/08 03:07:57 INFO : file1: Copied (new) to: sub/file2 2024/11/08 03:07:57 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:07:57 DEBUG : file1: Unchanged skipping 2024/11/08 03:07:57 DEBUG : Azure container rclone-test-saqused2liya: don't need to copy/move sub/file2, it is already at target location 2024/11/08 03:07:57 DEBUG : sub/: Removing directory marker --- PASS: TestCopyFile (0.51s) === RUN TestCopyLongFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" copy_test.go:153: Test only runs on local --- SKIP: TestCopyLongFile (0.08s) === RUN TestCopyFileBackupDir run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:07:57 DEBUG : dst/: Creating directory marker 2024/11/08 03:07:57 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/backup" 2024/11/08 03:07:57 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:07:57 DEBUG : Azure container rclone-test-saqused2liya path backup: Using directory markers 2024/11/08 03:07:57 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-saqused2liya/backup" to be canonical "TestAzureBlob{juk_h}:rclone-test-saqused2liya/backup" 2024/11/08 03:07:57 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2024/11/08 03:07:58 DEBUG : dst/: Creating directory marker 2024/11/08 03:07:58 DEBUG : dst/file1: md5 = 05164b153084ba910184c26e561a7c18 OK 2024/11/08 03:07:58 INFO : dst/file1: Copied (server-side copy) 2024/11/08 03:07:58 INFO : dst/file1: Deleted 2024/11/08 03:07:58 DEBUG : dst/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/11/08 03:07:58 INFO : dst/file1: Copied (new) 2024/11/08 03:07:58 DEBUG : dst/: Removing directory marker 2024/11/08 03:07:58 DEBUG : backup/dst/: Removing directory marker 2024/11/08 03:07:58 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 1/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:c240d036-601e-0060-338b-31c062000000 Time:2024-11-08T03:07:58.6202751Z -------------------------------------------------------------------------------- 2024/11/08 03:07:59 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 2/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:c240d1be-601e-0060-778b-31c062000000 Time:2024-11-08T03:07:59.6595038Z -------------------------------------------------------------------------------- 2024/11/08 03:08:00 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 3/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:c240d391-601e-0060-7c8b-31c062000000 Time:2024-11-08T03:08:00.6981286Z -------------------------------------------------------------------------------- run.go:128: removing dir "backup" failed: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:c240d391-601e-0060-7c8b-31c062000000 Time:2024-11-08T03:08:00.6981286Z -------------------------------------------------------------------------------- --- PASS: TestCopyFileBackupDir (4.12s) === RUN TestCopyFileCompareDest run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:01 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/dst" 2024/11/08 03:08:01 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:01 DEBUG : Azure container rclone-test-saqused2liya path dst: Using directory markers 2024/11/08 03:08:01 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:01 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:01 DEBUG : Azure container rclone-test-saqused2liya path CompareDest: Using directory markers 2024/11/08 03:08:01 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" to be canonical "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:01 DEBUG : one: Need to transfer - File not found at Destination 2024/11/08 03:08:01 DEBUG : /: Creating directory marker 2024/11/08 03:08:02 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2024/11/08 03:08:02 INFO : one: Copied (new) 2024/11/08 03:08:02 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:02 DEBUG : one: Sizes differ (src 5 vs dst 3) 2024/11/08 03:08:02 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2024/11/08 03:08:02 INFO : one: Copied (replaced existing) 2024/11/08 03:08:02 DEBUG : CompareDest/: Creating directory marker 2024/11/08 03:08:02 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:02 DEBUG : one: Sizes differ (src 5 vs dst 3) 2024/11/08 03:08:02 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:08:02 DEBUG : one: Destination found in --compare-dest, skipping 2024/11/08 03:08:03 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:03 DEBUG : two: Need to transfer - File not found at Destination 2024/11/08 03:08:03 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:08:03 DEBUG : two: Destination found in --compare-dest, skipping 2024/11/08 03:08:03 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:03 DEBUG : two: Need to transfer - File not found at Destination 2024/11/08 03:08:03 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:08:03 DEBUG : two: Destination found in --compare-dest, skipping 2024/11/08 03:08:03 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CompareDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CompareDest" 2024/11/08 03:08:03 DEBUG : two: Need to transfer - File not found at Destination 2024/11/08 03:08:03 DEBUG : two: Sizes differ (src 5 vs dst 3) 2024/11/08 03:08:03 DEBUG : two: md5 = 2379e4ce8c3380e996ab0509f17069ad OK 2024/11/08 03:08:03 INFO : two: Copied (new) 2024/11/08 03:08:03 DEBUG : dst/: Removing directory marker 2024/11/08 03:08:04 DEBUG : CompareDest/: Removing directory marker --- PASS: TestCopyFileCompareDest (2.34s) === RUN TestCopyFileCopyDest run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:04 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/dst" 2024/11/08 03:08:04 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:04 DEBUG : Azure container rclone-test-saqused2liya path dst: Using directory markers 2024/11/08 03:08:04 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:04 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:04 DEBUG : Azure container rclone-test-saqused2liya path CopyDest: Using directory markers 2024/11/08 03:08:04 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" to be canonical "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:04 DEBUG : one: Need to transfer - File not found at Destination 2024/11/08 03:08:04 DEBUG : /: Creating directory marker 2024/11/08 03:08:04 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2024/11/08 03:08:04 INFO : one: Copied (new) 2024/11/08 03:08:04 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:04 DEBUG : one: Sizes differ (src 5 vs dst 3) 2024/11/08 03:08:04 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2024/11/08 03:08:04 INFO : one: Copied (replaced existing) 2024/11/08 03:08:04 DEBUG : CopyDest/: Creating directory marker 2024/11/08 03:08:05 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/BackupDir" 2024/11/08 03:08:05 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:05 DEBUG : Azure container rclone-test-saqused2liya path BackupDir: Using directory markers 2024/11/08 03:08:05 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-saqused2liya/BackupDir" to be canonical "TestAzureBlob{juk_h}:rclone-test-saqused2liya/BackupDir" 2024/11/08 03:08:05 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:05 DEBUG : one: Sizes differ (src 5 vs dst 3) 2024/11/08 03:08:05 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:08:05 DEBUG : one: Sizes differ (src 5 vs dst 3) 2024/11/08 03:08:05 DEBUG : /: Creating directory marker 2024/11/08 03:08:05 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2024/11/08 03:08:05 INFO : one: Copied (server-side copy) 2024/11/08 03:08:05 INFO : one: Deleted 2024/11/08 03:08:05 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2024/11/08 03:08:05 INFO : one: Copied (server-side copy) 2024/11/08 03:08:05 DEBUG : one: Destination found in --copy-dest, using server-side copy 2024/11/08 03:08:05 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:05 DEBUG : two: Need to transfer - File not found at Destination 2024/11/08 03:08:05 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:08:06 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2024/11/08 03:08:06 INFO : two: Copied (server-side copy) 2024/11/08 03:08:06 DEBUG : two: Destination found in --copy-dest, using server-side copy 2024/11/08 03:08:06 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:06 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:08:06 DEBUG : two: Unchanged skipping 2024/11/08 03:08:06 DEBUG : fs cache: switching user supplied name "TestAzureBlob,directory_markers:rclone-test-saqused2liya/CopyDest" for canonical name "TestAzureBlob{juk_h}:rclone-test-saqused2liya/CopyDest" 2024/11/08 03:08:06 DEBUG : three: Need to transfer - File not found at Destination 2024/11/08 03:08:06 DEBUG : three: Sizes differ (src 7 vs dst 5) 2024/11/08 03:08:06 DEBUG : three: Destination not found in --copy-dest 2024/11/08 03:08:06 DEBUG : three: md5 = 1bccb9dccb3e9f6a3f9d2a8bdb54b7f5 OK 2024/11/08 03:08:06 INFO : three: Copied (new) 2024/11/08 03:08:07 DEBUG : dst/: Removing directory marker 2024/11/08 03:08:07 DEBUG : CopyDest/: Removing directory marker 2024/11/08 03:08:07 DEBUG : BackupDir/: Removing directory marker --- PASS: TestCopyFileCopyDest (3.12s) === RUN TestCopyInplace run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" copy_test.go:370: Partial uploads not supported --- SKIP: TestCopyInplace (0.08s) === RUN TestCopyLongFileName run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" copy_test.go:403: Partial uploads not supported --- SKIP: TestCopyLongFileName (0.08s) === RUN TestCopyFileMaxTransfer run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/file1: Need to transfer - File not found at Destination 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/: Creating directory marker 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/11/08 03:08:07 INFO : TestCopyFileMaxTransfer/file1: Copied (new) 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/file2: Need to transfer - File not found at Destination 2024/11/08 03:08:07 ERROR : TestCopyFileMaxTransfer/file2: Failed to copy: single part upload read failed: max transfer limit reached as set by --max-transfer 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/file3: Need to transfer - File not found at Destination 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/file4: Need to transfer - File not found at Destination 2024/11/08 03:08:07 DEBUG : TestCopyFileMaxTransfer/file4: md5 = 681e81fbb73e6e5fb48cedaa28454903 OK 2024/11/08 03:08:07 INFO : TestCopyFileMaxTransfer/file4: Copied (new) 2024/11/08 03:08:08 DEBUG : TestCopyFileMaxTransfer/: Removing directory marker --- PASS: TestCopyFileMaxTransfer (0.92s) === RUN TestDeduplicateInteractive run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateInteractive (0.08s) === RUN TestDeduplicateSkip run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSkip (0.08s) === RUN TestDeduplicateSizeOnly run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSizeOnly (0.08s) === RUN TestDeduplicateFirst run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateFirst (0.08s) === RUN TestDeduplicateNewest run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateNewest (0.08s) === RUN TestDeduplicateNewestByHash run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:08 DEBUG : also/: Creating directory marker 2024/11/08 03:08:09 INFO : Azure container rclone-test-saqused2liya: Looking for duplicate md5 hashes using newest mode. 2024/11/08 03:08:09 NOTICE: f4eb5752d262554cafada122d3387c12: Found 3 files with duplicate md5 hashes 2024/11/08 03:08:09 INFO : one: Deleted 2024/11/08 03:08:09 INFO : also/one: Deleted 2024/11/08 03:08:09 NOTICE: f4eb5752d262554cafada122d3387c12: Deleted 2 extra copies 2024/11/08 03:08:09 DEBUG : also/: Removing directory marker --- PASS: TestDeduplicateNewestByHash (0.96s) === RUN TestDeduplicateOldest run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateOldest (0.08s) === RUN TestDeduplicateLargest run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateLargest (0.08s) === RUN TestDeduplicateSmallest run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateSmallest (0.08s) === RUN TestDeduplicateRename run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:24: Can't test deduplicate - no duplicate files possible --- SKIP: TestDeduplicateRename (0.08s) === RUN TestMergeDirs run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" dedupe_test.go:256: Can't merge directories --- SKIP: TestMergeDirs (0.08s) === RUN TestListDirSorted run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:10 DEBUG : sub dir/: Creating directory marker 2024/11/08 03:08:10 DEBUG : sub dir/ignore dir/: Creating directory marker 2024/11/08 03:08:10 DEBUG : sub dir/sub sub dir/: Creating directory marker 2024/11/08 03:08:11 DEBUG : a.txt: Excluded (Size Filter) 2024/11/08 03:08:11 DEBUG : a.txt: Excluded 2024/11/08 03:08:11 DEBUG : sub dir/hello world: Excluded (Size Filter) 2024/11/08 03:08:11 DEBUG : sub dir/hello world: Excluded 2024/11/08 03:08:11 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2024/11/08 03:08:11 DEBUG : sub dir/hello world2: Excluded 2024/11/08 03:08:11 DEBUG : sub dir/hello world: Excluded (Size Filter) 2024/11/08 03:08:11 DEBUG : sub dir/hello world: Excluded 2024/11/08 03:08:11 DEBUG : sub dir/hello world2: Excluded (Size Filter) 2024/11/08 03:08:11 DEBUG : sub dir/hello world2: Excluded 2024/11/08 03:08:11 DEBUG : sub dir/ignore dir: Excluded 2024/11/08 03:08:11 DEBUG : sub dir/ignore dir: Excluded 2024/11/08 03:08:12 DEBUG : sub dir/sub sub dir/: Removing directory marker 2024/11/08 03:08:12 DEBUG : sub dir/ignore dir/: Removing directory marker 2024/11/08 03:08:12 DEBUG : sub dir/: Removing directory marker --- PASS: TestListDirSorted (2.15s) === RUN TestListJSON run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:12 DEBUG : sub/: Creating directory marker === RUN TestListJSON/Default === RUN TestListJSON/FilesOnly === RUN TestListJSON/DirsOnly === RUN TestListJSON/Recurse === RUN TestListJSON/SubDir === RUN TestListJSON/NoModTime === RUN TestListJSON/NoMimeType === RUN TestListJSON/ShowHash === RUN TestListJSON/HashTypes === RUN TestListJSON/Metadata 2024/11/08 03:08:13 DEBUG : sub/: Removing directory marker --- PASS: TestListJSON (0.95s) --- PASS: TestListJSON/Default (0.04s) --- PASS: TestListJSON/FilesOnly (0.04s) --- PASS: TestListJSON/DirsOnly (0.04s) --- PASS: TestListJSON/Recurse (0.07s) --- PASS: TestListJSON/SubDir (0.04s) --- PASS: TestListJSON/NoModTime (0.04s) --- PASS: TestListJSON/NoMimeType (0.04s) --- PASS: TestListJSON/ShowHash (0.04s) --- PASS: TestListJSON/HashTypes (0.04s) --- PASS: TestListJSON/Metadata (0.04s) === RUN TestStatJSON run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:13 DEBUG : sub/: Creating directory marker === RUN TestStatJSON/Root === RUN TestStatJSON/RootFilesOnly === RUN TestStatJSON/RootDirsOnly === RUN TestStatJSON/Dir === RUN TestStatJSON/DirWithTrailingSlash === RUN TestStatJSON/File === RUN TestStatJSON/NotFound === RUN TestStatJSON/DirFilesOnly === RUN TestStatJSON/FileFilesOnly === RUN TestStatJSON/NotFoundFilesOnly === RUN TestStatJSON/DirDirsOnly === RUN TestStatJSON/FileDirsOnly === RUN TestStatJSON/NotFoundDirsOnly === RUN TestStatJSON/RootNotFound 2024/11/08 03:08:13 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/notfound" 2024/11/08 03:08:13 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:13 DEBUG : Azure container rclone-test-saqused2liya path notfound: Using directory markers 2024/11/08 03:08:14 DEBUG : sub/: Removing directory marker --- PASS: TestStatJSON (1.18s) --- PASS: TestStatJSON/Root (0.04s) --- PASS: TestStatJSON/RootFilesOnly (0.00s) --- PASS: TestStatJSON/RootDirsOnly (0.04s) --- PASS: TestStatJSON/Dir (0.08s) --- PASS: TestStatJSON/DirWithTrailingSlash (0.04s) --- PASS: TestStatJSON/File (0.04s) --- PASS: TestStatJSON/NotFound (0.08s) --- PASS: TestStatJSON/DirFilesOnly (0.04s) --- PASS: TestStatJSON/FileFilesOnly (0.04s) --- PASS: TestStatJSON/NotFoundFilesOnly (0.04s) --- PASS: TestStatJSON/DirDirsOnly (0.04s) --- PASS: TestStatJSON/FileDirsOnly (0.04s) --- PASS: TestStatJSON/NotFoundDirsOnly (0.04s) --- PASS: TestStatJSON/RootNotFound (0.11s) === RUN TestMkdir run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:14 DEBUG : Azure container rclone-test-saqused2liya: Making directory 2024/11/08 03:08:14 DEBUG : Azure container rclone-test-saqused2liya: Making directory --- PASS: TestMkdir (0.11s) === RUN TestLsd run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:14 DEBUG : sub dir/: Creating directory marker 2024/11/08 03:08:14 DEBUG : sub dir/: Removing directory marker --- PASS: TestLsd (0.39s) === RUN TestLs run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestLs (0.39s) === RUN TestLsWithFilesFrom run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:15 DEBUG : empty space: Excluded (FilesFrom Filter) 2024/11/08 03:08:15 DEBUG : empty space: Excluded --- PASS: TestLsWithFilesFrom (0.42s) === RUN TestLsLong run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestLsLong (0.39s) === RUN TestHashSums run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" === RUN TestHashSums/Md5 === RUN TestHashSums/Md5Download --- PASS: TestHashSums (0.46s) --- PASS: TestHashSums/Md5 (0.04s) --- PASS: TestHashSums/Md5Download (0.08s) === RUN TestHashSumsWithErrors 2024/11/08 03:08:16 DEBUG : Creating backend with remote ":memory:" 2024/11/08 03:08:16 ERROR : file1: hash unsupported: hash type not supported --- PASS: TestHashSumsWithErrors (0.00s) === RUN TestHashStream 2024/11/08 03:08:16 DEBUG : Creating md5 hash of 0 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating md5 hash of 0 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating sha1 hash of 0 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating md5 hash of 12 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating md5 hash of 12 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating sha1 hash of 12 bytes read from input stream 2024/11/08 03:08:16 DEBUG : Creating sha1 hash of 12 bytes read from input stream --- PASS: TestHashStream (0.00s) === RUN TestSuffixName --- PASS: TestSuffixName (0.00s) === RUN TestCount run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:16 DEBUG : sub dir/: Creating directory marker 2024/11/08 03:08:17 DEBUG : sub dir/: Removing directory marker --- PASS: TestCount (0.69s) === RUN TestDelete run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:17 DEBUG : Waiting for deletions to finish 2024/11/08 03:08:17 DEBUG : large: Excluded (Size Filter) 2024/11/08 03:08:17 INFO : small: Deleted 2024/11/08 03:08:17 INFO : medium: Deleted --- PASS: TestDelete (0.58s) === RUN TestMaxDelete run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:18 DEBUG : Waiting for deletions to finish 2024/11/08 03:08:18 ERROR : small: Got fatal error on delete: --max-delete threshold reached 2024/11/08 03:08:18 INFO : medium: Deleted 2024/11/08 03:08:18 INFO : large: Deleted --- PASS: TestMaxDelete (0.65s) === RUN TestMaxDeleteSizeLargeFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:18 DEBUG : Waiting for deletions to finish 2024/11/08 03:08:18 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached 2024/11/08 03:08:18 INFO : small: Deleted 2024/11/08 03:08:18 INFO : medium: Deleted --- PASS: TestMaxDeleteSizeLargeFile (0.65s) === RUN TestMaxDeleteSize run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:19 DEBUG : Waiting for deletions to finish 2024/11/08 03:08:19 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2024/11/08 03:08:19 INFO : medium: Deleted 2024/11/08 03:08:19 INFO : large: Deleted --- PASS: TestMaxDeleteSize (0.65s) === RUN TestReadFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestReadFile (0.38s) === RUN TestRetry 2024/11/08 03:08:20 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 1/5 2024/11/08 03:08:20 DEBUG : Received error: Wrapped EOF is retriable: EOF - low level retry 2/5 2024/11/08 03:08:20 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2024/11/08 03:08:20 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2024/11/08 03:08:20 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2024/11/08 03:08:20 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG 2024/11/08 03:08:20 DEBUG : Sleeping for 10ms (as indicated by the server) to obey Retry-After error: BANG --- PASS: TestRetry (0.05s) === RUN TestCat run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestCat (0.93s) === RUN TestPurge 2024/11/08 03:08:21 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-faqusux5niwi" 2024/11/08 03:08:21 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/08 03:08:21 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:08:21 DEBUG : Azure container rclone-test-faqusux5niwi: Using directory markers 2024/11/08 03:08:21 DEBUG : Creating backend with remote "/tmp/rclone2368053146" run.go:180: Remote "Azure container rclone-test-faqusux5niwi", Local "Local file system at /tmp/rclone2368053146", Modify Window "1ns" 2024/11/08 03:08:21 DEBUG : A1/B1/C1/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A1/B1/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A1/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A2: Making directory 2024/11/08 03:08:21 DEBUG : A2/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A1/B2: Making directory 2024/11/08 03:08:21 DEBUG : A1/B2/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A1/B2/C2: Making directory 2024/11/08 03:08:21 DEBUG : A1/B2/C2/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A1/B1/C3: Making directory 2024/11/08 03:08:21 DEBUG : A1/B1/C3/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A3: Making directory 2024/11/08 03:08:21 DEBUG : A3/: Creating directory marker 2024/11/08 03:08:21 DEBUG : A3/B3: Making directory 2024/11/08 03:08:21 DEBUG : A3/B3/: Creating directory marker 2024/11/08 03:08:22 DEBUG : A3/B3/C4: Making directory 2024/11/08 03:08:22 DEBUG : A3/B3/C4/: Creating directory marker 2024/11/08 03:08:22 DEBUG : Waiting for deletions to finish 2024/11/08 03:08:22 INFO : A1/B1/C1/one: Deleted 2024/11/08 03:08:22 DEBUG : removing 2 level 3 directories 2024/11/08 03:08:22 INFO : A1/B1/C3: Removing directory 2024/11/08 03:08:22 DEBUG : A1/B1/C3/: Removing directory marker 2024/11/08 03:08:22 INFO : A1/B1/C1: Removing directory 2024/11/08 03:08:22 DEBUG : A1/B1/C1/: Removing directory marker 2024/11/08 03:08:22 DEBUG : removing 1 level 2 directories 2024/11/08 03:08:22 INFO : A1/B1: Removing directory 2024/11/08 03:08:22 DEBUG : A1/B1/: Removing directory marker 2024/11/08 03:08:22 DEBUG : Azure container rclone-test-faqusux5niwi: Purge remote 2024/11/08 03:08:22 NOTICE: purge failed: bucket already deleted --- PASS: TestPurge (1.70s) === RUN TestRmdirsNoLeaveRoot run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:22 DEBUG : A1/B1/C1/: Creating directory marker 2024/11/08 03:08:22 DEBUG : A1/B1/: Creating directory marker 2024/11/08 03:08:22 DEBUG : A1/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A2: Making directory 2024/11/08 03:08:23 DEBUG : A2/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A1/B2: Making directory 2024/11/08 03:08:23 DEBUG : A1/B2/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A1/B2/C2: Making directory 2024/11/08 03:08:23 DEBUG : A1/B2/C2/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A1/B1/C3: Making directory 2024/11/08 03:08:23 DEBUG : A1/B1/C3/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A3: Making directory 2024/11/08 03:08:23 DEBUG : A3/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A3/B3: Making directory 2024/11/08 03:08:23 DEBUG : A3/B3/: Creating directory marker 2024/11/08 03:08:23 DEBUG : A3/B3/C4: Making directory 2024/11/08 03:08:23 DEBUG : A3/B3/C4/: Creating directory marker 2024/11/08 03:08:24 DEBUG : removing 1 level 3 directories 2024/11/08 03:08:24 INFO : A3/B3/C4: Removing directory 2024/11/08 03:08:24 DEBUG : A3/B3/C4/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 2 level 3 directories 2024/11/08 03:08:24 INFO : A1/B2/C2: Removing directory 2024/11/08 03:08:24 DEBUG : A1/B2/C2/: Removing directory marker 2024/11/08 03:08:24 INFO : A1/B1/C3: Removing directory 2024/11/08 03:08:24 DEBUG : A1/B1/C3/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 2 level 2 directories 2024/11/08 03:08:24 INFO : A3/B3: Removing directory 2024/11/08 03:08:24 DEBUG : A3/B3/: Removing directory marker 2024/11/08 03:08:24 INFO : A1/B2: Removing directory 2024/11/08 03:08:24 DEBUG : A1/B2/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 2 level 1 directories 2024/11/08 03:08:24 INFO : A3: Removing directory 2024/11/08 03:08:24 DEBUG : A3/: Removing directory marker 2024/11/08 03:08:24 INFO : A2: Removing directory 2024/11/08 03:08:24 DEBUG : A2/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 1 level 3 directories 2024/11/08 03:08:24 INFO : A1/B1/C1: Removing directory 2024/11/08 03:08:24 DEBUG : A1/B1/C1/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 1 level 2 directories 2024/11/08 03:08:24 INFO : A1/B1: Removing directory 2024/11/08 03:08:24 DEBUG : A1/B1/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 1 level 1 directories 2024/11/08 03:08:24 INFO : A1: Removing directory 2024/11/08 03:08:24 DEBUG : A1/: Removing directory marker 2024/11/08 03:08:24 DEBUG : removing 1 level 0 directories 2024/11/08 03:08:24 INFO : Azure container rclone-test-saqused2liya: Removing directory --- PASS: TestRmdirsNoLeaveRoot (2.28s) === RUN TestRmdirsLeaveRoot run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:08:31 DEBUG : pacer: low level retry 1/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e5718-d01e-004a-628b-311f72000000 Time:2024-11-08T03:08:25.0423558Z -------------------------------------------------------------------------------- ) 2024/11/08 03:08:31 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2024/11/08 03:08:37 DEBUG : pacer: low level retry 2/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e5efe-d01e-004a-788b-311f72000000 Time:2024-11-08T03:08:31.0859343Z -------------------------------------------------------------------------------- ) 2024/11/08 03:08:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/08 03:08:43 DEBUG : pacer: low level retry 3/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e66bb-d01e-004a-0a8b-311f72000000 Time:2024-11-08T03:08:37.1300514Z -------------------------------------------------------------------------------- ) 2024/11/08 03:08:43 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/08 03:08:49 DEBUG : pacer: low level retry 4/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e6e35-d01e-004a-2d8b-311f72000000 Time:2024-11-08T03:08:43.1727498Z -------------------------------------------------------------------------------- ) 2024/11/08 03:08:49 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/08 03:08:55 DEBUG : pacer: low level retry 5/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e757f-d01e-004a-4d8b-311f72000000 Time:2024-11-08T03:08:49.2153883Z -------------------------------------------------------------------------------- ) 2024/11/08 03:08:55 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/11/08 03:09:01 DEBUG : pacer: low level retry 6/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e7c36-d01e-004a-5d8b-311f72000000 Time:2024-11-08T03:08:55.2594387Z -------------------------------------------------------------------------------- ) 2024/11/08 03:09:01 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/11/08 03:09:07 DEBUG : pacer: low level retry 7/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e82cf-d01e-004a-2c8b-311f72000000 Time:2024-11-08T03:09:01.3041230Z -------------------------------------------------------------------------------- ) 2024/11/08 03:09:07 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/11/08 03:09:13 DEBUG : pacer: low level retry 8/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e8c17-d01e-004a-368b-311f72000000 Time:2024-11-08T03:09:07.3472618Z -------------------------------------------------------------------------------- ) 2024/11/08 03:09:13 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/11/08 03:09:19 DEBUG : pacer: low level retry 9/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e92e0-d01e-004a-438b-311f72000000 Time:2024-11-08T03:09:13.3905735Z -------------------------------------------------------------------------------- ) 2024/11/08 03:09:19 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2024/11/08 03:09:25 DEBUG : pacer: low level retry 10/10 (error PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e994d-d01e-004a-068b-311f72000000 Time:2024-11-08T03:09:19.4349375Z -------------------------------------------------------------------------------- ) 2024/11/08 03:09:25 DEBUG : pacer: Rate limited, increasing sleep to 5.12s run.go:237: Failed to mkdir "Azure container rclone-test-saqused2liya": PUT https://rclone.blob.core.windows.net/rclone-test-saqused2liya -------------------------------------------------------------------------------- RESPONSE 409: 409 The specified container is being deleted. Try operation later. ERROR CODE: ContainerBeingDeleted -------------------------------------------------------------------------------- ContainerBeingDeletedThe specified container is being deleted. Try operation later. RequestId:5c5e994d-d01e-004a-068b-311f72000000 Time:2024-11-08T03:09:19.4349375Z -------------------------------------------------------------------------------- --- FAIL: TestRmdirsLeaveRoot (60.44s) === RUN TestRmdirsWithFilter run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:25 DEBUG : pacer: Reducing sleep to 2.56s 2024/11/08 03:09:25 DEBUG : A1: Making directory 2024/11/08 03:09:30 DEBUG : pacer: Reducing sleep to 1.28s 2024/11/08 03:09:30 DEBUG : A1/: Creating directory marker 2024/11/08 03:09:33 DEBUG : pacer: Reducing sleep to 640ms 2024/11/08 03:09:33 DEBUG : A1/B1: Making directory 2024/11/08 03:09:34 DEBUG : pacer: Reducing sleep to 320ms 2024/11/08 03:09:34 DEBUG : A1/B1/: Creating directory marker 2024/11/08 03:09:35 DEBUG : pacer: Reducing sleep to 160ms 2024/11/08 03:09:35 DEBUG : pacer: Reducing sleep to 80ms 2024/11/08 03:09:35 DEBUG : A1/B1/C1: Making directory 2024/11/08 03:09:35 DEBUG : pacer: Reducing sleep to 40ms 2024/11/08 03:09:35 DEBUG : A1/B1/C1/: Creating directory marker 2024/11/08 03:09:35 DEBUG : pacer: Reducing sleep to 20ms 2024/11/08 03:09:35 DEBUG : pacer: Reducing sleep to 10ms 2024/11/08 03:09:35 DEBUG : pacer: Reducing sleep to 0s 2024/11/08 03:09:35 DEBUG : removing 1 level 3 directories 2024/11/08 03:09:35 INFO : A1/B1/C1: Removing directory 2024/11/08 03:09:35 DEBUG : A1/B1/C1/: Removing directory marker 2024/11/08 03:09:35 DEBUG : removing 1 level 2 directories 2024/11/08 03:09:35 INFO : A1/B1: Removing directory 2024/11/08 03:09:35 DEBUG : A1/B1/: Removing directory marker 2024/11/08 03:09:36 DEBUG : A1/: Removing directory marker --- PASS: TestRmdirsWithFilter (10.72s) === RUN TestCopyURL run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:36 DEBUG : filename.txt: File name found in url 2024/11/08 03:09:36 DEBUG : headerfilename.txt: filename found in Content-Disposition header. --- PASS: TestCopyURL (0.78s) === RUN TestCopyURLToWriter --- PASS: TestCopyURLToWriter (0.00s) === RUN TestMoveFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:36 DEBUG : file1: Need to transfer - File not found at Destination 2024/11/08 03:09:37 DEBUG : sub/: Creating directory marker 2024/11/08 03:09:37 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/11/08 03:09:37 INFO : file1: Copied (new) to: sub/file2 2024/11/08 03:09:37 INFO : file1: Deleted 2024/11/08 03:09:37 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:09:37 DEBUG : file1: Unchanged skipping 2024/11/08 03:09:37 INFO : file1: Deleted 2024/11/08 03:09:37 DEBUG : Azure container rclone-test-saqused2liya: don't need to copy/move sub/file2, it is already at target location 2024/11/08 03:09:37 DEBUG : sub/: Removing directory marker --- PASS: TestMoveFile (0.51s) === RUN TestMoveFileWithIgnoreExisting run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:37 DEBUG : file1: Need to transfer - File not found at Destination 2024/11/08 03:09:37 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/11/08 03:09:37 INFO : file1: Copied (new) 2024/11/08 03:09:37 INFO : file1: Deleted 2024/11/08 03:09:37 DEBUG : file1: Destination exists, skipping 2024/11/08 03:09:37 DEBUG : file1: Not removing source file as destination file exists and --ignore-existing is set --- PASS: TestMoveFileWithIgnoreExisting (0.36s) === RUN TestCaseInsensitiveMoveFile run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestCaseInsensitiveMoveFile (0.08s) === RUN TestCaseInsensitiveMoveFileDryRun run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestCaseInsensitiveMoveFileDryRun (0.08s) === RUN TestMoveFileBackupDir run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:38 DEBUG : dst/: Creating directory marker 2024/11/08 03:09:38 DEBUG : Creating backend with remote "TestAzureBlob,directory_markers:rclone-test-saqused2liya/backup" 2024/11/08 03:09:38 DEBUG : TestAzureBlob: detected overridden config - adding "{juk_h}" suffix to name 2024/11/08 03:09:38 DEBUG : Azure container rclone-test-saqused2liya path backup: Using directory markers 2024/11/08 03:09:38 DEBUG : fs cache: renaming cache item "TestAzureBlob,directory_markers:rclone-test-saqused2liya/backup" to be canonical "TestAzureBlob{juk_h}:rclone-test-saqused2liya/backup" 2024/11/08 03:09:38 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2024/11/08 03:09:38 DEBUG : dst/: Creating directory marker 2024/11/08 03:09:38 DEBUG : dst/file1: md5 = 05164b153084ba910184c26e561a7c18 OK 2024/11/08 03:09:38 INFO : dst/file1: Copied (server-side copy) 2024/11/08 03:09:38 INFO : dst/file1: Deleted 2024/11/08 03:09:38 DEBUG : dst/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/11/08 03:09:38 INFO : dst/file1: Copied (new) 2024/11/08 03:09:38 INFO : dst/file1: Deleted 2024/11/08 03:09:39 DEBUG : dst/: Removing directory marker 2024/11/08 03:09:39 DEBUG : backup/dst/: Removing directory marker 2024/11/08 03:09:39 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 1/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:5c5eb173-d01e-004a-5d8b-311f72000000 Time:2024-11-08T03:09:39.1064255Z -------------------------------------------------------------------------------- 2024/11/08 03:09:40 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 2/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:5c5eb301-d01e-004a-078b-311f72000000 Time:2024-11-08T03:09:40.1445583Z -------------------------------------------------------------------------------- 2024/11/08 03:09:41 DEBUG : backup/: Removing directory marker run.go:125: removing dir "backup" failed - try 3/3: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:5c5eb451-d01e-004a-228b-311f72000000 Time:2024-11-08T03:09:41.1824404Z -------------------------------------------------------------------------------- run.go:128: removing dir "backup" failed: removing directory marker failed: DELETE https://rclone.blob.core.windows.net/rclone-test-saqused2liya/backup/ -------------------------------------------------------------------------------- RESPONSE 404: 404 The specified blob does not exist. ERROR CODE: BlobNotFound -------------------------------------------------------------------------------- BlobNotFoundThe specified blob does not exist. RequestId:5c5eb451-d01e-004a-228b-311f72000000 Time:2024-11-08T03:09:41.1824404Z -------------------------------------------------------------------------------- --- PASS: TestMoveFileBackupDir (4.28s) === RUN TestSameConfig --- PASS: TestSameConfig (0.00s) === RUN TestSame --- PASS: TestSame (0.00s) === RUN TestOverlappingFilterCheckWithoutFilter --- PASS: TestOverlappingFilterCheckWithoutFilter (0.00s) === RUN TestOverlappingFilterCheckWithFilter --- PASS: TestOverlappingFilterCheckWithFilter (0.00s) === RUN TestListFormat --- PASS: TestListFormat (0.00s) === RUN TestDirMove run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:42 DEBUG : A1/: Creating directory marker 2024/11/08 03:09:42 DEBUG : A1/B1/: Creating directory marker 2024/11/08 03:09:42 DEBUG : A1/B1/C1/: Creating directory marker 2024/11/08 03:09:42 DEBUG : A1/B1/C2/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A1/B2: Making directory 2024/11/08 03:09:43 DEBUG : A1/B2/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A1/B1/C3: Making directory 2024/11/08 03:09:43 DEBUG : A1/B1/C3/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A2/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A2/B1/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A2/B1/C1/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A2/B1/C2/: Creating directory marker 2024/11/08 03:09:43 DEBUG : A2/B1/C3/: Creating directory marker 2024/11/08 03:09:44 DEBUG : A2/B2/: Creating directory marker 2024/11/08 03:09:44 DEBUG : A1/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2024/11/08 03:09:44 INFO : A1/one: Copied (server-side copy) to: A2/one 2024/11/08 03:09:44 DEBUG : A1/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2024/11/08 03:09:44 INFO : A1/two: Copied (server-side copy) to: A2/two 2024/11/08 03:09:44 DEBUG : A1/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2024/11/08 03:09:44 INFO : A1/B1/C1/four: Copied (server-side copy) to: A2/B1/C1/four 2024/11/08 03:09:44 DEBUG : A1/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2024/11/08 03:09:44 INFO : A1/B1/C2/five: Copied (server-side copy) to: A2/B1/C2/five 2024/11/08 03:09:44 INFO : A1/one: Deleted 2024/11/08 03:09:44 INFO : A1/two: Deleted 2024/11/08 03:09:44 DEBUG : A1/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2024/11/08 03:09:44 INFO : A1/B1/three: Copied (server-side copy) to: A2/B1/three 2024/11/08 03:09:44 INFO : A1/B1/C1/four: Deleted 2024/11/08 03:09:44 INFO : A1/B1/C2/five: Deleted 2024/11/08 03:09:44 INFO : A1/B1/three: Deleted 2024/11/08 03:09:44 DEBUG : A1/B2/: Removing directory marker 2024/11/08 03:09:44 DEBUG : A1/B1/C3/: Removing directory marker 2024/11/08 03:09:44 DEBUG : A1/B1/C2/: Removing directory marker 2024/11/08 03:09:44 DEBUG : A1/B1/C1/: Removing directory marker 2024/11/08 03:09:44 DEBUG : A1/B1/: Removing directory marker 2024/11/08 03:09:44 DEBUG : A1/: Removing directory marker 2024/11/08 03:09:44 DEBUG : A3/: Creating directory marker 2024/11/08 03:09:44 DEBUG : A3/B1/: Creating directory marker 2024/11/08 03:09:45 DEBUG : A3/B1/C1/: Creating directory marker 2024/11/08 03:09:45 DEBUG : A3/B1/C2/: Creating directory marker 2024/11/08 03:09:45 DEBUG : A3/B1/C3/: Creating directory marker 2024/11/08 03:09:45 DEBUG : A3/B2/: Creating directory marker 2024/11/08 03:09:45 DEBUG : A2/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2024/11/08 03:09:45 INFO : A2/two: Copied (server-side copy) to: A3/two 2024/11/08 03:09:45 DEBUG : A2/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2024/11/08 03:09:45 INFO : A2/one: Copied (server-side copy) to: A3/one 2024/11/08 03:09:45 DEBUG : A2/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2024/11/08 03:09:45 INFO : A2/B1/C1/four: Copied (server-side copy) to: A3/B1/C1/four 2024/11/08 03:09:45 DEBUG : A2/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2024/11/08 03:09:45 INFO : A2/B1/C2/five: Copied (server-side copy) to: A3/B1/C2/five 2024/11/08 03:09:45 DEBUG : A2/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2024/11/08 03:09:45 INFO : A2/B1/three: Copied (server-side copy) to: A3/B1/three 2024/11/08 03:09:45 INFO : A2/two: Deleted 2024/11/08 03:09:45 INFO : A2/one: Deleted 2024/11/08 03:09:45 INFO : A2/B1/three: Deleted 2024/11/08 03:09:45 INFO : A2/B1/C1/four: Deleted 2024/11/08 03:09:45 INFO : A2/B1/C2/five: Deleted 2024/11/08 03:09:45 DEBUG : A2/B2/: Removing directory marker 2024/11/08 03:09:45 DEBUG : A2/B1/C3/: Removing directory marker 2024/11/08 03:09:45 DEBUG : A2/B1/C2/: Removing directory marker 2024/11/08 03:09:45 DEBUG : A2/B1/C1/: Removing directory marker 2024/11/08 03:09:45 DEBUG : A2/B1/: Removing directory marker 2024/11/08 03:09:45 DEBUG : A2/: Removing directory marker 2024/11/08 03:09:45 INFO : Azure container rclone-test-saqused2liya: Can't DirMove - falling back to file moves: can't move directory - incompatible remotes 2024/11/08 03:09:46 DEBUG : A4/: Creating directory marker 2024/11/08 03:09:46 DEBUG : A4/B1/: Creating directory marker 2024/11/08 03:09:46 DEBUG : A4/B1/C1/: Creating directory marker 2024/11/08 03:09:46 DEBUG : A4/B1/C2/: Creating directory marker 2024/11/08 03:09:46 DEBUG : A4/B1/C3/: Creating directory marker 2024/11/08 03:09:46 DEBUG : A4/B2/: Creating directory marker 2024/11/08 03:09:46 DEBUG : A3/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2024/11/08 03:09:46 INFO : A3/B1/C2/five: Copied (server-side copy) to: A4/B1/C2/five 2024/11/08 03:09:46 DEBUG : A3/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2024/11/08 03:09:46 INFO : A3/two: Copied (server-side copy) to: A4/two 2024/11/08 03:09:46 DEBUG : A3/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2024/11/08 03:09:46 INFO : A3/B1/three: Copied (server-side copy) to: A4/B1/three 2024/11/08 03:09:46 DEBUG : A3/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2024/11/08 03:09:46 DEBUG : A3/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2024/11/08 03:09:46 INFO : A3/B1/C1/four: Copied (server-side copy) to: A4/B1/C1/four 2024/11/08 03:09:46 INFO : A3/one: Copied (server-side copy) to: A4/one 2024/11/08 03:09:46 INFO : A3/B1/C2/five: Deleted 2024/11/08 03:09:46 INFO : A3/B1/three: Deleted 2024/11/08 03:09:46 INFO : A3/one: Deleted 2024/11/08 03:09:46 INFO : A3/two: Deleted 2024/11/08 03:09:46 INFO : A3/B1/C1/four: Deleted 2024/11/08 03:09:46 DEBUG : A3/B2/: Removing directory marker 2024/11/08 03:09:46 DEBUG : A3/B1/C3/: Removing directory marker 2024/11/08 03:09:46 DEBUG : A3/B1/C2/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A3/B1/C1/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A3/B1/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A3/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A4/B2/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A4/B1/C3/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A4/B1/C2/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A4/B1/C1/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A4/B1/: Removing directory marker 2024/11/08 03:09:47 DEBUG : A4/: Removing directory marker --- PASS: TestDirMove (5.51s) === RUN TestGetFsInfo run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" --- PASS: TestGetFsInfo (0.08s) === RUN TestRcat === RUN TestRcat/withChecksum=false,ignoreChecksum=false run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:47 DEBUG : Azure container rclone-test-saqused2liya: File to upload is small (34 bytes), uploading instead of streaming 2024/11/08 03:09:47 DEBUG : no_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2024/11/08 03:09:47 DEBUG : no_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical 2024/11/08 03:09:47 NOTICE: Azure container rclone-test-saqused2liya: Streaming uploads using chunk size 4Mi will have maximum file size of 195.312Gi 2024/11/08 03:09:47 DEBUG : no_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2024/11/08 03:09:47 DEBUG : no_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2024/11/08 03:09:47 DEBUG : no_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2024/11/08 03:09:48 DEBUG : no_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2024/11/08 03:09:48 DEBUG : no_checksum_big_file_from_pipe: multipart upload finished 2024/11/08 03:09:48 DEBUG : no_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2024/11/08 03:09:48 DEBUG : no_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=true,ignoreChecksum=false run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:48 DEBUG : Azure container rclone-test-saqused2liya: File to upload is small (34 bytes), uploading instead of streaming 2024/11/08 03:09:48 DEBUG : with_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2024/11/08 03:09:48 DEBUG : with_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: multipart upload finished 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2024/11/08 03:09:48 DEBUG : with_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=false,ignoreChecksum=true run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:48 DEBUG : Azure container rclone-test-saqused2liya: File to upload is small (34 bytes), uploading instead of streaming 2024/11/08 03:09:48 DEBUG : ignore_checksum_small_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/08 03:09:48 DEBUG : ignore_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2024/11/08 03:09:48 DEBUG : ignore_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2024/11/08 03:09:48 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2024/11/08 03:09:48 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2024/11/08 03:09:48 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload finished 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) === RUN TestRcat/withChecksum=true,ignoreChecksum=true run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:49 DEBUG : Azure container rclone-test-saqused2liya: File to upload is small (34 bytes), uploading instead of streaming 2024/11/08 03:09:49 DEBUG : ignore_checksum_small_file_from_pipe: Src hash empty - aborting Dst hash check 2024/11/08 03:09:49 DEBUG : ignore_checksum_small_file_from_pipe: Size of src and dst objects identical 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: Multipart upload session started for -1 parts of size 4Mi 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: open chunk writer: started multipart upload 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload finished 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: Src hash empty - aborting Dst hash check 2024/11/08 03:09:49 DEBUG : ignore_checksum_big_file_from_pipe: Size of src and dst objects identical --- PASS: TestRcat (1.83s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (0.54s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=false (0.43s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=true (0.43s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=true (0.43s) === RUN TestRcatMetadata run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1532: Skipping as destination doesn't support user metadata --- SKIP: TestRcatMetadata (0.08s) === RUN TestRcatSize run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:49 DEBUG : Azure container rclone-test-saqused2liya: File to upload is small (60 bytes), uploading instead of streaming 2024/11/08 03:09:49 DEBUG : potato2: md5 = d6548b156ea68a4e003e786df99eee76 OK 2024/11/08 03:09:49 DEBUG : potato2: Size and md5 of src and dst objects identical --- PASS: TestRcatSize (0.35s) === RUN TestRcatSizeMetadata run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1613: Skipping as destination doesn't support user metadata --- SKIP: TestRcatSizeMetadata (0.08s) === RUN TestTouchDir run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" 2024/11/08 03:09:50 DEBUG : sub dir/: Creating directory marker 2024/11/08 03:09:50 DEBUG : Azure container rclone-test-saqused2liya: Touching "empty space" 2024/11/08 03:09:50 DEBUG : Azure container rclone-test-saqused2liya: Touching "potato2" 2024/11/08 03:09:50 DEBUG : Azure container rclone-test-saqused2liya: Touching "sub dir/potato3" 2024/11/08 03:09:51 DEBUG : sub dir/: Removing directory marker --- PASS: TestTouchDir (0.92s) === RUN TestMkdirMetadata run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1703: Skipping test as remote does not support MkdirMetadata --- SKIP: TestMkdirMetadata (0.08s) === RUN TestMkdirModTime run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1722: Skipping test as remote does not support DirSetModTime or MkdirMetadata --- SKIP: TestMkdirModTime (0.08s) === RUN TestCopyDirMetadata run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1743: Skipping test as remote does not support WriteDirMetadata or MkdirMetadata --- SKIP: TestCopyDirMetadata (0.08s) === RUN TestSetDirModTime run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1779: Skipping test as remote does not support DirSetModTime or WriteDirSetModTime --- SKIP: TestSetDirModTime (0.08s) === RUN TestDirsEqual run.go:180: Remote "Azure container rclone-test-saqused2liya", Local "Local file system at /tmp/rclone2254323519", Modify Window "1ns" operations_test.go:1823: Skipping test as remote does not support WriteDirMetadata or MkdirMetadata --- SKIP: TestDirsEqual (0.08s) === RUN TestRcAbout rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcAbout (0.00s) === RUN TestRcCleanup rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCleanup (0.00s) === RUN TestRcCopyfile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCopyfile (0.00s) === RUN TestRcCopyurl rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCopyurl (0.00s) === RUN TestRcDelete rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcDelete (0.00s) === RUN TestRcDeletefile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcDeletefile (0.00s) === RUN TestRcList rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcList (0.00s) === RUN TestRcStat rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcStat (0.00s) === RUN TestRcSetTier rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcSetTier (0.00s) === RUN TestRcSetTierFile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcSetTierFile (0.00s) === RUN TestRcMkdir rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcMkdir (0.00s) === RUN TestRcMovefile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcMovefile (0.00s) === RUN TestRcPurge rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcPurge (0.00s) === RUN TestRcRmdir rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcRmdir (0.00s) === RUN TestRcRmdirs rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcRmdirs (0.00s) === RUN TestRcSize rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcSize (0.00s) === RUN TestRcPublicLink rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcPublicLink (0.00s) === RUN TestRcFsInfo rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcFsInfo (0.00s) === RUN TestUploadFile rc_test.go:30: Skipping test on non local remote --- SKIP: TestUploadFile (0.00s) === RUN TestRcCommand rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCommand (0.00s) === RUN TestRcDu rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcDu (0.00s) === RUN TestRcCheck rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcCheck (0.00s) === RUN TestRcHashsum rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcHashsum (0.00s) === RUN TestRcHashsumFile rc_test.go:30: Skipping test on non local remote --- SKIP: TestRcHashsumFile (0.00s) FAIL 2024/11/08 03:09:51 DEBUG : Azure container rclone-test-saqused2liya: Purge remote "./operations.test -test.v -test.timeout 1h0m0s -remote 'TestAzureBlob,directory_markers:' -verbose" - Finished ERROR in 2m29.440663494s (try 1/5): exit status 1: Failed [TestRmdirsLeaveRoot]