"./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose" - Starting (try 1/5) 2024/11/14 21:44:15 DEBUG : Creating backend with remote "TestB2:rclone-test-xisicex7vese" 2024/11/14 21:44:15 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/14 21:44:15 DEBUG : Creating backend with remote "/tmp/rclone21118984" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:180: Remote "B2 bucket rclone-test-xisicex7vese", Local "Local file system at /tmp/rclone21118984", Modify Window "1ms" 2024/11/14 21:44:29 DEBUG : chunksize-probe: Cancelling large file upload === RUN TestMultithreadCopy/upload=false,size=201326591,streams=2 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: write buffer set to 131072 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: Starting multi-thread copy with 3 chunks of size 64Mi with 3 parallel streams 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 3/3 (134217728-201326591) size 64.000Mi starting 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi starting 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi starting 2024/11/14 21:44:56 DEBUG : test-multithread-copy-false-201326591-2: writing chunk 2 2024/11/14 21:44:57 DEBUG : test-multithread-copy-false-201326591-2: writing chunk 1 2024/11/14 21:44:57 DEBUG : test-multithread-copy-false-201326591-2: writing chunk 0 2024/11/14 21:45:06 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi finished 2024/11/14 21:45:06 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 3/3 (134217728-201326591) size 64.000Mi finished 2024/11/14 21:45:06 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi finished 2024/11/14 21:45:06 DEBUG : test-multithread-copy-false-201326591-2: Finished multi-thread copy with 3 parts of size 64Mi === RUN TestMultithreadCopy/upload=false,size=201326592,streams=2 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: write buffer set to 131072 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: Starting multi-thread copy with 3 chunks of size 64Mi with 3 parallel streams 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 3/3 (134217728-201326592) size 64Mi starting 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi starting 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi starting 2024/11/14 21:49:05 DEBUG : test-multithread-copy-false-201326592-2: writing chunk 2 2024/11/14 21:49:06 DEBUG : test-multithread-copy-false-201326592-2: writing chunk 0 2024/11/14 21:49:06 DEBUG : test-multithread-copy-false-201326592-2: writing chunk 1 2024/11/14 21:49:11 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 3/3 (134217728-201326592) size 64Mi finished 2024/11/14 21:49:11 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi finished 2024/11/14 21:49:11 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi finished 2024/11/14 21:49:11 DEBUG : test-multithread-copy-false-201326592-2: Finished multi-thread copy with 3 parts of size 64Mi === RUN TestMultithreadCopy/upload=false,size=201326593,streams=2 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: write buffer set to 131072 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: Starting multi-thread copy with 4 chunks of size 64Mi with 4 parallel streams 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 1/4 (0-67108864) size 64Mi starting 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 4/4 (201326592-201326593) size 1 starting 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 3/4 (134217728-201326592) size 64Mi starting 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 2/4 (67108864-134217728) size 64Mi starting 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 0 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 3 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 4/4 (201326592-201326593) size 1 finished 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 2 2024/11/14 21:49:46 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 1 2024/11/14 21:49:51 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 1/4 (0-67108864) size 64Mi finished 2024/11/14 21:49:54 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 3/4 (134217728-201326592) size 64Mi finished 2024/11/14 21:49:55 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 2/4 (67108864-134217728) size 64Mi finished 2024/11/14 21:49:55 DEBUG : test-multithread-copy-false-201326593-2: Finished multi-thread copy with 4 parts of size 64Mi === RUN TestMultithreadCopy/upload=true,size=201326591,streams=2 2024/11/14 21:50:19 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: disabling buffering because source is local disk 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: Starting multi-thread copy with 2 chunks of size 96Mi with 2 parallel streams 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 2/2 (100663296-201326591) size 96.000Mi starting 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi starting 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: Sending chunk 1 length 100663295 2024/11/14 21:50:20 DEBUG : test-multithread-copy-true-201326591-2: Sending chunk 0 length 100663296 2024/11/14 21:52:12 DEBUG : test-multithread-copy-true-201326591-2: Done sending chunk 1 2024/11/14 21:52:12 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 2/2 (100663296-201326591) size 96.000Mi finished 2024/11/14 21:52:12 DEBUG : test-multithread-copy-true-201326591-2: Done sending chunk 0 2024/11/14 21:52:12 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi finished 2024/11/14 21:52:12 DEBUG : test-multithread-copy-true-201326591-2: Finishing large file upload with 2 parts 2024/11/14 21:52:14 DEBUG : test-multithread-copy-true-201326591-2: Finished multi-thread copy with 2 parts of size 96Mi === RUN TestMultithreadCopy/upload=true,size=201326592,streams=2 2024/11/14 21:52:35 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: disabling buffering because source is local disk 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: Starting multi-thread copy with 2 chunks of size 96Mi with 2 parallel streams 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 2/2 (100663296-201326592) size 96Mi starting 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi starting 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: Sending chunk 1 length 100663296 2024/11/14 21:52:36 DEBUG : test-multithread-copy-true-201326592-2: Sending chunk 0 length 100663296 2024/11/14 21:52:44 DEBUG : test-multithread-copy-true-201326592-2: Done sending chunk 0 2024/11/14 21:52:44 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi finished 2024/11/14 21:52:44 DEBUG : test-multithread-copy-true-201326592-2: Done sending chunk 1 2024/11/14 21:52:44 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 2/2 (100663296-201326592) size 96Mi finished 2024/11/14 21:52:44 DEBUG : test-multithread-copy-true-201326592-2: Finishing large file upload with 2 parts 2024/11/14 21:52:45 DEBUG : test-multithread-copy-true-201326592-2: Finished multi-thread copy with 2 parts of size 96Mi === RUN TestMultithreadCopy/upload=true,size=201326593,streams=2 2024/11/14 21:56:15 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: disabling buffering because source is local disk 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: Starting multi-thread copy with 3 chunks of size 96Mi with 3 parallel streams 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 1/3 (0-100663296) size 96Mi starting 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 3/3 (201326592-201326593) size 1 starting 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 2/3 (100663296-201326592) size 96Mi starting 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: Sending chunk 1 length 100663296 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: Sending chunk 2 length 1 2024/11/14 21:56:16 DEBUG : test-multithread-copy-true-201326593-2: Sending chunk 0 length 100663296 2024/11/14 21:56:17 DEBUG : test-multithread-copy-true-201326593-2: Done sending chunk 2 2024/11/14 21:56:17 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 3/3 (201326592-201326593) size 1 finished 2024/11/14 21:56:25 DEBUG : test-multithread-copy-true-201326593-2: Done sending chunk 1 2024/11/14 21:56:25 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 2/3 (100663296-201326592) size 96Mi finished 2024/11/14 21:56:25 DEBUG : test-multithread-copy-true-201326593-2: Done sending chunk 0 2024/11/14 21:56:25 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 1/3 (0-100663296) size 96Mi finished 2024/11/14 21:56:25 DEBUG : test-multithread-copy-true-201326593-2: Finishing large file upload with 3 parts 2024/11/14 21:56:26 DEBUG : test-multithread-copy-true-201326593-2: Finished multi-thread copy with 3 parts of size 96Mi --- PASS: TestMultithreadCopy (737.98s) --- PASS: TestMultithreadCopy/upload=false,size=201326591,streams=2 (44.88s) --- PASS: TestMultithreadCopy/upload=false,size=201326592,streams=2 (244.20s) --- PASS: TestMultithreadCopy/upload=false,size=201326593,streams=2 (43.90s) --- PASS: TestMultithreadCopy/upload=true,size=201326591,streams=2 (138.46s) --- PASS: TestMultithreadCopy/upload=true,size=201326592,streams=2 (31.86s) --- PASS: TestMultithreadCopy/upload=true,size=201326593,streams=2 (220.13s) === RUN TestMultithreadCopyAbort run.go:180: Remote "B2 bucket rclone-test-xisicex7vese", Local "Local file system at /tmp/rclone21118984", Modify Window "1ms" 2024/11/14 21:56:34 DEBUG : chunksize-probe: Cancelling large file upload "./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose" - Finished ERROR in 12m21.212808069s (try 1/5): signal: killed: Failed []