"./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose -fast-list" - Starting (try 1/5)
2024/11/26 01:54:21 DEBUG : Creating backend with remote "TestB2:rclone-test-jaxetun8xiha"
2024/11/26 01:54:21 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2024/11/26 01:54:21 DEBUG : Creating backend with remote "/tmp/rclone764241235"
=== RUN   TestDoMultiThreadCopy
--- PASS: TestDoMultiThreadCopy (0.00s)
=== RUN   TestMultithreadCalculateNumChunks
=== RUN   TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1}
=== RUN   TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576}
=== RUN   TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288}
=== RUN   TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289}
=== RUN   TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288}
--- PASS: TestMultithreadCalculateNumChunks (0.00s)
    --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s)
    --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s)
    --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s)
    --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s)
    --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s)
=== RUN   TestMultithreadCopy
    run.go:180: Remote "B2 bucket rclone-test-jaxetun8xiha", Local "Local file system at /tmp/rclone764241235", Modify Window "1ms"
2024/11/26 01:54:23 DEBUG : chunksize-probe: Cancelling large file upload
=== RUN   TestMultithreadCopy/upload=false,size=201326591,streams=2
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: write buffer set to 131072
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: Starting multi-thread copy with 3 chunks of size 64Mi with 3 parallel streams
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 3/3 (134217728-201326591) size 64.000Mi starting
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi starting
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi starting
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: writing chunk 2
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: writing chunk 0
2024/11/26 01:54:45 DEBUG : test-multithread-copy-false-201326591-2: writing chunk 1
2024/11/26 01:54:51 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi finished
2024/11/26 01:54:55 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi finished
2024/11/26 01:54:55 DEBUG : test-multithread-copy-false-201326591-2: multi-thread copy: chunk 3/3 (134217728-201326591) size 64.000Mi finished
2024/11/26 01:54:55 DEBUG : test-multithread-copy-false-201326591-2: Finished multi-thread copy with 3 parts of size 64Mi
=== RUN   TestMultithreadCopy/upload=false,size=201326592,streams=2
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: write buffer set to 131072
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: Starting multi-thread copy with 3 chunks of size 64Mi with 3 parallel streams
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 3/3 (134217728-201326592) size 64Mi starting
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi starting
2024/11/26 01:55:24 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi starting
2024/11/26 01:55:25 DEBUG : test-multithread-copy-false-201326592-2: writing chunk 2
2024/11/26 01:55:25 DEBUG : test-multithread-copy-false-201326592-2: writing chunk 1
2024/11/26 01:55:25 DEBUG : test-multithread-copy-false-201326592-2: writing chunk 0
2024/11/26 01:55:30 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 3/3 (134217728-201326592) size 64Mi finished
2024/11/26 01:55:30 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 1/3 (0-67108864) size 64Mi finished
2024/11/26 01:55:30 DEBUG : test-multithread-copy-false-201326592-2: multi-thread copy: chunk 2/3 (67108864-134217728) size 64Mi finished
2024/11/26 01:55:30 DEBUG : test-multithread-copy-false-201326592-2: Finished multi-thread copy with 3 parts of size 64Mi
=== RUN   TestMultithreadCopy/upload=false,size=201326593,streams=2
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: disabling buffering because destination uses OpenWriterAt
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: write buffer set to 131072
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: Starting multi-thread copy with 4 chunks of size 64Mi with 4 parallel streams
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 4/4 (201326592-201326593) size 1 starting
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 1/4 (0-67108864) size 64Mi starting
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 2/4 (67108864-134217728) size 64Mi starting
2024/11/26 01:55:59 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 3/4 (134217728-201326592) size 64Mi starting
2024/11/26 01:56:00 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 3
2024/11/26 01:56:00 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 4/4 (201326592-201326593) size 1 finished
2024/11/26 01:56:00 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 0
2024/11/26 01:56:00 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 1
2024/11/26 01:56:00 DEBUG : test-multithread-copy-false-201326593-2: writing chunk 2
2024/11/26 01:56:05 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 1/4 (0-67108864) size 64Mi finished
2024/11/26 01:56:05 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 2/4 (67108864-134217728) size 64Mi finished
2024/11/26 01:56:05 DEBUG : test-multithread-copy-false-201326593-2: multi-thread copy: chunk 3/4 (134217728-201326592) size 64Mi finished
2024/11/26 01:56:05 DEBUG : test-multithread-copy-false-201326593-2: Finished multi-thread copy with 4 parts of size 64Mi
=== RUN   TestMultithreadCopy/upload=true,size=201326591,streams=2
2024/11/26 01:56:27 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: disabling buffering because source is local disk
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: Starting multi-thread copy with 2 chunks of size 96Mi with 2 parallel streams
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 2/2 (100663296-201326591) size 96.000Mi starting
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi starting
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: Sending chunk 1 length 100663295
2024/11/26 01:56:28 DEBUG : test-multithread-copy-true-201326591-2: Sending chunk 0 length 100663296
2024/11/26 01:56:36 DEBUG : test-multithread-copy-true-201326591-2: Done sending chunk 1
2024/11/26 01:56:36 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 2/2 (100663296-201326591) size 96.000Mi finished
2024/11/26 01:56:36 DEBUG : test-multithread-copy-true-201326591-2: Done sending chunk 0
2024/11/26 01:56:36 DEBUG : test-multithread-copy-true-201326591-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi finished
2024/11/26 01:56:36 DEBUG : test-multithread-copy-true-201326591-2: Finishing large file upload with 2 parts
2024/11/26 01:56:37 DEBUG : test-multithread-copy-true-201326591-2: Finished multi-thread copy with 2 parts of size 96Mi
=== RUN   TestMultithreadCopy/upload=true,size=201326592,streams=2
2024/11/26 01:56:58 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: disabling buffering because source is local disk
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: number of streams 4 was bigger than number of chunks 2
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: Starting multi-thread copy with 2 chunks of size 96Mi with 2 parallel streams
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 2/2 (100663296-201326592) size 96Mi starting
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: Sending chunk 1 length 100663296
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi starting
2024/11/26 01:56:59 DEBUG : test-multithread-copy-true-201326592-2: Sending chunk 0 length 100663296
2024/11/26 01:57:07 DEBUG : test-multithread-copy-true-201326592-2: Done sending chunk 0
2024/11/26 01:57:07 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 1/2 (0-100663296) size 96Mi finished
2024/11/26 01:57:08 DEBUG : test-multithread-copy-true-201326592-2: Done sending chunk 1
2024/11/26 01:57:08 DEBUG : test-multithread-copy-true-201326592-2: multi-thread copy: chunk 2/2 (100663296-201326592) size 96Mi finished
2024/11/26 01:57:08 DEBUG : test-multithread-copy-true-201326592-2: Finishing large file upload with 2 parts
2024/11/26 01:57:08 DEBUG : test-multithread-copy-true-201326592-2: Finished multi-thread copy with 2 parts of size 96Mi
=== RUN   TestMultithreadCopy/upload=true,size=201326593,streams=2
2024/11/26 01:57:29 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: disabling buffering because source is local disk
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 2
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: number of streams 4 was bigger than number of chunks 3
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: Starting multi-thread copy with 3 chunks of size 96Mi with 3 parallel streams
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 3/3 (201326592-201326593) size 1 starting
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: Sending chunk 2 length 1
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 1/3 (0-100663296) size 96Mi starting
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 2/3 (100663296-201326592) size 96Mi starting
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: Sending chunk 0 length 100663296
2024/11/26 01:57:30 DEBUG : test-multithread-copy-true-201326593-2: Sending chunk 1 length 100663296
2024/11/26 01:57:31 DEBUG : test-multithread-copy-true-201326593-2: Done sending chunk 2
2024/11/26 01:57:31 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 3/3 (201326592-201326593) size 1 finished
2024/11/26 01:57:38 DEBUG : test-multithread-copy-true-201326593-2: Done sending chunk 0
2024/11/26 01:57:38 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 1/3 (0-100663296) size 96Mi finished
2024/11/26 01:57:39 DEBUG : test-multithread-copy-true-201326593-2: Done sending chunk 1
2024/11/26 01:57:39 DEBUG : test-multithread-copy-true-201326593-2: multi-thread copy: chunk 2/3 (100663296-201326592) size 96Mi finished
2024/11/26 01:57:39 DEBUG : test-multithread-copy-true-201326593-2: Finishing large file upload with 3 parts
2024/11/26 01:57:40 DEBUG : test-multithread-copy-true-201326593-2: Finished multi-thread copy with 3 parts of size 96Mi
--- PASS: TestMultithreadCopy (205.77s)
    --- PASS: TestMultithreadCopy/upload=false,size=201326591,streams=2 (40.22s)
    --- PASS: TestMultithreadCopy/upload=false,size=201326592,streams=2 (34.81s)
    --- PASS: TestMultithreadCopy/upload=false,size=201326593,streams=2 (35.38s)
    --- PASS: TestMultithreadCopy/upload=true,size=201326591,streams=2 (31.78s)
    --- PASS: TestMultithreadCopy/upload=true,size=201326592,streams=2 (31.02s)
    --- PASS: TestMultithreadCopy/upload=true,size=201326593,streams=2 (30.80s)
=== RUN   TestMultithreadCopyAbort
    run.go:180: Remote "B2 bucket rclone-test-jaxetun8xiha", Local "Local file system at /tmp/rclone764241235", Modify Window "1ms"
2024/11/26 01:57:47 DEBUG : chunksize-probe: Cancelling large file upload
2024/11/26 01:58:01 DEBUG : test-multithread-abort: multi-thread copy: disabling buffering because source is local disk
2024/11/26 01:58:02 DEBUG : test-multithread-abort: multi-thread copy: using backend concurrency of 4 instead of --multi-thread-streams 1
2024/11/26 01:58:02 DEBUG : test-multithread-abort: multi-thread copy: number of streams 4 was bigger than number of chunks 3
2024/11/26 01:58:02 DEBUG : test-multithread-abort: Starting multi-thread copy with 3 chunks of size 96Mi with 3 parallel streams
2024/11/26 01:58:02 DEBUG : test-multithread-abort: multi-thread copy: chunk 3/3 (201326592-201326593) size 1 starting
2024/11/26 01:58:02 DEBUG : Open with options = [RangeOption(201326592,201326592)]
2024/11/26 01:58:02 DEBUG : test-multithread-abort: multi-thread copy: chunk 1/3 (0-100663296) size 96Mi starting
2024/11/26 01:58:02 DEBUG : Open with options = [RangeOption(0,100663295)]
2024/11/26 01:58:02 DEBUG : test-multithread-abort: multi-thread copy: chunk 2/3 (100663296-201326592) size 96Mi starting
2024/11/26 01:58:02 DEBUG : test-multithread-abort: Sending chunk 0 length 100663296
2024/11/26 01:58:02 DEBUG : Open with options = [RangeOption(100663296,201326591)]
2024/11/26 01:58:02 DEBUG : test-multithread-abort: Sending chunk 1 length 100663296
"./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose -fast-list" - Finished ERROR in 6m13.514177416s (try 1/5): signal: killed: Failed []