"./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose" - Starting (try 1/5) 2025/11/03 01:07:10 DEBUG : Creating backend with remote "TestB2:rclone-test-moyeked3zefi" 2025/11/03 01:07:10 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:07:10 DEBUG : Creating backend with remote "/tmp/rclone891835090" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: expected a FileSseMode but found: '' (400 bad_request) Test: TestMultithreadCopy --- FAIL: TestMultithreadCopy (1.55s) === RUN TestMultithreadCopyAbort run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: expected a FileSseMode but found: '' (400 bad_request) Test: TestMultithreadCopyAbort --- FAIL: TestMultithreadCopyAbort (0.54s) === RUN TestSizeDiffers 2025/11/03 01:07:13 DEBUG : a: size = 0 OK 2025/11/03 01:07:13 DEBUG : a: size = 1 (memory) 2025/11/03 01:07:13 DEBUG : a: size = 2 (memory) --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2025/11/03 01:07:13 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/ReadAt 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/Normal/Seek 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2025/11/03 01:07:13 DEBUG : potato: Seek from 10 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 10 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/ReadAt 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithRangeOption/Seek 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 2 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2025/11/03 01:07:13 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/ReadAt 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithSeekOption/Seek 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 2 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2025/11/03 01:07:13 DEBUG : potato: Seek from 8 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 8 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2025/11/03 01:07:13 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 01:07:13 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/ReadAt 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/UnknownSize/Seek 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 01:07:13 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 01:07:13 DEBUG : potato: Seek from 5 to 2 2025/11/03 01:07:13 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2025/11/03 01:07:13 DEBUG : potato: Seek from 9 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 9 to 0 2025/11/03 01:07:13 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/ReadAt (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/ReadAt (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/ReadAt (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/ReadAt (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (5.38s) --- PASS: TestCheck/1 (0.18s) --- PASS: TestCheck/2 (0.18s) --- PASS: TestCheck/3 (0.18s) --- PASS: TestCheck/4 (0.18s) --- PASS: TestCheck/5 (0.18s) --- PASS: TestCheck/6 (0.18s) --- PASS: TestCheck/7 (0.18s) === RUN TestCheckFsError 2025/11/03 01:07:18 DEBUG : Creating backend with remote "nonexistent" 2025/11/03 01:07:18 DEBUG : Creating backend with remote "nonexistent" 2025/11/03 01:07:18 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2025/11/03 01:07:18 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2025/11/03 01:07:18 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 0 differences found 2025/11/03 01:07:18 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (6.63s) --- PASS: TestCheckDownload/1 (0.74s) --- PASS: TestCheckDownload/2 (0.40s) --- PASS: TestCheckDownload/3 (0.36s) --- PASS: TestCheckDownload/4 (0.55s) --- PASS: TestCheckDownload/5 (0.37s) --- PASS: TestCheckDownload/6 (0.37s) --- PASS: TestCheckDownload/7 (0.38s) === RUN TestCheckSizeOnly run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (5.91s) --- PASS: TestCheckSizeOnly/1 (0.18s) --- PASS: TestCheckSizeOnly/2 (0.22s) --- PASS: TestCheckSizeOnly/3 (0.18s) --- PASS: TestCheckSizeOnly/4 (0.18s) --- PASS: TestCheckSizeOnly/5 (0.18s) --- PASS: TestCheckSizeOnly/6 (0.18s) --- PASS: TestCheckSizeOnly/7 (0.18s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" 2025/11/03 01:07:32 NOTICE: test.sum: improperly formatted checksum line 4 2025/11/03 01:07:32 NOTICE: test.sum: improperly formatted checksum line 5 2025/11/03 01:07:32 NOTICE: test.sum: improperly formatted checksum line 6 2025/11/03 01:07:32 NOTICE: test.sum: 2 warning(s) suppressed... 2025/11/03 01:07:33 NOTICE: test.sum: improperly formatted checksum line 4 2025/11/03 01:07:33 NOTICE: test.sum: improperly formatted checksum line 5 2025/11/03 01:07:33 NOTICE: test.sum: improperly formatted checksum line 6 2025/11/03 01:07:33 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (2.82s) === RUN TestCheckSum run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" 2025/11/03 01:07:33 DEBUG : Creating backend with remote "TestB2:rclone-test-moyeked3zefi/data" check_test.go:350: B2 bucket rclone-test-moyeked3zefi path data lacks md5, skipping --- SKIP: TestCheckSum (1.50s) === RUN TestCheckSumDownload run.go:185: Remote "B2 bucket rclone-test-moyeked3zefi", Local "Local file system at /tmp/rclone891835090", Modify Window "1ms" 2025/11/03 01:07:35 DEBUG : Creating backend with remote "TestB2:rclone-test-moyeked3zefi/data" === RUN TestCheckSumDownload/subtest1 === RUN TestCheckSumDownload/subtest2 === RUN TestCheckSumDownload/subtest3 === RUN TestCheckSumDownload/subtest4 === RUN TestCheckSumDownload/subtest5 === RUN TestCheckSumDownload/subtest6 === RUN TestCheckSumDownload/subtest7 --- PASS: TestCheckSumDownload (14.93s) --- PASS: TestCheckSumDownload/subtest1 (1.31s) --- PASS: TestCheckSumDownload/subtest2 (0.79s) --- PASS: TestCheckSumDownload/subtest3 (0.91s) --- PASS: TestCheckSumDownload/subtest4 (0.74s) --- PASS: TestCheckSumDownload/subtest5 (0.77s) --- PASS: TestCheckSumDownload/subtest6 (0.74s) --- PASS: TestCheckSumDownload/subtest7 (0.74s) === RUN TestApplyTransforms 2025/11/03 01:07:50 DEBUG : Creating backend with remote "TestB2:rclone-test-cagogoc8mehi" 2025/11/03 01:07:50 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:07:50 DEBUG : Creating backend with remote "/tmp/rclone1372741129" run.go:185: Remote "B2 bucket rclone-test-cagogoc8mehi", Local "Local file system at /tmp/rclone1372741129", Modify Window "1ms" upper checkfile vs. lower remote (without normalization) 2025/11/03 01:07:52 ERROR : hello, world!: sum not found 2025/11/03 01:07:52 ERROR : HELLO, WORLD!: file not in B2 bucket rclone-test-cagogoc8mehi 2025/11/03 01:07:52 NOTICE: B2 bucket rclone-test-cagogoc8mehi: 1 files missing 2025/11/03 01:07:52 NOTICE: 1 hashes missing 2025/11/03 01:07:52 NOTICE: B2 bucket rclone-test-cagogoc8mehi: 1 differences found 2025/11/03 01:07:52 NOTICE: B2 bucket rclone-test-cagogoc8mehi: 2 errors while checking upper checkfile vs. lower remote (with normalization) 2025/11/03 01:07:53 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:07:53 NOTICE: B2 bucket rclone-test-cagogoc8mehi: 0 differences found 2025/11/03 01:07:53 NOTICE: B2 bucket rclone-test-cagogoc8mehi: 1 matching files 2025/11/03 01:07:53 DEBUG : Creating backend with remote "TestB2:rclone-test-dabetel1tonu" 2025/11/03 01:07:53 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:07:54 DEBUG : Creating backend with remote "/tmp/rclone1204526313" run.go:185: Remote "B2 bucket rclone-test-dabetel1tonu", Local "Local file system at /tmp/rclone1204526313", Modify Window "1ms" lower checkfile vs. upper remote (without normalization) 2025/11/03 01:07:56 ERROR : HELLO, WORLD!: sum not found 2025/11/03 01:07:56 ERROR : hello, world!: file not in B2 bucket rclone-test-dabetel1tonu 2025/11/03 01:07:56 NOTICE: B2 bucket rclone-test-dabetel1tonu: 1 files missing 2025/11/03 01:07:56 NOTICE: 1 hashes missing 2025/11/03 01:07:56 NOTICE: B2 bucket rclone-test-dabetel1tonu: 1 differences found 2025/11/03 01:07:56 NOTICE: B2 bucket rclone-test-dabetel1tonu: 2 errors while checking lower checkfile vs. upper remote (with normalization) 2025/11/03 01:07:56 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:07:56 NOTICE: B2 bucket rclone-test-dabetel1tonu: 0 differences found 2025/11/03 01:07:56 NOTICE: B2 bucket rclone-test-dabetel1tonu: 1 matching files 2025/11/03 01:07:56 DEBUG : Creating backend with remote "TestB2:rclone-test-xiwusek5zewe" 2025/11/03 01:07:56 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:07:57 DEBUG : Creating backend with remote "/tmp/rclone484041608" run.go:185: Remote "B2 bucket rclone-test-xiwusek5zewe", Local "Local file system at /tmp/rclone484041608", Modify Window "1ms" lower checkfile vs. upperlowermixed remote (without normalization) 2025/11/03 01:08:00 ERROR : HeLlO, wOrLd!: sum not found 2025/11/03 01:08:00 ERROR : hello, world!: file not in B2 bucket rclone-test-xiwusek5zewe 2025/11/03 01:08:00 NOTICE: B2 bucket rclone-test-xiwusek5zewe: 1 files missing 2025/11/03 01:08:00 NOTICE: 1 hashes missing 2025/11/03 01:08:00 NOTICE: B2 bucket rclone-test-xiwusek5zewe: 1 differences found 2025/11/03 01:08:00 NOTICE: B2 bucket rclone-test-xiwusek5zewe: 2 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2025/11/03 01:08:00 DEBUG : HeLlO, wOrLd!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:08:00 NOTICE: B2 bucket rclone-test-xiwusek5zewe: 0 differences found 2025/11/03 01:08:00 NOTICE: B2 bucket rclone-test-xiwusek5zewe: 1 matching files 2025/11/03 01:08:00 DEBUG : Creating backend with remote "TestB2:rclone-test-dewuvic9xogu" 2025/11/03 01:08:00 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:08:01 DEBUG : Creating backend with remote "/tmp/rclone1677555496" run.go:185: Remote "B2 bucket rclone-test-dewuvic9xogu", Local "Local file system at /tmp/rclone1677555496", Modify Window "1ms" upperlowermixed checkfile vs. upper remote (without normalization) 2025/11/03 01:08:03 ERROR : HELLO, WORLD!: sum not found 2025/11/03 01:08:03 ERROR : HeLlO, wOrLd!: file not in B2 bucket rclone-test-dewuvic9xogu 2025/11/03 01:08:03 NOTICE: B2 bucket rclone-test-dewuvic9xogu: 1 files missing 2025/11/03 01:08:03 NOTICE: 1 hashes missing 2025/11/03 01:08:03 NOTICE: B2 bucket rclone-test-dewuvic9xogu: 1 differences found 2025/11/03 01:08:03 NOTICE: B2 bucket rclone-test-dewuvic9xogu: 2 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2025/11/03 01:08:04 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:08:04 NOTICE: B2 bucket rclone-test-dewuvic9xogu: 0 differences found 2025/11/03 01:08:04 NOTICE: B2 bucket rclone-test-dewuvic9xogu: 1 matching files 2025/11/03 01:08:04 DEBUG : Creating backend with remote "TestB2:rclone-test-kerukov5huzu" 2025/11/03 01:08:04 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:08:04 DEBUG : Creating backend with remote "/tmp/rclone630549881" run.go:185: Remote "B2 bucket rclone-test-kerukov5huzu", Local "Local file system at /tmp/rclone630549881", Modify Window "1ms" NFD checkfile vs. NFC remote (without normalization) 2025/11/03 01:08:06 ERROR : 測試_Русский___ě_áñ: sum not found 2025/11/03 01:08:06 ERROR : 測試_Русский___ě_áñ: file not in B2 bucket rclone-test-kerukov5huzu 2025/11/03 01:08:06 NOTICE: B2 bucket rclone-test-kerukov5huzu: 1 files missing 2025/11/03 01:08:06 NOTICE: 1 hashes missing 2025/11/03 01:08:06 NOTICE: B2 bucket rclone-test-kerukov5huzu: 1 differences found 2025/11/03 01:08:06 NOTICE: B2 bucket rclone-test-kerukov5huzu: 2 errors while checking NFD checkfile vs. NFC remote (with normalization) 2025/11/03 01:08:07 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:08:07 NOTICE: B2 bucket rclone-test-kerukov5huzu: 0 differences found 2025/11/03 01:08:07 NOTICE: B2 bucket rclone-test-kerukov5huzu: 1 matching files 2025/11/03 01:08:07 DEBUG : Creating backend with remote "TestB2:rclone-test-cepejaz8goqo" 2025/11/03 01:08:07 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:08:08 DEBUG : Creating backend with remote "/tmp/rclone1069516152" run.go:185: Remote "B2 bucket rclone-test-cepejaz8goqo", Local "Local file system at /tmp/rclone1069516152", Modify Window "1ms" NFC checkfile vs. NFD remote (without normalization) 2025/11/03 01:08:10 ERROR : 測試_Русский___ě_áñ: sum not found 2025/11/03 01:08:10 ERROR : 測試_Русский___ě_áñ: file not in B2 bucket rclone-test-cepejaz8goqo 2025/11/03 01:08:10 NOTICE: B2 bucket rclone-test-cepejaz8goqo: 1 files missing 2025/11/03 01:08:10 NOTICE: 1 hashes missing 2025/11/03 01:08:10 NOTICE: B2 bucket rclone-test-cepejaz8goqo: 1 differences found 2025/11/03 01:08:10 NOTICE: B2 bucket rclone-test-cepejaz8goqo: 2 errors while checking NFC checkfile vs. NFD remote (with normalization) 2025/11/03 01:08:11 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:08:11 NOTICE: B2 bucket rclone-test-cepejaz8goqo: 0 differences found 2025/11/03 01:08:11 NOTICE: B2 bucket rclone-test-cepejaz8goqo: 1 matching files 2025/11/03 01:08:11 DEBUG : Creating backend with remote "TestB2:rclone-test-sanadah2yoge" 2025/11/03 01:08:11 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:08:11 DEBUG : Creating backend with remote "/tmp/rclone4150857062" run.go:185: Remote "B2 bucket rclone-test-sanadah2yoge", Local "Local file system at /tmp/rclone4150857062", Modify Window "1ms" NFDx2 checkfile vs. both remote (without normalization) 2025/11/03 01:08:14 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/11/03 01:08:14 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in B2 bucket rclone-test-sanadah2yoge 2025/11/03 01:08:14 NOTICE: B2 bucket rclone-test-sanadah2yoge: 1 files missing 2025/11/03 01:08:14 NOTICE: 1 hashes missing 2025/11/03 01:08:14 NOTICE: B2 bucket rclone-test-sanadah2yoge: 1 differences found 2025/11/03 01:08:14 NOTICE: B2 bucket rclone-test-sanadah2yoge: 2 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2025/11/03 01:08:15 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:08:15 NOTICE: B2 bucket rclone-test-sanadah2yoge: 0 differences found 2025/11/03 01:08:15 NOTICE: B2 bucket rclone-test-sanadah2yoge: 1 matching files 2025/11/03 01:08:15 DEBUG : Creating backend with remote "TestB2:rclone-test-kofenuy7vula" 2025/11/03 01:08:15 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:08:15 DEBUG : Creating backend with remote "/tmp/rclone3297282335" run.go:185: Remote "B2 bucket rclone-test-kofenuy7vula", Local "Local file system at /tmp/rclone3297282335", Modify Window "1ms" NFCx2 checkfile vs. both remote (without normalization) 2025/11/03 01:08:17 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/11/03 01:08:17 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in B2 bucket rclone-test-kofenuy7vula 2025/11/03 01:08:17 NOTICE: B2 bucket rclone-test-kofenuy7vula: 1 files missing 2025/11/03 01:08:17 NOTICE: 1 hashes missing 2025/11/03 01:08:17 NOTICE: B2 bucket rclone-test-kofenuy7vula: 1 differences found 2025/11/03 01:08:17 NOTICE: B2 bucket rclone-test-kofenuy7vula: 2 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2025/11/03 01:08:18 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 01:08:18 NOTICE: B2 bucket rclone-test-kofenuy7vula: 0 differences found 2025/11/03 01:08:18 NOTICE: B2 bucket rclone-test-kofenuy7vula: 1 matching files 2025/11/03 01:08:18 DEBUG : Creating backend with remote "TestB2:rclone-test-zomenus1xowa" 2025/11/03 01:08:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 01:08:19 DEBUG : pacer: low level retry 1/10 (error incident id 3894aee67876-a4e13c470bc94a11 (500 internal_error)) 2025/11/03 01:08:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/03 01:08:19 DEBUG : pacer: low level retry 2/10 (error incident id 3894aee67876-6ff117acf6c648f6 (500 internal_error)) 2025/11/03 01:08:19 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/11/03 01:08:19 DEBUG : pacer: low level retry 3/10 (error incident id 3894aee67876-074490fa425335ab (500 internal_error)) 2025/11/03 01:08:19 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/11/03 01:08:20 DEBUG : pacer: low level retry 4/10 (error incident id 3894aee67876-13f3d28b506fbe72 (500 internal_error)) 2025/11/03 01:08:20 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/11/03 01:08:20 DEBUG : pacer: low level retry 5/10 (error incident id 3894aee67876-d97afde330659e3a (500 internal_error)) 2025/11/03 01:08:20 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/11/03 01:08:20 DEBUG : pacer: low level retry 6/10 (error incident id 3894aee67876-c4ec644d0444a5b4 (500 internal_error)) 2025/11/03 01:08:20 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/11/03 01:08:20 DEBUG : pacer: low level retry 7/10 (error incident id 3894aee67876-361a5e4c2a226656 (500 internal_error)) 2025/11/03 01:08:20 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/11/03 01:08:21 DEBUG : pacer: low level retry 8/10 (error incident id 3894aee67876-578253801a09d2e0 (500 internal_error)) 2025/11/03 01:08:21 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2025/11/03 01:08:22 DEBUG : pacer: low level retry 9/10 (error incident id 3894aee67876-16f5ef9734f94959 (500 internal_error)) 2025/11/03 01:08:22 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2025/11/03 01:08:25 DEBUG : pacer: low level retry 10/10 (error incident id 3894aee67876-9155f6e36ed8a6d7 (500 internal_error)) 2025/11/03 01:08:25 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2025/11/03 01:08:25 NOTICE: Failed to open remote "TestB2:": failed to authorize account: failed to authenticate: incident id 3894aee67876-9155f6e36ed8a6d7 (500 internal_error) "./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose" - Finished ERROR in 1m15.110096875s (try 1/5): exit status 1: Failed [TestMultithreadCopy TestMultithreadCopyAbort]