"./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose -fast-list" - Starting (try 1/5) 2025/11/03 02:31:23 DEBUG : Creating backend with remote "TestB2:rclone-test-gobuber3lixa" 2025/11/03 02:31:23 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:31:24 DEBUG : Creating backend with remote "/tmp/rclone1264826974" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: expected a FileSseMode but found: '' (400 bad_request) Test: TestMultithreadCopy --- FAIL: TestMultithreadCopy (1.46s) === RUN TestMultithreadCopyAbort run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: expected a FileSseMode but found: '' (400 bad_request) Test: TestMultithreadCopyAbort --- FAIL: TestMultithreadCopyAbort (0.54s) === RUN TestSizeDiffers 2025/11/03 02:31:26 DEBUG : a: size = 0 OK 2025/11/03 02:31:26 DEBUG : a: size = 1 (memory) 2025/11/03 02:31:26 DEBUG : a: size = 2 (memory) --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2025/11/03 02:31:26 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/ReadAt 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/Normal/Seek 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2025/11/03 02:31:26 DEBUG : potato: Seek from 10 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 10 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/ReadAt 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithRangeOption/Seek 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 2 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2025/11/03 02:31:26 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/ReadAt 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithSeekOption/Seek 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 2 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2025/11/03 02:31:26 DEBUG : potato: Seek from 8 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 8 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2025/11/03 02:31:26 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/03 02:31:26 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/ReadAt 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/UnknownSize/Seek 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/03 02:31:26 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/03 02:31:26 DEBUG : potato: Seek from 5 to 2 2025/11/03 02:31:26 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2025/11/03 02:31:26 DEBUG : potato: Seek from 9 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 9 to 0 2025/11/03 02:31:26 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/ReadAt (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/ReadAt (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/ReadAt (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/ReadAt (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (4.51s) --- PASS: TestCheck/1 (0.18s) --- PASS: TestCheck/2 (0.18s) --- PASS: TestCheck/3 (0.18s) --- PASS: TestCheck/4 (0.18s) --- PASS: TestCheck/5 (0.18s) --- PASS: TestCheck/6 (0.18s) --- PASS: TestCheck/7 (0.18s) === RUN TestCheckFsError 2025/11/03 02:31:30 DEBUG : Creating backend with remote "nonexistent" 2025/11/03 02:31:30 DEBUG : Creating backend with remote "nonexistent" 2025/11/03 02:31:30 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2025/11/03 02:31:30 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2025/11/03 02:31:30 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 0 differences found 2025/11/03 02:31:30 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (5.89s) --- PASS: TestCheckDownload/1 (0.72s) --- PASS: TestCheckDownload/2 (0.37s) --- PASS: TestCheckDownload/3 (0.36s) --- PASS: TestCheckDownload/4 (0.58s) --- PASS: TestCheckDownload/5 (0.37s) --- PASS: TestCheckDownload/6 (0.38s) --- PASS: TestCheckDownload/7 (0.37s) === RUN TestCheckSizeOnly run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (4.06s) --- PASS: TestCheckSizeOnly/1 (0.18s) --- PASS: TestCheckSizeOnly/2 (0.18s) --- PASS: TestCheckSizeOnly/3 (0.18s) --- PASS: TestCheckSizeOnly/4 (0.18s) --- PASS: TestCheckSizeOnly/5 (0.18s) --- PASS: TestCheckSizeOnly/6 (0.23s) --- PASS: TestCheckSizeOnly/7 (0.19s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" 2025/11/03 02:31:41 NOTICE: test.sum: improperly formatted checksum line 4 2025/11/03 02:31:41 NOTICE: test.sum: improperly formatted checksum line 5 2025/11/03 02:31:41 NOTICE: test.sum: improperly formatted checksum line 6 2025/11/03 02:31:41 NOTICE: test.sum: 2 warning(s) suppressed... 2025/11/03 02:31:42 NOTICE: test.sum: improperly formatted checksum line 4 2025/11/03 02:31:42 NOTICE: test.sum: improperly formatted checksum line 5 2025/11/03 02:31:42 NOTICE: test.sum: improperly formatted checksum line 6 2025/11/03 02:31:42 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (2.07s) === RUN TestCheckSum run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" 2025/11/03 02:31:42 DEBUG : Creating backend with remote "TestB2:rclone-test-gobuber3lixa/data" check_test.go:350: B2 bucket rclone-test-gobuber3lixa path data lacks md5, skipping --- SKIP: TestCheckSum (1.46s) === RUN TestCheckSumDownload run.go:185: Remote "B2 bucket rclone-test-gobuber3lixa", Local "Local file system at /tmp/rclone1264826974", Modify Window "1ms" 2025/11/03 02:31:44 DEBUG : Creating backend with remote "TestB2:rclone-test-gobuber3lixa/data" === RUN TestCheckSumDownload/subtest1 === RUN TestCheckSumDownload/subtest2 === RUN TestCheckSumDownload/subtest3 === RUN TestCheckSumDownload/subtest4 === RUN TestCheckSumDownload/subtest5 === RUN TestCheckSumDownload/subtest6 === RUN TestCheckSumDownload/subtest7 --- PASS: TestCheckSumDownload (11.47s) --- PASS: TestCheckSumDownload/subtest1 (1.28s) --- PASS: TestCheckSumDownload/subtest2 (0.72s) --- PASS: TestCheckSumDownload/subtest3 (0.90s) --- PASS: TestCheckSumDownload/subtest4 (0.73s) --- PASS: TestCheckSumDownload/subtest5 (0.73s) --- PASS: TestCheckSumDownload/subtest6 (0.73s) --- PASS: TestCheckSumDownload/subtest7 (0.74s) === RUN TestApplyTransforms 2025/11/03 02:31:55 DEBUG : Creating backend with remote "TestB2:rclone-test-pawokox9moca" 2025/11/03 02:31:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:31:56 DEBUG : Creating backend with remote "/tmp/rclone731963415" run.go:185: Remote "B2 bucket rclone-test-pawokox9moca", Local "Local file system at /tmp/rclone731963415", Modify Window "1ms" upper checkfile vs. lower remote (without normalization) 2025/11/03 02:31:58 ERROR : hello, world!: sum not found 2025/11/03 02:31:58 ERROR : HELLO, WORLD!: file not in B2 bucket rclone-test-pawokox9moca 2025/11/03 02:31:58 NOTICE: B2 bucket rclone-test-pawokox9moca: 1 files missing 2025/11/03 02:31:58 NOTICE: 1 hashes missing 2025/11/03 02:31:58 NOTICE: B2 bucket rclone-test-pawokox9moca: 1 differences found 2025/11/03 02:31:58 NOTICE: B2 bucket rclone-test-pawokox9moca: 2 errors while checking upper checkfile vs. lower remote (with normalization) 2025/11/03 02:31:59 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:31:59 NOTICE: B2 bucket rclone-test-pawokox9moca: 0 differences found 2025/11/03 02:31:59 NOTICE: B2 bucket rclone-test-pawokox9moca: 1 matching files 2025/11/03 02:31:59 DEBUG : Creating backend with remote "TestB2:rclone-test-ruqaram1movi" 2025/11/03 02:31:59 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:31:59 DEBUG : Creating backend with remote "/tmp/rclone1627758494" run.go:185: Remote "B2 bucket rclone-test-ruqaram1movi", Local "Local file system at /tmp/rclone1627758494", Modify Window "1ms" lower checkfile vs. upper remote (without normalization) 2025/11/03 02:32:02 ERROR : HELLO, WORLD!: sum not found 2025/11/03 02:32:02 ERROR : hello, world!: file not in B2 bucket rclone-test-ruqaram1movi 2025/11/03 02:32:02 NOTICE: B2 bucket rclone-test-ruqaram1movi: 1 files missing 2025/11/03 02:32:02 NOTICE: 1 hashes missing 2025/11/03 02:32:02 NOTICE: B2 bucket rclone-test-ruqaram1movi: 1 differences found 2025/11/03 02:32:02 NOTICE: B2 bucket rclone-test-ruqaram1movi: 2 errors while checking lower checkfile vs. upper remote (with normalization) 2025/11/03 02:32:02 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:02 NOTICE: B2 bucket rclone-test-ruqaram1movi: 0 differences found 2025/11/03 02:32:02 NOTICE: B2 bucket rclone-test-ruqaram1movi: 1 matching files 2025/11/03 02:32:02 DEBUG : Creating backend with remote "TestB2:rclone-test-qasocig2pego" 2025/11/03 02:32:02 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:03 DEBUG : Creating backend with remote "/tmp/rclone2280415126" run.go:185: Remote "B2 bucket rclone-test-qasocig2pego", Local "Local file system at /tmp/rclone2280415126", Modify Window "1ms" lower checkfile vs. upperlowermixed remote (without normalization) 2025/11/03 02:32:05 ERROR : HeLlO, wOrLd!: sum not found 2025/11/03 02:32:05 ERROR : hello, world!: file not in B2 bucket rclone-test-qasocig2pego 2025/11/03 02:32:05 NOTICE: B2 bucket rclone-test-qasocig2pego: 1 files missing 2025/11/03 02:32:05 NOTICE: 1 hashes missing 2025/11/03 02:32:05 NOTICE: B2 bucket rclone-test-qasocig2pego: 1 differences found 2025/11/03 02:32:05 NOTICE: B2 bucket rclone-test-qasocig2pego: 2 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2025/11/03 02:32:06 DEBUG : HeLlO, wOrLd!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:06 NOTICE: B2 bucket rclone-test-qasocig2pego: 0 differences found 2025/11/03 02:32:06 NOTICE: B2 bucket rclone-test-qasocig2pego: 1 matching files 2025/11/03 02:32:06 DEBUG : Creating backend with remote "TestB2:rclone-test-gihakin1goco" 2025/11/03 02:32:06 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:06 DEBUG : Creating backend with remote "/tmp/rclone3360162343" run.go:185: Remote "B2 bucket rclone-test-gihakin1goco", Local "Local file system at /tmp/rclone3360162343", Modify Window "1ms" upperlowermixed checkfile vs. upper remote (without normalization) 2025/11/03 02:32:09 ERROR : HELLO, WORLD!: sum not found 2025/11/03 02:32:09 ERROR : HeLlO, wOrLd!: file not in B2 bucket rclone-test-gihakin1goco 2025/11/03 02:32:09 NOTICE: B2 bucket rclone-test-gihakin1goco: 1 files missing 2025/11/03 02:32:09 NOTICE: 1 hashes missing 2025/11/03 02:32:09 NOTICE: B2 bucket rclone-test-gihakin1goco: 1 differences found 2025/11/03 02:32:09 NOTICE: B2 bucket rclone-test-gihakin1goco: 2 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2025/11/03 02:32:10 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:10 NOTICE: B2 bucket rclone-test-gihakin1goco: 0 differences found 2025/11/03 02:32:10 NOTICE: B2 bucket rclone-test-gihakin1goco: 1 matching files 2025/11/03 02:32:10 DEBUG : Creating backend with remote "TestB2:rclone-test-coqaxuc1heli" 2025/11/03 02:32:10 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:10 DEBUG : Creating backend with remote "/tmp/rclone2581070145" run.go:185: Remote "B2 bucket rclone-test-coqaxuc1heli", Local "Local file system at /tmp/rclone2581070145", Modify Window "1ms" NFD checkfile vs. NFC remote (without normalization) 2025/11/03 02:32:12 ERROR : 測試_Русский___ě_áñ: sum not found 2025/11/03 02:32:12 ERROR : 測試_Русский___ě_áñ: file not in B2 bucket rclone-test-coqaxuc1heli 2025/11/03 02:32:12 NOTICE: B2 bucket rclone-test-coqaxuc1heli: 1 files missing 2025/11/03 02:32:12 NOTICE: 1 hashes missing 2025/11/03 02:32:12 NOTICE: B2 bucket rclone-test-coqaxuc1heli: 1 differences found 2025/11/03 02:32:12 NOTICE: B2 bucket rclone-test-coqaxuc1heli: 2 errors while checking NFD checkfile vs. NFC remote (with normalization) 2025/11/03 02:32:13 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:13 NOTICE: B2 bucket rclone-test-coqaxuc1heli: 0 differences found 2025/11/03 02:32:13 NOTICE: B2 bucket rclone-test-coqaxuc1heli: 1 matching files 2025/11/03 02:32:13 DEBUG : Creating backend with remote "TestB2:rclone-test-wujozan1kawa" 2025/11/03 02:32:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:13 DEBUG : Creating backend with remote "/tmp/rclone2461299074" run.go:185: Remote "B2 bucket rclone-test-wujozan1kawa", Local "Local file system at /tmp/rclone2461299074", Modify Window "1ms" NFC checkfile vs. NFD remote (without normalization) 2025/11/03 02:32:16 ERROR : 測試_Русский___ě_áñ: sum not found 2025/11/03 02:32:16 ERROR : 測試_Русский___ě_áñ: file not in B2 bucket rclone-test-wujozan1kawa 2025/11/03 02:32:16 NOTICE: B2 bucket rclone-test-wujozan1kawa: 1 files missing 2025/11/03 02:32:16 NOTICE: 1 hashes missing 2025/11/03 02:32:16 NOTICE: B2 bucket rclone-test-wujozan1kawa: 1 differences found 2025/11/03 02:32:16 NOTICE: B2 bucket rclone-test-wujozan1kawa: 2 errors while checking NFC checkfile vs. NFD remote (with normalization) 2025/11/03 02:32:17 DEBUG : 測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:17 NOTICE: B2 bucket rclone-test-wujozan1kawa: 0 differences found 2025/11/03 02:32:17 NOTICE: B2 bucket rclone-test-wujozan1kawa: 1 matching files 2025/11/03 02:32:17 DEBUG : Creating backend with remote "TestB2:rclone-test-mofamiw3tunu" 2025/11/03 02:32:17 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:17 DEBUG : Creating backend with remote "/tmp/rclone2538577467" run.go:185: Remote "B2 bucket rclone-test-mofamiw3tunu", Local "Local file system at /tmp/rclone2538577467", Modify Window "1ms" NFDx2 checkfile vs. both remote (without normalization) 2025/11/03 02:32:19 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/11/03 02:32:19 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in B2 bucket rclone-test-mofamiw3tunu 2025/11/03 02:32:19 NOTICE: B2 bucket rclone-test-mofamiw3tunu: 1 files missing 2025/11/03 02:32:19 NOTICE: 1 hashes missing 2025/11/03 02:32:19 NOTICE: B2 bucket rclone-test-mofamiw3tunu: 1 differences found 2025/11/03 02:32:19 NOTICE: B2 bucket rclone-test-mofamiw3tunu: 2 errors while checking NFDx2 checkfile vs. both remote (with normalization) 2025/11/03 02:32:20 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:20 NOTICE: B2 bucket rclone-test-mofamiw3tunu: 0 differences found 2025/11/03 02:32:20 NOTICE: B2 bucket rclone-test-mofamiw3tunu: 1 matching files 2025/11/03 02:32:20 DEBUG : Creating backend with remote "TestB2:rclone-test-wulaqus7wico" 2025/11/03 02:32:20 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:21 DEBUG : Creating backend with remote "/tmp/rclone2285703331" run.go:185: Remote "B2 bucket rclone-test-wulaqus7wico", Local "Local file system at /tmp/rclone2285703331", Modify Window "1ms" NFCx2 checkfile vs. both remote (without normalization) 2025/11/03 02:32:23 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: sum not found 2025/11/03 02:32:23 ERROR : 測試_Русский___ě_áñ測試_Русский___ě_áñ: file not in B2 bucket rclone-test-wulaqus7wico 2025/11/03 02:32:23 NOTICE: B2 bucket rclone-test-wulaqus7wico: 1 files missing 2025/11/03 02:32:23 NOTICE: 1 hashes missing 2025/11/03 02:32:23 NOTICE: B2 bucket rclone-test-wulaqus7wico: 1 differences found 2025/11/03 02:32:23 NOTICE: B2 bucket rclone-test-wulaqus7wico: 2 errors while checking NFCx2 checkfile vs. both remote (with normalization) 2025/11/03 02:32:24 DEBUG : 測試_Русский___ě_áñ測試_Русский___ě_áñ: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/03 02:32:24 NOTICE: B2 bucket rclone-test-wulaqus7wico: 0 differences found 2025/11/03 02:32:24 NOTICE: B2 bucket rclone-test-wulaqus7wico: 1 matching files 2025/11/03 02:32:24 DEBUG : Creating backend with remote "TestB2:rclone-test-cuwikob6yumu" 2025/11/03 02:32:24 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/03 02:32:24 DEBUG : pacer: low level retry 1/10 (error incident id 3894aee67876-be06787704a47c24 (500 internal_error)) 2025/11/03 02:32:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/03 02:32:24 DEBUG : pacer: low level retry 2/10 (error incident id 3894aee67876-1d6b7d7e82d21713 (500 internal_error)) 2025/11/03 02:32:24 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/11/03 02:32:25 DEBUG : pacer: low level retry 3/10 (error incident id 3894aee67876-66695d35e7158094 (500 internal_error)) 2025/11/03 02:32:25 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/11/03 02:32:25 DEBUG : pacer: low level retry 4/10 (error incident id 3894aee67876-bfe1486ca0edd692 (500 internal_error)) 2025/11/03 02:32:25 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/11/03 02:32:25 DEBUG : pacer: low level retry 5/10 (error incident id 3894aee67876-afa6b3760b1cb442 (500 internal_error)) 2025/11/03 02:32:25 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/11/03 02:32:25 DEBUG : pacer: low level retry 6/10 (error incident id 3894aee67876-d984800b6ead4584 (500 internal_error)) 2025/11/03 02:32:25 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/11/03 02:32:26 DEBUG : pacer: low level retry 7/10 (error incident id 3894aee67876-00146c89fce24dc5 (500 internal_error)) 2025/11/03 02:32:26 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/11/03 02:32:26 DEBUG : pacer: low level retry 8/10 (error incident id 3894aee67876-0deb14d422ef6bc4 (500 internal_error)) 2025/11/03 02:32:26 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2025/11/03 02:32:27 DEBUG : pacer: low level retry 9/10 (error incident id 3894aee67876-dfa55feaad96ef6a (500 internal_error)) 2025/11/03 02:32:27 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2025/11/03 02:32:30 DEBUG : pacer: low level retry 10/10 (error incident id 3894aee67876-fb2030c444073cdb (500 internal_error)) 2025/11/03 02:32:30 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2025/11/03 02:32:30 NOTICE: Failed to open remote "TestB2:": failed to authorize account: failed to authenticate: incident id 3894aee67876-fb2030c444073cdb (500 internal_error) "./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose -fast-list" - Finished ERROR in 1m6.860383337s (try 1/5): exit status 1: Failed [TestMultithreadCopy TestMultithreadCopyAbort]