"./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose" - Starting (try 2/5) 2025/11/01 03:04:35 DEBUG : Creating backend with remote "TestB2:rclone-test-zoxezaq3reyu" 2025/11/01 03:04:35 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/01 03:04:36 DEBUG : Creating backend with remote "/tmp/rclone1254279678" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: expected a FileSseMode but found: '' (400 bad_request) Test: TestMultithreadCopy --- FAIL: TestMultithreadCopy (1.38s) === RUN TestMultithreadCopyAbort run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: expected a FileSseMode but found: '' (400 bad_request) Test: TestMultithreadCopyAbort --- FAIL: TestMultithreadCopyAbort (0.53s) === RUN TestSizeDiffers --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2025/11/01 03:04:38 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/ReadAt 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/Normal/Seek 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2025/11/01 03:04:38 DEBUG : potato: Seek from 10 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 10 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/ReadAt 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithRangeOption/Seek 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 2 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2025/11/01 03:04:38 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/ReadAt 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithSeekOption/Seek 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 2 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2025/11/01 03:04:38 DEBUG : potato: Seek from 8 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 8 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2025/11/01 03:04:38 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2025/11/01 03:04:38 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/ReadAt 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/UnknownSize/Seek 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2025/11/01 03:04:38 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2025/11/01 03:04:38 DEBUG : potato: Seek from 5 to 2 2025/11/01 03:04:38 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2025/11/01 03:04:38 DEBUG : potato: Seek from 9 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 9 to 0 2025/11/01 03:04:38 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.01s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/ReadAt (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/ReadAt (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/ReadAt (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/ReadAt (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (5.81s) --- PASS: TestCheck/1 (0.18s) --- PASS: TestCheck/2 (0.18s) --- PASS: TestCheck/3 (0.18s) --- PASS: TestCheck/4 (0.18s) --- PASS: TestCheck/5 (0.18s) --- PASS: TestCheck/6 (0.19s) --- PASS: TestCheck/7 (0.18s) === RUN TestCheckFsError 2025/11/01 03:04:44 DEBUG : Creating backend with remote "nonexistent" 2025/11/01 03:04:44 DEBUG : Creating backend with remote "nonexistent" 2025/11/01 03:04:44 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2025/11/01 03:04:44 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2025/11/01 03:04:44 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 0 differences found 2025/11/01 03:04:44 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.00s) === RUN TestCheckDownload run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (6.79s) --- PASS: TestCheckDownload/1 (0.73s) --- PASS: TestCheckDownload/2 (0.43s) --- PASS: TestCheckDownload/3 (0.36s) --- PASS: TestCheckDownload/4 (0.55s) --- PASS: TestCheckDownload/5 (0.37s) --- PASS: TestCheckDownload/6 (0.37s) --- PASS: TestCheckDownload/7 (0.38s) === RUN TestCheckSizeOnly run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (4.98s) --- PASS: TestCheckSizeOnly/1 (0.18s) --- PASS: TestCheckSizeOnly/2 (0.18s) --- PASS: TestCheckSizeOnly/3 (0.18s) --- PASS: TestCheckSizeOnly/4 (0.18s) --- PASS: TestCheckSizeOnly/5 (0.18s) --- PASS: TestCheckSizeOnly/6 (0.18s) --- PASS: TestCheckSizeOnly/7 (0.18s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" 2025/11/01 03:04:57 NOTICE: test.sum: improperly formatted checksum line 4 2025/11/01 03:04:57 NOTICE: test.sum: improperly formatted checksum line 5 2025/11/01 03:04:57 NOTICE: test.sum: improperly formatted checksum line 6 2025/11/01 03:04:57 NOTICE: test.sum: 2 warning(s) suppressed... 2025/11/01 03:04:57 NOTICE: test.sum: improperly formatted checksum line 4 2025/11/01 03:04:57 NOTICE: test.sum: improperly formatted checksum line 5 2025/11/01 03:04:57 NOTICE: test.sum: improperly formatted checksum line 6 2025/11/01 03:04:57 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (2.45s) === RUN TestCheckSum run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" 2025/11/01 03:04:58 DEBUG : Creating backend with remote "TestB2:rclone-test-zoxezaq3reyu/data" check_test.go:350: B2 bucket rclone-test-zoxezaq3reyu path data lacks md5, skipping --- SKIP: TestCheckSum (1.59s) === RUN TestCheckSumDownload run.go:185: Remote "B2 bucket rclone-test-zoxezaq3reyu", Local "Local file system at /tmp/rclone1254279678", Modify Window "1ms" 2025/11/01 03:05:00 DEBUG : Creating backend with remote "TestB2:rclone-test-zoxezaq3reyu/data" === RUN TestCheckSumDownload/subtest1 === RUN TestCheckSumDownload/subtest2 === RUN TestCheckSumDownload/subtest3 === RUN TestCheckSumDownload/subtest4 === RUN TestCheckSumDownload/subtest5 === RUN TestCheckSumDownload/subtest6 === RUN TestCheckSumDownload/subtest7 --- PASS: TestCheckSumDownload (14.61s) --- PASS: TestCheckSumDownload/subtest1 (1.30s) --- PASS: TestCheckSumDownload/subtest2 (0.74s) --- PASS: TestCheckSumDownload/subtest3 (0.91s) --- PASS: TestCheckSumDownload/subtest4 (0.74s) --- PASS: TestCheckSumDownload/subtest5 (0.75s) --- PASS: TestCheckSumDownload/subtest6 (0.75s) --- PASS: TestCheckSumDownload/subtest7 (1.07s) === RUN TestApplyTransforms 2025/11/01 03:05:14 DEBUG : Creating backend with remote "TestB2:rclone-test-qanisib8domo" 2025/11/01 03:05:14 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/01 03:05:15 DEBUG : Creating backend with remote "/tmp/rclone2331979263" run.go:185: Remote "B2 bucket rclone-test-qanisib8domo", Local "Local file system at /tmp/rclone2331979263", Modify Window "1ms" upper checkfile vs. lower remote (without normalization) 2025/11/01 03:05:17 ERROR : hello, world!: sum not found 2025/11/01 03:05:17 ERROR : HELLO, WORLD!: file not in B2 bucket rclone-test-qanisib8domo 2025/11/01 03:05:17 NOTICE: B2 bucket rclone-test-qanisib8domo: 1 files missing 2025/11/01 03:05:17 NOTICE: 1 hashes missing 2025/11/01 03:05:17 NOTICE: B2 bucket rclone-test-qanisib8domo: 1 differences found 2025/11/01 03:05:17 NOTICE: B2 bucket rclone-test-qanisib8domo: 2 errors while checking upper checkfile vs. lower remote (with normalization) 2025/11/01 03:05:18 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/01 03:05:18 NOTICE: B2 bucket rclone-test-qanisib8domo: 0 differences found 2025/11/01 03:05:18 NOTICE: B2 bucket rclone-test-qanisib8domo: 1 matching files 2025/11/01 03:05:18 DEBUG : Creating backend with remote "TestB2:rclone-test-zihacab5weku" 2025/11/01 03:05:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/01 03:05:19 DEBUG : Creating backend with remote "/tmp/rclone2594983722" run.go:185: Remote "B2 bucket rclone-test-zihacab5weku", Local "Local file system at /tmp/rclone2594983722", Modify Window "1ms" lower checkfile vs. upper remote (without normalization) 2025/11/01 03:05:21 ERROR : HELLO, WORLD!: sum not found 2025/11/01 03:05:21 ERROR : hello, world!: file not in B2 bucket rclone-test-zihacab5weku 2025/11/01 03:05:21 NOTICE: B2 bucket rclone-test-zihacab5weku: 1 files missing 2025/11/01 03:05:21 NOTICE: 1 hashes missing 2025/11/01 03:05:21 NOTICE: B2 bucket rclone-test-zihacab5weku: 1 differences found 2025/11/01 03:05:21 NOTICE: B2 bucket rclone-test-zihacab5weku: 2 errors while checking lower checkfile vs. upper remote (with normalization) 2025/11/01 03:05:21 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/01 03:05:21 NOTICE: B2 bucket rclone-test-zihacab5weku: 0 differences found 2025/11/01 03:05:21 NOTICE: B2 bucket rclone-test-zihacab5weku: 1 matching files 2025/11/01 03:05:21 DEBUG : Creating backend with remote "TestB2:rclone-test-fuhajox0voba" 2025/11/01 03:05:21 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/01 03:05:22 DEBUG : Creating backend with remote "/tmp/rclone2872946429" run.go:185: Remote "B2 bucket rclone-test-fuhajox0voba", Local "Local file system at /tmp/rclone2872946429", Modify Window "1ms" lower checkfile vs. upperlowermixed remote (without normalization) 2025/11/01 03:05:24 ERROR : HeLlO, wOrLd!: sum not found 2025/11/01 03:05:24 ERROR : hello, world!: file not in B2 bucket rclone-test-fuhajox0voba 2025/11/01 03:05:24 NOTICE: B2 bucket rclone-test-fuhajox0voba: 1 files missing 2025/11/01 03:05:24 NOTICE: 1 hashes missing 2025/11/01 03:05:24 NOTICE: B2 bucket rclone-test-fuhajox0voba: 1 differences found 2025/11/01 03:05:24 NOTICE: B2 bucket rclone-test-fuhajox0voba: 2 errors while checking lower checkfile vs. upperlowermixed remote (with normalization) 2025/11/01 03:05:25 DEBUG : HeLlO, wOrLd!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/01 03:05:25 NOTICE: B2 bucket rclone-test-fuhajox0voba: 0 differences found 2025/11/01 03:05:25 NOTICE: B2 bucket rclone-test-fuhajox0voba: 1 matching files 2025/11/01 03:05:25 DEBUG : Creating backend with remote "TestB2:rclone-test-wivoqer2fesu" 2025/11/01 03:05:25 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/01 03:05:25 DEBUG : Creating backend with remote "/tmp/rclone1328997173" run.go:185: Remote "B2 bucket rclone-test-wivoqer2fesu", Local "Local file system at /tmp/rclone1328997173", Modify Window "1ms" upperlowermixed checkfile vs. upper remote (without normalization) 2025/11/01 03:05:28 ERROR : HELLO, WORLD!: sum not found 2025/11/01 03:05:28 ERROR : HeLlO, wOrLd!: file not in B2 bucket rclone-test-wivoqer2fesu 2025/11/01 03:05:28 NOTICE: B2 bucket rclone-test-wivoqer2fesu: 1 files missing 2025/11/01 03:05:28 NOTICE: 1 hashes missing 2025/11/01 03:05:28 NOTICE: B2 bucket rclone-test-wivoqer2fesu: 1 differences found 2025/11/01 03:05:28 NOTICE: B2 bucket rclone-test-wivoqer2fesu: 2 errors while checking upperlowermixed checkfile vs. upper remote (with normalization) 2025/11/01 03:05:28 DEBUG : HELLO, WORLD!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2025/11/01 03:05:28 NOTICE: B2 bucket rclone-test-wivoqer2fesu: 0 differences found 2025/11/01 03:05:28 NOTICE: B2 bucket rclone-test-wivoqer2fesu: 1 matching files 2025/11/01 03:05:28 DEBUG : Creating backend with remote "TestB2:rclone-test-cunonub5yeta" 2025/11/01 03:05:28 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/01 03:05:29 DEBUG : pacer: low level retry 1/10 (error incident id 3894aee67876-61ba093482a6d8ab (500 internal_error)) 2025/11/01 03:05:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/01 03:05:29 DEBUG : pacer: low level retry 2/10 (error incident id 3894aee67876-79574cdf4f8cfbd1 (500 internal_error)) 2025/11/01 03:05:29 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/11/01 03:05:29 DEBUG : pacer: low level retry 3/10 (error incident id 3894aee67876-18db05dacb06defa (500 internal_error)) 2025/11/01 03:05:29 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/11/01 03:05:30 DEBUG : pacer: low level retry 4/10 (error incident id 3894aee67876-62b91763c4878b1f (500 internal_error)) 2025/11/01 03:05:30 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/11/01 03:05:30 DEBUG : pacer: low level retry 5/10 (error incident id 3894aee67876-ab2876889f1582e3 (500 internal_error)) 2025/11/01 03:05:30 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/11/01 03:05:30 DEBUG : pacer: low level retry 6/10 (error incident id 3894aee67876-034e8ddedf9fc653 (500 internal_error)) 2025/11/01 03:05:30 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/11/01 03:05:30 DEBUG : pacer: low level retry 7/10 (error incident id 3894aee67876-6ef7f442e5da6172 (500 internal_error)) 2025/11/01 03:05:30 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/11/01 03:05:31 DEBUG : pacer: low level retry 8/10 (error incident id 3894aee67876-c86e2ff2e11ab1d4 (500 internal_error)) 2025/11/01 03:05:31 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2025/11/01 03:05:32 DEBUG : pacer: low level retry 9/10 (error incident id 3894aee67876-29d4eb98608dab3b (500 internal_error)) 2025/11/01 03:05:32 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2025/11/01 03:05:35 DEBUG : pacer: low level retry 10/10 (error incident id 3894aee67876-dc5f0827dd5d777e (500 internal_error)) 2025/11/01 03:05:35 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2025/11/01 03:05:35 NOTICE: Failed to open remote "TestB2:": failed to authorize account: failed to authenticate: incident id 3894aee67876-dc5f0827dd5d777e (500 internal_error) "./operations.test -test.v -test.timeout 1h0m0s -remote TestB2: -list-retries 5 -verbose" - Finished ERROR in 59.380762845s (try 2/5): exit status 1: Failed [TestMultithreadCopy TestMultithreadCopyAbort]