"./operations.test -test.v -test.timeout 1h0m0s -remote TestInternxt: -verbose" - Starting (try 1/5) 2026/02/09 03:58:20 DEBUG : Creating backend with remote "TestInternxt:rclone-test-sohorok8kimo" 2026/02/09 03:58:20 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/09 03:58:21 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/02/09 03:58:21 DEBUG : Creating backend with remote "/tmp/rclone2821405687" === RUN TestDoMultiThreadCopy --- PASS: TestDoMultiThreadCopy (0.00s) === RUN TestMultithreadCalculateNumChunks === RUN TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} === RUN TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} === RUN TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} === RUN TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} --- PASS: TestMultithreadCalculateNumChunks (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1_chunkSize:65536_wantNumChunks:1} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:1_wantNumChunks:1048576} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048576_chunkSize:2_wantNumChunks:524288} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048577_chunkSize:2_wantNumChunks:524289} (0.00s) --- PASS: TestMultithreadCalculateNumChunks/{size:1048575_chunkSize:2_wantNumChunks:524288} (0.00s) === RUN TestMultithreadCopy run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" multithread_test.go:119: multithread writing not supported 2026/02/09 03:58:21 ERROR : error listing: directory not found --- SKIP: TestMultithreadCopy (0.13s) === RUN TestMultithreadCopyAbort run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" multithread_test.go:119: multithread writing not supported 2026/02/09 03:58:21 ERROR : error listing: directory not found --- SKIP: TestMultithreadCopyAbort (0.19s) === RUN TestSizeDiffers 2026/02/09 03:58:21 DEBUG : a: size = 0 OK 2026/02/09 03:58:21 DEBUG : a: size = 1 (memory) 2026/02/09 03:58:21 DEBUG : a: size = 2 (memory) --- PASS: TestSizeDiffers (0.00s) === RUN TestReOpen === RUN TestReOpen/Normal === RUN TestReOpen/Normal/Basics 2026/02/09 03:58:21 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/ErrorAtStart === RUN TestReOpen/Normal/WithErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/Normal/TooManyErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/Normal/ReadAt 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/Normal/Seek 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 2 === RUN TestReOpen/Normal/AccountRead === RUN TestReOpen/Normal/AccountReadDelay 2026/02/09 03:58:21 DEBUG : potato: Seek from 10 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 10 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 10 to 0 === RUN TestReOpen/Normal/AccountReadError === RUN TestReOpen/WithRangeOption === RUN TestReOpen/WithRangeOption/Basics 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/ErrorAtStart === RUN TestReOpen/WithRangeOption/WithErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithRangeOption/TooManyErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithRangeOption/ReadAt 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithRangeOption/Seek 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 2 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 4 === RUN TestReOpen/WithRangeOption/AccountRead === RUN TestReOpen/WithRangeOption/AccountReadDelay 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 0 === RUN TestReOpen/WithRangeOption/AccountReadError === RUN TestReOpen/WithSeekOption === RUN TestReOpen/WithSeekOption/Basics 2026/02/09 03:58:21 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/ErrorAtStart === RUN TestReOpen/WithSeekOption/WithErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/WithSeekOption/TooManyErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/WithSeekOption/ReadAt 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/WithSeekOption/Seek 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 2 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 5 === RUN TestReOpen/WithSeekOption/AccountRead === RUN TestReOpen/WithSeekOption/AccountReadDelay 2026/02/09 03:58:21 DEBUG : potato: Seek from 8 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 8 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 8 to 0 === RUN TestReOpen/WithSeekOption/AccountReadError === RUN TestReOpen/UnknownSize === RUN TestReOpen/UnknownSize/Basics 2026/02/09 03:58:21 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/ErrorAtStart === RUN TestReOpen/UnknownSize/WithErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/10: test error === RUN TestReOpen/UnknownSize/TooManyErrors 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 1/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 2/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 6 bytes: retry 3/3: test error 2026/02/09 03:58:21 DEBUG : potato: Reopen failed after offset 6 bytes read: failed to reopen: too many retries === RUN TestReOpen/UnknownSize/ReadAt 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 1 === RUN TestReOpen/UnknownSize/Seek 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 2 bytes: retry 0/10: test error 2026/02/09 03:58:21 DEBUG : potato: Reopening on read failure after offset 3 bytes: retry 1/10: test error 2026/02/09 03:58:21 DEBUG : potato: Seek from 5 to 2 2026/02/09 03:58:21 DEBUG : potato: Seek from 7 to 6 === RUN TestReOpen/UnknownSize/AccountRead === RUN TestReOpen/UnknownSize/AccountReadDelay 2026/02/09 03:58:21 DEBUG : potato: Seek from 9 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 9 to 0 2026/02/09 03:58:21 DEBUG : potato: Seek from 9 to 0 === RUN TestReOpen/UnknownSize/AccountReadError --- PASS: TestReOpen (0.00s) --- PASS: TestReOpen/Normal (0.00s) --- PASS: TestReOpen/Normal/Basics (0.00s) --- PASS: TestReOpen/Normal/ErrorAtStart (0.00s) --- PASS: TestReOpen/Normal/WithErrors (0.00s) --- PASS: TestReOpen/Normal/TooManyErrors (0.00s) --- PASS: TestReOpen/Normal/ReadAt (0.00s) --- PASS: TestReOpen/Normal/Seek (0.00s) --- PASS: TestReOpen/Normal/AccountRead (0.00s) --- PASS: TestReOpen/Normal/AccountReadDelay (0.00s) --- PASS: TestReOpen/Normal/AccountReadError (0.00s) --- PASS: TestReOpen/WithRangeOption (0.00s) --- PASS: TestReOpen/WithRangeOption/Basics (0.00s) --- PASS: TestReOpen/WithRangeOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithRangeOption/WithErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithRangeOption/ReadAt (0.00s) --- PASS: TestReOpen/WithRangeOption/Seek (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountRead (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithRangeOption/AccountReadError (0.00s) --- PASS: TestReOpen/WithSeekOption (0.00s) --- PASS: TestReOpen/WithSeekOption/Basics (0.00s) --- PASS: TestReOpen/WithSeekOption/ErrorAtStart (0.00s) --- PASS: TestReOpen/WithSeekOption/WithErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/TooManyErrors (0.00s) --- PASS: TestReOpen/WithSeekOption/ReadAt (0.00s) --- PASS: TestReOpen/WithSeekOption/Seek (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountRead (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadDelay (0.00s) --- PASS: TestReOpen/WithSeekOption/AccountReadError (0.00s) --- PASS: TestReOpen/UnknownSize (0.00s) --- PASS: TestReOpen/UnknownSize/Basics (0.00s) --- PASS: TestReOpen/UnknownSize/ErrorAtStart (0.00s) --- PASS: TestReOpen/UnknownSize/WithErrors (0.00s) --- PASS: TestReOpen/UnknownSize/TooManyErrors (0.00s) --- PASS: TestReOpen/UnknownSize/ReadAt (0.00s) --- PASS: TestReOpen/UnknownSize/Seek (0.00s) --- PASS: TestReOpen/UnknownSize/AccountRead (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadDelay (0.00s) --- PASS: TestReOpen/UnknownSize/AccountReadError (0.00s) === RUN TestCheck run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" === RUN TestCheck/1 === RUN TestCheck/2 === RUN TestCheck/3 === RUN TestCheck/4 === RUN TestCheck/5 === RUN TestCheck/6 === RUN TestCheck/7 --- PASS: TestCheck (7.91s) --- PASS: TestCheck/1 (0.25s) --- PASS: TestCheck/2 (0.25s) --- PASS: TestCheck/3 (0.25s) --- PASS: TestCheck/4 (0.27s) --- PASS: TestCheck/5 (0.28s) --- PASS: TestCheck/6 (0.26s) --- PASS: TestCheck/7 (0.26s) === RUN TestCheckFsError 2026/02/09 03:58:29 DEBUG : Creating backend with remote "nonexistent" 2026/02/09 03:58:29 DEBUG : Creating backend with remote "nonexistent" 2026/02/09 03:58:29 DEBUG : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: Waiting for checks to finish 2026/02/09 03:58:29 ERROR : Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: error reading source root directory: directory not found 2026/02/09 03:58:29 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 0 differences found 2026/02/09 03:58:29 NOTICE: Local file system at /home/rclone/go/src/github.com/rclone/rclone/fs/operations/nonexistent: 2 errors while checking --- PASS: TestCheckFsError (0.01s) === RUN TestCheckDownload run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" === RUN TestCheckDownload/1 === RUN TestCheckDownload/2 === RUN TestCheckDownload/3 === RUN TestCheckDownload/4 === RUN TestCheckDownload/5 === RUN TestCheckDownload/6 === RUN TestCheckDownload/7 --- PASS: TestCheckDownload (10.76s) --- PASS: TestCheckDownload/1 (0.81s) --- PASS: TestCheckDownload/2 (0.51s) --- PASS: TestCheckDownload/3 (0.54s) --- PASS: TestCheckDownload/4 (0.71s) --- PASS: TestCheckDownload/5 (0.68s) --- PASS: TestCheckDownload/6 (0.60s) --- PASS: TestCheckDownload/7 (0.67s) === RUN TestCheckSizeOnly run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" === RUN TestCheckSizeOnly/1 === RUN TestCheckSizeOnly/2 === RUN TestCheckSizeOnly/3 === RUN TestCheckSizeOnly/4 === RUN TestCheckSizeOnly/5 === NAME TestCheckSizeOnly fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSizeOnly/6 === RUN TestCheckSizeOnly/7 --- PASS: TestCheckSizeOnly (15.30s) --- PASS: TestCheckSizeOnly/1 (0.38s) --- PASS: TestCheckSizeOnly/2 (0.28s) --- PASS: TestCheckSizeOnly/3 (0.27s) --- PASS: TestCheckSizeOnly/4 (0.26s) --- PASS: TestCheckSizeOnly/5 (0.26s) --- PASS: TestCheckSizeOnly/6 (0.54s) --- PASS: TestCheckSizeOnly/7 (0.27s) === RUN TestCheckEqualReaders --- PASS: TestCheckEqualReaders (0.00s) === RUN TestParseSumFile run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/3 (object not found) 2026/02/09 03:58:58 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/09 03:58:58 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/09 03:58:58 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/09 03:58:58 NOTICE: test.sum: 2 warning(s) suppressed... 2026/02/09 03:58:59 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-bebibam5.sum (UUID: 02ad41ec-9751-4412-bc28-79acf8bddf5e) 2026/02/09 03:58:59 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-bebibam5.sum (UUID: 02ad41ec-9751-4412-bc28-79acf8bddf5e) 2026/02/09 03:59:00 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file 2026/02/09 03:59:00 NOTICE: test.sum: improperly formatted checksum line 4 2026/02/09 03:59:00 NOTICE: test.sum: improperly formatted checksum line 5 2026/02/09 03:59:00 NOTICE: test.sum: improperly formatted checksum line 6 2026/02/09 03:59:00 NOTICE: test.sum: 2 warning(s) suppressed... --- PASS: TestParseSumFile (5.66s) === RUN TestCheckSum run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" 2026/02/09 03:59:01 DEBUG : Creating backend with remote "TestInternxt:rclone-test-sohorok8kimo/data" 2026/02/09 03:59:01 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 check_test.go:350: Internxt root 'rclone-test-sohorok8kimo/data' lacks md5, skipping --- SKIP: TestCheckSum (1.39s) === RUN TestCheckSumDownload run.go:185: Remote "Internxt root 'rclone-test-sohorok8kimo'", Local "Local file system at /tmp/rclone2821405687", Modify Window "876000h0m0s" 2026/02/09 03:59:02 DEBUG : Creating backend with remote "TestInternxt:rclone-test-sohorok8kimo/data" 2026/02/09 03:59:03 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSumDownload/subtest1 2026/02/09 03:59:16 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-quverad4.sum (UUID: e7247b8f-8414-45b4-acae-99319e1a4ec1) 2026/02/09 03:59:17 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-quverad4.sum (UUID: e7247b8f-8414-45b4-acae-99319e1a4ec1) 2026/02/09 03:59:17 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file === RUN TestCheckSumDownload/subtest2 2026/02/09 03:59:19 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-qirojob8.sum (UUID: e1590086-3fe3-43c6-87f3-472c61c641c7) 2026/02/09 03:59:20 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-qirojob8.sum (UUID: e1590086-3fe3-43c6-87f3-472c61c641c7) 2026/02/09 03:59:20 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file === RUN TestCheckSumDownload/subtest3 2026/02/09 03:59:22 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-rekilax3.sum (UUID: 2fc2d60c-f04f-4bd0-9e18-479492d9ba9d) 2026/02/09 03:59:23 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-rekilax3.sum (UUID: 2fc2d60c-f04f-4bd0-9e18-479492d9ba9d) 2026/02/09 03:59:23 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSumDownload/subtest4 2026/02/09 03:59:33 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-yafixid5.sum (UUID: f2bfb724-774d-4ea3-a6c3-f0d39bb31bbb) 2026/02/09 03:59:33 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-yafixid5.sum (UUID: f2bfb724-774d-4ea3-a6c3-f0d39bb31bbb) 2026/02/09 03:59:34 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSumDownload/subtest5 2026/02/09 03:59:43 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-gageyet8.sum (UUID: c46313d0-4c8e-441d-8581-572b80f51744) 2026/02/09 03:59:44 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-gageyet8.sum (UUID: c46313d0-4c8e-441d-8581-572b80f51744) 2026/02/09 03:59:44 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file === RUN TestCheckSumDownload/subtest6 2026/02/09 03:59:46 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file data/banana to backup banana.rclone-backup-wigicim1. (UUID: bdc0871b-f59d-4706-8b16-6bbf90cccf18) 2026/02/09 03:59:47 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file banana.rclone-backup-wigicim1. (UUID: bdc0871b-f59d-4706-8b16-6bbf90cccf18) 2026/02/09 03:59:47 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file 2026/02/09 03:59:48 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file data/potato to backup potato.rclone-backup-kumezil0. (UUID: 2572e15c-6dad-47f8-8585-22dd02a6e572) 2026/02/09 03:59:49 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file potato.rclone-backup-kumezil0. (UUID: 2572e15c-6dad-47f8-8585-22dd02a6e572) 2026/02/09 03:59:49 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file 2026/02/09 03:59:49 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Renamed existing file test.sum to backup test.rclone-backup-lifoboj3.sum (UUID: ffe6743b-f42a-44bc-adef-b413bfab9f33) 2026/02/09 03:59:50 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Upload succeeded, deleting backup file test.rclone-backup-lifoboj3.sum (UUID: ffe6743b-f42a-44bc-adef-b413bfab9f33) 2026/02/09 03:59:50 DEBUG : Internxt root 'rclone-test-sohorok8kimo': Successfully deleted backup file === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 6s just to make sure === RUN TestCheckSumDownload/subtest7 2026/02/09 04:00:02 ERROR : data: error listing: directory not found === NAME TestCheckSumDownload fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 6s just to make sure --- PASS: TestCheckSumDownload (66.91s) --- PASS: TestCheckSumDownload/subtest1 (1.35s) --- PASS: TestCheckSumDownload/subtest2 (0.95s) --- PASS: TestCheckSumDownload/subtest3 (1.07s) --- PASS: TestCheckSumDownload/subtest4 (1.21s) --- PASS: TestCheckSumDownload/subtest5 (1.01s) --- PASS: TestCheckSumDownload/subtest6 (1.22s) --- PASS: TestCheckSumDownload/subtest7 (1.25s) === RUN TestApplyTransforms 2026/02/09 04:00:09 DEBUG : Creating backend with remote "TestInternxt:rclone-test-ruzahus2rega" 2026/02/09 04:00:09 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/09 04:00:10 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/02/09 04:00:10 DEBUG : Creating backend with remote "/tmp/rclone1868401013" run.go:185: Remote "Internxt root 'rclone-test-ruzahus2rega'", Local "Local file system at /tmp/rclone1868401013", Modify Window "876000h0m0s" upper checkfile vs. lower remote (without normalization) 2026/02/09 04:00:12 ERROR : hello, world!: sum not found 2026/02/09 04:00:12 ERROR : HELLO, WORLD!: file not in Internxt root 'rclone-test-ruzahus2rega' 2026/02/09 04:00:12 NOTICE: Internxt root 'rclone-test-ruzahus2rega': 1 files missing 2026/02/09 04:00:12 NOTICE: 1 hashes missing 2026/02/09 04:00:12 NOTICE: Internxt root 'rclone-test-ruzahus2rega': 1 differences found 2026/02/09 04:00:12 NOTICE: Internxt root 'rclone-test-ruzahus2rega': 2 errors while checking upper checkfile vs. lower remote (with normalization) 2026/02/09 04:00:13 DEBUG : hello, world!: md5 = 65a8e27d8879283831b664bd8b7f0ad4 OK 2026/02/09 04:00:13 NOTICE: Internxt root 'rclone-test-ruzahus2rega': 0 differences found 2026/02/09 04:00:13 NOTICE: Internxt root 'rclone-test-ruzahus2rega': 1 matching files 2026/02/09 04:00:13 DEBUG : Creating backend with remote "TestInternxt:rclone-test-soloxub7baze" 2026/02/09 04:00:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/02/09 04:00:13 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/02/09 04:00:13 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/02/09 04:00:14 DEBUG : pacer: low level retry 2/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/02/09 04:00:14 DEBUG : pacer: low level retry 3/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/02/09 04:00:14 DEBUG : pacer: low level retry 4/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/02/09 04:00:14 DEBUG : pacer: low level retry 5/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/02/09 04:00:14 DEBUG : pacer: low level retry 6/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/02/09 04:00:14 DEBUG : pacer: low level retry 7/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/02/09 04:00:15 DEBUG : pacer: low level retry 8/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:15 DEBUG : pacer: Rate limited, increasing sleep to 2s 2026/02/09 04:00:16 DEBUG : pacer: low level retry 9/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:18 DEBUG : pacer: low level retry 10/10 (error failed to list all folders at offset 0: failed to execute list folders request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/folders?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:20 DEBUG : pacer: low level retry 1/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:22 DEBUG : pacer: low level retry 2/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:24 DEBUG : pacer: low level retry 3/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:26 DEBUG : pacer: low level retry 4/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:28 DEBUG : pacer: low level retry 5/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:30 DEBUG : pacer: low level retry 6/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:32 DEBUG : pacer: low level retry 7/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:34 DEBUG : pacer: low level retry 8/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:36 DEBUG : pacer: low level retry 9/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:38 DEBUG : pacer: low level retry 10/10 (error failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused) 2026/02/09 04:00:38 NOTICE: Failed to open remote "TestInternxt:": failed to list all files at offset 0: failed to execute list files request: Get "https://backend.internxt.com/api/folders/content/2661cf64-e104-478b-b737-48c3ac8984d2/files?limit=50&offset=0&order=ASC&sort=plainName": dial tcp 37.59.19.148:443: connect: connection refused "./operations.test -test.v -test.timeout 1h0m0s -remote TestInternxt: -verbose" - Finished ERROR in 2m18.048860384s (try 1/5): exit status 1: Failed []