"./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestCopyFileBackupDir|TestDirMove|TestMoveFileBackupDir|TestPurge|TestRcatSize|TestRmdirsLeaveRoot|TestRmdirsNoLeaveRoot|TestRmdirsWithFilter)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$|^TestRcatSizeChecksum$/^SizeDiffers$'" - Starting (try 2/5) 2026/09/20 04:22:14 DEBUG : Creating backend with remote "TestInternxt:rclone-test-dawepek6redo" 2026/09/20 04:22:14 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/20 04:22:14 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/20 04:22:14 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/20 04:22:14 DEBUG : TestInternxt: Saved new token in config file 2026/09/20 04:22:14 DEBUG : Internxt root 'rclone-test-dawepek6redo': Persisted rotated token from user info, expiry: 2026-09-27 04:22:14 +0000 UTC 2026/09/20 04:22:16 DEBUG : Creating backend with remote "/tmp/rclone3029328377" === RUN TestMultithreadCopy run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/09/20 04:22:17 NOTICE: Internxt root 'rclone-test-dawepek6redo': Multipart upload aborted for chunksize-probe === RUN TestMultithreadCopy/upload=true,size=62914560,streams=2 2026/09/20 04:22:22 DEBUG : test-multithread-copy-true-62914560-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:226: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) === RUN TestMultithreadCopy/upload=true,size=62914561,streams=2 fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:306: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:306 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:194 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: listing wrong, want test-multithread-copy-true-62914561-2 (62914561) got test-multithread-copy-true-62914560-2 (62914560), test-multithread-copy-true-62914561-2 (62914561) fstest.go:192: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:192 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:309 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:194 /usr/local/go/src/runtime/asm_amd64.s:1264 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: Unexpected file "test-multithread-copy-true-62914560-2" 2026/09/20 04:22:59 DEBUG : test-multithread-copy-true-62914561-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:226: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) --- FAIL: TestMultithreadCopy (43.95s) --- SKIP: TestMultithreadCopy/upload=true,size=62914560,streams=2 (5.38s) --- FAIL: TestMultithreadCopy/upload=true,size=62914561,streams=2 (36.43s) === RUN TestCopyFileBackupDir run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:23:02 DEBUG : Creating backend with remote "TestInternxt:rclone-test-dawepek6redo/backup" 2026/09/20 04:23:02 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/20 04:23:02 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/20 04:23:02 DEBUG : TestInternxt: Saved new token in config file 2026/09/20 04:23:02 DEBUG : Internxt root 'rclone-test-dawepek6redo/backup': Persisted rotated token from user info, expiry: 2026-09-27 04:23:02 +0000 UTC 2026/09/20 04:23:03 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone3029328377) 2026/09/20 04:23:03 DEBUG : dst/file1: size = 18 (Internxt root 'rclone-test-dawepek6redo') 2026/09/20 04:23:03 DEBUG : dst/file1: Sizes differ 2026/09/20 04:23:06 ERROR : dst/file1: Couldn't move: move file: Not Found (status 404) copy_test.go:186: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:186 Error: Received unexpected error: moving to --backup-dir failed: move file: Not Found (status 404) Test: TestCopyFileBackupDir run.go:186: removing dir "backup" failed - try 1/5: sleeping 1s: directory not empty 2026/09/20 04:23:10 ERROR : backup: error listing: directory not found fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- FAIL: TestCopyFileBackupDir (17.46s) === RUN TestPurge 2026/09/20 04:23:18 DEBUG : Creating backend with remote "TestInternxt:rclone-test-kulenul7rayu" 2026/09/20 04:23:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/20 04:23:18 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/20 04:23:18 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/20 04:23:18 DEBUG : TestInternxt: Saved new token in config file 2026/09/20 04:23:18 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Persisted rotated token from user info, expiry: 2026-09-27 04:23:18 +0000 UTC 2026/09/20 04:23:19 DEBUG : Creating backend with remote "/tmp/rclone4106174306" run.go:198: Remote "Internxt root 'rclone-test-kulenul7rayu'", Local "Local file system at /tmp/rclone4106174306", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/09/20 04:23:23 INFO : A2: Making directory 2026/09/20 04:23:23 INFO : A1/B2: Making directory 2026/09/20 04:23:24 INFO : A1/B2/C2: Making directory 2026/09/20 04:23:24 INFO : A1/B1/C3: Making directory 2026/09/20 04:23:25 INFO : A3: Making directory 2026/09/20 04:23:25 INFO : A3/B3: Making directory 2026/09/20 04:23:26 INFO : A3/B3/C4: Making directory 2026/09/20 04:23:28 DEBUG : Waiting for deletions to finish 2026/09/20 04:23:29 INFO : A1/B1/C1/one: Deleted 2026/09/20 04:23:30 DEBUG : removing 2 level 3 directories 2026/09/20 04:23:30 INFO : A1/B1/C3: Removing directory 2026/09/20 04:23:30 INFO : A1/B1/C1: Removing directory 2026/09/20 04:23:30 DEBUG : removing 1 level 2 directories 2026/09/20 04:23:30 INFO : A1/B1: Removing directory 2026/09/20 04:23:30 ERROR : A1/B1: Failed to rmdir: directory not empty operations_test.go:615: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:615 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestPurge 2026/09/20 04:23:31 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge object "A1/two" 2026/09/20 04:23:31 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A3/B3/C4" 2026/09/20 04:23:32 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A3/B3" 2026/09/20 04:23:32 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A3" 2026/09/20 04:23:32 NOTICE: purge failed to rmdir "A3": directory not empty 2026/09/20 04:23:32 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A2" 2026/09/20 04:23:33 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A1/B2/C2" 2026/09/20 04:23:33 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A1/B2" 2026/09/20 04:23:33 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A1/B1" 2026/09/20 04:23:34 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "A1" 2026/09/20 04:23:34 DEBUG : Internxt root 'rclone-test-kulenul7rayu': Purge dir "" 2026/09/20 04:23:34 NOTICE: purge failed to rmdir "": directory not empty --- FAIL: TestPurge (16.56s) === RUN TestRmdirsNoLeaveRoot run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:23:37 INFO : A2: Making directory 2026/09/20 04:23:37 INFO : A1/B2: Making directory 2026/09/20 04:23:37 INFO : A1/B2/C2: Making directory 2026/09/20 04:23:38 INFO : A1/B1/C3: Making directory 2026/09/20 04:23:38 INFO : A3: Making directory 2026/09/20 04:23:39 INFO : A3/B3: Making directory 2026/09/20 04:23:39 INFO : A3/B3/C4: Making directory 2026/09/20 04:23:45 DEBUG : removing 1 level 3 directories 2026/09/20 04:23:45 INFO : A3/B3/C4: Removing directory 2026/09/20 04:23:48 DEBUG : removing 2 level 3 directories 2026/09/20 04:23:48 INFO : A1/B2/C2: Removing directory 2026/09/20 04:23:48 INFO : A1/B1/C3: Removing directory 2026/09/20 04:23:49 DEBUG : removing 2 level 2 directories 2026/09/20 04:23:49 INFO : A3/B3: Removing directory 2026/09/20 04:23:49 INFO : A1/B2: Removing directory 2026/09/20 04:23:49 DEBUG : removing 2 level 1 directories 2026/09/20 04:23:49 INFO : A3: Removing directory 2026/09/20 04:23:49 INFO : A2: Removing directory 2026/09/20 04:23:49 ERROR : A3: Failed to rmdir: directory not empty operations_test.go:709: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:709 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestRmdirsNoLeaveRoot 2026/09/20 04:23:50 ERROR : A2: error listing: directory not found --- FAIL: TestRmdirsNoLeaveRoot (18.54s) === RUN TestRmdirsLeaveRoot run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:23:53 INFO : A1: Making directory 2026/09/20 04:23:53 INFO : A1/B1: Making directory 2026/09/20 04:23:53 INFO : A1/B1/C1: Making directory fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:302: Flushing the directory cache fstest.go:328: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:328 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:754 Error: Not equal: expected: []string{"A1", "A1/B1", "A1/B1/C1"} actual : []string{"A1", "A1/B1", "A1/B1/C1", "A3"} Diff: --- Expected +++ Actual @@ -1,5 +1,6 @@ -([]string) (len=3) { +([]string) (len=4) { (string) (len=2) "A1", (string) (len=5) "A1/B1", - (string) (len=8) "A1/B1/C1" + (string) (len=8) "A1/B1/C1", + (string) (len=2) "A3" } Test: TestRmdirsLeaveRoot Messages: directories 2026/09/20 04:24:36 DEBUG : removing 1 level 3 directories 2026/09/20 04:24:36 INFO : A1/B1/C1: Removing directory 2026/09/20 04:24:36 DEBUG : removing 1 level 2 directories 2026/09/20 04:24:36 INFO : A1/B1: Removing directory 2026/09/20 04:24:36 ERROR : A1/B1: Failed to rmdir: directory not empty operations_test.go:766: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:766 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestRmdirsLeaveRoot run.go:186: removing dir "A1" failed - try 1/5: sleeping 1s: directory not empty --- FAIL: TestRmdirsLeaveRoot (46.46s) === RUN TestRmdirsWithFilter run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:24:39 INFO : A1: Making directory 2026/09/20 04:24:40 INFO : A1/B1: Making directory 2026/09/20 04:24:40 INFO : A1/B1/C1: Making directory 2026/09/20 04:24:46 DEBUG : removing 1 level 3 directories 2026/09/20 04:24:46 INFO : A1/B1/C1: Removing directory 2026/09/20 04:24:47 DEBUG : removing 1 level 2 directories 2026/09/20 04:24:47 INFO : A1/B1: Removing directory --- PASS: TestRmdirsWithFilter (9.23s) === RUN TestMoveFileBackupDir run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:24:51 DEBUG : Creating backend with remote "TestInternxt:rclone-test-dawepek6redo/backup" 2026/09/20 04:24:51 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/20 04:24:51 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/20 04:24:51 DEBUG : TestInternxt: Saved new token in config file 2026/09/20 04:24:51 DEBUG : Internxt root 'rclone-test-dawepek6redo/backup': Persisted rotated token from user info, expiry: 2026-09-27 04:24:51 +0000 UTC 2026/09/20 04:24:52 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone3029328377) 2026/09/20 04:24:52 DEBUG : dst/file1: size = 18 (Internxt root 'rclone-test-dawepek6redo') 2026/09/20 04:24:52 DEBUG : dst/file1: Sizes differ 2026/09/20 04:24:54 INFO : dst/file1: Moved (server-side) 2026/09/20 04:25:04 DEBUG : dst/file1: size = 14 OK 2026/09/20 04:25:04 INFO : dst/file1: Copied (new) 2026/09/20 04:25:04 INFO : dst/file1: Deleted 2026/09/20 04:25:10 ERROR : backup: error listing: directory not found fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- PASS: TestMoveFileBackupDir (30.05s) === RUN TestDirMove run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:25:25 INFO : A1/B2: Making directory 2026/09/20 04:25:25 INFO : A1/B1/C3: Making directory 2026/09/20 04:25:36 INFO : A2/B1/C1/four: Moved (server-side) to: A3/B1/C1/four 2026/09/20 04:25:36 INFO : A2/one: Moved (server-side) to: A3/one 2026/09/20 04:25:36 INFO : A2/two: Moved (server-side) to: A3/two 2026/09/20 04:25:36 INFO : A2/B1/C2/five: Moved (server-side) to: A3/B1/C2/five 2026/09/20 04:25:37 INFO : A2/B1/three: Moved (server-side) to: A3/B1/three operations_test.go:1440: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1440 Error: Received unexpected error: RenameDir rmdir: directory not empty Test: TestDirMove run.go:186: removing dir "A3/B1" failed - try 1/5: sleeping 1s: directory not empty 2026/09/20 04:25:46 ERROR : A2: error listing: directory not found fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- FAIL: TestDirMove (35.51s) === RUN TestRcatSize run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:25:56 DEBUG : potato1: size = 60 OK 2026/09/20 04:25:56 DEBUG : Internxt root 'rclone-test-dawepek6redo': File to upload is small (60 bytes), uploading instead of streaming 2026/09/20 04:25:56 DEBUG : potato2: size = 60 OK 2026/09/20 04:25:56 NOTICE: Internxt root 'rclone-test-dawepek6redo': --checksum is in use but the source and destination have no hashes in common; falling back to --size-only 2026/09/20 04:25:56 DEBUG : potato2: Size of src and dst objects identical --- PASS: TestRcatSize (3.83s) === RUN TestRcatSizeChecksum === RUN TestRcatSizeChecksum/SizeDiffers run.go:198: Remote "Internxt root 'rclone-test-dawepek6redo'", Local "Local file system at /tmp/rclone3029328377", Modify Window "876000h0m0s" 2026/09/20 04:25:59 DEBUG : pacer: low level retry 1/1 (error failed to create file metadata: create meta: error code: 502 (status 502)) 2026/09/20 04:25:59 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/20 04:25:59 ERROR : potato4: Post request put error: failed to create file metadata: create meta: error code: 502 (status 502) operations_test.go:1814: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1814 Error: "failed to create file metadata: create meta: error code: 502\n (status 502)" does not contain "corrupted on transfer: sizes differ" Test: TestRcatSizeChecksum/SizeDiffers 2026/09/20 04:26:00 DEBUG : pacer: Reducing sleep to 15ms 2026/09/20 04:26:00 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/20 04:26:00 DEBUG : pacer: Reducing sleep to 10ms --- FAIL: TestRcatSizeChecksum (2.29s) --- FAIL: TestRcatSizeChecksum/SizeDiffers (2.29s) FAIL 2026/09/20 04:26:00 DEBUG : Internxt root 'rclone-test-dawepek6redo': Purge dir "" "./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestCopyFileBackupDir|TestDirMove|TestMoveFileBackupDir|TestPurge|TestRcatSize|TestRmdirsLeaveRoot|TestRmdirsNoLeaveRoot|TestRmdirsWithFilter)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$|^TestRcatSizeChecksum$/^SizeDiffers$'" - Finished ERROR in 3m47.207592021s (try 2/5): exit status 1: Failed [TestMultithreadCopy/upload=true,size=62914561,streams=2 TestCopyFileBackupDir TestPurge TestRmdirsNoLeaveRoot TestRmdirsLeaveRoot TestDirMove TestRcatSizeChecksum/SizeDiffers]