"./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestCopyFileBackupDir|TestDirMove)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$'" - Starting (try 2/5) 2026/09/23 02:32:08 DEBUG : Creating backend with remote "TestInternxt:rclone-test-cudadox1tuqe" 2026/09/23 02:32:08 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/23 02:32:09 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/23 02:32:09 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/23 02:32:09 DEBUG : TestInternxt: Saved new token in config file 2026/09/23 02:32:09 DEBUG : Internxt root 'rclone-test-cudadox1tuqe': Persisted rotated token from user info, expiry: 2026-09-30 02:32:09 +0000 UTC 2026/09/23 02:32:10 DEBUG : Creating backend with remote "/tmp/rclone239110838" === RUN TestMultithreadCopy run.go:198: Remote "Internxt root 'rclone-test-cudadox1tuqe'", Local "Local file system at /tmp/rclone239110838", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/09/23 02:32:10 NOTICE: Internxt root 'rclone-test-cudadox1tuqe': Multipart upload aborted for chunksize-probe === RUN TestMultithreadCopy/upload=true,size=62914560,streams=2 2026/09/23 02:32:16 DEBUG : test-multithread-copy-true-62914560-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:226: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) === RUN TestMultithreadCopy/upload=true,size=62914561,streams=2 fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:306: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:306 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:194 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: listing wrong, want test-multithread-copy-true-62914561-2 (62914561) got test-multithread-copy-true-62914560-2 (62914560), test-multithread-copy-true-62914561-2 (62914561) fstest.go:192: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:192 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:309 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:194 /usr/local/go/src/runtime/asm_amd64.s:1264 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: Unexpected file "test-multithread-copy-true-62914560-2" 2026/09/23 02:32:52 DEBUG : test-multithread-copy-true-62914561-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:226: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) --- FAIL: TestMultithreadCopy (43.33s) --- SKIP: TestMultithreadCopy/upload=true,size=62914560,streams=2 (5.54s) --- FAIL: TestMultithreadCopy/upload=true,size=62914561,streams=2 (36.59s) === RUN TestCopyFileBackupDir run.go:198: Remote "Internxt root 'rclone-test-cudadox1tuqe'", Local "Local file system at /tmp/rclone239110838", Modify Window "876000h0m0s" 2026/09/23 02:32:55 DEBUG : Creating backend with remote "TestInternxt:rclone-test-cudadox1tuqe/backup" 2026/09/23 02:32:55 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/23 02:32:55 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/23 02:32:55 DEBUG : TestInternxt: Saved new token in config file 2026/09/23 02:32:55 DEBUG : Internxt root 'rclone-test-cudadox1tuqe/backup': Persisted rotated token from user info, expiry: 2026-09-30 02:32:55 +0000 UTC 2026/09/23 02:32:57 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone239110838) 2026/09/23 02:32:57 DEBUG : dst/file1: size = 18 (Internxt root 'rclone-test-cudadox1tuqe') 2026/09/23 02:32:57 DEBUG : dst/file1: Sizes differ 2026/09/23 02:32:58 INFO : dst/file1: Moved (server-side) 2026/09/23 02:33:01 DEBUG : Internxt root 'rclone-test-cudadox1tuqe': Renamed existing file dst/file1 to backup file1.rclone-backup-kopapot4. (UUID: 01a0cc1b-e21b-720a-965a-53b5b23153fd) 2026/09/23 02:33:01 DEBUG : Internxt root 'rclone-test-cudadox1tuqe': Upload succeeded, deleting backup file file1.rclone-backup-kopapot4. (UUID: 01a0cc1b-e21b-720a-965a-53b5b23153fd) 2026/09/23 02:33:02 DEBUG : Internxt root 'rclone-test-cudadox1tuqe': Successfully deleted backup file 2026/09/23 02:33:02 DEBUG : dst/file1: size = 14 OK 2026/09/23 02:33:02 INFO : dst/file1: Copied (new) fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:302: Flushing the directory cache 2026/09/23 02:33:32 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/23 02:33:32 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/23 02:33:32 DEBUG : pacer: Reducing sleep to 15ms 2026/09/23 02:33:32 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/23 02:33:32 DEBUG : pacer: Rate limited, increasing sleep to 30ms 2026/09/23 02:33:32 DEBUG : pacer: Reducing sleep to 22.5ms 2026/09/23 02:33:32 DEBUG : pacer: Reducing sleep to 16.875ms fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:302: Flushing the directory cache fstest.go:306: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:306 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:358 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:223 Error: Should be true Test: TestCopyFileBackupDir Messages: listing wrong, want backup/dst/file1 (18), dst/file1 (14) got dst/file1 (14) fstest.go:204: Not found "backup/dst/file1" fstest.go:207: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:207 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:311 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:358 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:223 /usr/local/go/src/runtime/asm_amd64.s:1264 Error: Not equal: expected: 0 actual : 1 Test: TestCopyFileBackupDir Messages: 1 objects not found 2026/09/23 02:33:49 DEBUG : pacer: Reducing sleep to 12.65625ms 2026/09/23 02:33:49 DEBUG : pacer: Reducing sleep to 10ms run.go:186: removing dir "backup" failed - try 1/5: sleeping 1s: directory not empty --- FAIL: TestCopyFileBackupDir (63.54s) === RUN TestDirMove run.go:198: Remote "Internxt root 'rclone-test-cudadox1tuqe'", Local "Local file system at /tmp/rclone239110838", Modify Window "876000h0m0s" 2026/09/23 02:34:03 INFO : A1/B2: Making directory 2026/09/23 02:34:04 INFO : A1/B1/C3: Making directory 2026/09/23 02:34:12 INFO : A2/B1/C1/four: Moved (server-side) to: A3/B1/C1/four 2026/09/23 02:34:12 INFO : A2/B1/C2/five: Moved (server-side) to: A3/B1/C2/five 2026/09/23 02:34:12 INFO : A2/one: Moved (server-side) to: A3/one 2026/09/23 02:34:12 INFO : A2/B1/three: Moved (server-side) to: A3/B1/three 2026/09/23 02:34:12 INFO : A2/two: Moved (server-side) to: A3/two operations_test.go:1618: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1618 Error: Received unexpected error: RenameDir rmdir: directory not empty Test: TestDirMove run.go:186: removing dir "A3/B1" failed - try 1/5: sleeping 1s: directory not empty 2026/09/23 02:34:24 ERROR : A2: error listing: directory not found fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- FAIL: TestDirMove (34.89s) FAIL 2026/09/23 02:34:32 DEBUG : Internxt root 'rclone-test-cudadox1tuqe': Purge dir "" "./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestCopyFileBackupDir|TestDirMove)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$'" - Finished ERROR in 2m23.609566176s (try 2/5): exit status 1: Failed [TestMultithreadCopy/upload=true,size=62914561,streams=2 TestCopyFileBackupDir TestDirMove]