"./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestDirMove|TestMoveFileBackupDir|TestPurge)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$|^TestRcatSizeChecksum$/^IgnoreChecksum$'" - Starting (try 2/5) 2026/09/08 02:27:41 DEBUG : Creating backend with remote "TestInternxt:rclone-test-pexecoh0yesa" 2026/09/08 02:27:41 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/08 02:27:42 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/08 02:27:42 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/08 02:27:42 DEBUG : TestInternxt: Saved new token in config file 2026/09/08 02:27:42 DEBUG : Internxt root 'rclone-test-pexecoh0yesa': Persisted rotated token from user info, expiry: 2026-09-15 02:27:42 +0000 UTC 2026/09/08 02:27:43 DEBUG : Creating backend with remote "/tmp/rclone3268502933" === RUN TestMultithreadCopy run.go:198: Remote "Internxt root 'rclone-test-pexecoh0yesa'", Local "Local file system at /tmp/rclone3268502933", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/09/08 02:27:48 NOTICE: Internxt root 'rclone-test-pexecoh0yesa': Multipart upload aborted for chunksize-probe === RUN TestMultithreadCopy/upload=true,size=62914560,streams=2 2026/09/08 02:27:53 DEBUG : test-multithread-copy-true-62914560-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:225: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) === RUN TestMultithreadCopy/upload=true,size=62914561,streams=2 fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:306: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:306 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:193 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: listing wrong, want test-multithread-copy-true-62914561-2 (62914561) got test-multithread-copy-true-62914560-2 (62914560), test-multithread-copy-true-62914561-2 (62914561) fstest.go:192: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:192 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:309 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:193 /usr/local/go/src/runtime/asm_amd64.s:1264 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: Unexpected file "test-multithread-copy-true-62914560-2" 2026/09/08 02:28:30 DEBUG : test-multithread-copy-true-62914561-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:225: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) --- FAIL: TestMultithreadCopy (49.73s) --- SKIP: TestMultithreadCopy/upload=true,size=62914560,streams=2 (5.56s) --- FAIL: TestMultithreadCopy/upload=true,size=62914561,streams=2 (36.18s) === RUN TestPurge 2026/09/08 02:28:32 DEBUG : Creating backend with remote "TestInternxt:rclone-test-jofezok0yeyi" 2026/09/08 02:28:32 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/08 02:28:33 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/08 02:28:33 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/08 02:28:33 DEBUG : TestInternxt: Saved new token in config file 2026/09/08 02:28:33 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Persisted rotated token from user info, expiry: 2026-09-15 02:28:32 +0000 UTC 2026/09/08 02:28:33 DEBUG : Creating backend with remote "/tmp/rclone3184285768" run.go:198: Remote "Internxt root 'rclone-test-jofezok0yeyi'", Local "Local file system at /tmp/rclone3184285768", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/09/08 02:28:45 INFO : A2: Making directory 2026/09/08 02:28:46 INFO : A1/B2: Making directory 2026/09/08 02:28:47 DEBUG : pacer: low level retry 1/1 (error create folder: error code: 502 (status 502)) 2026/09/08 02:28:47 DEBUG : pacer: Rate limited, increasing sleep to 20ms operations_test.go:585: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:585 Error: Received unexpected error: failed to make directory: can't create folder, create folder: error code: 502 (status 502) Test: TestPurge 2026/09/08 02:28:47 DEBUG : pacer: Reducing sleep to 15ms 2026/09/08 02:28:47 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/08 02:28:47 DEBUG : pacer: Reducing sleep to 10ms 2026/09/08 02:28:49 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Purge object "A1/B1/C1/one" 2026/09/08 02:28:50 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Purge dir "A2" 2026/09/08 02:28:50 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Purge dir "A1/B1/C1" 2026/09/08 02:28:51 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Purge dir "A1/B1" 2026/09/08 02:28:53 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Purge dir "A1" 2026/09/08 02:28:53 NOTICE: purge failed to rmdir "A1": directory not empty 2026/09/08 02:28:53 DEBUG : Internxt root 'rclone-test-jofezok0yeyi': Purge dir "" 2026/09/08 02:28:53 NOTICE: purge failed to rmdir "": directory not empty --- FAIL: TestPurge (20.97s) === RUN TestMoveFileBackupDir run.go:198: Remote "Internxt root 'rclone-test-pexecoh0yesa'", Local "Local file system at /tmp/rclone3268502933", Modify Window "876000h0m0s" 2026/09/08 02:28:57 DEBUG : Creating backend with remote "TestInternxt:rclone-test-pexecoh0yesa/backup" 2026/09/08 02:28:59 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/08 02:28:59 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/08 02:28:59 DEBUG : TestInternxt: Saved new token in config file 2026/09/08 02:28:59 DEBUG : Internxt root 'rclone-test-pexecoh0yesa/backup': Persisted rotated token from user info, expiry: 2026-09-15 02:28:59 +0000 UTC 2026/09/08 02:28:59 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone3268502933) 2026/09/08 02:28:59 DEBUG : dst/file1: size = 18 (Internxt root 'rclone-test-pexecoh0yesa') 2026/09/08 02:28:59 DEBUG : dst/file1: Sizes differ 2026/09/08 02:29:05 ERROR : dst/file1: Couldn't move: move file: Not Found (status 404) operations_test.go:1079: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1079 Error: Received unexpected error: moving to --backup-dir failed: move file: Not Found (status 404) Test: TestMoveFileBackupDir --- FAIL: TestMoveFileBackupDir (17.40s) === RUN TestDirMove run.go:198: Remote "Internxt root 'rclone-test-pexecoh0yesa'", Local "Local file system at /tmp/rclone3268502933", Modify Window "876000h0m0s" 2026/09/08 02:29:13 DEBUG : pacer: low level retry 1/1 (error failed to create file metadata: create meta: error code: 502 (status 502)) 2026/09/08 02:29:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:299: Retry Put of "A1/two" to Internxt root 'rclone-test-pexecoh0yesa': 1/10 (failed to create file metadata: create meta: error code: 502 (status 502)) 2026/09/08 02:29:17 DEBUG : pacer: Reducing sleep to 15ms 2026/09/08 02:29:19 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/08 02:29:19 DEBUG : pacer: Reducing sleep to 10ms 2026/09/08 02:29:23 INFO : A1/B2: Making directory 2026/09/08 02:29:24 INFO : A1/B1/C3: Making directory 2026/09/08 02:29:41 INFO : A2/B1/three: Moved (server-side) to: A3/B1/three 2026/09/08 02:29:41 INFO : A2/two: Moved (server-side) to: A3/two 2026/09/08 02:29:41 INFO : A2/B1/C1/four: Moved (server-side) to: A3/B1/C1/four 2026/09/08 02:29:41 INFO : A2/B1/C2/five: Moved (server-side) to: A3/B1/C2/five 2026/09/08 02:29:46 INFO : A2/one: Moved (server-side) to: A3/one 2026/09/08 02:29:49 DEBUG : pacer: low level retry 1/10 (error delete folder: error code: 502 (status 502)) 2026/09/08 02:29:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/08 02:29:51 DEBUG : pacer: Reducing sleep to 15ms 2026/09/08 02:29:51 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/08 02:29:51 DEBUG : pacer: Reducing sleep to 10ms 2026/09/08 02:30:00 INFO : Internxt root 'rclone-test-pexecoh0yesa': Can't DirMove - falling back to file moves: can't move directory - incompatible remotes 2026/09/08 02:30:14 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/08 02:30:14 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/08 02:30:14 DEBUG : pacer: Reducing sleep to 15ms 2026/09/08 02:30:14 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/08 02:30:14 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/08 02:30:14 DEBUG : pacer: Rate limited, increasing sleep to 22.5ms 2026/09/08 02:30:15 DEBUG : pacer: Reducing sleep to 16.875ms 2026/09/08 02:30:15 DEBUG : pacer: Reducing sleep to 12.65625ms 2026/09/08 02:30:15 DEBUG : pacer: Reducing sleep to 10ms 2026/09/08 02:30:15 INFO : A3/one: Moved (server-side) to: A4/one 2026/09/08 02:30:15 INFO : A3/two: Moved (server-side) to: A4/two 2026/09/08 02:30:15 INFO : A3/B1/three: Moved (server-side) to: A4/B1/three 2026/09/08 02:30:15 INFO : A3/B1/C1/four: Moved (server-side) to: A4/B1/C1/four 2026/09/08 02:30:17 INFO : A3/B1/C2/five: Moved (server-side) to: A4/B1/C2/five operations_test.go:1468: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1468 Error: Received unexpected error: RenameDir rmdir: directory not empty Test: TestDirMove fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:302: Flushing the directory cache fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:302: Flushing the directory cache fstest.go:328: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:328 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1474 Error: Not equal: expected: []string{"A4", "A4/B1", "A4/B1/C1", "A4/B1/C2", "A4/B1/C3", "A4/B2"} actual : []string{"A3", "A4", "A4/B1", "A4/B1/C1", "A4/B1/C2", "A4/B1/C3", "A4/B2"} Diff: --- Expected +++ Actual @@ -1,2 +1,3 @@ -([]string) (len=6) { +([]string) (len=7) { + (string) (len=2) "A3", (string) (len=2) "A4", Test: TestDirMove Messages: directories 2026/09/08 02:31:30 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/08 02:31:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/08 02:31:30 DEBUG : pacer: Reducing sleep to 15ms 2026/09/08 02:31:30 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/08 02:31:30 DEBUG : pacer: low level retry 1/10 (error failed to list all files at offset 0: list files: error code: 502 (status 502)) 2026/09/08 02:31:30 DEBUG : pacer: Rate limited, increasing sleep to 22.5ms 2026/09/08 02:31:30 DEBUG : pacer: low level retry 2/10 (error failed to list all files at offset 0: list files: error code: 502 (status 502)) 2026/09/08 02:31:30 DEBUG : pacer: Rate limited, increasing sleep to 45ms 2026/09/08 02:31:31 DEBUG : pacer: Reducing sleep to 33.75ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 25.3125ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 18.984375ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 14.238281ms 2026/09/08 02:31:32 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/08 02:31:32 DEBUG : pacer: Rate limited, increasing sleep to 28.476562ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 21.357421ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 16.018065ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 12.013548ms 2026/09/08 02:31:32 DEBUG : pacer: Reducing sleep to 10ms run.go:186: removing dir "A4/B1" failed - try 1/5: sleeping 1s: directory not empty --- FAIL: TestDirMove (152.74s) === RUN TestRcatSizeChecksum === RUN TestRcatSizeChecksum/IgnoreChecksum run.go:198: Remote "Internxt root 'rclone-test-pexecoh0yesa'", Local "Local file system at /tmp/rclone3268502933", Modify Window "876000h0m0s" 2026/09/08 02:31:44 DEBUG : potato2: size = 60 OK --- PASS: TestRcatSizeChecksum (4.35s) --- PASS: TestRcatSizeChecksum/IgnoreChecksum (4.35s) FAIL 2026/09/08 02:31:48 DEBUG : Internxt root 'rclone-test-pexecoh0yesa': Purge dir "" "./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestDirMove|TestMoveFileBackupDir|TestPurge)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$|^TestRcatSizeChecksum$/^IgnoreChecksum$'" - Finished ERROR in 4m7.640826938s (try 2/5): exit status 1: Failed [TestMultithreadCopy/upload=true,size=62914561,streams=2 TestPurge TestMoveFileBackupDir TestDirMove]