"./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestCheckSumDownload|TestPurge|TestRmdirsLeaveRoot|TestRmdirsNoLeaveRoot|TestRmdirsWithFilter)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$'" - Starting (try 2/5) 2026/08/26 04:47:24 DEBUG : Creating backend with remote "TestInternxt:rclone-test-vogodim0cunu" 2026/08/26 04:47:24 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/08/26 04:47:25 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/08/26 04:47:25 DEBUG : Creating backend with remote "/tmp/rclone356714887" === RUN TestMultithreadCopy run.go:198: Remote "Internxt root 'rclone-test-vogodim0cunu'", Local "Local file system at /tmp/rclone356714887", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/08/26 04:47:32 NOTICE: Internxt root 'rclone-test-vogodim0cunu': Multipart upload aborted for chunksize-probe === RUN TestMultithreadCopy/upload=true,size=62914560,streams=2 2026/08/26 04:47:38 DEBUG : test-multithread-copy-true-62914560-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:225: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) === RUN TestMultithreadCopy/upload=true,size=62914561,streams=2 fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:299: Sleeping for 2s for list eventual consistency: 2/5 fstest.go:299: Sleeping for 4s for list eventual consistency: 3/5 fstest.go:299: Sleeping for 8s for list eventual consistency: 4/5 fstest.go:299: Sleeping for 16s for list eventual consistency: 5/5 fstest.go:306: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:306 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:193 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: listing wrong, want test-multithread-copy-true-62914561-2 (62914561) got test-multithread-copy-true-62914560-2 (62914560), test-multithread-copy-true-62914561-2 (62914561) fstest.go:192: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:192 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:309 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:339 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:351 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:352 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:193 /usr/local/go/src/runtime/asm_amd64.s:1771 Error: Should be true Test: TestMultithreadCopy/upload=true,size=62914561,streams=2 Messages: Unexpected file "test-multithread-copy-true-62914560-2" 2026/08/26 04:48:15 DEBUG : test-multithread-copy-true-62914561-2: multi-thread copy: disabling buffering because source is local disk multithread_test.go:225: file too small for multipart upload: multi-thread copy: failed to open chunk writer: file too small for multipart upload (minimum 104857600 bytes) --- FAIL: TestMultithreadCopy (50.37s) --- SKIP: TestMultithreadCopy/upload=true,size=62914560,streams=2 (5.72s) --- FAIL: TestMultithreadCopy/upload=true,size=62914561,streams=2 (36.58s) === RUN TestCheckSumDownload run.go:198: Remote "Internxt root 'rclone-test-vogodim0cunu'", Local "Local file system at /tmp/rclone356714887", Modify Window "876000h0m0s" 2026/08/26 04:48:15 DEBUG : Creating backend with remote "TestInternxt:rclone-test-vogodim0cunu/data" 2026/08/26 04:48:16 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 === RUN TestCheckSumDownload/subtest1 2026/08/26 04:48:25 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file test.sum to backup test.rclone-backup-luzuvit7.sum (UUID: 408fb07f-2707-4ac5-ae3b-55abc203d81d) 2026/08/26 04:48:26 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file test.rclone-backup-luzuvit7.sum (UUID: 408fb07f-2707-4ac5-ae3b-55abc203d81d) 2026/08/26 04:48:26 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file === RUN TestCheckSumDownload/subtest2 2026/08/26 04:48:29 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file test.sum to backup test.rclone-backup-homiruy0.sum (UUID: 16964c18-0332-4d6a-b31a-a01cb8547bb6) 2026/08/26 04:48:30 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file test.rclone-backup-homiruy0.sum (UUID: 16964c18-0332-4d6a-b31a-a01cb8547bb6) 2026/08/26 04:48:30 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file 2026/08/26 04:48:33 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/08/26 04:48:33 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/08/26 04:48:33 DEBUG : pacer: Reducing sleep to 15ms 2026/08/26 04:48:33 DEBUG : pacer: Reducing sleep to 11.25ms === RUN TestCheckSumDownload/subtest3 2026/08/26 04:48:35 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file test.sum to backup test.rclone-backup-podewub6.sum (UUID: 400679e3-01a5-4340-a118-e81c200d4077) 2026/08/26 04:48:36 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file test.rclone-backup-podewub6.sum (UUID: 400679e3-01a5-4340-a118-e81c200d4077) 2026/08/26 04:48:36 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file === RUN TestCheckSumDownload/subtest4 2026/08/26 04:48:38 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file test.sum to backup test.rclone-backup-hequfop1.sum (UUID: be8b336e-8dd5-4a44-b59d-91087e71ed0a) 2026/08/26 04:48:39 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file test.rclone-backup-hequfop1.sum (UUID: be8b336e-8dd5-4a44-b59d-91087e71ed0a) 2026/08/26 04:48:40 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file === RUN TestCheckSumDownload/subtest5 2026/08/26 04:48:42 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file test.sum to backup test.rclone-backup-xofoqay6.sum (UUID: b7f5790f-d364-4fbf-b91a-ed4a725c9eeb) 2026/08/26 04:48:42 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file test.rclone-backup-xofoqay6.sum (UUID: b7f5790f-d364-4fbf-b91a-ed4a725c9eeb) 2026/08/26 04:48:43 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file === RUN TestCheckSumDownload/subtest6 2026/08/26 04:48:45 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file data/banana to backup banana.rclone-backup-jutodom4. (UUID: 3f0c0690-b641-437e-8a04-ebd143fed187) 2026/08/26 04:48:46 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file banana.rclone-backup-jutodom4. (UUID: 3f0c0690-b641-437e-8a04-ebd143fed187) 2026/08/26 04:48:46 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file 2026/08/26 04:48:47 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file data/potato to backup potato.rclone-backup-zubabin4. (UUID: c2bebad2-5fa4-46a6-87a4-44263383c4ca) 2026/08/26 04:48:47 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file potato.rclone-backup-zubabin4. (UUID: c2bebad2-5fa4-46a6-87a4-44263383c4ca) 2026/08/26 04:48:48 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file 2026/08/26 04:48:48 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Renamed existing file test.sum to backup test.rclone-backup-wugimeb2.sum (UUID: a3b9bea0-649a-4efe-aeb8-2dbf32a54a89) 2026/08/26 04:48:49 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Upload succeeded, deleting backup file test.rclone-backup-wugimeb2.sum (UUID: a3b9bea0-649a-4efe-aeb8-2dbf32a54a89) 2026/08/26 04:48:49 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Successfully deleted backup file === RUN TestCheckSumDownload/subtest7 2026/08/26 04:48:54 ERROR : data: error listing: directory not found === NAME TestCheckSumDownload fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- PASS: TestCheckSumDownload (45.95s) --- PASS: TestCheckSumDownload/subtest1 (1.24s) --- PASS: TestCheckSumDownload/subtest2 (1.04s) --- PASS: TestCheckSumDownload/subtest3 (1.08s) --- PASS: TestCheckSumDownload/subtest4 (1.01s) --- PASS: TestCheckSumDownload/subtest5 (0.93s) --- PASS: TestCheckSumDownload/subtest6 (0.99s) --- PASS: TestCheckSumDownload/subtest7 (1.73s) === RUN TestPurge 2026/08/26 04:49:01 DEBUG : Creating backend with remote "TestInternxt:rclone-test-najiqah0piku" 2026/08/26 04:49:01 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/08/26 04:49:01 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/08/26 04:49:02 DEBUG : Creating backend with remote "/tmp/rclone1947678083" run.go:198: Remote "Internxt root 'rclone-test-najiqah0piku'", Local "Local file system at /tmp/rclone1947678083", Modify Window "876000h0m0s" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/08/26 04:49:10 INFO : A2: Making directory 2026/08/26 04:49:10 INFO : A1/B2: Making directory 2026/08/26 04:49:11 INFO : A1/B2/C2: Making directory 2026/08/26 04:49:12 INFO : A1/B1/C3: Making directory 2026/08/26 04:49:12 INFO : A3: Making directory 2026/08/26 04:49:13 INFO : A3/B3: Making directory 2026/08/26 04:49:14 INFO : A3/B3/C4: Making directory 2026/08/26 04:49:18 DEBUG : Waiting for deletions to finish 2026/08/26 04:49:19 INFO : A1/B1/C1/one: Deleted 2026/08/26 04:49:20 DEBUG : removing 2 level 3 directories 2026/08/26 04:49:20 INFO : A1/B1/C3: Removing directory 2026/08/26 04:49:20 INFO : A1/B1/C1: Removing directory 2026/08/26 04:49:21 DEBUG : removing 1 level 2 directories 2026/08/26 04:49:21 INFO : A1/B1: Removing directory 2026/08/26 04:49:21 ERROR : A1/B1: Failed to rmdir: directory not empty operations_test.go:612: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:612 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestPurge 2026/08/26 04:49:22 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge object "A1/two" 2026/08/26 04:49:22 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A3/B3/C4" 2026/08/26 04:49:23 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A3/B3" 2026/08/26 04:49:23 NOTICE: purge failed to rmdir "A3/B3": directory not empty 2026/08/26 04:49:23 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A3" 2026/08/26 04:49:23 NOTICE: purge failed to rmdir "A3": directory not empty 2026/08/26 04:49:23 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A2" 2026/08/26 04:49:24 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A1/B2/C2" 2026/08/26 04:49:24 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A1/B2" 2026/08/26 04:49:25 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A1/B1" 2026/08/26 04:49:27 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "A1" 2026/08/26 04:49:28 DEBUG : Internxt root 'rclone-test-najiqah0piku': Purge dir "" 2026/08/26 04:49:28 NOTICE: purge failed to rmdir "": directory not empty --- FAIL: TestPurge (26.54s) === RUN TestRmdirsNoLeaveRoot run.go:198: Remote "Internxt root 'rclone-test-vogodim0cunu'", Local "Local file system at /tmp/rclone356714887", Modify Window "876000h0m0s" 2026/08/26 04:49:31 INFO : A2: Making directory 2026/08/26 04:49:31 INFO : A1/B2: Making directory 2026/08/26 04:49:32 INFO : A1/B2/C2: Making directory 2026/08/26 04:49:33 INFO : A1/B1/C3: Making directory 2026/08/26 04:49:33 INFO : A3: Making directory 2026/08/26 04:49:33 INFO : A3/B3: Making directory 2026/08/26 04:49:34 INFO : A3/B3/C4: Making directory 2026/08/26 04:49:40 DEBUG : removing 1 level 3 directories 2026/08/26 04:49:40 INFO : A3/B3/C4: Removing directory 2026/08/26 04:49:43 DEBUG : removing 2 level 3 directories 2026/08/26 04:49:43 INFO : A1/B2/C2: Removing directory 2026/08/26 04:49:43 INFO : A1/B1/C3: Removing directory 2026/08/26 04:49:44 DEBUG : removing 2 level 2 directories 2026/08/26 04:49:44 INFO : A3/B3: Removing directory 2026/08/26 04:49:44 INFO : A1/B2: Removing directory 2026/08/26 04:49:44 DEBUG : removing 2 level 1 directories 2026/08/26 04:49:44 INFO : A3: Removing directory 2026/08/26 04:49:44 INFO : A2: Removing directory 2026/08/26 04:49:51 DEBUG : removing 1 level 3 directories 2026/08/26 04:49:51 INFO : A1/B1/C1: Removing directory 2026/08/26 04:49:51 DEBUG : removing 1 level 2 directories 2026/08/26 04:49:51 INFO : A1/B1: Removing directory 2026/08/26 04:49:52 DEBUG : removing 1 level 1 directories 2026/08/26 04:49:52 INFO : A1: Removing directory 2026/08/26 04:49:52 ERROR : A1: Failed to rmdir: directory not empty 2026/08/26 04:49:52 DEBUG : removing 1 level 0 directories 2026/08/26 04:49:52 INFO : Internxt root 'rclone-test-vogodim0cunu': Removing directory 2026/08/26 04:49:52 ERROR : Failed to rmdir: directory not empty operations_test.go:729: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:729 Error: Received unexpected error: failed to remove directories: 2 errors: last error: directory not empty Test: TestRmdirsNoLeaveRoot --- FAIL: TestRmdirsNoLeaveRoot (25.40s) === RUN TestRmdirsLeaveRoot run.go:198: Remote "Internxt root 'rclone-test-vogodim0cunu'", Local "Local file system at /tmp/rclone356714887", Modify Window "876000h0m0s" 2026/08/26 04:49:53 INFO : A1: Making directory 2026/08/26 04:49:53 INFO : A1/B1: Making directory 2026/08/26 04:49:54 INFO : A1/B1/C1: Making directory 2026/08/26 04:49:58 DEBUG : removing 1 level 3 directories 2026/08/26 04:49:58 INFO : A1/B1/C1: Removing directory 2026/08/26 04:49:58 DEBUG : removing 1 level 2 directories 2026/08/26 04:49:58 INFO : A1/B1: Removing directory 2026/08/26 04:49:58 ERROR : A1/B1: Failed to rmdir: directory not empty operations_test.go:763: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:763 Error: Received unexpected error: failed to remove directories: directory not empty Test: TestRmdirsLeaveRoot 2026/08/26 04:50:00 ERROR : A1: error listing: directory not found fstest.go:299: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:302: Flushing the directory cache fstest.go:293: Sleeping for 6s just to make sure --- FAIL: TestRmdirsLeaveRoot (14.63s) === RUN TestRmdirsWithFilter run.go:198: Remote "Internxt root 'rclone-test-vogodim0cunu'", Local "Local file system at /tmp/rclone356714887", Modify Window "876000h0m0s" 2026/08/26 04:50:08 INFO : A1: Making directory 2026/08/26 04:50:08 INFO : A1/B1: Making directory 2026/08/26 04:50:09 INFO : A1/B1/C1: Making directory 2026/08/26 04:50:12 DEBUG : removing 1 level 3 directories 2026/08/26 04:50:12 INFO : A1/B1/C1: Removing directory 2026/08/26 04:50:13 DEBUG : removing 1 level 2 directories 2026/08/26 04:50:13 INFO : A1/B1: Removing directory --- PASS: TestRmdirsWithFilter (8.10s) FAIL 2026/08/26 04:50:17 DEBUG : Internxt root 'rclone-test-vogodim0cunu': Purge dir "" "./operations.test -test.v -test.timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose -test.run '^(TestCheckSumDownload|TestPurge|TestRmdirsLeaveRoot|TestRmdirsNoLeaveRoot|TestRmdirsWithFilter)$|^TestMultithreadCopy$/^(upload=true,size=62914560,streams=2|upload=true,size=62914561,streams=2)$'" - Finished ERROR in 2m53.672429786s (try 2/5): exit status 1: Failed [TestMultithreadCopy/upload=true,size=62914561,streams=2 TestPurge TestRmdirsNoLeaveRoot TestRmdirsLeaveRoot]