"go test -v -timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose" - Starting (try 1/5) === RUN TestSplitJoinNameExt --- PASS: TestSplitJoinNameExt (0.00s) === RUN TestFindFile === RUN TestFindFile/split_as_rclone_splits_it === RUN TestFindFile/whole_name_stored_as_plainName_by_another_client === RUN TestFindFile/extensionless_name_is_not_confused_with_an_extended_one === RUN TestFindFile/dotfile_stored_the_way_the_web_client_splits_it === RUN TestFindFile/dotfile_stored_the_way_older_rclone_versions_split_it === RUN TestFindFile/trailing_dot_kept_in_plainName_by_a_rename === RUN TestFindFile/missing_file --- PASS: TestFindFile (0.07s) --- PASS: TestFindFile/split_as_rclone_splits_it (0.01s) --- PASS: TestFindFile/whole_name_stored_as_plainName_by_another_client (0.01s) --- PASS: TestFindFile/extensionless_name_is_not_confused_with_an_extended_one (0.01s) --- PASS: TestFindFile/dotfile_stored_the_way_the_web_client_splits_it (0.01s) --- PASS: TestFindFile/dotfile_stored_the_way_older_rclone_versions_split_it (0.01s) --- PASS: TestFindFile/trailing_dot_kept_in_plainName_by_a_rename (0.01s) --- PASS: TestFindFile/missing_file (0.00s) === RUN TestFindFileIgnoresStale --- PASS: TestFindFileIgnoresStale (0.03s) === RUN TestIntegration fstests.go:464: Using remote "TestInternxt:" 2026/09/28 01:53:13 DEBUG : Creating backend with remote "TestInternxt:rclone-test-kufudek0nuju" 2026/09/28 01:53:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/09/28 01:53:13 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:53:13 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:53:13 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:53:13 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Persisted rotated token from user info, expiry: 2026-10-05 01:53:13 +0000 UTC === RUN TestIntegration/FsCheckWrap fstests.go:505: Not a wrapping Fs === RUN TestIntegration/FsCommand fstests.go:533: No commands in this remote === RUN TestIntegration/FsRmdirNotFound === RUN TestIntegration/FsString === RUN TestIntegration/FsName === RUN TestIntegration/FsRoot === RUN TestIntegration/FsRmdirEmpty === RUN TestIntegration/FsMkdir === RUN TestIntegration/FsMkdir/FsMkdirRmdirSubdir 2026/09/28 01:53:19 INFO : dir/subdir: Making directory 2026/09/28 01:53:24 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/28 01:53:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:53:24 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 01:53:24 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 01:53:25 DEBUG : pacer: Reducing sleep to 10ms 2026/09/28 01:53:26 INFO : dir/subdir: Removing directory 2026/09/28 01:53:29 INFO : dir: Removing directory === RUN TestIntegration/FsMkdir/FsListEmpty === RUN TestIntegration/FsMkdir/FsListDirEmpty === RUN TestIntegration/FsMkdir/FsListRDirEmpty fstests.go:425: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsListDirNotFound 2026/09/28 01:53:31 ERROR : does not exist: error listing: directory not found === RUN TestIntegration/FsMkdir/FsListRDirNotFound fstests.go:425: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsEncoding === RUN TestIntegration/FsMkdir/FsEncoding/control_chars fstests.go:734: testing "␀␁␂␃␄␅␆␇␈␉␊␋␌␍␎␏␐␑␒␓␔␕␖␗␘␙␚␛␜␝␞␟␡" FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } 2026/09/28 01:53:36 DEBUG : pacer: low level retry 1/1 (error failed to create file metadata: create meta: error code: 502 (status 502)) 2026/09/28 01:53:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms fstests.go:148: Put error: failed to create file metadata: create meta: error code: 502 (status 502) - low level retry 1/10 2026/09/28 01:53:38 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 01:53:39 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 01:53:39 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsEncoding/dot fstests.go:734: testing "." === RUN TestIntegration/FsMkdir/FsEncoding/dot_dot fstests.go:734: testing ".." === RUN TestIntegration/FsMkdir/FsEncoding/punctuation fstests.go:734: testing "!\"#$%&'()*+,-./:;<=>?@[\\]^_`{|}~" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/leading_space fstests.go:734: testing " leading space" === RUN TestIntegration/FsMkdir/FsEncoding/leading_tilde fstests.go:734: testing "~leading tilde" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/leading_CR fstests.go:734: testing "␍leading CR" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/leading_LF fstests.go:734: testing "␊leading LF" 2026/09/28 01:54:30 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/28 01:54:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:54:30 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 01:54:31 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 01:54:31 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsEncoding/leading_HT fstests.go:734: testing "␉leading HT" === RUN TestIntegration/FsMkdir/FsEncoding/leading_VT fstests.go:734: testing "␋leading VT" === RUN TestIntegration/FsMkdir/FsEncoding/leading_dot fstests.go:734: testing ".leading dot" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/trailing_space fstests.go:734: testing "trailing space " fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/trailing_CR fstests.go:734: testing "trailing CR␍" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_LF fstests.go:734: testing "trailing LF␊" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_HT fstests.go:734: testing "trailing HT␉" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_VT fstests.go:734: testing "trailing VT␋" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/trailing_dot fstests.go:734: testing "trailing dot." fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8 fstests.go:734: testing "invalid utf-8\xfe" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsEncoding/URL_encoding fstests.go:734: testing "test%46.txt" fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 01:55:43 DEBUG : pacer: low level retry 1/10 (error delete file: error code: 502 (status 502)) 2026/09/28 01:55:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:55:43 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 01:55:43 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 01:55:43 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsNewObjectNotFound === RUN TestIntegration/FsMkdir/FsPutError === RUN TestIntegration/FsMkdir/FsPutZeroLength fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsOpenWriterAt fstests.go:813: FS has no OpenWriterAt interface === RUN TestIntegration/FsMkdir/FsOpenChunkWriter fstests.go:858: file too small for multipart upload: file too small for multipart upload (minimum 104857600 bytes) === RUN TestIntegration/FsMkdir/FsChangeNotify fstests.go:899: FS has no ChangeNotify interface === RUN TestIntegration/FsMkdir/FsPutFiles fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 01:56:01 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Renamed existing file file name.txt to backup file name.rclone-backup-sufekuc9.txt (UUID: 01a0e5b9-c06e-732d-bbbb-a1fad9c3d0d3) 2026/09/28 01:56:02 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Upload succeeded, deleting backup file file name.rclone-backup-sufekuc9.txt (UUID: 01a0e5b9-c06e-732d-bbbb-a1fad9c3d0d3) 2026/09/28 01:56:02 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Successfully deleted backup file === RUN TestIntegration/FsMkdir/FsPutFiles/FsListDirFile2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRDirFile2 fstests.go:425: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsListR === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir === RUN TestIntegration/FsMkdir/FsPutFiles/FsListDirRoot 2026/09/28 01:56:16 DEBUG : Creating backend with remote "TestInternxt:" 2026/09/28 01:56:16 DEBUG : Config file has changed externally - reloading 2026/09/28 01:56:16 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:56:16 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:56:16 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:56:16 DEBUG : Internxt root '': Persisted rotated token from user info, expiry: 2026-10-05 01:56:16 +0000 UTC === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRDirRoot fstests.go:425: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsListSubdir === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir#01 fstests.go:425: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsListLevel2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRLevel2 fstests.go:425: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsListFile1 === RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObject === RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObjectCaseInsensitive fstests.go:1152: Not Case Insensitive === RUN TestIntegration/FsMkdir/FsPutFiles/FsListFile1and2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObjectDir === RUN TestIntegration/FsMkdir/FsPutFiles/FsPurge fstests.go:1184: FS has no Purge interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot fstests.go:1221: FS has no Purge interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRootedSubdir 2026/09/28 01:56:25 DEBUG : Creating backend with remote "TestInternxt:rclone-test-kufudek0nuju/hello? sausage/êé" 2026/09/28 01:56:25 DEBUG : Config file has changed externally - reloading 2026/09/28 01:56:25 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:56:25 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:56:25 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:56:25 DEBUG : Internxt root 'rclone-test-kufudek0nuju/hello? sausage/êé': Persisted rotated token from user info, expiry: 2026-10-05 01:56:25 +0000 UTC FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 01:56:38 DEBUG : Waiting for deletions to finish 2026/09/28 01:56:41 INFO : a/b/c/d/e.txt: Deleted 2026/09/28 01:56:43 DEBUG : removing 1 level 4 directories 2026/09/28 01:56:43 INFO : a/b/c/d: Removing directory 2026/09/28 01:56:44 DEBUG : removing 1 level 3 directories 2026/09/28 01:56:44 INFO : a/b/c: Removing directory 2026/09/28 01:56:44 DEBUG : removing 1 level 2 directories 2026/09/28 01:56:44 INFO : a/b: Removing directory 2026/09/28 01:56:44 DEBUG : removing 1 level 1 directories 2026/09/28 01:56:44 INFO : a: Removing directory === RUN TestIntegration/FsMkdir/FsPutFiles/FsCopy fstests.go:1285: FS has no Copier interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsMove 2026/09/28 01:56:49 DEBUG : pacer: low level retry 1/10 (error move file: Not Found (status 404)) 2026/09/28 01:56:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:56:49 DEBUG : pacer: low level retry 2/10 (error move file: Not Found (status 404)) 2026/09/28 01:56:49 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/09/28 01:56:49 DEBUG : pacer: Reducing sleep to 30ms 2026/09/28 01:56:49 DEBUG : pacer: Reducing sleep to 22.5ms 2026/09/28 01:56:50 DEBUG : pacer: Reducing sleep to 16.875ms 2026/09/28 01:56:50 DEBUG : pacer: Reducing sleep to 12.65625ms 2026/09/28 01:56:50 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsPutFiles/FsMove/Metadata fstests.go:1437: Skipping test as can't write metadata === RUN TestIntegration/FsMkdir/FsPutFiles/FsDirMove 2026/09/28 01:56:58 DEBUG : Creating backend with remote "TestInternxt:rclone-test-dawoqih2xuba" 2026/09/28 01:56:58 DEBUG : Config file has changed externally - reloading 2026/09/28 01:56:58 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:56:58 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:56:58 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:56:58 DEBUG : Internxt root 'rclone-test-dawoqih2xuba': Persisted rotated token from user info, expiry: 2026-10-05 01:56:58 +0000 UTC 2026/09/28 01:57:21 DEBUG : Internxt root 'rclone-test-dawoqih2xuba': Purge dir "new_name" 2026/09/28 01:57:24 DEBUG : Internxt root 'rclone-test-dawoqih2xuba': Purge dir "" === RUN TestIntegration/FsMkdir/FsPutFiles/FsRmdirFull === RUN TestIntegration/FsMkdir/FsPutFiles/FsPrecision === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectString === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectFs === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectRemote === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectHashes === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectModTime === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMimeType fstests.go:1633: MimeType method not supported === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMetadata fstests.go:1664: Metadata method not supported === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSetMetadata fstests.go:1735: SetMetadata method not supported === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSetModTime fstests.go:1792: can't set modified time === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSize === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpen === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenSeek === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenRange === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectPartialRead === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/full_read === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/seek_read === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/range_read === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/range_read_to_end === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/refresh === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectUpdate 2026/09/28 01:57:43 DEBUG : pacer: low level retry 1/10 (error rename file: error code: 502 (status 502)) 2026/09/28 01:57:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:57:43 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 01:57:43 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Renamed existing file file name.txt to backup file name.rclone-backup-nixuwis1.txt (UUID: 01a0e5b9-eced-7675-874b-ae4669398c1a) 2026/09/28 01:57:44 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 01:57:44 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Upload succeeded, deleting backup file file name.rclone-backup-nixuwis1.txt (UUID: 01a0e5b9-eced-7675-874b-ae4669398c1a) 2026/09/28 01:57:44 DEBUG : pacer: Reducing sleep to 10ms 2026/09/28 01:57:44 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Successfully deleted backup file === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectStorable === RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFile 2026/09/28 01:57:45 DEBUG : Creating backend with remote "TestInternxt:rclone-test-kufudek0nuju/hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt" 2026/09/28 01:57:45 DEBUG : Config file has changed externally - reloading 2026/09/28 01:57:45 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:57:45 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:57:45 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:57:45 DEBUG : Internxt root 'rclone-test-kufudek0nuju/hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt': Persisted rotated token from user info, expiry: 2026-10-05 01:57:45 +0000 UTC === RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFile/FsRoot === RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFileNotFound 2026/09/28 01:57:50 DEBUG : Creating backend with remote "TestInternxt:rclone-test-kufudek0nuju/not found.txt" 2026/09/28 01:57:50 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:57:50 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:57:50 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:57:50 DEBUG : Internxt root 'rclone-test-kufudek0nuju/not found.txt': Persisted rotated token from user info, expiry: 2026-10-05 01:57:50 +0000 UTC 2026/09/28 01:57:51 ERROR : error listing: directory not found === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot fstests.go:1994: Opening root remote "TestInternxt:" path "rclone-test-kufudek0nuju" from "TestInternxt:rclone-test-kufudek0nuju" 2026/09/28 01:57:51 DEBUG : Creating backend with remote "TestInternxt:" 2026/09/28 01:57:51 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 01:57:51 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 01:57:51 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 01:57:51 DEBUG : Internxt root '': Persisted rotated token from user info, expiry: 2026-10-05 01:57:51 +0000 UTC === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/List 2026/09/28 01:57:59 DEBUG : pacer: low level retry 1/10 (error failed to list all folders at offset 0: list folders: error code: 502 (status 502)) 2026/09/28 01:57:59 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:57:59 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 01:57:59 DEBUG : pacer: Reducing sleep to 11.25ms === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListEntries 2026/09/28 01:57:59 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListR fstests.go:2031: FS has no ListR interface === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/Put FileLimitsResponse { "maxUploadFileSize": 107374182400, "versioning": { "enabled": true, "maxFileSize": 20971520, "retentionDays": 30, "maxVersions": 20 } } === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/Put/Remove 2026/09/28 01:58:16 DEBUG : pacer: low level retry 1/10 (error failed to list all files at offset 0: list files: error code: 502 (status 502)) 2026/09/28 01:58:16 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 01:58:16 DEBUG : pacer: Reducing sleep to 15ms === RUN TestIntegration/FsMkdir/FsPutFiles/PublicLink fstests.go:2090: FS has no PublicLinker interface === RUN TestIntegration/FsMkdir/FsPutFiles/SetTier fstests.go:438: FS has no SetTier & GetTier interfaces === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectCheckWrap fstests.go:2195: Not a wrapping Fs === RUN TestIntegration/FsMkdir/FsPutFiles/Bucket fstests.go:2211: Not a bucket based backend === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectRemove === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectAbout === RUN TestIntegration/FsMkdir/FsPutFiles/FsPutStream fstests.go:2385: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutFiles/Internal fstests.go:2431: *internxt.Fs does not implement InternalTester === RUN TestIntegration/FsMkdir/FsPutChunked === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi/104857601 2026/09/28 01:58:27 DEBUG : chunked-100Mi-100.000Mi.bin: multipart upload: starting chunk 0 size 100Mi offset 0/100.000Mi 2026/09/28 01:58:27 DEBUG : chunked-100Mi-100.000Mi.bin: multipart upload: starting chunk 1 size 1 offset 100Mi/100.000Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi/104857601/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi/209715200 2026/09/28 01:58:43 DEBUG : chunked-100Mi-200Mi.bin: multipart upload: starting chunk 0 size 100Mi offset 0/200Mi 2026/09/28 01:58:48 DEBUG : chunked-100Mi-200Mi.bin: multipart upload: starting chunk 1 size 100Mi offset 100Mi/200Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi/209715200/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi/209715201 2026/09/28 01:59:05 DEBUG : chunked-100Mi-200.000Mi.bin: multipart upload: starting chunk 0 size 100Mi offset 0/200.000Mi 2026/09/28 01:59:09 DEBUG : chunked-100Mi-200.000Mi.bin: multipart upload: starting chunk 1 size 100Mi offset 100Mi/200.000Mi 2026/09/28 01:59:09 DEBUG : chunked-100Mi-200.000Mi.bin: multipart upload: starting chunk 2 size 1 offset 200Mi/200.000Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100Mi/209715201/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi/104900001 2026/09/28 01:59:26 DEBUG : chunked-100.040Mi-100.040Mi.bin: multipart upload: starting chunk 0 size 100.040Mi offset 0/100.040Mi 2026/09/28 01:59:26 DEBUG : chunked-100.040Mi-100.040Mi.bin: multipart upload: starting chunk 1 size 1 offset 100.040Mi/100.040Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi/104900001/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800000 2026/09/28 01:59:40 DEBUG : chunked-100.040Mi-200.081Mi.bin: multipart upload: starting chunk 0 size 100.040Mi offset 0/200.081Mi 2026/09/28 01:59:44 DEBUG : chunked-100.040Mi-200.081Mi.bin: multipart upload: starting chunk 1 size 100.040Mi offset 100.040Mi/200.081Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800000/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800001 2026/09/28 02:00:02 DEBUG : chunked-100.040Mi-200.081Mi.bin: multipart upload: starting chunk 0 size 100.040Mi offset 0/200.081Mi 2026/09/28 02:00:06 DEBUG : chunked-100.040Mi-200.081Mi.bin: multipart upload: starting chunk 1 size 100.040Mi offset 100.040Mi/200.081Mi 2026/09/28 02:00:06 DEBUG : chunked-100.040Mi-200.081Mi.bin: multipart upload: starting chunk 2 size 1 offset 200.081Mi/200.081Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800001/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi/104901050 2026/09/28 02:00:20 DEBUG : pacer: low level retry 1/10 (error check files existence: error code: 502 (status 502)) 2026/09/28 02:00:20 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 02:00:20 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:00:21 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 02:00:25 DEBUG : chunked-100.041Mi-100.041Mi.bin: multipart upload: starting chunk 0 size 100.041Mi offset 0/100.041Mi 2026/09/28 02:00:25 DEBUG : chunked-100.041Mi-100.041Mi.bin: multipart upload: starting chunk 1 size 1 offset 100.041Mi/100.041Mi 2026/09/28 02:00:25 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi/104901050/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802098 2026/09/28 02:00:37 DEBUG : chunked-100.041Mi-200.083Mi.bin: multipart upload: starting chunk 0 size 100.041Mi offset 0/200.083Mi 2026/09/28 02:00:41 DEBUG : chunked-100.041Mi-200.083Mi.bin: multipart upload: starting chunk 1 size 100.041Mi offset 100.041Mi/200.083Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802098/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802099 2026/09/28 02:00:58 DEBUG : chunked-100.041Mi-200.083Mi.bin: multipart upload: starting chunk 0 size 100.041Mi offset 0/200.083Mi 2026/09/28 02:01:02 DEBUG : chunked-100.041Mi-200.083Mi.bin: multipart upload: starting chunk 1 size 100.041Mi offset 100.041Mi/200.083Mi 2026/09/28 02:01:02 DEBUG : chunked-100.041Mi-200.083Mi.bin: multipart upload: starting chunk 2 size 1 offset 200.083Mi/200.083Mi === RUN TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802099/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi/134217729 2026/09/28 02:01:19 DEBUG : chunked-128Mi-128.000Mi.bin: multipart upload: starting chunk 0 size 128Mi offset 0/128.000Mi 2026/09/28 02:01:19 DEBUG : chunked-128Mi-128.000Mi.bin: multipart upload: starting chunk 1 size 1 offset 128Mi/128.000Mi 2026/09/28 02:01:23 DEBUG : pacer: low level retry 1/10 (error create meta: error code: 502 (status 502)) 2026/09/28 02:01:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 02:01:23 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:01:23 DEBUG : pacer: Reducing sleep to 11.25ms fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 02:01:24 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi/134217729/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi/268435456 2026/09/28 02:01:35 DEBUG : chunked-128Mi-256Mi.bin: multipart upload: starting chunk 0 size 128Mi offset 0/256Mi 2026/09/28 02:01:41 DEBUG : chunked-128Mi-256Mi.bin: multipart upload: starting chunk 1 size 128Mi offset 128Mi/256Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi/268435456/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi/268435457 2026/09/28 02:02:04 DEBUG : chunked-128Mi-256.000Mi.bin: multipart upload: starting chunk 0 size 128Mi offset 0/256.000Mi 2026/09/28 02:02:11 DEBUG : chunked-128Mi-256.000Mi.bin: multipart upload: starting chunk 1 size 128Mi offset 128Mi/256.000Mi 2026/09/28 02:02:11 DEBUG : chunked-128Mi-256.000Mi.bin: multipart upload: starting chunk 2 size 1 offset 256Mi/256.000Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/128Mi/268435457/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi/139810134 2026/09/28 02:02:37 DEBUG : chunked-133.333Mi-133.333Mi.bin: multipart upload: starting chunk 0 size 133.333Mi offset 0/133.333Mi 2026/09/28 02:02:37 DEBUG : chunked-133.333Mi-133.333Mi.bin: multipart upload: starting chunk 1 size 1 offset 133.333Mi/133.333Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi/139810134/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620266 2026/09/28 02:02:57 DEBUG : chunked-133.333Mi-266.667Mi.bin: multipart upload: starting chunk 0 size 133.333Mi offset 0/266.667Mi 2026/09/28 02:03:03 DEBUG : chunked-133.333Mi-266.667Mi.bin: multipart upload: starting chunk 1 size 133.333Mi offset 133.333Mi/266.667Mi 2026/09/28 02:03:08 DEBUG : pacer: low level retry 1/10 (error create meta: error code: 502 (status 502)) 2026/09/28 02:03:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 02:03:08 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:03:08 DEBUG : pacer: Reducing sleep to 11.25ms fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 02:03:09 DEBUG : pacer: Reducing sleep to 10ms === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620266/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620267 2026/09/28 02:03:30 DEBUG : chunked-133.333Mi-266.667Mi.bin: multipart upload: starting chunk 0 size 133.333Mi offset 0/266.667Mi 2026/09/28 02:03:39 DEBUG : chunked-133.333Mi-266.667Mi.bin: multipart upload: starting chunk 1 size 133.333Mi offset 133.333Mi/266.667Mi 2026/09/28 02:03:39 DEBUG : chunked-133.333Mi-266.667Mi.bin: multipart upload: starting chunk 2 size 1 offset 266.667Mi/266.667Mi fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620267/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi/209715201 2026/09/28 02:04:06 DEBUG : chunked-200Mi-200.000Mi.bin: multipart upload: starting chunk 0 size 200Mi offset 0/200.000Mi 2026/09/28 02:04:06 DEBUG : chunked-200Mi-200.000Mi.bin: multipart upload: starting chunk 1 size 1 offset 200Mi/200.000Mi === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi/209715201/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi/419430400 2026/09/28 02:04:30 DEBUG : chunked-200Mi-400Mi.bin: multipart upload: starting chunk 0 size 200Mi offset 0/400Mi 2026/09/28 02:04:41 DEBUG : chunked-200Mi-400Mi.bin: multipart upload: starting chunk 1 size 200Mi offset 200Mi/400Mi === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi/419430400/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi/419430401 2026/09/28 02:05:16 DEBUG : chunked-200Mi-400.000Mi.bin: multipart upload: starting chunk 0 size 200Mi offset 0/400.000Mi 2026/09/28 02:05:25 DEBUG : chunked-200Mi-400.000Mi.bin: multipart upload: starting chunk 1 size 200Mi offset 200Mi/400.000Mi 2026/09/28 02:05:25 DEBUG : chunked-200Mi-400.000Mi.bin: multipart upload: starting chunk 2 size 1 offset 400Mi/400.000Mi === RUN TestIntegration/FsMkdir/FsPutChunked/200Mi/419430401/Streamed fstests.go:2540: FS has no PutStream interface === RUN TestIntegration/FsMkdir/FsPutRetry === RUN TestIntegration/FsMkdir/FsPutRetry/Simple === RUN TestIntegration/FsMkdir/FsPutRetry/Simple/Status500 2026/09/28 02:05:49 DEBUG : pacer: low level retry 1/1 (error failed to transfer file data: transfer: status 500) 2026/09/28 02:05:49 DEBUG : pacer: Rate limited, increasing sleep to 20ms fstests.go:2660: Put returned an error after the injected failure (acceptable): failed to transfer file data: transfer: status 500 2026/09/28 02:05:50 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:05:50 DEBUG : pacer: Reducing sleep to 11.25ms === RUN TestIntegration/FsMkdir/FsPutRetry/Simple/NetError 2026/09/28 02:05:50 DEBUG : pacer: Reducing sleep to 10ms 2026/09/28 02:05:50 DEBUG : pacer: low level retry 1/1 (error failed to transfer file data: failed to execute transfer request: Put "https://s3.eu-west-2.wasabisys.com/internxt-files/d7cee5f9-bcf6-4c3e-b00c-f574471346a3?Content-Type=application%2Foctet-stream&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=HZLT0JKM7MSJF24GMWG0%2F20260928%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20260928T020550Z&X-Amz-Expires=28800&X-Amz-Signature=b3d3e8f340316385d4ed4bf77d147b5f476f8145a41a685b8c4da51809a7d02c&X-Amz-SignedHeaders=host": write tcp: unexpected EOF) 2026/09/28 02:05:50 DEBUG : pacer: Rate limited, increasing sleep to 20ms fstests.go:2660: Put returned an error after the injected failure (acceptable): failed to transfer file data: failed to execute transfer request: Put "https://s3.eu-west-2.wasabisys.com/internxt-files/d7cee5f9-bcf6-4c3e-b00c-f574471346a3?Content-Type=application%2Foctet-stream&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=HZLT0JKM7MSJF24GMWG0%2F20260928%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20260928T020550Z&X-Amz-Expires=28800&X-Amz-Signature=b3d3e8f340316385d4ed4bf77d147b5f476f8145a41a685b8c4da51809a7d02c&X-Amz-SignedHeaders=host": write tcp: unexpected EOF 2026/09/28 02:05:50 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:05:50 DEBUG : pacer: Reducing sleep to 11.25ms === RUN TestIntegration/FsMkdir/FsPutRetry/Chunked === RUN TestIntegration/FsMkdir/FsPutRetry/Chunked/Status500 2026/09/28 02:05:50 DEBUG : pacer: Reducing sleep to 10ms 2026/09/28 02:05:56 DEBUG : retry-chunked-Status500.bin: multipart upload: starting chunk 0 size 100Mi offset 0/200.000Mi 2026/09/28 02:05:56 DEBUG : pacer: low level retry 1/10 (error failed to upload chunk 0: transfer: status 500) 2026/09/28 02:05:56 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 02:05:58 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:06:01 DEBUG : retry-chunked-Status500.bin: multipart upload: starting chunk 1 size 100Mi offset 100Mi/200.000Mi 2026/09/28 02:06:01 DEBUG : retry-chunked-Status500.bin: multipart upload: starting chunk 2 size 1 offset 200Mi/200.000Mi 2026/09/28 02:06:01 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 02:06:03 DEBUG : pacer: Reducing sleep to 10ms fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) === RUN TestIntegration/FsMkdir/FsPutRetry/Chunked/NetError 2026/09/28 02:06:23 DEBUG : retry-chunked-NetError.bin: multipart upload: starting chunk 0 size 100Mi offset 0/200.000Mi 2026/09/28 02:06:23 DEBUG : pacer: low level retry 1/10 (error failed to upload chunk 0: failed to execute transfer request: Put "https://s3.eu-west-2.wasabisys.com/internxt-files/a26e206e-f408-435d-87bb-45fdf1debc41?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=HZLT0JKM7MSJF24GMWG0%2F20260928%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20260928T020616Z&X-Amz-Expires=28800&X-Amz-Signature=55914a01075c01ac6a663e2b920f14a68d00168620d0bc70d7d354394a9224f6&X-Amz-SignedHeaders=host&partNumber=1&uploadId=1HPSFWNRz8rQIMV25iClDMQFkgJQpT19t3YsuvOLd6B5HRZ5LhYWetk4ZgwK-3QV4sFr1Bkyc-bjoGqiROFIUZJA-do_y8PIhFYWEJIHwy0xYsTGVbe5SGI8l6I_Nvca": write tcp: unexpected EOF) 2026/09/28 02:06:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 02:06:25 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:06:27 DEBUG : retry-chunked-NetError.bin: multipart upload: starting chunk 1 size 100Mi offset 100Mi/200.000Mi 2026/09/28 02:06:27 DEBUG : retry-chunked-NetError.bin: multipart upload: starting chunk 2 size 1 offset 200Mi/200.000Mi 2026/09/28 02:06:27 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 02:06:29 DEBUG : pacer: Reducing sleep to 10ms fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 02:06:40 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Ignoring stale lookup of "retry-chunked-NetError.bin" (UUID: 01a0e5c3-7ea1-71b1-b2b8-59cccd6af20f) which was moved or deleted === RUN TestIntegration/FsMkdir/FsPutShortEOF === RUN TestIntegration/FsMkdir/FsPutShortEOF/Simple 2026/09/28 02:06:40 DEBUG : pacer: low level retry 1/1 (error failed to transfer file data: failed to execute transfer request: Put "https://s3.eu-west-2.wasabisys.com/internxt-files/837fa2df-dadb-4a46-bb0d-64b67e4cccd8?Content-Type=application%2Foctet-stream&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=HZLT0JKM7MSJF24GMWG0%2F20260928%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20260928T020640Z&X-Amz-Expires=28800&X-Amz-Signature=5ea07da4fff22ecc382a859799848f40703bd94e9dc0c76353c1d51139a9fd14&X-Amz-SignedHeaders=host": net/http: HTTP/1.x transport connection broken: http: ContentLength=10240 with Body length 5120) 2026/09/28 02:06:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms fstests.go:2784: Put returned an error (acceptable): failed to transfer file data: failed to execute transfer request: Put "https://s3.eu-west-2.wasabisys.com/internxt-files/837fa2df-dadb-4a46-bb0d-64b67e4cccd8?Content-Type=application%2Foctet-stream&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=HZLT0JKM7MSJF24GMWG0%2F20260928%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20260928T020640Z&X-Amz-Expires=28800&X-Amz-Signature=5ea07da4fff22ecc382a859799848f40703bd94e9dc0c76353c1d51139a9fd14&X-Amz-SignedHeaders=host": net/http: HTTP/1.x transport connection broken: http: ContentLength=10240 with Body length 5120 2026/09/28 02:06:40 DEBUG : pacer: Reducing sleep to 15ms === RUN TestIntegration/FsMkdir/FsPutShortEOF/Chunked 2026/09/28 02:06:42 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 02:06:42 DEBUG : pacer: Reducing sleep to 10ms 2026/09/28 02:06:42 DEBUG : short-eof-chunked.bin: multipart upload: starting chunk 0 size 100Mi offset 0/400Mi 2026/09/28 02:06:42 DEBUG : short-eof-chunked.bin: multipart upload: starting chunk 1 size 50Mi offset 100Mi/400Mi 2026/09/28 02:06:45 DEBUG : short-eof-chunked.bin: Cancelling multipart upload 2026/09/28 02:06:45 NOTICE: Internxt root 'rclone-test-kufudek0nuju': Multipart upload aborted for short-eof-chunked.bin fstests.go:2784: Put returned an error (acceptable): multipart upload: expected 419430400 bytes in input, but got 157286400: unexpected EOF === RUN TestIntegration/FsMkdir/FsCopyChunked fstests.go:2870: FS has no Copier interface === RUN TestIntegration/FsMkdir/FsUploadUnknownSize === RUN TestIntegration/FsMkdir/FsUploadUnknownSize/FsPutUnknownSize 2026/09/28 02:06:45 NOTICE: Internxt root 'rclone-test-kufudek0nuju': Streaming uploads using chunk size 30Mi will have maximum file size of 292.969Gi === RUN TestIntegration/FsMkdir/FsUploadUnknownSize/FsUpdateUnknownSize fstest.go:542: Sleeping for 1s for findObject eventual consistency: 1/5 (object not found) 2026/09/28 02:06:52 DEBUG : Internxt root 'rclone-test-kufudek0nuju': Renamed existing file unknown-size-update.txt to backup unknown-size-update.rclone-backup-zejabuw6.txt (UUID: 01a0e5c3-c17b-74d9-a7c9-0eb6c3562ab5) === RUN TestIntegration/FsMkdir/FsRootCollapse 2026/09/28 02:06:53 DEBUG : Creating backend with remote "TestInternxt:rclone-test-kufudek0nuju/deeper/nonexisting/directory" 2026/09/28 02:06:53 DEBUG : Config file has changed externally - reloading 2026/09/28 02:06:53 DEBUG : User info: rootFolderId=2661cf64-e104-478b-b737-48c3ac8984d2, bucket=697358bf16ceabcf39af85f2 2026/09/28 02:06:53 DEBUG : Saving config "token" in section "TestInternxt" of the config file 2026/09/28 02:06:53 DEBUG : TestInternxt: Saved new token in config file 2026/09/28 02:06:53 DEBUG : Internxt root 'rclone-test-kufudek0nuju/deeper/nonexisting/directory': Persisted rotated token from user info, expiry: 2026-10-05 02:06:53 +0000 UTC === RUN TestIntegration/FsMkdir/FsDirSetModTime fstests.go:3019: FS has no DirSetModTime interface === RUN TestIntegration/FsMkdir/FsMkdirMetadata fstests.go:3062: FS has no MkdirMetadata interface === RUN TestIntegration/FsMkdir/FsDirectory fstests.go:3119: FS has no Directory methods and doesn't Wrap 2026/09/28 02:07:05 DEBUG : Waiting for deletions to finish 2026/09/28 02:07:06 INFO : unknown-size-update.txt: Deleted 2026/09/28 02:07:06 INFO : hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt: Deleted 2026/09/28 02:07:10 DEBUG : pacer: low level retry 1/10 (error failed to list all files at offset 0: list files: error code: 502 (status 502)) 2026/09/28 02:07:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/09/28 02:07:11 DEBUG : pacer: Reducing sleep to 15ms 2026/09/28 02:07:11 DEBUG : pacer: Reducing sleep to 11.25ms 2026/09/28 02:07:11 DEBUG : pacer: Reducing sleep to 10ms 2026/09/28 02:07:12 DEBUG : removing 1 level 4 directories 2026/09/28 02:07:12 INFO : hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠: Removing directory 2026/09/28 02:07:12 DEBUG : removing 1 level 3 directories 2026/09/28 02:07:12 INFO : hello? sausage/êé/Hello, 世界: Removing directory 2026/09/28 02:07:12 DEBUG : removing 1 level 2 directories 2026/09/28 02:07:12 INFO : hello? sausage/êé: Removing directory 2026/09/28 02:07:13 DEBUG : removing 1 level 1 directories 2026/09/28 02:07:13 INFO : hello? sausage: Removing directory 2026/09/28 02:07:14 DEBUG : removing 1 level 0 directories 2026/09/28 02:07:14 INFO : Internxt root 'rclone-test-kufudek0nuju': Removing directory 2026/09/28 02:07:15 ERROR : error listing: directory not found 2026/09/28 02:07:15 DEBUG : Waiting for deletions to finish 2026/09/28 02:07:15 ERROR : error listing: directory not found 2026/09/28 02:07:15 ERROR : Internxt root 'rclone-test-kufudek0nuju': Failed to list "": directory not found 2026/09/28 02:07:15 DEBUG : removing 1 level 0 directories 2026/09/28 02:07:15 INFO : Internxt root 'rclone-test-kufudek0nuju': Removing directory 2026/09/28 02:07:17 ERROR : Failed to rmdir: directory not found === RUN TestIntegration/FsShutdown --- PASS: TestIntegration (844.12s) --- SKIP: TestIntegration/FsCheckWrap (0.00s) --- SKIP: TestIntegration/FsCommand (0.00s) --- PASS: TestIntegration/FsRmdirNotFound (0.11s) --- PASS: TestIntegration/FsString (0.00s) --- PASS: TestIntegration/FsName (0.00s) --- PASS: TestIntegration/FsRoot (0.00s) --- PASS: TestIntegration/FsRmdirEmpty (0.76s) --- PASS: TestIntegration/FsMkdir (838.39s) --- PASS: TestIntegration/FsMkdir/FsMkdirRmdirSubdir (10.20s) --- PASS: TestIntegration/FsMkdir/FsListEmpty (0.25s) --- PASS: TestIntegration/FsMkdir/FsListDirEmpty (0.25s) --- SKIP: TestIntegration/FsMkdir/FsListRDirEmpty (0.00s) --- PASS: TestIntegration/FsMkdir/FsListDirNotFound (0.81s) --- SKIP: TestIntegration/FsMkdir/FsListRDirNotFound (0.00s) --- PASS: TestIntegration/FsMkdir/FsEncoding (132.65s) --- PASS: TestIntegration/FsMkdir/FsEncoding/control_chars (9.97s) --- PASS: TestIntegration/FsMkdir/FsEncoding/dot (4.37s) --- PASS: TestIntegration/FsMkdir/FsEncoding/dot_dot (3.42s) --- PASS: TestIntegration/FsMkdir/FsEncoding/punctuation (5.50s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_space (5.20s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_tilde (8.21s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_CR (7.79s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_LF (17.56s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_HT (6.09s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_VT (4.88s) --- PASS: TestIntegration/FsMkdir/FsEncoding/leading_dot (5.26s) --- PASS: TestIntegration/FsMkdir/FsEncoding/trailing_space (4.67s) --- PASS: TestIntegration/FsMkdir/FsEncoding/trailing_CR (6.07s) --- PASS: TestIntegration/FsMkdir/FsEncoding/trailing_LF (7.64s) --- PASS: TestIntegration/FsMkdir/FsEncoding/trailing_HT (5.40s) --- PASS: TestIntegration/FsMkdir/FsEncoding/trailing_VT (3.88s) --- PASS: TestIntegration/FsMkdir/FsEncoding/trailing_dot (8.80s) --- PASS: TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8 (7.91s) --- PASS: TestIntegration/FsMkdir/FsEncoding/URL_encoding (8.35s) --- PASS: TestIntegration/FsMkdir/FsNewObjectNotFound (0.24s) --- PASS: TestIntegration/FsMkdir/FsPutError (3.32s) --- PASS: TestIntegration/FsMkdir/FsPutZeroLength (2.97s) --- SKIP: TestIntegration/FsMkdir/FsOpenWriterAt (0.00s) --- SKIP: TestIntegration/FsMkdir/FsOpenChunkWriter (0.00s) --- SKIP: TestIntegration/FsMkdir/FsChangeNotify (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles (152.40s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListDirFile2 (1.27s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsListRDirFile2 (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListR (10.10s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir (1.70s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListDirRoot (3.18s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsListRDirRoot (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListSubdir (1.51s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir#01 (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListLevel2 (0.46s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsListRLevel2 (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListFile1 (1.25s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsNewObject (0.20s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsNewObjectCaseInsensitive (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListFile1and2 (2.58s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsNewObjectDir (0.12s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsPurge (0.00s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsListRootedSubdir (20.00s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsCopy (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsMove (13.12s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsMove/Metadata (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsDirMove (26.21s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsRmdirFull (0.21s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsPrecision (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectString (0.21s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectFs (1.68s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectRemote (0.24s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectHashes (0.96s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectModTime (0.32s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/ObjectMimeType (0.21s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/ObjectMetadata (0.22s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/ObjectSetMetadata (0.23s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectSetModTime (0.22s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectSize (0.32s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpen (5.14s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenSeek (0.84s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenRange (2.27s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectPartialRead (0.60s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint (4.14s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/full_read (0.29s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/seek_read (0.63s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/range_read (0.95s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/range_read_to_end (0.34s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenFingerprint/refresh (0.56s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectUpdate (2.69s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectStorable (0.21s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsIsFile (5.12s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsIsFile/FsRoot (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FsIsFileNotFound (0.86s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FromRoot (25.01s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FromRoot/List (8.05s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListEntries (0.22s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListR (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FromRoot/Put (16.56s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/FromRoot/Put/Remove (10.14s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/PublicLink (0.00s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/SetTier (0.00s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/ObjectCheckWrap (0.00s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/Bucket (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectRemove (5.13s) --- PASS: TestIntegration/FsMkdir/FsPutFiles/ObjectAbout (1.31s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/FsPutStream (0.00s) --- SKIP: TestIntegration/FsMkdir/FsPutFiles/Internal (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked (446.80s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100Mi (58.75s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100Mi/104857601 (16.29s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100Mi/104857601/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100Mi/209715200 (22.01s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100Mi/209715200/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100Mi/209715201 (20.45s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100Mi/209715201/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.040Mi (58.26s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.040Mi/104900001 (14.03s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100.040Mi/104900001/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800000 (21.54s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800000/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800001 (22.69s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100.040Mi/209800001/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.041Mi (54.20s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.041Mi/104901050 (12.95s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100.041Mi/104901050/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802098 (20.83s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802098/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802099 (20.42s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/100.041Mi/209802099/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/128Mi (74.17s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/128Mi/134217729 (15.95s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/128Mi/134217729/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/128Mi/268435456 (27.56s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/128Mi/268435456/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/128Mi/268435457 (30.65s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/128Mi/268435457/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/133.333Mi (87.56s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/133.333Mi/139810134 (22.63s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/133.333Mi/139810134/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620266 (31.96s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620266/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620267 (32.97s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/133.333Mi/279620267/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/200Mi (113.86s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/200Mi/209715201 (24.00s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/200Mi/209715201/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/200Mi/419430400 (44.72s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/200Mi/419430400/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutChunked/200Mi/419430401 (45.13s) --- SKIP: TestIntegration/FsMkdir/FsPutChunked/200Mi/419430401/Streamed (0.00s) --- PASS: TestIntegration/FsMkdir/FsPutRetry (50.71s) --- PASS: TestIntegration/FsMkdir/FsPutRetry/Simple (1.10s) --- PASS: TestIntegration/FsMkdir/FsPutRetry/Simple/Status500 (0.61s) --- PASS: TestIntegration/FsMkdir/FsPutRetry/Simple/NetError (0.49s) --- PASS: TestIntegration/FsMkdir/FsPutRetry/Chunked (49.61s) --- PASS: TestIntegration/FsMkdir/FsPutRetry/Chunked/Status500 (25.95s) --- PASS: TestIntegration/FsMkdir/FsPutRetry/Chunked/NetError (23.66s) --- PASS: TestIntegration/FsMkdir/FsPutShortEOF (4.82s) --- PASS: TestIntegration/FsMkdir/FsPutShortEOF/Simple (0.44s) --- PASS: TestIntegration/FsMkdir/FsPutShortEOF/Chunked (4.38s) --- SKIP: TestIntegration/FsMkdir/FsCopyChunked (0.00s) --- PASS: TestIntegration/FsMkdir/FsUploadUnknownSize (7.85s) --- PASS: TestIntegration/FsMkdir/FsUploadUnknownSize/FsPutUnknownSize (0.61s) --- PASS: TestIntegration/FsMkdir/FsUploadUnknownSize/FsUpdateUnknownSize (7.24s) --- PASS: TestIntegration/FsMkdir/FsRootCollapse (11.93s) --- SKIP: TestIntegration/FsMkdir/FsDirSetModTime (0.00s) --- SKIP: TestIntegration/FsMkdir/FsMkdirMetadata (0.00s) --- SKIP: TestIntegration/FsMkdir/FsDirectory (0.00s) --- PASS: TestIntegration/FsShutdown (0.00s) PASS ok github.com/rclone/rclone/backend/internxt 844.381s "go test -v -timeout 2h0m0s -remote TestInternxt: -list-retries 5 -verbose" - Finished OK in 14m5.776062615s (try 1/5)