"go test -v -timeout 1h0m0s -remote TestS3Wasabi: -verbose" - Starting (try 1/5) === RUN TestSignHTTP --- PASS: TestSignHTTP (0.00s) === RUN TestVersionLess --- PASS: TestVersionLess (0.00s) === RUN TestMergeDeleteMarkers --- PASS: TestMergeDeleteMarkers (0.00s) === RUN TestRemoveAWSChunked === RUN TestRemoveAWSChunked/nil === RUN TestRemoveAWSChunked/empty === RUN TestRemoveAWSChunked/only_aws === RUN TestRemoveAWSChunked/leading_aws === RUN TestRemoveAWSChunked/trailing_aws === RUN TestRemoveAWSChunked/middle_aws === RUN TestRemoveAWSChunked/case_insensitive === RUN TestRemoveAWSChunked/duplicates === RUN TestRemoveAWSChunked/no_aws_normalize_spaces === RUN TestRemoveAWSChunked/surrounding_spaces === RUN TestRemoveAWSChunked/no_change --- PASS: TestRemoveAWSChunked (0.00s) --- PASS: TestRemoveAWSChunked/nil (0.00s) --- PASS: TestRemoveAWSChunked/empty (0.00s) --- PASS: TestRemoveAWSChunked/only_aws (0.00s) --- PASS: TestRemoveAWSChunked/leading_aws (0.00s) --- PASS: TestRemoveAWSChunked/trailing_aws (0.00s) --- PASS: TestRemoveAWSChunked/middle_aws (0.00s) --- PASS: TestRemoveAWSChunked/case_insensitive (0.00s) --- PASS: TestRemoveAWSChunked/duplicates (0.00s) --- PASS: TestRemoveAWSChunked/no_aws_normalize_spaces (0.00s) --- PASS: TestRemoveAWSChunked/surrounding_spaces (0.00s) --- PASS: TestRemoveAWSChunked/no_change (0.00s) === RUN TestIntegration fstests.go:438: Using remote "TestS3Wasabi:" 2025/12/18 04:02:03 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-meqocih4kuci" 2025/12/18 04:02:03 DEBUG : Using config file from "/home/rclone/.rclone.conf" === RUN TestIntegration/FsCheckWrap fstests.go:479: Not a wrapping Fs === RUN TestIntegration/FsCommand === RUN TestIntegration/FsRmdirNotFound 2025/12/18 04:02:04 INFO : S3 bucket rclone-test-meqocih4kuci: Bucket "rclone-test-meqocih4kuci" created with ACL "" === RUN TestIntegration/FsString === RUN TestIntegration/FsName === RUN TestIntegration/FsRoot === RUN TestIntegration/FsRmdirEmpty 2025/12/18 04:02:05 INFO : S3 bucket rclone-test-meqocih4kuci: Bucket "rclone-test-meqocih4kuci" deleted === RUN TestIntegration/FsMkdir 2025/12/18 04:02:05 INFO : S3 bucket rclone-test-meqocih4kuci: Bucket "rclone-test-meqocih4kuci" created with ACL "" === RUN TestIntegration/FsMkdir/FsMkdirRmdirSubdir 2025/12/18 04:02:05 INFO : dir/subdir: Making directory fstest.go:250: Filtering empty directory "dir" fstest.go:250: Filtering empty directory "dir/subdir" 2025/12/18 04:02:05 INFO : dir/subdir: Removing directory fstest.go:250: Filtering empty directory "dir" 2025/12/18 04:02:06 INFO : dir: Removing directory === RUN TestIntegration/FsMkdir/FsListEmpty === RUN TestIntegration/FsMkdir/FsListDirEmpty === RUN TestIntegration/FsMkdir/FsListRDirEmpty === RUN TestIntegration/FsMkdir/FsListDirNotFound === RUN TestIntegration/FsMkdir/FsListRDirNotFound === RUN TestIntegration/FsMkdir/FsEncoding === RUN TestIntegration/FsMkdir/FsEncoding/control_chars fstests.go:707: testing "␀␁␂␃␄␅␆␇␈␉␊␋␌␍␎␏␐␑␒␓␔␕␖␗␘␙␚␛␜␝␞␟␡" === RUN TestIntegration/FsMkdir/FsEncoding/dot fstests.go:707: testing "." === RUN TestIntegration/FsMkdir/FsEncoding/dot_dot fstests.go:707: testing ".." === RUN TestIntegration/FsMkdir/FsEncoding/punctuation fstests.go:707: testing "!\"#$%&'()*+,-./:;<=>?@[\\]^_`{|}~" === RUN TestIntegration/FsMkdir/FsEncoding/leading_space fstests.go:707: testing " leading space" === RUN TestIntegration/FsMkdir/FsEncoding/leading_tilde fstests.go:707: testing "~leading tilde" === RUN TestIntegration/FsMkdir/FsEncoding/leading_CR fstests.go:707: testing "␍leading CR" === RUN TestIntegration/FsMkdir/FsEncoding/leading_LF fstests.go:707: testing "␊leading LF" === RUN TestIntegration/FsMkdir/FsEncoding/leading_HT fstests.go:707: testing "␉leading HT" === RUN TestIntegration/FsMkdir/FsEncoding/leading_VT fstests.go:707: testing "␋leading VT" === RUN TestIntegration/FsMkdir/FsEncoding/leading_dot fstests.go:707: testing ".leading dot" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_space fstests.go:707: testing "trailing space " === RUN TestIntegration/FsMkdir/FsEncoding/trailing_CR fstests.go:707: testing "trailing CR␍" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_LF fstests.go:707: testing "trailing LF␊" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_HT fstests.go:707: testing "trailing HT␉" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_VT fstests.go:707: testing "trailing VT␋" === RUN TestIntegration/FsMkdir/FsEncoding/trailing_dot fstests.go:707: testing "trailing dot." === RUN TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8 fstests.go:707: testing "invalid utf-8\xfe" === RUN TestIntegration/FsMkdir/FsEncoding/URL_encoding fstests.go:707: testing "test%46.txt" === RUN TestIntegration/FsMkdir/FsNewObjectNotFound === RUN TestIntegration/FsMkdir/FsPutError === RUN TestIntegration/FsMkdir/FsPutZeroLength === RUN TestIntegration/FsMkdir/FsOpenWriterAt fstests.go:786: FS has no OpenWriterAt interface === RUN TestIntegration/FsMkdir/FsOpenChunkWriter 2025/12/18 04:02:35 NOTICE: S3 bucket rclone-test-meqocih4kuci: Streaming uploads using chunk size 5Mi will have maximum file size of 48.828Gi 2025/12/18 04:02:35 DEBUG : writer-at-subdir/writer-at-file: open chunk writer: started multipart upload: DHqc_cREL0h3nFcIKzs4TAO5E2aRCj0yOqOvVcAA83ihJ5uBMQIU1GYX8vFC2XB9wL7iHXMtQweC-LBKix7Sm5XJCLZCsMGBQ6h_cQZ7fA0XmWEWBU2maNYfvnL6BrFU 2025/12/18 04:04:45 DEBUG : writer-at-subdir/writer-at-file: multipart upload wrote chunk 2 with 5242880 bytes and etag "4ba06f4a93840025f355ae50e125c438" 2025/12/18 04:05:13 DEBUG : writer-at-subdir/writer-at-file: multipart upload wrote chunk 3 with 1048576 bytes and etag "5f2f07eec6c74bf83e23bc1e77fe8b77" 2025/12/18 04:07:35 DEBUG : writer-at-subdir/writer-at-file: multipart upload wrote chunk 1 with 5242880 bytes and etag "6ca6aa12e70468da1538cd724e7ca650" 2025/12/18 04:07:36 DEBUG : writer-at-subdir/writer-at-file: multipart upload "DHqc_cREL0h3nFcIKzs4TAO5E2aRCj0yOqOvVcAA83ihJ5uBMQIU1GYX8vFC2XB9wL7iHXMtQweC-LBKix7Sm5XJCLZCsMGBQ6h_cQZ7fA0XmWEWBU2maNYfvnL6BrFU" finished === RUN TestIntegration/FsMkdir/FsChangeNotify fstests.go:868: FS has no ChangeNotify interface === RUN TestIntegration/FsMkdir/FsPutFiles === RUN TestIntegration/FsMkdir/FsPutFiles/FsListDirFile2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRDirFile2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListR === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir === RUN TestIntegration/FsMkdir/FsPutFiles/FsListDirRoot 2025/12/18 04:07:41 DEBUG : Creating backend with remote "TestS3Wasabi:" === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRDirRoot 2025/12/18 04:07:42 DEBUG : Creating backend with remote "TestS3Wasabi:" === RUN TestIntegration/FsMkdir/FsPutFiles/FsListSubdir === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir#01 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListLevel2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRLevel2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsListFile1 === RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObject === RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObjectCaseInsensitive fstests.go:1121: Not Case Insensitive === RUN TestIntegration/FsMkdir/FsPutFiles/FsListFile1and2 === RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObjectDir === RUN TestIntegration/FsMkdir/FsPutFiles/FsPurge 2025/12/18 04:07:54 DEBUG : S3 bucket rclone-test-meqocih4kuci: bucket is versioned: false 2025/12/18 04:07:54 DEBUG : Waiting for deletions to finish 2025/12/18 04:07:55 DEBUG : "dirToPurge/fileToPurge.txt" version false 2025/12/18 04:07:55 DEBUG : dirToPurge/fileToPurge.txt: Deleting (id "") 2025/12/18 04:07:55 INFO : dirToPurge/fileToPurge.txt: Deleted === RUN TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot 2025/12/18 04:07:56 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-meqocih4kuci/dirToPurgeFromRoot" 2025/12/18 04:07:58 DEBUG : S3 bucket rclone-test-meqocih4kuci path dirToPurgeFromRoot: bucket is versioned: false 2025/12/18 04:07:58 DEBUG : Waiting for deletions to finish 2025/12/18 04:07:58 DEBUG : "fileToPurgeFromRoot.txt" version false 2025/12/18 04:07:58 DEBUG : fileToPurgeFromRoot.txt: Deleting (id "") 2025/12/18 04:07:58 INFO : fileToPurgeFromRoot.txt: Deleted === RUN TestIntegration/FsMkdir/FsPutFiles/FsListRootedSubdir 2025/12/18 04:07:59 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-meqocih4kuci/hello? sausage/êé" 2025/12/18 04:08:00 INFO : S3 bucket rclone-test-meqocih4kuci path hello? sausage/êé: Bucket "rclone-test-meqocih4kuci" created with ACL "" 2025/12/18 04:08:02 DEBUG : S3 bucket rclone-test-meqocih4kuci path hello? sausage/êé: bucket is versioned: false 2025/12/18 04:08:02 DEBUG : Waiting for deletions to finish 2025/12/18 04:08:02 DEBUG : "a/b/c/d/e.txt" version false 2025/12/18 04:08:02 DEBUG : a/b/c/d/e.txt: Deleting (id "") 2025/12/18 04:08:02 INFO : a/b/c/d/e.txt: Deleted === RUN TestIntegration/FsMkdir/FsPutFiles/FsCopy === RUN TestIntegration/FsMkdir/FsPutFiles/FsCopy/Metadata === RUN TestIntegration/FsMkdir/FsPutFiles/FsMove fstests.go:1342: FS has no Mover interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsDirMove fstests.go:1459: FS has no DirMover interface === RUN TestIntegration/FsMkdir/FsPutFiles/FsRmdirFull === RUN TestIntegration/FsMkdir/FsPutFiles/FsPrecision === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectString === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectFs === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectRemote === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectHashes === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectModTime === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMimeType === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMetadata === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMetadata/mtime === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSetMetadata fstests.go:1694: SetMetadata method not supported === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSetModTime === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSize === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpen === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenSeek === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenRange === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectPartialRead === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectUpdate === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectStorable === RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFile 2025/12/18 04:08:15 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-meqocih4kuci/hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt" === RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFile/FsRoot === RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFileNotFound 2025/12/18 04:08:17 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-meqocih4kuci/not found.txt" === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot fstests.go:1911: Opening root remote "TestS3Wasabi:" path "rclone-test-meqocih4kuci" from "TestS3Wasabi:rclone-test-meqocih4kuci" 2025/12/18 04:08:18 DEBUG : Creating backend with remote "TestS3Wasabi:" === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/List === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListEntries === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListR === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/Put === RUN TestIntegration/FsMkdir/FsPutFiles/FromRoot/Put/Remove === RUN TestIntegration/FsMkdir/FsPutFiles/PublicLink fstests.go:2052: skipping directory tests as not supported on this backend === RUN TestIntegration/FsMkdir/FsPutFiles/SetTier fstests.go:412: FS has no SetTier & GetTier interfaces === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectCheckWrap fstests.go:2109: Not a wrapping Fs === RUN TestIntegration/FsMkdir/FsPutFiles/Bucket fstests.go:2131: Can't have // in paths === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectRemove === RUN TestIntegration/FsMkdir/FsPutFiles/ObjectAbout fstests.go:2281: FS does not support About === RUN TestIntegration/FsMkdir/FsPutFiles/FsPutStream === RUN TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0 2025/12/18 04:08:28 DEBUG : piped data.txt: open chunk writer: started multipart upload: bOW0KpxYlNv3h2b48jWaIb8MX_dV3LnGqIjZYilcY1KUjjkMEkTzoHLLM-kjLa4rNEm6KkkhHt4NkJhQBPCXJxK4a9lcUQRTOrkH0s9amdVVMEYUd-VPoVdZP2oGrHRq 2025/12/18 04:08:28 DEBUG : piped data.txt: multipart upload: starting chunk 0 size 0 offset 0/off 2025/12/18 04:08:28 DEBUG : piped data.txt: multipart upload wrote chunk 1 with 0 bytes and etag "d41d8cd98f00b204e9800998ecf8427e" 2025/12/18 04:08:29 DEBUG : piped data.txt: multipart upload "bOW0KpxYlNv3h2b48jWaIb8MX_dV3LnGqIjZYilcY1KUjjkMEkTzoHLLM-kjLa4rNEm6KkkhHt4NkJhQBPCXJxK4a9lcUQRTOrkH0s9amdVVMEYUd-VPoVdZP2oGrHRq" finished 2025/12/18 04:08:29 DEBUG : piped data.txt: Multipart upload Etag: 59adb24ef3cdbe0297f05b395827453f-1 OK === RUN TestIntegration/FsMkdir/FsPutFiles/FsPutStream/100 2025/12/18 04:08:29 DEBUG : piped data.txt: open chunk writer: started multipart upload: wXC-uBUliSNnhS77d5ElhCZ054ZDlXJ1sJHgMrkmTxN4kRetxWeJ4UhmcP8JOa5l7SGTriTmcW0VEeIygGcCAEOY_Y-GVUQrddGgtIiGOezUtyTYZQ6ZwiR093ZgCOfU 2025/12/18 04:08:29 DEBUG : piped data.txt: multipart upload: starting chunk 0 size 100 offset 0/off 2025/12/18 04:08:30 DEBUG : piped data.txt: multipart upload wrote chunk 1 with 100 bytes and etag "549acc8f358c9cd09ad03cf94da5dca4" 2025/12/18 04:08:30 DEBUG : piped data.txt: multipart upload "wXC-uBUliSNnhS77d5ElhCZ054ZDlXJ1sJHgMrkmTxN4kRetxWeJ4UhmcP8JOa5l7SGTriTmcW0VEeIygGcCAEOY_Y-GVUQrddGgtIiGOezUtyTYZQ6ZwiR093ZgCOfU" finished 2025/12/18 04:08:30 DEBUG : piped data.txt: Multipart upload Etag: 3998927f16f9c0b721aba175ad0d4bb3-1 OK === RUN TestIntegration/FsMkdir/FsPutFiles/Internal === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Metadata === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Metadata/GzipEncoding === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Metadata/GzipEncoding/NoDecompress 2025/12/18 04:08:32 NOTICE: test-metadata: Not decompressing 'Content-Encoding: gzip' compressed file. Use --s3-decompress to override === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Metadata/GzipEncoding/Decompress === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/NoHead === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Versions s3_internal_test.go:347: versions/test-versions.txt === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Versions/ReadCurrent === NAME TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Versions s3_internal_test.go:347: versions/test-versions-v2025-12-18-040836-000.txt === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Versions/ReadVersion === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Versions/NewObject === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Versions/NewFs 2025/12/18 04:08:41 DEBUG : oldPath = "TestS3Wasabi:rclone-test-meqocih4kuci/versions/test-versions-v2025-12-18-040836-000.txt" 2025/12/18 04:08:41 DEBUG : newPath = "TestS3Wasabi,versions:rclone-test-meqocih4kuci/versions/test-versions-v2025-12-18-040836-000.txt" 2025/12/18 04:08:41 DEBUG : Creating backend with remote "TestS3Wasabi,versions:rclone-test-meqocih4kuci/versions/test-versions-v2025-12-18-040836-000.txt" 2025/12/18 04:08:41 DEBUG : TestS3Wasabi: detected overridden config - adding "{pO73u}" suffix to name 2025/12/18 04:08:42 DEBUG : fs cache: renaming child cache item "TestS3Wasabi,versions:rclone-test-meqocih4kuci/versions/test-versions-v2025-12-18-040836-000.txt" to be canonical for parent "TestS3Wasabi{pO73u}:rclone-test-meqocih4kuci/versions" === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/Before === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/Before/List === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/Before/NewObject === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterOne === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterOne/List === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterOne/NewObject === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterDelete === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterDelete/List === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterDelete/NewObject === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterTwo === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterTwo/List === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterTwo/NewObject === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Mkdir s3_internal_test.go:475: Creating a bucket we already have created returned code: No Error === RUN TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/Cleanup 2025/12/18 04:08:47 DEBUG : Waiting for deletions to finish 2025/12/18 04:08:47 DEBUG : "hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt" version false 2025/12/18 04:08:47 DEBUG : hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt: Not deleting current version "null" 2025/12/18 04:08:47 DEBUG : "versions/test-versions.txt" version false 2025/12/18 04:08:47 DEBUG : versions/test-versions.txt: Not deleting current version "001766030920299661224-m7-Oc0I0Hq" 2025/12/18 04:08:47 DEBUG : "versions/test-versions-v2025-12-18-040838-000.txt" version true 2025/12/18 04:08:47 DEBUG : versions/test-versions-v2025-12-18-040838-000.txt: Deleting delete marker (id "001766030918029584465-CJ9mJr7da5") 2025/12/18 04:08:47 DEBUG : "versions/test-versions-v2025-12-18-040836-000.txt" version true 2025/12/18 04:08:47 DEBUG : versions/test-versions-v2025-12-18-040836-000.txt: Deleting (id "001766030915562165420-iy3G7YjfuF") 2025/12/18 04:08:48 INFO : versions/test-versions-v2025-12-18-040836-000.txt: Deleted 2025/12/18 04:08:48 INFO : versions/test-versions-v2025-12-18-040838-000.txt: Deleted === RUN TestIntegration/FsMkdir/FsPutChunked === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi/5242879 === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi/5242879/Streamed 2025/12/18 04:11:06 DEBUG : chunked-5Mi-5.000Mi-streamed.bin: open chunk writer: started multipart upload: gYJB0DwniYwsf-Hog7JiDmDX398lsxNaZJGu82XBY7QD9JgVScSN0TlFsuSZlg6N7ad2kYhF2ZXQBqX7t3QHiKXbPTV5XkpX_yS9ZnYeVgdfqcNtOe_5E3-9h5hCIO9L 2025/12/18 04:11:06 DEBUG : chunked-5Mi-5.000Mi-streamed.bin: multipart upload: starting chunk 0 size 5.000Mi offset 0/off 2025/12/18 04:13:25 DEBUG : chunked-5Mi-5.000Mi-streamed.bin: multipart upload wrote chunk 1 with 5242879 bytes and etag "ff7aec5a89bdb0fd7d9cf4ff8c484545" 2025/12/18 04:13:25 DEBUG : chunked-5Mi-5.000Mi-streamed.bin: multipart upload "gYJB0DwniYwsf-Hog7JiDmDX398lsxNaZJGu82XBY7QD9JgVScSN0TlFsuSZlg6N7ad2kYhF2ZXQBqX7t3QHiKXbPTV5XkpX_yS9ZnYeVgdfqcNtOe_5E3-9h5hCIO9L" finished 2025/12/18 04:13:25 DEBUG : chunked-5Mi-5.000Mi-streamed.bin: Multipart upload Etag: ed4a32f2cde07f87d68a56ca08356e58-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi/5242880 2025/12/18 04:13:27 DEBUG : chunked-5Mi-5Mi.bin: open chunk writer: started multipart upload: n6lSX2FIfApzitEnP-3GEQ90b_rWZmJ3nxUMSmnWxKrOgtgLlrzSs58d7-PYN8nXsImyrZx5Tl7lYByvyPGt_aXjDlxOYlFBTlFN5AU7C-yjPqqz8GY_PLQbLa1K_B_d 2025/12/18 04:13:27 DEBUG : chunked-5Mi-5Mi.bin: multipart upload: starting chunk 0 size 5Mi offset 0/5Mi 2025/12/18 04:15:25 DEBUG : chunked-5Mi-5Mi.bin: multipart upload wrote chunk 1 with 5242880 bytes and etag "4c28640dc8df1933aaea192100d50ae0" 2025/12/18 04:15:25 DEBUG : chunked-5Mi-5Mi.bin: multipart upload "n6lSX2FIfApzitEnP-3GEQ90b_rWZmJ3nxUMSmnWxKrOgtgLlrzSs58d7-PYN8nXsImyrZx5Tl7lYByvyPGt_aXjDlxOYlFBTlFN5AU7C-yjPqqz8GY_PLQbLa1K_B_d" finished 2025/12/18 04:15:25 DEBUG : chunked-5Mi-5Mi.bin: Multipart upload Etag: 59a976105e80464acdcd6ee2a0678dfd-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi/5242880/Streamed 2025/12/18 04:15:27 DEBUG : chunked-5Mi-5Mi-streamed.bin: open chunk writer: started multipart upload: QmzL9K8dBnp1hez3V_3QphTiXlYr2Rng0BKtrnNtbb_M0gbWllPsPUVx06ymBcHrhc8o5DPFaxMwicCf4BP4_n_ohEBvvAXH2CjUFYIusp534wGCSgL7xcn0omncD9Vl 2025/12/18 04:15:28 DEBUG : chunked-5Mi-5Mi-streamed.bin: multipart upload: starting chunk 0 size 5Mi offset 0/off 2025/12/18 04:17:41 DEBUG : chunked-5Mi-5Mi-streamed.bin: multipart upload wrote chunk 1 with 5242880 bytes and etag "4c28640dc8df1933aaea192100d50ae0" 2025/12/18 04:17:41 DEBUG : chunked-5Mi-5Mi-streamed.bin: multipart upload "QmzL9K8dBnp1hez3V_3QphTiXlYr2Rng0BKtrnNtbb_M0gbWllPsPUVx06ymBcHrhc8o5DPFaxMwicCf4BP4_n_ohEBvvAXH2CjUFYIusp534wGCSgL7xcn0omncD9Vl" finished 2025/12/18 04:17:41 DEBUG : chunked-5Mi-5Mi-streamed.bin: Multipart upload Etag: 59a976105e80464acdcd6ee2a0678dfd-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi/10485761 2025/12/18 04:17:43 DEBUG : chunked-5Mi-10.000Mi.bin: open chunk writer: started multipart upload: VYUDFHmB8eenyWPbOMhvhB7qTxqXJu-y2_nlT8Lgrkb1hFbOl6ANWSqTvyXdLHqF2kxzylDkh29dL8mO3QWYsKYT81gK86j7aj254JCMZmwdXShOSLc6tLY6Guc2Fqiz 2025/12/18 04:17:43 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload: starting chunk 0 size 5Mi offset 0/10.000Mi 2025/12/18 04:17:43 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload: starting chunk 1 size 5Mi offset 5Mi/10.000Mi 2025/12/18 04:17:43 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload: starting chunk 2 size 1 offset 10Mi/10.000Mi 2025/12/18 04:17:44 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload wrote chunk 3 with 1 bytes and etag "ab95f1fa7da6a90274409b89562f3ffd" 2025/12/18 04:19:55 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload wrote chunk 1 with 5242880 bytes and etag "4c28640dc8df1933aaea192100d50ae0" 2025/12/18 04:19:57 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload wrote chunk 2 with 5242880 bytes and etag "e264fa295ef081d5ad9bfaa7e5e130b6" 2025/12/18 04:19:57 DEBUG : chunked-5Mi-10.000Mi.bin: multipart upload "VYUDFHmB8eenyWPbOMhvhB7qTxqXJu-y2_nlT8Lgrkb1hFbOl6ANWSqTvyXdLHqF2kxzylDkh29dL8mO3QWYsKYT81gK86j7aj254JCMZmwdXShOSLc6tLY6Guc2Fqiz" finished 2025/12/18 04:19:57 DEBUG : chunked-5Mi-10.000Mi.bin: Multipart upload Etag: b677d8f19ed57bf218653ea38827c920-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5Mi/10485761/Streamed 2025/12/18 04:19:59 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: open chunk writer: started multipart upload: i2cbbTJ9tnOw_Fy5XaEctezxa3qYdrQeETKTGMsRU7d12U4HkQKRPDTP7XLUjnn5tEfwiwEzKVoAbY6vb7YmgdRHAl-6uZzbj7sBjWEQaK-CYkjhMqKJqZVZMwHz6Il5 2025/12/18 04:20:00 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload: starting chunk 0 size 5Mi offset 0/off 2025/12/18 04:20:00 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload: starting chunk 1 size 5Mi offset 5Mi/off 2025/12/18 04:20:00 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload: starting chunk 2 size 1 offset 10Mi/off 2025/12/18 04:20:01 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload wrote chunk 3 with 1 bytes and etag "ab95f1fa7da6a90274409b89562f3ffd" 2025/12/18 04:22:13 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload wrote chunk 2 with 5242880 bytes and etag "e264fa295ef081d5ad9bfaa7e5e130b6" 2025/12/18 04:22:29 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload wrote chunk 1 with 5242880 bytes and etag "4c28640dc8df1933aaea192100d50ae0" 2025/12/18 04:22:29 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: multipart upload "i2cbbTJ9tnOw_Fy5XaEctezxa3qYdrQeETKTGMsRU7d12U4HkQKRPDTP7XLUjnn5tEfwiwEzKVoAbY6vb7YmgdRHAl-6uZzbj7sBjWEQaK-CYkjhMqKJqZVZMwHz6Il5" finished 2025/12/18 04:22:30 DEBUG : chunked-5Mi-10.000Mi-streamed.bin: Multipart upload Etag: b677d8f19ed57bf218653ea38827c920-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi/5299999 === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi/5299999/Streamed 2025/12/18 04:24:52 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: open chunk writer: started multipart upload: pcbKOqJLTHZ7J_LzPveF-Kv3Uveo6XE6JGKA-GHPSWWJHn2Phom0a2SrWUVSJ6-H0wNRYkb7sivgA5knocWXGEk7Zg7-iTvoGHwNJGZmEUayqP3FYxJUiw7oWQjpz7aK 2025/12/18 04:24:53 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: multipart upload: starting chunk 0 size 5.054Mi offset 0/off 2025/12/18 04:27:15 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: multipart upload wrote chunk 1 with 5299999 bytes and etag "2aa9b1ba4a7866fe619f84267d862086" 2025/12/18 04:27:15 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: multipart upload "pcbKOqJLTHZ7J_LzPveF-Kv3Uveo6XE6JGKA-GHPSWWJHn2Phom0a2SrWUVSJ6-H0wNRYkb7sivgA5knocWXGEk7Zg7-iTvoGHwNJGZmEUayqP3FYxJUiw7oWQjpz7aK" finished 2025/12/18 04:27:15 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: Multipart upload Etag: 070ae709b83078a0b79bf9a5d1dc765c-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi/5300000 2025/12/18 04:27:17 DEBUG : chunked-5.054Mi-5.054Mi.bin: open chunk writer: started multipart upload: iUdDeg5J-pfTwfuXOgC4yWzzpXLfNEdw0_oG5KZ6TBpVI_fBM2193djSgUnDfg9gPsEnYFgmCpyEifaYtgzeTmH5kFEeAMH9M5We7ZgaEJL2RL14rtT2Co5cRd7Zyw1F 2025/12/18 04:27:17 DEBUG : chunked-5.054Mi-5.054Mi.bin: multipart upload: starting chunk 0 size 5.054Mi offset 0/5.054Mi 2025/12/18 04:29:28 DEBUG : chunked-5.054Mi-5.054Mi.bin: multipart upload wrote chunk 1 with 5300000 bytes and etag "9618edfd251d9205c98f3f98bea76248" 2025/12/18 04:29:28 DEBUG : chunked-5.054Mi-5.054Mi.bin: multipart upload "iUdDeg5J-pfTwfuXOgC4yWzzpXLfNEdw0_oG5KZ6TBpVI_fBM2193djSgUnDfg9gPsEnYFgmCpyEifaYtgzeTmH5kFEeAMH9M5We7ZgaEJL2RL14rtT2Co5cRd7Zyw1F" finished 2025/12/18 04:29:28 DEBUG : chunked-5.054Mi-5.054Mi.bin: Multipart upload Etag: 3206ce1fe2872bce7fc98309c9c126a0-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi/5300000/Streamed 2025/12/18 04:29:30 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: open chunk writer: started multipart upload: JS3xV5Exa6yW8OEXV3DoFWJ7mFu98leaxdZhHoEV1yyt0UPPq5YOnO0t5N2BxQXB1GigRBi_npcVD0JQwb65ol2lEnKKZ2KPG15ZjflBZk05ygbX88cFIyr9npfDklxA 2025/12/18 04:29:31 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: multipart upload: starting chunk 0 size 5.054Mi offset 0/off 2025/12/18 04:31:36 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: multipart upload wrote chunk 1 with 5300000 bytes and etag "9618edfd251d9205c98f3f98bea76248" 2025/12/18 04:31:36 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: multipart upload "JS3xV5Exa6yW8OEXV3DoFWJ7mFu98leaxdZhHoEV1yyt0UPPq5YOnO0t5N2BxQXB1GigRBi_npcVD0JQwb65ol2lEnKKZ2KPG15ZjflBZk05ygbX88cFIyr9npfDklxA" finished 2025/12/18 04:31:36 DEBUG : chunked-5.054Mi-5.054Mi-streamed.bin: Multipart upload Etag: 3206ce1fe2872bce7fc98309c9c126a0-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi/10600001 2025/12/18 04:31:38 DEBUG : chunked-5.054Mi-10.109Mi.bin: open chunk writer: started multipart upload: a8_J5do2fSTQdKkujJkdp9FTyMf_qsz6KaclZp8LV0XHU1Mmn7r6VzKj26O10rSV8ukJYSa82q4gg5-56RMsJsEzUUGx5wFSphn9G4JH6uPcOvBNq-q0lqYOn2wkO6uc 2025/12/18 04:31:39 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload: starting chunk 0 size 5.054Mi offset 0/10.109Mi 2025/12/18 04:31:39 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload: starting chunk 1 size 5.054Mi offset 5.054Mi/10.109Mi 2025/12/18 04:31:39 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload: starting chunk 2 size 1 offset 10.109Mi/10.109Mi 2025/12/18 04:31:40 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload wrote chunk 3 with 1 bytes and etag "ffe51d3e7d8297237588704eeddc6ab2" 2025/12/18 04:33:49 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload wrote chunk 2 with 5300000 bytes and etag "442123fe50ef82513b6b6ae0fdef48b5" 2025/12/18 04:33:52 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload wrote chunk 1 with 5300000 bytes and etag "9618edfd251d9205c98f3f98bea76248" 2025/12/18 04:33:52 DEBUG : chunked-5.054Mi-10.109Mi.bin: multipart upload "a8_J5do2fSTQdKkujJkdp9FTyMf_qsz6KaclZp8LV0XHU1Mmn7r6VzKj26O10rSV8ukJYSa82q4gg5-56RMsJsEzUUGx5wFSphn9G4JH6uPcOvBNq-q0lqYOn2wkO6uc" finished 2025/12/18 04:33:52 DEBUG : chunked-5.054Mi-10.109Mi.bin: Multipart upload Etag: ca2015b20b6523be232378f6c43a655e-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.054Mi/10600001/Streamed 2025/12/18 04:33:54 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: open chunk writer: started multipart upload: 7XMy_E2Rdgsf_blno28XvcaZPJPDtWzzAIXqBs8Bo7S5P1fBtlARgHmDA95Jt2oCGPbJbuByq1ybfGJEZlhkHh06_3k-BzRGzWXq5DO9I8eCTDJHt7IbiKx1CcqyjCGF 2025/12/18 04:33:54 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload: starting chunk 0 size 5.054Mi offset 0/off 2025/12/18 04:33:55 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload: starting chunk 1 size 5.054Mi offset 5.054Mi/off 2025/12/18 04:33:55 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload: starting chunk 2 size 1 offset 10.109Mi/off 2025/12/18 04:33:55 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload wrote chunk 3 with 1 bytes and etag "ffe51d3e7d8297237588704eeddc6ab2" 2025/12/18 04:36:16 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload wrote chunk 2 with 5300000 bytes and etag "442123fe50ef82513b6b6ae0fdef48b5" 2025/12/18 04:36:24 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload wrote chunk 1 with 5300000 bytes and etag "9618edfd251d9205c98f3f98bea76248" 2025/12/18 04:36:25 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: multipart upload "7XMy_E2Rdgsf_blno28XvcaZPJPDtWzzAIXqBs8Bo7S5P1fBtlARgHmDA95Jt2oCGPbJbuByq1ybfGJEZlhkHh06_3k-BzRGzWXq5DO9I8eCTDJHt7IbiKx1CcqyjCGF" finished 2025/12/18 04:36:25 DEBUG : chunked-5.054Mi-10.109Mi-streamed.bin: Multipart upload Etag: ca2015b20b6523be232378f6c43a655e-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi/5300052 === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi/5300052/Streamed 2025/12/18 04:38:28 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: open chunk writer: started multipart upload: NfZonAErbC8iQ83PspWX46C9-I7oQb9t0xfF7XKhX13d6cru8-vJUDGq2rXxu2kiuaQyovDOvynHWpDUslgtkWySenpTlMiJX7sEK_1lHcdHoOfpHEH50kHcm_QOY50P 2025/12/18 04:38:28 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: multipart upload: starting chunk 0 size 5.055Mi offset 0/off 2025/12/18 04:40:36 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: multipart upload wrote chunk 1 with 5300052 bytes and etag "e5c2980c0cc5f4df179c21e20019663d" 2025/12/18 04:40:36 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: multipart upload "NfZonAErbC8iQ83PspWX46C9-I7oQb9t0xfF7XKhX13d6cru8-vJUDGq2rXxu2kiuaQyovDOvynHWpDUslgtkWySenpTlMiJX7sEK_1lHcdHoOfpHEH50kHcm_QOY50P" finished 2025/12/18 04:40:36 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: Multipart upload Etag: 71944443394f5a6630c3e854be917d49-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi/5300053 2025/12/18 04:40:38 DEBUG : chunked-5.055Mi-5.055Mi.bin: open chunk writer: started multipart upload: vvsN-hlktZ4f5hJlsJU-V8qwCqC-1fegy-ZtEkf9oGk1C2OFuw7R14Gbz8DySP3-Q2nD7heeINl2Lvc8ZasKITvZ5XaZ-wdZFmXYaXkc-w38DmS4z2SlMqMYS1SRawc3 2025/12/18 04:40:38 DEBUG : chunked-5.055Mi-5.055Mi.bin: multipart upload: starting chunk 0 size 5.055Mi offset 0/5.055Mi 2025/12/18 04:42:25 DEBUG : chunked-5.055Mi-5.055Mi.bin: multipart upload wrote chunk 1 with 5300053 bytes and etag "96c71725f4c229231bc16c79b1ff08fd" 2025/12/18 04:42:25 DEBUG : chunked-5.055Mi-5.055Mi.bin: multipart upload "vvsN-hlktZ4f5hJlsJU-V8qwCqC-1fegy-ZtEkf9oGk1C2OFuw7R14Gbz8DySP3-Q2nD7heeINl2Lvc8ZasKITvZ5XaZ-wdZFmXYaXkc-w38DmS4z2SlMqMYS1SRawc3" finished 2025/12/18 04:42:25 DEBUG : chunked-5.055Mi-5.055Mi.bin: Multipart upload Etag: 2dd0af08a18bb9524235b819d990351b-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi/5300053/Streamed 2025/12/18 04:42:27 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: open chunk writer: started multipart upload: z1r2-xX2cke6fCYnlXWhaDPOj7I2bEjk0Z7sY6FcmtIrPzXOq2qfe4u4Udzp6Gb7wJUxtjI02-0OPy3ZwZF2bAe2KbmgRxf_XHHJjDTY-n5Q0RCxP34uim8Di_9S5qu6 2025/12/18 04:42:27 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: multipart upload: starting chunk 0 size 5.055Mi offset 0/off 2025/12/18 04:44:12 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: multipart upload wrote chunk 1 with 5300053 bytes and etag "96c71725f4c229231bc16c79b1ff08fd" 2025/12/18 04:44:13 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: multipart upload "z1r2-xX2cke6fCYnlXWhaDPOj7I2bEjk0Z7sY6FcmtIrPzXOq2qfe4u4Udzp6Gb7wJUxtjI02-0OPy3ZwZF2bAe2KbmgRxf_XHHJjDTY-n5Q0RCxP34uim8Di_9S5qu6" finished 2025/12/18 04:44:13 DEBUG : chunked-5.055Mi-5.055Mi-streamed.bin: Multipart upload Etag: 2dd0af08a18bb9524235b819d990351b-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi/10600107 2025/12/18 04:44:15 DEBUG : chunked-5.055Mi-10.109Mi.bin: open chunk writer: started multipart upload: RYyOSTYsXrhqr4obxJ_cHFc4fHXgOg08I5g6S4N0uYfp2zi0ch-zHJUvmJKSmYORszAHwsvVtJDiGOO2INi_8I5ZkMI3uHmVxW4LJc4r1CMpLX4OVpJEquoX92a5HV1i 2025/12/18 04:44:16 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload: starting chunk 0 size 5.055Mi offset 0/10.109Mi 2025/12/18 04:44:16 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload: starting chunk 1 size 5.055Mi offset 5.055Mi/10.109Mi 2025/12/18 04:44:16 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload: starting chunk 2 size 1 offset 10.109Mi/10.109Mi 2025/12/18 04:44:17 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload wrote chunk 3 with 1 bytes and etag "cbb184dd8e05c9709e5dcaedaa0495cf" 2025/12/18 04:45:47 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload wrote chunk 2 with 5300053 bytes and etag "ea93706a29454b4fd13cc395bea103bb" 2025/12/18 04:45:48 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload wrote chunk 1 with 5300053 bytes and etag "96c71725f4c229231bc16c79b1ff08fd" 2025/12/18 04:45:48 DEBUG : chunked-5.055Mi-10.109Mi.bin: multipart upload "RYyOSTYsXrhqr4obxJ_cHFc4fHXgOg08I5g6S4N0uYfp2zi0ch-zHJUvmJKSmYORszAHwsvVtJDiGOO2INi_8I5ZkMI3uHmVxW4LJc4r1CMpLX4OVpJEquoX92a5HV1i" finished 2025/12/18 04:45:48 DEBUG : chunked-5.055Mi-10.109Mi.bin: Multipart upload Etag: 65ca3f2f064ee118f2db3a528b303125-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/5.055Mi/10600107/Streamed 2025/12/18 04:45:51 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: open chunk writer: started multipart upload: nNmJ0b14ZLhE3rNR03ZUnlvtCFkLir1oHYn-A-DzWh5LrkSb1pUvBuXnqtzmgRUj4hScLCUuPibD-ROgnrq-Ve7sMOvTmPMsmg8Xi9BmFa04Pg65hRbr5hy9TGMJs4Ol 2025/12/18 04:45:51 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload: starting chunk 0 size 5.055Mi offset 0/off 2025/12/18 04:45:51 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload: starting chunk 1 size 5.055Mi offset 5.055Mi/off 2025/12/18 04:45:51 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload: starting chunk 2 size 1 offset 10.109Mi/off 2025/12/18 04:45:51 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload wrote chunk 3 with 1 bytes and etag "cbb184dd8e05c9709e5dcaedaa0495cf" 2025/12/18 04:47:42 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload wrote chunk 2 with 5300053 bytes and etag "ea93706a29454b4fd13cc395bea103bb" 2025/12/18 04:47:46 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload wrote chunk 1 with 5300053 bytes and etag "96c71725f4c229231bc16c79b1ff08fd" 2025/12/18 04:47:46 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: multipart upload "nNmJ0b14ZLhE3rNR03ZUnlvtCFkLir1oHYn-A-DzWh5LrkSb1pUvBuXnqtzmgRUj4hScLCUuPibD-ROgnrq-Ve7sMOvTmPMsmg8Xi9BmFa04Pg65hRbr5hy9TGMJs4Ol" finished 2025/12/18 04:47:46 DEBUG : chunked-5.055Mi-10.109Mi-streamed.bin: Multipart upload Etag: 65ca3f2f064ee118f2db3a528b303125-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi/6990505 === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi/6990505/Streamed 2025/12/18 04:50:07 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: open chunk writer: started multipart upload: U8tNlFLGoYPGWPpTylhBGYfFH3mZCniSpUrcxzoa9XUFU658Hdp53uCUjMvT5aMQRqWdEYoH6Mfdcn2IHdqZFXUbmeXzXpJOGihtHOxoXggsWfG8h2kV06H1xr3IgHaW 2025/12/18 04:50:07 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: multipart upload: starting chunk 0 size 6.667Mi offset 0/off 2025/12/18 04:52:33 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: multipart upload wrote chunk 1 with 6990505 bytes and etag "e9548a82ce25f02a063ee0076122ee24" 2025/12/18 04:52:34 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: multipart upload "U8tNlFLGoYPGWPpTylhBGYfFH3mZCniSpUrcxzoa9XUFU658Hdp53uCUjMvT5aMQRqWdEYoH6Mfdcn2IHdqZFXUbmeXzXpJOGihtHOxoXggsWfG8h2kV06H1xr3IgHaW" finished 2025/12/18 04:52:34 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: Multipart upload Etag: 350df36975967a82a7468a62a63e0761-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi/6990506 2025/12/18 04:52:36 DEBUG : chunked-6.667Mi-6.667Mi.bin: open chunk writer: started multipart upload: yTCXG7uuMvMcJG5DeUG1_2b5SLN38bgA7VhcBToGd2UQfIjDqe1ixoeH4jjhGwFZqsGzmTxn6TfatBn8dGOQQjBWOUzwrYo_zpEe1gmYRNJ4QdpLOOd9uwCKo2dkRpYZ 2025/12/18 04:52:36 DEBUG : chunked-6.667Mi-6.667Mi.bin: multipart upload: starting chunk 0 size 6.667Mi offset 0/6.667Mi 2025/12/18 04:54:50 DEBUG : chunked-6.667Mi-6.667Mi.bin: multipart upload wrote chunk 1 with 6990506 bytes and etag "6d02ef9f797a6d2cac923531b40a7113" 2025/12/18 04:54:51 DEBUG : chunked-6.667Mi-6.667Mi.bin: multipart upload "yTCXG7uuMvMcJG5DeUG1_2b5SLN38bgA7VhcBToGd2UQfIjDqe1ixoeH4jjhGwFZqsGzmTxn6TfatBn8dGOQQjBWOUzwrYo_zpEe1gmYRNJ4QdpLOOd9uwCKo2dkRpYZ" finished 2025/12/18 04:54:51 DEBUG : chunked-6.667Mi-6.667Mi.bin: Multipart upload Etag: d8a820173c91e166112e77c629504581-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi/6990506/Streamed 2025/12/18 04:54:53 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: open chunk writer: started multipart upload: ENik2EvQ9n8yZNbi8ZGswQUCa1bh1nT8fMRafUgfgiSu_f7L9hLNi59au4HNym3wyXh_kxfOhPYAkAlwkP_khAGRNnndof4GjrHXeUVw0W8yeMnuNKPp6hQY03-54NDr 2025/12/18 04:54:53 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: multipart upload: starting chunk 0 size 6.667Mi offset 0/off 2025/12/18 04:57:23 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: multipart upload wrote chunk 1 with 6990506 bytes and etag "6d02ef9f797a6d2cac923531b40a7113" 2025/12/18 04:57:23 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: multipart upload "ENik2EvQ9n8yZNbi8ZGswQUCa1bh1nT8fMRafUgfgiSu_f7L9hLNi59au4HNym3wyXh_kxfOhPYAkAlwkP_khAGRNnndof4GjrHXeUVw0W8yeMnuNKPp6hQY03-54NDr" finished 2025/12/18 04:57:23 DEBUG : chunked-6.667Mi-6.667Mi-streamed.bin: Multipart upload Etag: d8a820173c91e166112e77c629504581-1 OK === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi/13981013 2025/12/18 04:57:27 DEBUG : chunked-6.667Mi-13.333Mi.bin: open chunk writer: started multipart upload: ZwniPgIze07Q5mYCrHCrstu0O2QFrE-Ddx7rk7BB6xtdswSvmDxGiBq6a-mFfmkLHqMywcA26gXXSwVRbmTm3YoBVwzQpGPBGo-FS9nCAfzDCRVzAICpr69NoYO2G9ad 2025/12/18 04:57:28 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload: starting chunk 0 size 6.667Mi offset 0/13.333Mi 2025/12/18 04:57:28 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload: starting chunk 1 size 6.667Mi offset 6.667Mi/13.333Mi 2025/12/18 04:57:28 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload: starting chunk 2 size 1 offset 13.333Mi/13.333Mi 2025/12/18 04:57:29 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload wrote chunk 3 with 1 bytes and etag "43ec3e5dee6e706af7766fffea512721" 2025/12/18 04:59:54 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload wrote chunk 1 with 6990506 bytes and etag "6d02ef9f797a6d2cac923531b40a7113" 2025/12/18 05:00:00 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload wrote chunk 2 with 6990506 bytes and etag "d01a45d4e43a2541c997a15d557b0479" 2025/12/18 05:00:01 DEBUG : chunked-6.667Mi-13.333Mi.bin: multipart upload "ZwniPgIze07Q5mYCrHCrstu0O2QFrE-Ddx7rk7BB6xtdswSvmDxGiBq6a-mFfmkLHqMywcA26gXXSwVRbmTm3YoBVwzQpGPBGo-FS9nCAfzDCRVzAICpr69NoYO2G9ad" finished 2025/12/18 05:00:01 DEBUG : chunked-6.667Mi-13.333Mi.bin: Multipart upload Etag: 4544b41f053fa26e7f5f5e06ac981f9b-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/6.667Mi/13981013/Streamed 2025/12/18 05:00:03 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: open chunk writer: started multipart upload: V-A7dYg2c5A1jW0nzFO9Z7OLT36ZEQewTSLqg8pXPM7ZpAnRjjvHV_BSpWZ7pQPLpkhULb5XKHVUPfao3C-zFUGOvgaX4NvkFzzNpqIR_-XlCafw6YWpswW63vVildLe 2025/12/18 05:00:03 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload: starting chunk 0 size 6.667Mi offset 0/off 2025/12/18 05:00:04 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload: starting chunk 1 size 6.667Mi offset 6.667Mi/off 2025/12/18 05:00:04 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload: starting chunk 2 size 1 offset 13.333Mi/off 2025/12/18 05:00:04 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload wrote chunk 3 with 1 bytes and etag "43ec3e5dee6e706af7766fffea512721" 2025/12/18 05:01:52 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload wrote chunk 2 with 6990506 bytes and etag "d01a45d4e43a2541c997a15d557b0479" 2025/12/18 05:01:54 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload wrote chunk 1 with 6990506 bytes and etag "6d02ef9f797a6d2cac923531b40a7113" 2025/12/18 05:01:55 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: multipart upload "V-A7dYg2c5A1jW0nzFO9Z7OLT36ZEQewTSLqg8pXPM7ZpAnRjjvHV_BSpWZ7pQPLpkhULb5XKHVUPfao3C-zFUGOvgaX4NvkFzzNpqIR_-XlCafw6YWpswW63vVildLe" finished 2025/12/18 05:01:55 DEBUG : chunked-6.667Mi-13.333Mi-streamed.bin: Multipart upload Etag: 4544b41f053fa26e7f5f5e06ac981f9b-3 OK === RUN TestIntegration/FsMkdir/FsPutChunked/8Mi === RUN TestIntegration/FsMkdir/FsPutChunked/8Mi/8388607 panic: test timed out after 1h0m0s running tests: TestIntegration (1h0m0s) TestIntegration/FsMkdir (59m58s) TestIntegration/FsMkdir/FsPutChunked (53m13s) TestIntegration/FsMkdir/FsPutChunked/8Mi (5s) TestIntegration/FsMkdir/FsPutChunked/8Mi/8388607 (5s) goroutine 1375 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2484 +0x394 created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 60 minutes]: testing.(*T).Run(0xc0004e4e00, {0x12edcba?, 0xc0000f5b30?}, 0x1370a90) /usr/local/go/src/testing/testing.go:1859 +0x431 testing.runTests.func1(0xc0004e4e00) /usr/local/go/src/testing/testing.go:2279 +0x37 testing.tRunner(0xc0004e4e00, 0xc0000f5c70) /usr/local/go/src/testing/testing.go:1792 +0xf4 testing.runTests(0xc0000101c8, {0x1d5d360, 0x7, 0x7}, {0x1d884c0?, 0x7?, 0x1d86420?}) /usr/local/go/src/testing/testing.go:2277 +0x4b4 testing.(*M).Run(0xc00039ee60) /usr/local/go/src/testing/testing.go:2142 +0x64a main.main() _testmain.go:57 +0x9b goroutine 54 [chan receive, 59 minutes]: testing.(*T).Run(0xc000334a80, {0x12e3a34?, 0xc000644a88?}, 0xc0007b6300) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/fstest/fstests.Run(0xc000334a80, 0xc0005860d0) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:584 +0x103e github.com/rclone/rclone/backend/s3.TestIntegration(0xc000334a80) /home/rclone/go/src/github.com/rclone/rclone/backend/s3/s3_test.go:38 +0x146 testing.tRunner(0xc000334a80, 0x1370a90) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 11 [chan receive, 53 minutes]: testing.(*T).Run(0xc0004e4700, {0x12ea888?, 0x0?}, 0xc00038d590) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/fstest/fstests.Run.func13(0xc0004e4700) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:2352 +0xc73 testing.tRunner(0xc0004e4700, 0xc0007b6300) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 54 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 22 [syscall, 60 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 54 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 23 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 54 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 1359 [chan receive]: testing.(*T).Run(0xc000334c40, {0xc0003b6720?, 0xc00069df48?}, 0xc0003d5a10) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/fstest/fstests.Run.func13.15.3(0xc000334c40) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:2444 +0x18e testing.tRunner(0xc000334c40, 0xc0004fb360) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 952 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 9 [select]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc0001ac780, {0x154a5d8, 0xc000794fa0}) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:352 +0x145 created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 54 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:389 +0x11a goroutine 1360 [select]: net/http.(*persistConn).roundTrip(0xc00059cc60, 0xc0004fbae0) /usr/local/go/src/net/http/transport.go:2826 +0x785 net/http.(*Transport).roundTrip(0xc0006381a0, 0xc0001c52c0) /usr/local/go/src/net/http/transport.go:696 +0xb9a net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:30 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0000a03c0, 0xc0001c52c0) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:496 +0x345 net/http.send(0xc0001c52c0, {0x1539140, 0xc0000a03c0}, {0xc00067fe01?, 0x6b?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e2 net/http.(*Client).send(0xc0003cc9c0, 0xc0001c52c0, {0x10?, 0xc000100008?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x91 net/http.(*Client).do(0xc0003cc9c0, 0xc0001c52c0) /usr/local/go/src/net/http/client.go:728 +0x989 net/http.(*Client).Do(0x7465949f2898?, 0xc00073cd30?) /usr/local/go/src/net/http/client.go:587 +0x13 github.com/aws/smithy-go/transport/http.ClientHandler.Handle({{0x746594a38198?, 0xc0003cc9c0?}, {0x1552148?, 0x1da82a0?}}, {0x154a5a0?, 0xc0028c4030?}, {0x12c1560, 0xc0003c2ea0}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/client.go:92 +0x358 github.com/aws/smithy-go/middleware.deserializeWrapHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:191 github.com/aws/smithy-go/transport/http.(*InterceptTransmit).HandleDeserialize(0xc0003c2450, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b320, 0xc00073d350}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/interceptor_middleware.go:207 +0x159 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/smithy-go/transport/http.(*RequestResponseLogger).HandleDeserialize(0xc0003b67d0, {0x154a5a0, 0xc0028c4030}, {{0x12c1560, 0xc0003c2ea0}}, {0x153b340, 0xc000467b00}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/middleware_http_logging.go:58 +0x28f github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/aws-sdk-go-v2/aws/middleware.RecordResponseTiming.HandleDeserialize({}, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467b20?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2@v1.39.6/aws/middleware/middleware.go:57 +0x6e github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/aws-sdk-go-v2/internal/middleware.(*AddTimeOffsetMiddleware).HandleDeserialize(0xc0003203b8, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340, 0xc000467b40}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2@v1.39.6/internal/middleware/middleware.go:41 +0xa2 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/smithy-go/transport/http.(*InterceptBeforeDeserialization).HandleDeserialize(0xc0005d5188, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467b60?}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/interceptor_middleware.go:241 +0x58 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/aws-sdk-go-v2/service/s3.(*awsRestxml_deserializeOpPutObject).HandleDeserialize(0x0?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467b80?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/deserializers.go:12343 +0x8e github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/smithy-go/transport/http.(*InterceptAfterDeserialization).HandleDeserialize(0xc0005d51a0, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467ba0?}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/interceptor_middleware.go:274 +0x58 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/aws-sdk-go-v2/service/internal/s3shared.(*metadataRetriever).HandleDeserialize(0x153af40?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467bc0?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/internal/s3shared@v1.19.13/metadata_retriever.go:32 +0x5c github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/aws-sdk-go-v2/service/internal/s3shared.(*errorWrapper).HandleDeserialize(0x0?, {0x154a5a0?, 0xc0028c4030?}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467be0?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/internal/s3shared@v1.19.13/response_error_middleware.go:30 +0x53 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/smithy-go/transport/http.(*closeResponseBody).HandleDeserialize(0x0?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467c00?}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/middleware_close_response_body.go:60 +0x53 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/smithy-go/transport/http.(*errorCloseResponseBodyMiddleware).HandleDeserialize(0x100?, {0x154a5a0?, 0xc0028c4030?}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467c20?}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/middleware_close_response_body.go:29 +0x53 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/aws-sdk-go-v2/aws/middleware.AddRawResponse.HandleDeserialize({}, {0x154a5a0?, 0xc0028c4030?}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b340?, 0xc000467c40?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2@v1.39.6/aws/middleware/middleware.go:154 +0x62 github.com/aws/smithy-go/middleware.decoratedDeserializeHandler.HandleDeserialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:207 github.com/aws/smithy-go/middleware.(*DeserializeStep).HandleMiddleware(0x47e77e?, {0x154a5a0, 0xc0028c4030}, {0x12c1560, 0xc0003c2ea0}, {0x153afc0, 0xc0004671a0}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_deserialize.go:121 +0x22c github.com/aws/smithy-go/middleware.decoratedHandler.Handle(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/middleware.go:57 github.com/aws/smithy-go/middleware.finalizeWrapHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:185 github.com/aws/smithy-go/transport/http.(*InterceptAfterSigning).HandleFinalize(0x1da82a0?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b2e0, 0xc00073cf60}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/interceptor_middleware.go:181 +0x10a github.com/aws/smithy-go/middleware.decoratedFinalizeHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:201 github.com/aws/aws-sdk-go-v2/service/s3.(*signRequestMiddleware).HandleFinalize(0x8a235b?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b300, 0xc000467740}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/auth.go:372 +0x4f8 github.com/aws/smithy-go/middleware.decoratedFinalizeHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:201 github.com/aws/smithy-go/transport/http.(*InterceptBeforeSigning).HandleFinalize(0xc000681280?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b300, 0xc000467760}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/interceptor_middleware.go:156 +0x10a github.com/aws/smithy-go/middleware.decoratedFinalizeHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:201 github.com/aws/aws-sdk-go-v2/service/s3.(*setLegacyContextSigningOptionsMiddleware).HandleFinalize(0xc00068130a?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b300, 0xc000467780}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/auth.go:56 +0x5e2 github.com/aws/smithy-go/middleware.decoratedFinalizeHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:201 github.com/aws/aws-sdk-go-v2/aws/signer/v4.(*ContentSHA256Header).HandleFinalize(0x8a1fd8?, {0x154a5a0, 0xc0028c4030}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b300, 0xc0004677a0}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2@v1.39.6/aws/signer/v4/middleware.go:242 +0x1ba github.com/aws/smithy-go/middleware.decoratedFinalizeHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:201 github.com/aws/aws-sdk-go-v2/aws/signer/v4.(*UnsignedPayload).HandleFinalize(0x154a5a0?, {0x154a5a0, 0xc0003c3f50}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b300, 0xc0004677c0}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2@v1.39.6/aws/signer/v4/middleware.go:123 +0xdb github.com/aws/smithy-go/middleware.decoratedFinalizeHandler.HandleFinalize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_finalize.go:201 github.com/aws/aws-sdk-go-v2/service/internal/checksum.(*AddInputChecksumTrailer).HandleFinalize(0xc0005d50e0, {0x154a5a0, 0xc0003c3f50}, {{0x12c1560?, 0xc0003c2ea0?}}, {0x153b300, 0xc0004677e0}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/internal/checksum@v1.9.4/middleware_compute_input_checksum.go:273 +0x2e6 ...64 frames elided... github.com/aws/aws-sdk-go-v2/service/s3/internal/customizations.(*processARNResource).HandleSerialize(0xc0025e0e40, {0x154a5a0, 0xc0003c2ae0}, {{0x11cb840?, 0xc0004ce680?}, {0x12c1560?, 0xc0003c2930?}}, {0x153b280, 0xc000467520}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/internal/customizations/process_arn_resource.go:54 +0x1219 github.com/aws/smithy-go/middleware.decoratedSerializeHandler.HandleSerialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_serialize.go:208 github.com/aws/aws-sdk-go-v2/service/s3.(*ResolveEndpoint).HandleSerialize(0xc0004fb4f0, {0x154a5a0, 0xc0003c2ae0}, {{0x11cb840?, 0xc0004ce680?}, {0x12c1560?, 0xc0003c2930?}}, {0x153b280, 0xc000467540}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/endpoints.go:89 +0x755 github.com/aws/smithy-go/middleware.decoratedSerializeHandler.HandleSerialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_serialize.go:208 github.com/aws/aws-sdk-go-v2/service/s3.(*setOperationInputMiddleware).HandleSerialize(0x1da82a0?, {0x154a5a0?, 0xc0003c2a20?}, {{0x11cb840?, 0xc0004ce680?}, {0x12c1560?, 0xc0003c2930?}}, {0x153b280, 0xc000467560}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_client.go:355 +0xb5 github.com/aws/smithy-go/middleware.decoratedSerializeHandler.HandleSerialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_serialize.go:208 github.com/aws/aws-sdk-go-v2/service/s3.(*putBucketContextMiddleware).HandleSerialize(0x41b014?, {0x154a5a0, 0xc0003c2900}, {{0x11cb840?, 0xc0004ce680?}, {0x12c1560?, 0xc0003c2930?}}, {0x153b280, 0xc000467580}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/bucket_context.go:26 +0xdc github.com/aws/smithy-go/middleware.decoratedSerializeHandler.HandleSerialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_serialize.go:208 github.com/aws/aws-sdk-go-v2/service/s3.(*spanBuildRequestStart).HandleSerialize(0x90?, {0x154a5a0?, 0xc0003c2900?}, {{0x11cb840?, 0xc0004ce680?}, {0x12c1560?, 0xc0003c2930?}}, {0x153b280, 0xc0004675a0}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_client.go:1426 +0xaf github.com/aws/smithy-go/middleware.decoratedSerializeHandler.HandleSerialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_serialize.go:208 github.com/aws/smithy-go/middleware.(*SerializeStep).HandleMiddleware(0xc00073cda0, {0x154a5a0, 0xc0003c2900}, {0x11cb840, 0xc0004ce680}, {0x153b020, 0xc000467220}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_serialize.go:122 +0x26f github.com/aws/smithy-go/middleware.decoratedHandler.Handle(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/middleware.go:57 github.com/aws/smithy-go/middleware.initializeWrapHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:184 github.com/aws/aws-sdk-go-v2/service/s3.(*spanInitializeEnd).HandleInitialize(0x3?, {0x154a5a0?, 0xc0003c2900?}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2a0, 0xc00073ce40}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_client.go:1409 +0x8b github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/aws-sdk-go-v2/service/s3.(*validateOpPutObject).HandleInitialize(0xc000320301?, {0x154a5a0, 0xc0003c2900}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0, 0xc000467280}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/validators.go:1790 +0xc6 github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/smithy-go/middleware.(*setLogger).HandleInitialize(0xc0003203a8?, {0x154a5a0?, 0xc0003c2840?}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0, 0xc0004672a0}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/logging.go:45 +0x8c github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/aws-sdk-go-v2/service/internal/s3shared.(*ARNLookup).HandleInitialize(0xc0003c2840?, {0x154a5a0, 0xc0003c2840}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0, 0xc0004672c0}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/internal/s3shared@v1.19.13/arn_lookup.go:39 +0x262 github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/aws-sdk-go-v2/service/s3.(*legacyEndpointContextSetter).HandleInitialize(0x8a1fd8?, {0x154a5a0?, 0xc0003c2840?}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0?, 0xc000467360?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_client.go:418 +0x9e github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/aws-sdk-go-v2/aws/middleware.RegisterServiceMetadata.HandleInitialize({{0x12d8a98, 0x2}, {0x0, 0x0}, {0x12e606c, 0x9}, {0x12e673e, 0x9}}, {0x154a5a0, 0xc0003c2630}, ...) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2@v1.39.6/aws/middleware/metadata.go:41 +0x1c6 github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/aws-sdk-go-v2/service/internal/checksum.(*SetupInputContext).HandleInitialize(0xc0005d50c8?, {0x154a5a0, 0xc0003c2630}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0, 0xc0004673c0}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/internal/checksum@v1.9.4/middleware_setup_context.go:62 +0xf2 github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/smithy-go/transport/http.(*InterceptExecution).HandleInitialize(0xc0003c2390, {0x154a5a0, 0xc0003c2510}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0, 0xc0004673e0}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/transport/http/interceptor_middleware.go:46 +0x1f0 github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/aws-sdk-go-v2/service/s3.(*spanInitializeStart).HandleInitialize(0x4181bf?, {0x154a5a0?, 0xc0003c2510?}, {{0x11cb840?, 0xc0004ce680?}}, {0x153b2c0, 0xc000467400}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_client.go:1391 +0x85 github.com/aws/smithy-go/middleware.decoratedInitializeHandler.HandleInitialize(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:200 github.com/aws/smithy-go/middleware.(*InitializeStep).HandleMiddleware(0xc0000c6270?, {0x154a5a0, 0xc0003c2510}, {0x11cb840, 0xc0004ce680}, {0x153b020, 0xc000467240}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/step_initialize.go:114 +0x22c github.com/aws/smithy-go/middleware.decoratedHandler.Handle(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/middleware.go:57 github.com/aws/smithy-go/middleware.(*Stack).HandleMiddleware(0x418101?, {0x154a5a0, 0xc0003c2510}, {0x11cb840, 0xc0004ce680}, {0x153afc0?, 0xc0004671a0?}) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/stack.go:109 +0x183 github.com/aws/smithy-go/middleware.decoratedHandler.Handle(...) /home/rclone/go/pkg/mod/github.com/aws/smithy-go@v1.23.2/middleware/middleware.go:57 github.com/aws/aws-sdk-go-v2/service/s3.(*Client).invokeOperation(0xc000644708, {0x154a4f8?, 0x1da82a0?}, {0x12e673e, 0x9}, {0x11cb840, 0xc0004ce680}, {0xc00073cd40, 0x2, 0x2}, ...) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_client.go:305 +0xb75 github.com/aws/aws-sdk-go-v2/service/s3.(*Client).PutObject(0x41c193?, {0x154a4f8?, 0x1da82a0?}, 0xc000629698?, {0xc00073cd40?, 0xc000335dc0?, 0xc0006296c8?}) /home/rclone/go/pkg/mod/github.com/aws/aws-sdk-go-v2/service/s3@v1.90.0/api_op_PutObject.go:152 +0x10c github.com/rclone/rclone/backend/s3.(*Object).uploadSinglepartPutObject.func2() /home/rclone/go/src/github.com/rclone/rclone/backend/s3/s3.go:4409 +0x5e github.com/rclone/rclone/fs.pacerInvoker(0x1, 0x1, 0x4181bf?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:86 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000630120, 0xc0004fb4a0, 0x1) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:216 +0xd2 github.com/rclone/rclone/lib/pacer.(*Pacer).CallNoRetry(...) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:244 github.com/rclone/rclone/backend/s3.(*Object).uploadSinglepartPutObject(0xc002893b90, {0x154a4f8, 0x1da82a0}, 0xc0004ce680, 0xc0004b0d90?, {0x1539340, 0xc000466f40}) /home/rclone/go/src/github.com/rclone/rclone/backend/s3/s3.go:4408 +0x3ba github.com/rclone/rclone/backend/s3.(*Object).Update(0xc002893b90, {0x154a4f8, 0x1da82a0}, {0x1539340, 0xc000466f40}, {0x154efb0, 0xc0004b0d90}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/s3/s3.go:4683 +0x414 github.com/rclone/rclone/backend/s3.(*Fs).Put(0xc000644a88, {0x154a4f8, 0x1da82a0}, {0x1539340, 0xc000466f40}, {0x154efb0, 0xc0004b0d90}, {0x0, 0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/backend/s3/s3.go:2544 +0x108 github.com/rclone/rclone/fstest/fstests.testPutLarge.func1() /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:246 +0x230 github.com/rclone/rclone/fstest/fstests.retry(0xc0006c2c40, {0x12e52de, 0x8}, 0xc000687e08) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:138 +0x117 github.com/rclone/rclone/fstest/fstests.testPutLarge({0x154a4f8, 0x1da82a0}, 0xc0006c2c40, {0x1550e80, 0xc000644a88}, 0xc000687f00, 0x6b?) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:236 +0x11d github.com/rclone/rclone/fstest/fstests.TestPutLarge(...) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:275 github.com/rclone/rclone/fstest/fstests.Run.func13.15.3.1(0xc0006c2c40) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:2445 +0x1e7 testing.tRunner(0xc0006c2c40, 0xc0003d5a10) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 1359 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 952 [chan receive]: testing.(*T).Run(0xc0027c1880, {0xc0003b66f8?, 0x0?}, 0xc0004fb360) /usr/local/go/src/testing/testing.go:1859 +0x431 github.com/rclone/rclone/fstest/fstests.Run.func13.15(0xc0027c1880) /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:2427 +0x665 testing.tRunner(0xc0027c1880, 0xc00038d590) /usr/local/go/src/testing/testing.go:1792 +0xf4 created by testing.(*T).Run in goroutine 11 /usr/local/go/src/testing/testing.go:1851 +0x413 goroutine 1193 [IO wait]: internal/poll.runtime_pollWait(0x7465dee76820, 0x72) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc000241400?, 0xc00059e000?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc000241400, {0xc00059e000, 0xa000, 0xa000}) /usr/local/go/src/internal/poll/fd_unix.go:165 +0x27a net.(*netFD).Read(0xc000241400, {0xc00059e000?, 0x2000?, 0x0?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc0006021a8, {0xc00059e000?, 0x5?, 0x5?}) /usr/local/go/src/net/net.go:194 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc00011a3f0, {0xc00059e000?, 0x74659638d278?, 0x7465df214108?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x29 crypto/tls.(*atLeastReader).Read(0xc0005d4078, {0xc00059e000?, 0x1da9f00?, 0xc0000f79d0?}) /usr/local/go/src/crypto/tls/conn.go:809 +0x3b bytes.(*Buffer).ReadFrom(0xc0004470b8, {0x153a180, 0xc0005d4078}) /usr/local/go/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc000446e08, {0x746594a3b328, 0xc00011a3f0}, 0x442654?) /usr/local/go/src/crypto/tls/conn.go:831 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc000446e08, 0x0) /usr/local/go/src/crypto/tls/conn.go:629 +0x3cf crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:591 crypto/tls.(*Conn).Read(0xc000446e08, {0xc000647000, 0x1000, 0xc000294840?}) /usr/local/go/src/crypto/tls/conn.go:1385 +0x145 net/http.(*persistConn).Read(0xc0001a3320, {0xc000647000?, 0x783ec5?, 0x1538e80?}) /usr/local/go/src/net/http/transport.go:2122 +0x47 bufio.(*Reader).fill(0xc000631020) /usr/local/go/src/bufio/bufio.go:113 +0x103 bufio.(*Reader).Peek(0xc000631020, 0x1) /usr/local/go/src/bufio/bufio.go:152 +0x53 net/http.(*persistConn).readLoop(0xc0001a3320) /usr/local/go/src/net/http/transport.go:2275 +0x172 created by net/http.(*Transport).dialConn in goroutine 1188 /usr/local/go/src/net/http/transport.go:1944 +0x174f goroutine 1362 [IO wait]: internal/poll.runtime_pollWait(0x7465dee765f0, 0x77) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc000241300?, 0xc0005ef886?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitWrite(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:93 internal/poll.(*FD).Write(0xc000241300, {0xc0005ed000, 0x4016, 0x4800}) /usr/local/go/src/internal/poll/fd_unix.go:397 +0x2ff net.(*netFD).Write(0xc000241300, {0xc0005ed000?, 0xf2cdeb?, 0xc000602288?}) /usr/local/go/src/net/fd_posix.go:96 +0x25 net.(*conn).Write(0xc000602288, {0xc0005ed000?, 0x4006?, 0xc000645e60?}) /usr/local/go/src/net/net.go:206 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Write(0xc000780450, {0xc0005ed000, 0x4016, 0x4800}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:122 +0x58 crypto/tls.(*Conn).write(0xc000645c08, {0xc0005ed000?, 0x5?, 0x4800?}) /usr/local/go/src/crypto/tls/conn.go:948 +0x109 crypto/tls.(*Conn).writeRecordLocked(0xc000645c08, 0x17, {0xc000160000, 0x8000, 0x8000}) /usr/local/go/src/crypto/tls/conn.go:1029 +0x67d crypto/tls.(*Conn).Write(0xc0005d53b0?, {0xc000160000, 0x8000, 0x8000}) /usr/local/go/src/crypto/tls/conn.go:1248 +0x37e io.copyBuffer({0x7465949f3b78, 0xc000645c08}, {0x1538d60, 0xc0005d53b0}, {0x0, 0x0, 0x0}) /usr/local/go/src/io/io.go:431 +0x1d7 io.Copy(...) /usr/local/go/src/io/io.go:388 net/http.persistConnWriter.ReadFrom({0x1d218d0?}, {0x1538d60?, 0xc0005d53b0?}) /usr/local/go/src/net/http/transport.go:1969 +0x5b bufio.(*Writer).ReadFrom(0xc0027bce40, {0x1538d60, 0xc0005d53b0}) /usr/local/go/src/bufio/bufio.go:798 +0x17c io.copyBuffer({0x1538f20, 0xc0027bce40}, {0x1538d60, 0xc0005d53b0}, {0xc0005c0000, 0x8000, 0x8000}) /usr/local/go/src/io/io.go:415 +0x151 io.CopyBuffer({0x1538f20?, 0xc0027bce40?}, {0x1538d60?, 0xc0005d53b0?}, {0xc0005c0000?, 0xc0005e3be0?, 0x479239?}) /usr/local/go/src/io/io.go:402 +0x36 net/http.(*transferWriter).doBodyCopy(0xc000210460, {0x1538f20, 0xc0027bce40}, {0x1538d60, 0xc0005d53b0}) /usr/local/go/src/net/http/transfer.go:417 +0xe5 net/http.(*transferWriter).writeBody(0xc000210460, {0x1538f20, 0xc0027bce40}) /usr/local/go/src/net/http/transfer.go:372 +0x366 net/http.(*Request).write(0xc0001c5400, {0x1538f20, 0xc0027bce40}, 0x0, 0x0, 0x0) /usr/local/go/src/net/http/request.go:762 +0xacd net/http.(*persistConn).writeLoop(0xc00059cc60) /usr/local/go/src/net/http/transport.go:2593 +0x174 created by net/http.(*Transport).dialConn in goroutine 1293 /usr/local/go/src/net/http/transport.go:1945 +0x17a5 goroutine 838 [chan receive, 53 minutes]: github.com/rclone/rclone/lib/atexit.Register.func1.1() /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:45 +0x29 created by github.com/rclone/rclone/lib/atexit.Register.func1 in goroutine 836 /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:44 +0x68 goroutine 1194 [select]: net/http.(*persistConn).writeLoop(0xc0001a3320) /usr/local/go/src/net/http/transport.go:2590 +0xe7 created by net/http.(*Transport).dialConn in goroutine 1188 /usr/local/go/src/net/http/transport.go:1945 +0x17a5 goroutine 1313 [IO wait]: internal/poll.runtime_pollWait(0x7465dee765f0, 0x72) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc000241300?, 0xc0001d6000?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc000241300, {0xc0001d6000, 0xa000, 0xa000}) /usr/local/go/src/internal/poll/fd_unix.go:165 +0x27a net.(*netFD).Read(0xc000241300, {0xc0001d6000?, 0xb9e1d6ce75a18803?, 0x5ddce3385746af69?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc000602288, {0xc0001d6000?, 0xc0005dd6d8?, 0x82e1d6ce75a18803?}) /usr/local/go/src/net/net.go:194 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc000780450, {0xc0001d6000?, 0x74659525ded0?, 0x7465df2145c0?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x29 crypto/tls.(*atLeastReader).Read(0xc000780378, {0xc0001d6000?, 0xc001847340?, 0x400d67bd0d0b1adc?}) /usr/local/go/src/crypto/tls/conn.go:809 +0x3b bytes.(*Buffer).ReadFrom(0xc000645eb8, {0x153a180, 0xc000780378}) /usr/local/go/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc000645c08, {0x746594a3b328, 0xc000780450}, 0x442654?) /usr/local/go/src/crypto/tls/conn.go:831 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc000645c08, 0x0) /usr/local/go/src/crypto/tls/conn.go:629 +0x3cf crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:591 crypto/tls.(*Conn).Read(0xc000645c08, {0xc0001f0000, 0x1000, 0x30?}) /usr/local/go/src/crypto/tls/conn.go:1385 +0x145 net/http.(*persistConn).Read(0xc00059cc60, {0xc0001f0000?, 0x723906?, 0xc0005ddcb0?}) /usr/local/go/src/net/http/transport.go:2122 +0x47 bufio.(*Reader).fill(0xc0025e1680) /usr/local/go/src/bufio/bufio.go:113 +0x103 bufio.(*Reader).ReadSlice(0xc0025e1680, 0xa) /usr/local/go/src/bufio/bufio.go:380 +0x29 bufio.(*Reader).ReadLine(0xc0025e1680) /usr/local/go/src/bufio/bufio.go:409 +0x25 net/textproto.(*Reader).readLineSlice(0xc0005ddcb0, 0xffffffffffffffff) /usr/local/go/src/net/textproto/reader.go:64 +0xa5 net/textproto.(*Reader).ReadLine(...) /usr/local/go/src/net/textproto/reader.go:44 net/http.ReadResponse(0xc0025e1680, 0xc0001c5400) /usr/local/go/src/net/http/response.go:161 +0x9e net/http.(*persistConn).readResponse(0xc00059cc60, {{}, 0xc0004fbae0, 0xc0000aac40, 0x0, 0x0, 0xc0000aabd0}, 0x0) /usr/local/go/src/net/http/transport.go:2463 +0xb1 net/http.(*persistConn).readLoop(0xc00059cc60) /usr/local/go/src/net/http/transport.go:2290 +0x2f4 created by net/http.(*Transport).dialConn in goroutine 1293 /usr/local/go/src/net/http/transport.go:1944 +0x174f exit status 2 FAIL github.com/rclone/rclone/backend/s3 3600.089s "go test -v -timeout 1h0m0s -remote TestS3Wasabi: -verbose" - Finished ERROR in 1h0m3.386087285s (try 1/5): exit status 1: Failed []