"./operations.test -test.v -test.timeout 1h0m0s -remote TestS3R2: -verbose -test.run '^(TestCopyURL|TestDirMove|TestMoveFile|TestMoveFileBackupDir|TestRcatSizeMetadata)$|^TestRcat$/^(withChecksum=false,ignoreChecksum=false|withChecksum=false,ignoreChecksum=true|withChecksum=true,ignoreChecksum=false|withChecksum=true,ignoreChecksum=true)$'" - Starting (try 2/5) 2025/01/11 02:43:34 DEBUG : Creating backend with remote "TestS3R2:rclone-test-koleped7nele" 2025/01/11 02:43:34 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/11 02:43:34 DEBUG : Creating backend with remote "/tmp/rclone772593980" === RUN TestCopyURL run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:35 INFO : S3 bucket rclone-test-koleped7nele: Bucket "rclone-test-koleped7nele" created with ACL "" 2025/01/11 02:43:35 DEBUG : filename.txt: File name found in url 2025/01/11 02:43:36 DEBUG : headerfilename.txt: filename found in Content-Disposition header. --- PASS: TestCopyURL (3.85s) === RUN TestMoveFile run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:38 DEBUG : file1: Need to transfer - File not found at Destination 2025/01/11 02:43:38 DEBUG : file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/01/11 02:43:38 INFO : file1: Copied (new) to: sub/file2 2025/01/11 02:43:38 INFO : file1: Deleted 2025/01/11 02:43:38 DEBUG : file1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/11 02:43:39 DEBUG : file1: Unchanged skipping 2025/01/11 02:43:39 INFO : file1: Deleted 2025/01/11 02:43:39 DEBUG : S3 bucket rclone-test-koleped7nele: don't need to copy/move sub/file2, it is already at target location --- PASS: TestMoveFile (1.65s) === RUN TestMoveFileBackupDir run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:40 DEBUG : Creating backend with remote "TestS3R2:rclone-test-koleped7nele/backup" 2025/01/11 02:43:40 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2025/01/11 02:43:41 DEBUG : dst/file1: md5 = 05164b153084ba910184c26e561a7c18 OK 2025/01/11 02:43:41 INFO : dst/file1: Copied (server-side copy) 2025/01/11 02:43:41 INFO : dst/file1: Deleted 2025/01/11 02:43:41 DEBUG : dst/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2025/01/11 02:43:41 INFO : dst/file1: Copied (new) 2025/01/11 02:43:41 INFO : dst/file1: Deleted --- PASS: TestMoveFileBackupDir (2.72s) === RUN TestDirMove run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:44 INFO : A1/B2: Making directory 2025/01/11 02:43:44 INFO : A1/B1/C3: Making directory fstest.go:244: Filtering empty directory "A1/B2" fstest.go:244: Filtering empty directory "A1/B1/C3" 2025/01/11 02:43:45 DEBUG : A1/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/01/11 02:43:45 INFO : A1/B1/C1/four: Copied (server-side copy) to: A2/B1/C1/four 2025/01/11 02:43:45 DEBUG : A1/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/11 02:43:45 INFO : A1/two: Copied (server-side copy) to: A2/two 2025/01/11 02:43:45 DEBUG : A1/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/01/11 02:43:45 INFO : A1/one: Copied (server-side copy) to: A2/one 2025/01/11 02:43:45 INFO : A1/B1/C1/four: Deleted 2025/01/11 02:43:45 DEBUG : A1/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/01/11 02:43:45 INFO : A1/B1/three: Copied (server-side copy) to: A2/B1/three 2025/01/11 02:43:45 INFO : A1/one: Deleted 2025/01/11 02:43:45 INFO : A1/two: Deleted 2025/01/11 02:43:46 INFO : A1/B1/three: Deleted 2025/01/11 02:43:46 DEBUG : A1/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/01/11 02:43:46 INFO : A1/B1/C2/five: Copied (server-side copy) to: A2/B1/C2/five 2025/01/11 02:43:46 INFO : A1/B1/C2/five: Deleted fstest.go:244: Filtering empty directory "A2/B2" fstest.go:244: Filtering empty directory "A2/B1/C3" 2025/01/11 02:43:47 DEBUG : A2/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/01/11 02:43:47 INFO : A2/one: Copied (server-side copy) to: A3/one 2025/01/11 02:43:47 DEBUG : A2/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/01/11 02:43:47 INFO : A2/B1/C2/five: Copied (server-side copy) to: A3/B1/C2/five 2025/01/11 02:43:47 DEBUG : A2/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/01/11 02:43:47 INFO : A2/B1/C1/four: Copied (server-side copy) to: A3/B1/C1/four 2025/01/11 02:43:47 DEBUG : A2/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/11 02:43:47 INFO : A2/two: Copied (server-side copy) to: A3/two 2025/01/11 02:43:47 INFO : A2/one: Deleted 2025/01/11 02:43:47 DEBUG : A2/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/01/11 02:43:47 INFO : A2/B1/three: Copied (server-side copy) to: A3/B1/three 2025/01/11 02:43:47 INFO : A2/B1/C2/five: Deleted 2025/01/11 02:43:47 INFO : A2/B1/C1/four: Deleted 2025/01/11 02:43:47 INFO : A2/two: Deleted 2025/01/11 02:43:47 INFO : A2/B1/three: Deleted fstest.go:244: Filtering empty directory "A3/B2" fstest.go:244: Filtering empty directory "A3/B1/C3" 2025/01/11 02:43:48 INFO : S3 bucket rclone-test-koleped7nele: Can't DirMove - falling back to file moves: can't move directory - incompatible remotes 2025/01/11 02:43:48 DEBUG : A3/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/01/11 02:43:48 INFO : A3/B1/C2/five: Copied (server-side copy) to: A4/B1/C2/five 2025/01/11 02:43:48 DEBUG : A3/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/01/11 02:43:48 INFO : A3/B1/C1/four: Copied (server-side copy) to: A4/B1/C1/four 2025/01/11 02:43:48 DEBUG : A3/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/01/11 02:43:48 INFO : A3/one: Copied (server-side copy) to: A4/one 2025/01/11 02:43:48 DEBUG : A3/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/11 02:43:48 INFO : A3/two: Copied (server-side copy) to: A4/two 2025/01/11 02:43:48 INFO : A3/B1/C2/five: Deleted 2025/01/11 02:43:48 INFO : A3/one: Deleted 2025/01/11 02:43:48 INFO : A3/B1/C1/four: Deleted 2025/01/11 02:43:48 DEBUG : A3/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/01/11 02:43:48 INFO : A3/B1/three: Copied (server-side copy) to: A4/B1/three 2025/01/11 02:43:49 INFO : A3/two: Deleted 2025/01/11 02:43:49 INFO : A3/B1/three: Deleted fstest.go:244: Filtering empty directory "A4/B2" fstest.go:244: Filtering empty directory "A4/B1/C3" --- PASS: TestDirMove (7.66s) === RUN TestRcat === RUN TestRcat/withChecksum=false,ignoreChecksum=false run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:50 DEBUG : S3 bucket rclone-test-koleped7nele: File to upload is small (34 bytes), uploading instead of streaming 2025/01/11 02:43:50 DEBUG : no_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2025/01/11 02:43:50 DEBUG : no_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical 2025/01/11 02:43:50 NOTICE: S3 bucket rclone-test-koleped7nele: Streaming uploads using chunk size 5Mi will have maximum file size of 48.828Gi 2025/01/11 02:43:50 DEBUG : no_checksum_big_file_from_pipe: open chunk writer: started multipart upload: AMF4ZQMlxPMeQH3aEEmzzzbcMTDrnT1cV2K0RQV8AZogf1epC4jpgamWrKuhzsTkfHhx3IwEQ6DvALhUmcW26HNI7_w247exCLIobXMujUneVtskTCfRCiRQyLNJuLyS8_Oz7aQQDMOIaJ1jcUjCRYEi23lv69qjuvRc4Waos6OL4nqsJ_HZsuEmczqAYsSDbv8OJhZCMTZaSP0TrXxWjOelvYdW2z61AVBluJSkU_k6W2ihP-DhbtYwwDqdzEec07h-ijPLALhGWdzwTRv50gXyyNAR8WeLYJstO2KGoxEpfzcI436U3VA3pRDQ9XR3d9YlRjwSZAmwtHcrkxAT7fY 2025/01/11 02:43:50 DEBUG : no_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/01/11 02:43:50 DEBUG : no_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes and etag "fffc7956ba9a7b58a63c01b6ce1ddc45" 2025/01/11 02:43:51 DEBUG : no_checksum_big_file_from_pipe: multipart upload "AMF4ZQMlxPMeQH3aEEmzzzbcMTDrnT1cV2K0RQV8AZogf1epC4jpgamWrKuhzsTkfHhx3IwEQ6DvALhUmcW26HNI7_w247exCLIobXMujUneVtskTCfRCiRQyLNJuLyS8_Oz7aQQDMOIaJ1jcUjCRYEi23lv69qjuvRc4Waos6OL4nqsJ_HZsuEmczqAYsSDbv8OJhZCMTZaSP0TrXxWjOelvYdW2z61AVBluJSkU_k6W2ihP-DhbtYwwDqdzEec07h-ijPLALhGWdzwTRv50gXyyNAR8WeLYJstO2KGoxEpfzcI436U3VA3pRDQ9XR3d9YlRjwSZAmwtHcrkxAT7fY" finished 2025/01/11 02:43:51 DEBUG : no_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2025/01/11 02:43:51 DEBUG : no_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=true,ignoreChecksum=false run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:52 DEBUG : S3 bucket rclone-test-koleped7nele: File to upload is small (34 bytes), uploading instead of streaming 2025/01/11 02:43:52 DEBUG : with_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK 2025/01/11 02:43:52 DEBUG : with_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical 2025/01/11 02:43:52 DEBUG : with_checksum_big_file_from_pipe: open chunk writer: started multipart upload: AOQ-6zD1e74en-Ph6P_NnCqQdQn8z69-IAqsl1CKhPc1ibLyHD25WtAvDq6jIsGT-DN1EaZ2NU980Ufbg1Z5b0yZ7JxUW5F4N7npkvITJquL-n40TbFI3mFeQfn61C7xGb4G_KYXV5lSczllZUvbkMudy5E6aDg0Hasd0cTBM9JiC9uDTNUYAWEeKS0NxNXamFlKb8QFkC8jeYsbmfh5rhl2ANUor6_sFElBGxSXbVE9-SV1MeLj5D5zXKMpjOpBpL6G2gczwYxGRL0aVfyd2M_6SHIcUTfMSx6vOAEl2BFcFTHsWLvRILGyXXSHKQ3u3LSrASszKyr0TFXsrYOUyPk 2025/01/11 02:43:52 DEBUG : with_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/01/11 02:43:52 DEBUG : with_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes and etag "fffc7956ba9a7b58a63c01b6ce1ddc45" 2025/01/11 02:43:53 DEBUG : with_checksum_big_file_from_pipe: multipart upload "AOQ-6zD1e74en-Ph6P_NnCqQdQn8z69-IAqsl1CKhPc1ibLyHD25WtAvDq6jIsGT-DN1EaZ2NU980Ufbg1Z5b0yZ7JxUW5F4N7npkvITJquL-n40TbFI3mFeQfn61C7xGb4G_KYXV5lSczllZUvbkMudy5E6aDg0Hasd0cTBM9JiC9uDTNUYAWEeKS0NxNXamFlKb8QFkC8jeYsbmfh5rhl2ANUor6_sFElBGxSXbVE9-SV1MeLj5D5zXKMpjOpBpL6G2gczwYxGRL0aVfyd2M_6SHIcUTfMSx6vOAEl2BFcFTHsWLvRILGyXXSHKQ3u3LSrASszKyr0TFXsrYOUyPk" finished 2025/01/11 02:43:53 DEBUG : with_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2025/01/11 02:43:53 DEBUG : with_checksum_big_file_from_pipe: Size of src and dst objects identical === RUN TestRcat/withChecksum=false,ignoreChecksum=true run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:53 DEBUG : S3 bucket rclone-test-koleped7nele: File to upload is small (34 bytes), uploading instead of streaming 2025/01/11 02:43:54 DEBUG : ignore_checksum_small_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/11 02:43:54 DEBUG : ignore_checksum_big_file_from_pipe: open chunk writer: started multipart upload: AMR43LoNhc5C6aM5mn3aW3fHX6OCIqEmaizcfakDhrtTozb_Q-oZu7UMgwG5MrbERlLgSYSOfmJDVZ4BOWqqCFkVBu6guGMFg_dkLJ6fjQ5huSPSkmmqEQ10z4wR1juYzL1JL8g51RCo9bLrxf4hOR3uX3KFReIlcPNYWMTQpP4hKmd9xI_Zhv6MIjpOlORkKVQZlKo8B9m-K1AGiFZoW_PWMS_w8YlKBqk9Ne534X4UiCMFP4vRjs2P-Gb0kFL9jCXRpR79n6ttzVG5M4fGP1Nj2TFLUC3KiE2knhf9g5igoJVvvUE8xA8qYfgdntSoTHtsg_aluPj4OQQNYJdzLPs 2025/01/11 02:43:54 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/01/11 02:43:54 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes and etag "fffc7956ba9a7b58a63c01b6ce1ddc45" 2025/01/11 02:43:54 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload "AMR43LoNhc5C6aM5mn3aW3fHX6OCIqEmaizcfakDhrtTozb_Q-oZu7UMgwG5MrbERlLgSYSOfmJDVZ4BOWqqCFkVBu6guGMFg_dkLJ6fjQ5huSPSkmmqEQ10z4wR1juYzL1JL8g51RCo9bLrxf4hOR3uX3KFReIlcPNYWMTQpP4hKmd9xI_Zhv6MIjpOlORkKVQZlKo8B9m-K1AGiFZoW_PWMS_w8YlKBqk9Ne534X4UiCMFP4vRjs2P-Gb0kFL9jCXRpR79n6ttzVG5M4fGP1Nj2TFLUC3KiE2knhf9g5igoJVvvUE8xA8qYfgdntSoTHtsg_aluPj4OQQNYJdzLPs" finished 2025/01/11 02:43:54 DEBUG : ignore_checksum_big_file_from_pipe: Size and modification time the same (differ by 0s, within tolerance 1ns) === RUN TestRcat/withChecksum=true,ignoreChecksum=true run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:55 DEBUG : S3 bucket rclone-test-koleped7nele: File to upload is small (34 bytes), uploading instead of streaming 2025/01/11 02:43:56 DEBUG : ignore_checksum_small_file_from_pipe: Src hash empty - aborting Dst hash check 2025/01/11 02:43:56 DEBUG : ignore_checksum_small_file_from_pipe: Size of src and dst objects identical 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: open chunk writer: started multipart upload: AO2qigEaiFk8EAWbwklBSN097bk4O1MD_mCymwQ0XvdmDK3Sa416PFyXN64i-J9tf3qAhOXOtGQQkGGrTjdWcPEtabam11W2zRYsq2a0U465Y5fe05kRm0ALaO2Nor1gmW4lyrdfC3lp2ZCnZYQ621_WoLGhHt_5O8Vcg7T2tMVyGk_sWYsDi7vI9o5FCurhAVGZVvicXUlKF75KZzxUjKRiyhoTXWZsdTo5Xp7Zc4qXgKlNFTJFbAdpnL7OES4UYLSFkCAhMoIf77629CSsFacZCbrZ5dxi45XvoHpvOoYyJsUt0eVn13PQNChP3Oi5q-h3_Nab0_PquvEpwepix6k 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes and etag "fffc7956ba9a7b58a63c01b6ce1ddc45" 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: multipart upload "AO2qigEaiFk8EAWbwklBSN097bk4O1MD_mCymwQ0XvdmDK3Sa416PFyXN64i-J9tf3qAhOXOtGQQkGGrTjdWcPEtabam11W2zRYsq2a0U465Y5fe05kRm0ALaO2Nor1gmW4lyrdfC3lp2ZCnZYQ621_WoLGhHt_5O8Vcg7T2tMVyGk_sWYsDi7vI9o5FCurhAVGZVvicXUlKF75KZzxUjKRiyhoTXWZsdTo5Xp7Zc4qXgKlNFTJFbAdpnL7OES4UYLSFkCAhMoIf77629CSsFacZCbrZ5dxi45XvoHpvOoYyJsUt0eVn13PQNChP3Oi5q-h3_Nab0_PquvEpwepix6k" finished 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: Src hash empty - aborting Dst hash check 2025/01/11 02:43:56 DEBUG : ignore_checksum_big_file_from_pipe: Size of src and dst objects identical --- PASS: TestRcat (7.11s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (1.68s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=false (1.85s) --- PASS: TestRcat/withChecksum=false,ignoreChecksum=true (1.88s) --- PASS: TestRcat/withChecksum=true,ignoreChecksum=true (1.71s) === RUN TestRcatSizeMetadata run.go:180: Remote "S3 bucket rclone-test-koleped7nele", Local "Local file system at /tmp/rclone772593980", Modify Window "1ns" 2025/01/11 02:43:57 DEBUG : S3 bucket rclone-test-koleped7nele: File to upload is small (60 bytes), uploading instead of streaming 2025/01/11 02:43:58 DEBUG : potato2: md5 = d6548b156ea68a4e003e786df99eee76 OK 2025/01/11 02:43:58 DEBUG : potato2: Size and md5 of src and dst objects identical --- PASS: TestRcatSizeMetadata (1.66s) PASS 2025/01/11 02:43:59 DEBUG : S3 bucket rclone-test-koleped7nele: Purge remote 2025/01/11 02:43:59 DEBUG : S3 bucket rclone-test-koleped7nele: bucket is versioned: false 2025/01/11 02:43:59 DEBUG : Waiting for deletions to finish 2025/01/11 02:44:00 INFO : S3 bucket rclone-test-koleped7nele: Bucket "rclone-test-koleped7nele" deleted "./operations.test -test.v -test.timeout 1h0m0s -remote TestS3R2: -verbose -test.run '^(TestCopyURL|TestDirMove|TestMoveFile|TestMoveFileBackupDir|TestRcatSizeMetadata)$|^TestRcat$/^(withChecksum=false,ignoreChecksum=false|withChecksum=false,ignoreChecksum=true|withChecksum=true,ignoreChecksum=false|withChecksum=true,ignoreChecksum=true)$'" - Finished OK in 25.791170565s (try 2/5)