"./operations.test -test.v -test.timeout 1h0m0s -remote TestS3R2: -verbose -test.run '^(TestCopyURL|TestDirMove)$|^TestRcat$/^withChecksum=false,ignoreChecksum=false$'" - Starting (try 2/5)
2024/12/07 04:02:57 DEBUG : Creating backend with remote "TestS3R2:rclone-test-wetogen3yife"
2024/12/07 04:02:57 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2024/12/07 04:02:57 DEBUG : Creating backend with remote "/tmp/rclone1768573803"
=== RUN   TestCopyURL
    run.go:180: Remote "S3 bucket rclone-test-wetogen3yife", Local "Local file system at /tmp/rclone1768573803", Modify Window "1ns"
2024/12/07 04:02:58 INFO  : S3 bucket rclone-test-wetogen3yife: Bucket "rclone-test-wetogen3yife" created with ACL ""
2024/12/07 04:02:59 DEBUG : filename.txt: File name found in url
2024/12/07 04:02:59 DEBUG : headerfilename.txt: filename found in Content-Disposition header.
--- PASS: TestCopyURL (3.65s)
=== RUN   TestDirMove
    run.go:180: Remote "S3 bucket rclone-test-wetogen3yife", Local "Local file system at /tmp/rclone1768573803", Modify Window "1ns"
2024/12/07 04:03:02 DEBUG : A1/B2: Making directory
2024/12/07 04:03:02 DEBUG : A1/B1/C3: Making directory
    fstest.go:244: Filtering empty directory "A1/B2"
    fstest.go:244: Filtering empty directory "A1/B1/C3"
2024/12/07 04:03:03 DEBUG : A1/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK
2024/12/07 04:03:03 INFO  : A1/B1/C1/four: Copied (server-side copy) to: A2/B1/C1/four
2024/12/07 04:03:04 DEBUG : A1/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK
2024/12/07 04:03:04 INFO  : A1/one: Copied (server-side copy) to: A2/one
2024/12/07 04:03:04 INFO  : A1/B1/C1/four: Deleted
2024/12/07 04:03:04 DEBUG : A1/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK
2024/12/07 04:03:04 INFO  : A1/B1/C2/five: Copied (server-side copy) to: A2/B1/C2/five
2024/12/07 04:03:04 DEBUG : A1/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK
2024/12/07 04:03:04 INFO  : A1/B1/three: Copied (server-side copy) to: A2/B1/three
2024/12/07 04:03:04 DEBUG : A1/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK
2024/12/07 04:03:04 INFO  : A1/two: Copied (server-side copy) to: A2/two
2024/12/07 04:03:04 INFO  : A1/one: Deleted
2024/12/07 04:03:04 INFO  : A1/B1/C2/five: Deleted
2024/12/07 04:03:04 INFO  : A1/B1/three: Deleted
2024/12/07 04:03:04 INFO  : A1/two: Deleted
    fstest.go:244: Filtering empty directory "A2/B2"
    fstest.go:244: Filtering empty directory "A2/B1/C3"
2024/12/07 04:03:05 DEBUG : A2/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK
2024/12/07 04:03:05 INFO  : A2/two: Copied (server-side copy) to: A3/two
2024/12/07 04:03:05 DEBUG : A2/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK
2024/12/07 04:03:05 INFO  : A2/B1/C2/five: Copied (server-side copy) to: A3/B1/C2/five
2024/12/07 04:03:05 DEBUG : A2/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK
2024/12/07 04:03:05 INFO  : A2/B1/C1/four: Copied (server-side copy) to: A3/B1/C1/four
2024/12/07 04:03:05 DEBUG : A2/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK
2024/12/07 04:03:05 INFO  : A2/B1/three: Copied (server-side copy) to: A3/B1/three
2024/12/07 04:03:05 INFO  : A2/two: Deleted
2024/12/07 04:03:05 INFO  : A2/B1/C2/five: Deleted
2024/12/07 04:03:05 INFO  : A2/B1/C1/four: Deleted
2024/12/07 04:03:05 INFO  : A2/B1/three: Deleted
2024/12/07 04:11:38 DEBUG : pacer: low level retry 1/2 (error operation error S3: CopyObject, exceeded maximum number of attempts, 10, https response error StatusCode: 500, RequestID: , HostID: , api error InternalError: We encountered an internal error. Please try again.)
2024/12/07 04:11:38 DEBUG : pacer: Rate limited, increasing sleep to 10ms
2024/12/07 04:18:25 DEBUG : pacer: Reducing sleep to 0s
2024/12/07 04:18:25 DEBUG : A2/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK
2024/12/07 04:18:25 INFO  : A2/one: Copied (server-side copy) to: A3/one
2024/12/07 04:18:25 INFO  : A2/one: Deleted
    fstest.go:244: Filtering empty directory "A3/B2"
    fstest.go:244: Filtering empty directory "A3/B1/C3"
2024/12/07 04:18:26 INFO  : S3 bucket rclone-test-wetogen3yife: Can't DirMove - falling back to file moves: can't move directory - incompatible remotes
2024/12/07 04:18:27 DEBUG : A3/B1/three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK
2024/12/07 04:18:27 INFO  : A3/B1/three: Copied (server-side copy) to: A4/B1/three
2024/12/07 04:18:27 DEBUG : A3/one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK
2024/12/07 04:18:27 INFO  : A3/one: Copied (server-side copy) to: A4/one
2024/12/07 04:18:27 DEBUG : A3/two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK
2024/12/07 04:18:27 INFO  : A3/two: Copied (server-side copy) to: A4/two
2024/12/07 04:18:27 DEBUG : A3/B1/C2/five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK
2024/12/07 04:18:27 INFO  : A3/B1/C2/five: Copied (server-side copy) to: A4/B1/C2/five
2024/12/07 04:18:27 DEBUG : A3/B1/C1/four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK
2024/12/07 04:18:27 INFO  : A3/B1/C1/four: Copied (server-side copy) to: A4/B1/C1/four
2024/12/07 04:18:27 INFO  : A3/one: Deleted
2024/12/07 04:18:27 INFO  : A3/B1/three: Deleted
2024/12/07 04:18:27 INFO  : A3/two: Deleted
2024/12/07 04:18:27 INFO  : A3/B1/C2/five: Deleted
2024/12/07 04:18:27 INFO  : A3/B1/C1/four: Deleted
    fstest.go:244: Filtering empty directory "A4/B2"
    fstest.go:244: Filtering empty directory "A4/B1/C3"
--- PASS: TestDirMove (927.38s)
=== RUN   TestRcat
=== RUN   TestRcat/withChecksum=false,ignoreChecksum=false
    run.go:180: Remote "S3 bucket rclone-test-wetogen3yife", Local "Local file system at /tmp/rclone1768573803", Modify Window "1ns"
2024/12/07 04:18:28 DEBUG : S3 bucket rclone-test-wetogen3yife: File to upload is small (34 bytes), uploading instead of streaming
2024/12/07 04:18:29 DEBUG : no_checksum_small_file_from_pipe: md5 = 4c762bc6ec18f21b23fcae426c7863b5 OK
2024/12/07 04:18:29 DEBUG : no_checksum_small_file_from_pipe: Size and md5 of src and dst objects identical
2024/12/07 04:18:29 NOTICE: S3 bucket rclone-test-wetogen3yife: Streaming uploads using chunk size 5Mi will have maximum file size of 48.828Gi
2024/12/07 04:18:29 DEBUG : no_checksum_big_file_from_pipe: open chunk writer: started multipart upload: AEb-oERwrMSM5u5GJsxKB7RtDx5CpVUDc3CDQAh1QRLmi_guXdLWPmi5uR4DWMjy5fYtN_FaQkGODXJboI4I67aOCqoqONASoYMAmkqP-W3mNwlonZVtuvZyrJcEHvuVLE29QPukHS0i0ygMB6Wy0IOYyv7ymQ3YlIa0mj2XRNY2P8x-6HrgEkzfz79voEWiE_I4thrW0d5N7ok6t9kZ6uY33wTvJEUczedIMmmTNvLRq9M_8hRLN3x4A7GbdERVmmLrgQ3bDcmbxNDj6V0AYkdbeZNlOVGju8KWSfucAD8IU5Xq4bFUbVaxOYoSypIjkSEHSeXYayUYcVKSEBIo_0o
2024/12/07 04:18:29 DEBUG : no_checksum_big_file_from_pipe: multipart upload: starting chunk 0 size 100.001Ki offset 0/off
2024/12/07 04:18:29 DEBUG : no_checksum_big_file_from_pipe: multipart upload wrote chunk 1 with 102401 bytes and etag "fffc7956ba9a7b58a63c01b6ce1ddc45"
2024/12/07 04:18:29 DEBUG : no_checksum_big_file_from_pipe: multipart upload "AEb-oERwrMSM5u5GJsxKB7RtDx5CpVUDc3CDQAh1QRLmi_guXdLWPmi5uR4DWMjy5fYtN_FaQkGODXJboI4I67aOCqoqONASoYMAmkqP-W3mNwlonZVtuvZyrJcEHvuVLE29QPukHS0i0ygMB6Wy0IOYyv7ymQ3YlIa0mj2XRNY2P8x-6HrgEkzfz79voEWiE_I4thrW0d5N7ok6t9kZ6uY33wTvJEUczedIMmmTNvLRq9M_8hRLN3x4A7GbdERVmmLrgQ3bDcmbxNDj6V0AYkdbeZNlOVGju8KWSfucAD8IU5Xq4bFUbVaxOYoSypIjkSEHSeXYayUYcVKSEBIo_0o" finished
2024/12/07 04:18:30 DEBUG : no_checksum_big_file_from_pipe: Dst hash empty - aborting Src hash check
2024/12/07 04:18:30 DEBUG : no_checksum_big_file_from_pipe: Size of src and dst objects identical
--- PASS: TestRcat (2.00s)
    --- PASS: TestRcat/withChecksum=false,ignoreChecksum=false (2.00s)
PASS
2024/12/07 04:18:30 DEBUG : S3 bucket rclone-test-wetogen3yife: Purge remote
2024/12/07 04:18:30 DEBUG : S3 bucket rclone-test-wetogen3yife: bucket is versioned: false
2024/12/07 04:18:30 DEBUG : Waiting for deletions to finish
2024/12/07 04:18:31 INFO  : S3 bucket rclone-test-wetogen3yife: Bucket "rclone-test-wetogen3yife" deleted
"./operations.test -test.v -test.timeout 1h0m0s -remote TestS3R2: -verbose -test.run '^(TestCopyURL|TestDirMove)$|^TestRcat$/^withChecksum=false,ignoreChecksum=false$'" - Finished OK in 15m34.185857854s (try 2/5)