"./operations.test -test.v -test.timeout 1h0m0s -remote TestS3MinioEdge: -verbose -test.run '^(TestApplyTransforms|TestCheck|TestCheckDownload|TestCheckSizeOnly|TestCheckSum|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyLongFile|TestMultithreadCopy|TestMultithreadCopyAbort|TestParseSumFile)$'" - Starting (try 4/5) 2025/10/26 04:57:55 DEBUG : Creating backend with remote "TestS3MinioEdge:rclone-test-fenofaq8vodi" 2025/10/26 04:57:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/10/26 04:57:55 DEBUG : Setting type="s3" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_TYPE 2025/10/26 04:57:55 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 04:57:55 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 04:57:55 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 04:57:55 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 04:57:55 DEBUG : TestS3MinioEdge: detected overridden config - adding "{FbV4e}" suffix to name 2025/10/26 04:57:55 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 04:57:55 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 04:57:55 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 04:57:55 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 04:57:55 DEBUG : Creating backend with remote "/tmp/rclone4101715420" === RUN TestMultithreadCopy run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 04:59:44 DEBUG : pacer: low level retry 1/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 04:59:44 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2025/10/26 05:01:39 DEBUG : pacer: low level retry 2/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:01:39 DEBUG : pacer: Rate limited, increasing sleep to 20ms multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: failed to prepare upload: operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused Test: TestMultithreadCopy 2025/10/26 05:03:34 DEBUG : pacer: low level retry 1/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:03:34 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/10/26 05:05:41 DEBUG : pacer: low level retry 2/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:05:41 DEBUG : pacer: Rate limited, increasing sleep to 80ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:148 Error: Received unexpected error: operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused Test: TestMultithreadCopy --- FAIL: TestMultithreadCopy (465.75s) === RUN TestMultithreadCopyAbort run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:07:37 DEBUG : pacer: low level retry 1/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:07:37 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/10/26 05:09:28 DEBUG : pacer: low level retry 2/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:09:28 DEBUG : pacer: Rate limited, increasing sleep to 320ms multithread_test.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: failed to prepare upload: operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused Test: TestMultithreadCopyAbort 2025/10/26 05:11:22 DEBUG : pacer: low level retry 1/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:11:22 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/10/26 05:13:21 DEBUG : pacer: low level retry 2/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:13:21 DEBUG : pacer: Rate limited, increasing sleep to 1.28s run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:137 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/multithread_test.go:293 Error: Received unexpected error: operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused Test: TestMultithreadCopyAbort --- FAIL: TestMultithreadCopyAbort (459.87s) === RUN TestCheck run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:15:07 DEBUG : pacer: low level retry 1/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:15:07 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/10/26 05:17:10 DEBUG : pacer: low level retry 2/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused) run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused 2025/10/26 05:19:11 DEBUG : pacer: low level retry 1/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:19:11 DEBUG : pacer: Reducing sleep to 1.5s run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:303 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:98 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:181 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCheck --- FAIL: TestCheck (349.62s) === RUN TestCheckDownload run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:19:13 DEBUG : pacer: Reducing sleep to 1.125s run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:19:14 DEBUG : pacer: Reducing sleep to 843.75ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:303 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:98 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:204 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCheckDownload --- FAIL: TestCheckDownload (3.47s) === RUN TestCheckSizeOnly run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:19:15 DEBUG : pacer: Reducing sleep to 632.8125ms run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:19:16 DEBUG : pacer: Reducing sleep to 474.609375ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:303 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:98 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:181 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCheckSizeOnly --- FAIL: TestCheckSizeOnly (1.97s) === RUN TestParseSumFile run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:19:17 DEBUG : pacer: Reducing sleep to 355.957031ms run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:19:17 DEBUG : pacer: Reducing sleep to 266.967773ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:308 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestParseSumFile --- FAIL: TestParseSumFile (1.11s) === RUN TestCheckSum run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:19:17 DEBUG : Creating backend with remote "TestS3MinioEdge:rclone-test-fenofaq8vodi/data" 2025/10/26 05:19:17 DEBUG : Config file has changed externally - reloading 2025/10/26 05:19:17 DEBUG : Setting type="s3" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_TYPE 2025/10/26 05:19:17 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:19:17 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:19:17 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:19:17 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:19:17 DEBUG : TestS3MinioEdge: detected overridden config - adding "{FbV4e}" suffix to name 2025/10/26 05:19:17 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:19:17 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:19:17 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:19:17 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:21:08 DEBUG : pacer: low level retry 1/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/data": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:21:08 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2025/10/26 05:23:10 DEBUG : pacer: low level retry 2/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/data": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:23:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/10/26 05:23:10 DEBUG : pacer: Reducing sleep to 200.225829ms run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:23:10 DEBUG : pacer: Reducing sleep to 150.169371ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:355 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:432 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:537 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCheckSum --- FAIL: TestCheckSum (233.27s) === RUN TestCheckSumDownload run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:23:10 DEBUG : Creating backend with remote "TestS3MinioEdge:rclone-test-fenofaq8vodi/data" 2025/10/26 05:23:10 DEBUG : Config file has changed externally - reloading 2025/10/26 05:23:10 DEBUG : Setting type="s3" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_TYPE 2025/10/26 05:23:10 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:23:10 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:23:10 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:23:10 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:23:10 DEBUG : TestS3MinioEdge: detected overridden config - adding "{FbV4e}" suffix to name 2025/10/26 05:23:10 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:23:10 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:23:10 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:23:10 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:24:55 DEBUG : pacer: low level retry 1/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/data": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:24:55 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2025/10/26 05:26:51 DEBUG : pacer: low level retry 2/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/data": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:26:51 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/10/26 05:26:51 DEBUG : pacer: Reducing sleep to 112.627028ms run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:26:51 DEBUG : pacer: Reducing sleep to 84.470271ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:355 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:432 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCheckSumDownload --- FAIL: TestCheckSumDownload (221.06s) === RUN TestApplyTransforms 2025/10/26 05:26:51 DEBUG : Creating backend with remote "TestS3MinioEdge:rclone-test-moculoc9yoxa" 2025/10/26 05:26:51 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/10/26 05:26:51 DEBUG : Setting type="s3" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_TYPE 2025/10/26 05:26:51 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:26:51 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:26:51 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:26:51 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:26:51 DEBUG : TestS3MinioEdge: detected overridden config - adding "{FbV4e}" suffix to name 2025/10/26 05:26:51 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:26:51 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:26:51 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:26:51 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:26:51 DEBUG : Creating backend with remote "/tmp/rclone3593638451" run.go:180: Remote "S3 bucket rclone-test-moculoc9yoxa", Local "Local file system at /tmp/rclone3593638451", Modify Window "1ns" 2025/10/26 05:28:49 DEBUG : pacer: low level retry 1/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-moculoc9yoxa": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:28:49 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2025/10/26 05:30:48 DEBUG : pacer: low level retry 2/2 (error operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-moculoc9yoxa": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:30:48 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:237: Failed to mkdir "S3 bucket rclone-test-moculoc9yoxa": operation error S3: CreateBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-moculoc9yoxa": dial tcp 127.0.0.1:28626: connect: connection refused 2025/10/26 05:30:48 DEBUG : S3 bucket rclone-test-moculoc9yoxa: Purge remote 2025/10/26 05:32:41 DEBUG : pacer: low level retry 1/2 (error operation error S3: GetBucketVersioning, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-moculoc9yoxa?versioning=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:32:41 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/10/26 05:34:36 DEBUG : pacer: low level retry 2/2 (error operation error S3: GetBucketVersioning, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-moculoc9yoxa?versioning=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:34:36 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/10/26 05:34:36 ERROR : S3 bucket rclone-test-moculoc9yoxa: Failed to read versioning status, assuming unversioned: operation error S3: GetBucketVersioning, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-moculoc9yoxa?versioning=": dial tcp 127.0.0.1:28626: connect: connection refused 2025/10/26 05:34:36 DEBUG : S3 bucket rclone-test-moculoc9yoxa: bucket is versioned: false 2025/10/26 05:34:36 DEBUG : Waiting for deletions to finish 2025/10/26 05:36:34 DEBUG : pacer: low level retry 1/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-moculoc9yoxa?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:36:34 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/10/26 05:38:31 DEBUG : pacer: low level retry 2/2 (error operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-moculoc9yoxa?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:38:31 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/10/26 05:40:24 DEBUG : pacer: low level retry 1/2 (error operation error S3: DeleteBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Delete "http://127.0.0.1:28626/rclone-test-moculoc9yoxa": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:40:24 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/10/26 05:42:12 DEBUG : pacer: low level retry 2/2 (error operation error S3: DeleteBucket, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Delete "http://127.0.0.1:28626/rclone-test-moculoc9yoxa": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:42:12 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/10/26 05:42:12 NOTICE: purge failed: operation error S3: ListObjectsV2, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-moculoc9yoxa?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused --- FAIL: TestApplyTransforms (920.80s) === RUN TestCopyFile run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:108 Error: Should be true Test: TestCopyFile Messages: listing wrong, want file1 (14) got file1 (14), rutabaga (8) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:108 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCopyFile Messages: Unexpected file "rutabaga" 2025/10/26 05:42:19 DEBUG : pacer: Reducing sleep to 63.352703ms copy_test.go:114: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:114 Error: Received unexpected error: operation error S3: HeadObject, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/sub/file2": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCopyFile 2025/10/26 05:42:19 DEBUG : pacer: Reducing sleep to 47.514527ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:114 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCopyFile --- FAIL: TestCopyFile (7.10s) === RUN TestCopyLongFile run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" copy_test.go:154: Test only runs on local 2025/10/26 05:42:19 DEBUG : pacer: Reducing sleep to 35.635895ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1156 /usr/local/go/src/testing/testing.go:1132 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:154 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCopyLongFile --- FAIL: TestCopyLongFile (0.06s) === RUN TestCopyFileBackupDir run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:180 Error: Should be true Test: TestCopyFileBackupDir Messages: listing wrong, want dst/file1 (14) got dst/file1 (14), file1 (14), rutabaga (8) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:180 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCopyFileBackupDir Messages: Unexpected file "file1" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:180 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCopyFileBackupDir Messages: Unexpected file "rutabaga" 2025/10/26 05:42:26 DEBUG : pacer: Reducing sleep to 26.726921ms run.go:237: Failed to mkdir "S3 bucket rclone-test-fenofaq8vodi": operation error S3: CreateBucket, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://127.0.0.1:28626/rclone-test-fenofaq8vodi": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:42:26 DEBUG : pacer: Reducing sleep to 20.04519ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /usr/local/go/src/testing/testing.go:1125 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:237 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:245 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:258 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:292 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:182 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCopyFileBackupDir --- FAIL: TestCopyFileBackupDir (7.05s) === RUN TestCopyFileCompareDest run.go:180: Remote "S3 bucket rclone-test-fenofaq8vodi", Local "Local file system at /tmp/rclone4101715420", Modify Window "1ns" 2025/10/26 05:42:26 DEBUG : Creating backend with remote "TestS3MinioEdge:rclone-test-fenofaq8vodi/dst" 2025/10/26 05:42:26 DEBUG : Config file has changed externally - reloading 2025/10/26 05:42:26 DEBUG : Setting type="s3" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_TYPE 2025/10/26 05:42:26 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:42:26 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:42:26 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:42:26 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:42:26 DEBUG : TestS3MinioEdge: detected overridden config - adding "{FbV4e}" suffix to name 2025/10/26 05:42:26 DEBUG : Setting provider="Minio" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_PROVIDER 2025/10/26 05:42:26 DEBUG : Setting access_key_id="rclone" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ACCESS_KEY_ID 2025/10/26 05:42:26 DEBUG : Setting secret_access_key="DeniseOxygenEiffel4" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_SECRET_ACCESS_KEY 2025/10/26 05:42:26 DEBUG : Setting endpoint="http://127.0.0.1:28626/" for "TestS3MinioEdge" from environment variable RCLONE_CONFIG_TESTS3MINIOEDGE_ENDPOINT 2025/10/26 05:44:19 DEBUG : pacer: low level retry 1/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/dst": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:44:19 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2025/10/26 05:46:18 DEBUG : pacer: low level retry 2/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/dst": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:46:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:305: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:204 Error: Should be true Test: TestCopyFileCompareDest Messages: listing wrong, want one (3) got dst/file1 (14), file1 (14), one (3), rutabaga (8) fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:204 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCopyFileCompareDest Messages: Unexpected file "file1" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:204 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCopyFileCompareDest Messages: Unexpected file "rutabaga" fstest.go:191: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:191 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:308 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:334 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:204 /usr/local/go/src/runtime/asm_amd64.s:1700 Error: Should be true Test: TestCopyFileCompareDest Messages: Unexpected file "dst/file1" 2025/10/26 05:48:22 DEBUG : pacer: low level retry 1/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/dst/one": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:48:22 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/10/26 05:50:15 DEBUG : pacer: low level retry 2/2 (error operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/dst/one": dial tcp 127.0.0.1:28626: connect: connection refused) 2025/10/26 05:50:15 DEBUG : pacer: Rate limited, increasing sleep to 80ms copy_test.go:207: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:207 Error: Received unexpected error: operation error S3: HeadObject, exceeded maximum number of attempts, 10, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Head "http://127.0.0.1:28626/rclone-test-fenofaq8vodi/dst/one": dial tcp 127.0.0.1:28626: connect: connection refused Test: TestCopyFileCompareDest 2025/10/26 05:50:15 DEBUG : pacer: Reducing sleep to 15.033892ms run.go:164: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:164 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:207 Error: Received unexpected error: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested Test: TestCopyFileCompareDest --- FAIL: TestCopyFileCompareDest (468.31s) FAIL 2025/10/26 05:50:15 DEBUG : S3 bucket rclone-test-fenofaq8vodi: Purge remote 2025/10/26 05:50:15 DEBUG : pacer: Reducing sleep to 11.275419ms 2025/10/26 05:50:15 ERROR : S3 bucket rclone-test-fenofaq8vodi: Failed to read versioning status, assuming unversioned: operation error S3: GetBucketVersioning, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?versioning=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested 2025/10/26 05:50:15 DEBUG : S3 bucket rclone-test-fenofaq8vodi: bucket is versioned: false 2025/10/26 05:50:15 DEBUG : Waiting for deletions to finish 2025/10/26 05:50:15 DEBUG : pacer: Reducing sleep to 0s 2025/10/26 05:50:15 NOTICE: purge failed: operation error S3: ListObjectsV2, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Get "http://127.0.0.1:28626/rclone-test-fenofaq8vodi?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=": dial tcp 127.0.0.1:28626: connect: connection refused failed to get rate limit token, retry quota exceeded, 0 available, 5 requested "./operations.test -test.v -test.timeout 1h0m0s -remote TestS3MinioEdge: -verbose -test.run '^(TestApplyTransforms|TestCheck|TestCheckDownload|TestCheckSizeOnly|TestCheckSum|TestCheckSumDownload|TestCopyFile|TestCopyFileBackupDir|TestCopyFileCompareDest|TestCopyLongFile|TestMultithreadCopy|TestMultithreadCopyAbort|TestParseSumFile)$'" - Finished ERROR in 52m19.552657801s (try 4/5): exit status 1: Failed [TestMultithreadCopy TestMultithreadCopyAbort TestCheck TestCheckDownload TestCheckSizeOnly TestParseSumFile TestCheckSum TestCheckSumDownload TestApplyTransforms TestCopyFile TestCopyLongFile TestCopyFileBackupDir TestCopyFileCompareDest]