"./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMoveOverSelf)$'" - Starting (try 4/5) 2026/07/08 09:45:55 DEBUG : Creating backend with remote "TestDrime:rclone-test-cinukeq3dire" 2026/07/08 09:45:55 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/07/08 09:46:59 DEBUG : Creating backend with remote "/tmp/rclone2035730969" === RUN TestServerSideCopy run.go:198: Remote "drime root 'rclone-test-cinukeq3dire'", Local "Local file system at /tmp/rclone2035730969", Modify Window "876000h0m0s" 2026/07/08 09:47:30 DEBUG : Creating backend with remote "TestDrime:rclone-test-silixok3volo" sync_test.go:620: Server side copy (if possible) drime root 'rclone-test-cinukeq3dire' -> drime root 'rclone-test-silixok3volo' 2026/07/08 09:47:49 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2026/07/08 09:47:49 DEBUG : drime root 'rclone-test-silixok3volo': Waiting for checks to finish 2026/07/08 09:47:49 DEBUG : drime root 'rclone-test-silixok3volo': Waiting for transfers to finish 2026/07/08 09:48:16 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 09:48:16 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/08 09:48:20 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 09:48:20 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/08 09:49:16 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 09:49:16 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/08 09:49:20 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 09:49:20 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/08 09:49:24 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 09:49:24 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/08 09:49:27 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 09:49:27 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/07/08 09:49:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 09:49:31 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/07/08 09:49:35 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 09:49:35 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/07/08 09:49:45 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 09:49:45 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/07/08 09:49:48 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 09:49:48 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/08 09:49:48 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10 2026/07/08 09:49:53 DEBUG : pacer: Reducing sleep to 5.12s 2026/07/08 09:50:03 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 09:50:03 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/08 09:50:09 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 09:50:09 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 09:50:19 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 09:50:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 09:51:56 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e2fffe845a103\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e2fffe845a103\",\"timestamp\":\"2026-07-08T09:51:56Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 09:51:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 09:52:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 09:52:39 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 09:53:01 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 09:53:19 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 09:53:19 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10 2026/07/08 09:53:39 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 09:53:59 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 09:53:59 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 09:54:12 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 09:54:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 09:54:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 09:55:09 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 09:55:29 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 09:55:49 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 09:56:09 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 09:56:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 09:56:48 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 09:56:48 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10 2026/07/08 09:57:11 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 09:57:30 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 09:57:30 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 09:57:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 09:58:05 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 09:58:21 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 09:59:31 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 09:59:34 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:00:02 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:00:14 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:00:34 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:00:55 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:00:55 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10 2026/07/08 10:01:15 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:01:34 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:01:34 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:01:44 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:02:04 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:02:41 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:02:44 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:03:04 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:03:24 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:03:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:04:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:04:24 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:04:24 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10 2026/07/08 10:04:46 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:05:04 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:05:04 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:05:14 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:05:35 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:05:57 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:06:14 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:06:34 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:06:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:07:13 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:07:34 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:07:54 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:07:54 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10 2026/07/08 10:08:14 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:08:34 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:08:34 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:09:15 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:09:22 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:09:38 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:09:58 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:10:21 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:10:38 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:11:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:11:18 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:11:40 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:11:40 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10 2026/07/08 10:11:58 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:12:18 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:12:18 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:12:30 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:12:48 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:13:09 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:13:29 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:13:50 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:14:12 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:14:28 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:14:50 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:15:08 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:15:08 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10 2026/07/08 10:15:28 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:15:48 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:15:48 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:16:00 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:16:19 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:16:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:16:58 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:17:21 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:17:44 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:18:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:18:19 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:18:39 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:18:39 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10 2026/07/08 10:18:58 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:19:18 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:19:18 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:19:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:20:45 DEBUG : pacer: low level retry 3/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e5a3a19ada103\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e5a3a19ada103\",\"timestamp\":\"2026-07-08T10:20:45Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:20:50 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:21:11 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:21:29 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:21:50 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:22:10 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:22:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:22:49 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:22:49 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10 2026/07/08 10:22:49 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error" sync_test.go:624: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:624 Error: Received unexpected error: failed to copy item: Error "Server Error" Test: TestServerSideCopy 2026/07/08 10:22:49 DEBUG : drime root 'rclone-test-silixok3volo': Purge remote 2026/07/08 10:23:08 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestServerSideCopy (2196.03s) === RUN TestServerSideCopyOverSelf run.go:198: Remote "drime root 'rclone-test-cinukeq3dire'", Local "Local file system at /tmp/rclone2035730969", Modify Window "876000h0m0s" 2026/07/08 10:24:48 DEBUG : pacer: low level retry 1/1 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e6025e9338d5b\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e6025e9338d5b\",\"timestamp\":\"2026-07-08T10:24:48Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:24:48 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:299: Retry Put of "sub dir/hello world" to drime root 'rclone-test-cinukeq3dire': 1/10 (failed to upload file: Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e6025e9338d5b\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e6025e9338d5b\",\"timestamp\":\"2026-07-08T10:24:48Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:24:53 DEBUG : pacer: Reducing sleep to 10ms 2026/07/08 10:25:05 DEBUG : Creating backend with remote "TestDrime:rclone-test-hehixud1lece" sync_test.go:656: Server side copy (if possible) drime root 'rclone-test-cinukeq3dire' -> drime root 'rclone-test-hehixud1lece' 2026/07/08 10:25:19 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2026/07/08 10:25:19 DEBUG : drime root 'rclone-test-hehixud1lece': Waiting for checks to finish 2026/07/08 10:25:19 DEBUG : drime root 'rclone-test-hehixud1lece': Waiting for transfers to finish 2026/07/08 10:26:02 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:26:02 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/08 10:26:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:26:05 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/08 10:27:05 DEBUG : pacer: low level retry 3/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e6381ce14dc20\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e6381ce14dc20\",\"timestamp\":\"2026-07-08T10:27:05Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:27:05 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/08 10:27:09 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:27:09 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/08 10:27:12 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:27:12 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/08 10:27:17 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:27:17 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/07/08 10:27:22 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:27:22 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/07/08 10:27:25 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:27:25 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/07/08 10:27:28 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:27:28 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/07/08 10:27:32 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:27:32 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/08 10:27:32 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10 2026/07/08 10:27:36 DEBUG : pacer: Reducing sleep to 5.12s 2026/07/08 10:27:49 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:27:49 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/08 10:27:52 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:27:52 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:28:02 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:29:19 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e66c648addc20\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e66c648addc20\",\"timestamp\":\"2026-07-08T10:29:19Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:29:19 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:29:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:29:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:30:19 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:30:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:30:59 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:30:59 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10 2026/07/08 10:31:19 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:31:39 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:31:59 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:32:19 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:32:39 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:32:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:33:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:33:39 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:33:59 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:34:19 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:34:39 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:34:59 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:35:19 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:35:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:35:59 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:36:19 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:36:39 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:36:59 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:37:19 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:37:39 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:37:39 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10 2026/07/08 10:37:59 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:38:19 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:38:39 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:38:59 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:39:19 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:39:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:39:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 10:40:19 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 10:42:18 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:43:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 10:43:47 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:43:50 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 10:44:07 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 10:44:27 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 10:44:47 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 10:46:31 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 10:48:31 DEBUG : pacer: low level retry 7/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e816fd9a9dc20\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e816fd9a9dc20\",\"timestamp\":\"2026-07-08T10:48:31Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:48:31 DEBUG : pacer: low level retry 8/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e845eac23dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e845eac23dc20\",\"timestamp\":\"2026-07-08T10:48:31Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:48:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 10:49:11 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 10:49:11 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10 2026/07/08 10:50:52 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 10:52:52 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e87d01d93dc20\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e87d01d93dc20\",\"timestamp\":\"2026-07-08T10:52:52Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:52:52 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 10:53:52 DEBUG : pacer: low level retry 2/10 (error Error "520 (520): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-520/\",\"title\":\"Error 520: Web server is returning an unknown error\",\"status\":520,\"detail\":\"The origin web server sent a response that Cloudflare could not parse. This may indicate the origin returned an empty response, malformed HTTP headers, or an otherwise invalid response.\",\"instance\":\"a17e8abe6a6fdc20\",\"error_code\":520,\"error_name\":\"unknown_origin_error\",\"error_category\":\"origin\",\"ray_id\":\"a17e8abe6a6fdc20\",\"timestamp\":\"2026-07-08T10:53:52Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check the origin server error logs and submit them to Cloudflare support.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:53:52 DEBUG : pacer: low level retry 3/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8c306857dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8c306857dc20\",\"timestamp\":\"2026-07-08T10:53:52Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:54:12 DEBUG : pacer: low level retry 4/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8cad6929dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8cad6929dc20\",\"timestamp\":\"2026-07-08T10:54:12Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:54:32 DEBUG : pacer: low level retry 5/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8d2a6b4cdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8d2a6b4cdc20\",\"timestamp\":\"2026-07-08T10:54:32Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:54:52 DEBUG : pacer: low level retry 6/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8da76c08dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8da76c08dc20\",\"timestamp\":\"2026-07-08T10:54:52Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:55:12 DEBUG : pacer: low level retry 7/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8e246fdddc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8e246fdddc20\",\"timestamp\":\"2026-07-08T10:55:12Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:55:32 DEBUG : pacer: low level retry 8/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8ea16ddcdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8ea16ddcdc20\",\"timestamp\":\"2026-07-08T10:55:32Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:55:52 DEBUG : pacer: low level retry 9/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8f1e7e8edc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8f1e7e8edc20\",\"timestamp\":\"2026-07-08T10:55:52Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:56:12 DEBUG : pacer: low level retry 10/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8f9b7b38dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8f9b7b38dc20\",\"timestamp\":\"2026-07-08T10:56:12Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:56:12 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e8f9b7b38dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e8f9b7b38dc20\",\"timestamp\":\"2026-07-08T10:56:12Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n" - low level retry 4/10 2026/07/08 10:57:28 DEBUG : pacer: low level retry 1/10 (error Error "521 (521): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-521/\",\"title\":\"Error 521: Web server is down\",\"status\":521,\"detail\":\"Cloudflare attempted to connect to the origin web server, but the connection was refused. The origin is down, blocking Cloudflare IPs, or not accepting connections on the configured port.\",\"instance\":\"a17e90187d6ddc20\",\"error_code\":521,\"error_name\":\"origin_down\",\"error_category\":\"origin\",\"ray_id\":\"a17e90187d6ddc20\",\"timestamp\":\"2026-07-08T10:57:28Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the origin is offline or blocking Cloudflare — the website operator must restart the origin or whitelist Cloudflare IPs.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:57:29 DEBUG : pacer: low level retry 2/10 (error Error "521 (521): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-521/\",\"title\":\"Error 521: Web server is down\",\"status\":521,\"detail\":\"Cloudflare attempted to connect to the origin web server, but the connection was refused. The origin is down, blocking Cloudflare IPs, or not accepting connections on the configured port.\",\"instance\":\"a17e917c18dddc20\",\"error_code\":521,\"error_name\":\"origin_down\",\"error_category\":\"origin\",\"ray_id\":\"a17e917c18dddc20\",\"timestamp\":\"2026-07-08T10:57:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the origin is offline or blocking Cloudflare — the website operator must restart the origin or whitelist Cloudflare IPs.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:57:49 DEBUG : pacer: low level retry 3/10 (error Error "521 (521): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-521/\",\"title\":\"Error 521: Web server is down\",\"status\":521,\"detail\":\"Cloudflare attempted to connect to the origin web server, but the connection was refused. The origin is down, blocking Cloudflare IPs, or not accepting connections on the configured port.\",\"instance\":\"a17e91f91cfedc20\",\"error_code\":521,\"error_name\":\"origin_down\",\"error_category\":\"origin\",\"ray_id\":\"a17e91f91cfedc20\",\"timestamp\":\"2026-07-08T10:57:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the origin is offline or blocking Cloudflare — the website operator must restart the origin or whitelist Cloudflare IPs.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:58:09 DEBUG : pacer: low level retry 4/10 (error Error "521 (521): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-521/\",\"title\":\"Error 521: Web server is down\",\"status\":521,\"detail\":\"Cloudflare attempted to connect to the origin web server, but the connection was refused. The origin is down, blocking Cloudflare IPs, or not accepting connections on the configured port.\",\"instance\":\"a17e927628fedc20\",\"error_code\":521,\"error_name\":\"origin_down\",\"error_category\":\"origin\",\"ray_id\":\"a17e927628fedc20\",\"timestamp\":\"2026-07-08T10:58:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the origin is offline or blocking Cloudflare — the website operator must restart the origin or whitelist Cloudflare IPs.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:58:29 DEBUG : pacer: low level retry 5/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e92f32db2dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e92f32db2dc20\",\"timestamp\":\"2026-07-08T10:58:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:58:49 DEBUG : pacer: low level retry 6/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e93702943dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e93702943dc20\",\"timestamp\":\"2026-07-08T10:58:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:59:09 DEBUG : pacer: low level retry 7/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e93ed2f77dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e93ed2f77dc20\",\"timestamp\":\"2026-07-08T10:59:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:59:29 DEBUG : pacer: low level retry 8/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e946a2e77dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e946a2e77dc20\",\"timestamp\":\"2026-07-08T10:59:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 10:59:49 DEBUG : pacer: low level retry 9/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e94e72852dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e94e72852dc20\",\"timestamp\":\"2026-07-08T10:59:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:00:09 DEBUG : pacer: low level retry 10/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e95642909dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e95642909dc20\",\"timestamp\":\"2026-07-08T11:00:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:00:29 DEBUG : pacer: low level retry 1/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e95e12937dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e95e12937dc20\",\"timestamp\":\"2026-07-08T11:00:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:00:49 DEBUG : pacer: low level retry 2/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e965e28cfdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e965e28cfdc20\",\"timestamp\":\"2026-07-08T11:00:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:01:09 DEBUG : pacer: low level retry 3/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e96db2847dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e96db2847dc20\",\"timestamp\":\"2026-07-08T11:01:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:01:29 DEBUG : pacer: low level retry 4/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e97583a8adc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e97583a8adc20\",\"timestamp\":\"2026-07-08T11:01:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:01:49 DEBUG : pacer: low level retry 5/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e97d52a8fdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e97d52a8fdc20\",\"timestamp\":\"2026-07-08T11:01:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:02:09 DEBUG : pacer: low level retry 6/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e98523e92dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e98523e92dc20\",\"timestamp\":\"2026-07-08T11:02:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:02:29 DEBUG : pacer: low level retry 7/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e98cf38cedc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e98cf38cedc20\",\"timestamp\":\"2026-07-08T11:02:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:02:49 DEBUG : pacer: low level retry 8/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e994c3983dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e994c3983dc20\",\"timestamp\":\"2026-07-08T11:02:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:03:09 DEBUG : pacer: low level retry 9/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e99c93bacdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e99c93bacdc20\",\"timestamp\":\"2026-07-08T11:03:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:03:29 DEBUG : pacer: low level retry 10/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e9a463b4cdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e9a463b4cdc20\",\"timestamp\":\"2026-07-08T11:03:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:03:29 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e9a463b4cdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e9a463b4cdc20\",\"timestamp\":\"2026-07-08T11:03:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n" - low level retry 5/10 2026/07/08 11:03:49 DEBUG : pacer: low level retry 1/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e9ac33e7fdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e9ac33e7fdc20\",\"timestamp\":\"2026-07-08T11:03:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:04:09 DEBUG : pacer: low level retry 2/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e9b403fa8dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e9b403fa8dc20\",\"timestamp\":\"2026-07-08T11:04:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:04:29 DEBUG : pacer: low level retry 3/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e9bbd3b4fdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e9bbd3b4fdc20\",\"timestamp\":\"2026-07-08T11:04:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:04:49 DEBUG : pacer: low level retry 4/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17e9c3a3b24dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17e9c3a3b24dc20\",\"timestamp\":\"2026-07-08T11:04:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:07:09 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e9cb73f4adc20\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e9cb73f4adc20\",\"timestamp\":\"2026-07-08T11:07:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:09:09 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a17e9fa66f02dc20\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a17e9fa66f02dc20\",\"timestamp\":\"2026-07-08T11:09:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:09:09 DEBUG : pacer: low level retry 7/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17ea2959c14dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17ea2959c14dc20\",\"timestamp\":\"2026-07-08T11:09:09Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:09:29 DEBUG : pacer: low level retry 8/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17ea3129a7cdc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17ea3129a7cdc20\",\"timestamp\":\"2026-07-08T11:09:29Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:09:49 DEBUG : pacer: low level retry 9/10 (error Error "502 Bad Gateway (502): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-502/\",\"title\":\"Error 502: Bad gateway\",\"status\":502,\"detail\":\"The origin web server returned an invalid or incomplete response to Cloudflare. This typically indicates the origin is overloaded or misconfigured.\",\"instance\":\"a17ea38f9e79dc20\",\"error_code\":502,\"error_name\":\"origin_bad_gateway\",\"error_category\":\"origin\",\"ray_id\":\"a17ea38f9e79dc20\",\"timestamp\":\"2026-07-08T11:09:49Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":60,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 60 seconds. If the error persists, the website operator should check their origin server health and configuration.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/08 11:10:09 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:10:29 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:10:29 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:10:39 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:11:01 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:11:22 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:11:41 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:12:01 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:12:22 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:12:41 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:13:01 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:13:21 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:13:21 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10 2026/07/08 11:13:40 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:14:00 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:14:00 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:14:10 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:14:33 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:14:52 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:15:11 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:15:33 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:15:52 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:16:11 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:16:33 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:16:52 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:16:52 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10 2026/07/08 11:17:13 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:17:31 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:17:31 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:17:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:18:01 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:18:22 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:18:43 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:19:01 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:19:21 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:19:42 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:20:01 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:20:21 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:20:21 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10 2026/07/08 11:20:43 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:21:01 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:21:01 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:21:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:21:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:21:50 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:22:12 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:22:32 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:22:52 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:23:11 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:23:32 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:23:52 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:23:52 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10 2026/07/08 11:23:52 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error" sync_test.go:660: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:660 Error: Received unexpected error: failed to copy item: Error "Server Error" Test: TestServerSideCopyOverSelf 2026/07/08 11:23:52 DEBUG : drime root 'rclone-test-hehixud1lece': Purge remote 2026/07/08 11:24:14 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestServerSideCopyOverSelf (3659.83s) === RUN TestServerSideMoveOverSelf run.go:198: Remote "drime root 'rclone-test-cinukeq3dire'", Local "Local file system at /tmp/rclone2035730969", Modify Window "876000h0m0s" 2026/07/08 11:24:51 DEBUG : Creating backend with remote "TestDrime:rclone-test-lozezek1qopo" sync_test.go:701: Server side copy (if possible) drime root 'rclone-test-cinukeq3dire' -> drime root 'rclone-test-lozezek1qopo' 2026/07/08 11:25:03 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2026/07/08 11:25:03 DEBUG : drime root 'rclone-test-lozezek1qopo': Waiting for checks to finish 2026/07/08 11:25:03 DEBUG : drime root 'rclone-test-lozezek1qopo': Waiting for transfers to finish 2026/07/08 11:25:23 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:25:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/08 11:25:25 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:25:25 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/08 11:25:27 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:25:27 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/08 11:25:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:25:31 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/08 11:25:35 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:25:35 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/08 11:25:38 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:25:38 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/07/08 11:25:41 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:25:41 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/07/08 11:25:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:25:44 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/07/08 11:25:48 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:25:48 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/07/08 11:25:51 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:25:51 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/08 11:25:51 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10 2026/07/08 11:25:55 DEBUG : pacer: Reducing sleep to 5.12s 2026/07/08 11:26:06 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:26:06 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/08 11:26:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:26:11 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:26:21 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:26:42 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:27:02 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:27:23 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:27:43 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:28:02 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:28:22 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:28:42 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:28:42 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10 2026/07/08 11:29:02 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:29:22 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:29:22 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:29:33 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:29:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:30:14 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:30:32 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:30:51 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:31:13 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:31:33 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:31:52 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:32:13 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:32:13 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10 2026/07/08 11:32:32 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:32:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:32:51 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:33:03 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:33:22 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:33:42 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:34:03 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:34:22 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:34:41 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:35:01 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:35:23 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:35:45 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:35:45 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10 2026/07/08 11:36:02 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:36:21 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:36:21 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:36:33 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:36:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:37:12 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:37:33 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:37:53 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:38:13 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:38:33 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:38:53 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:39:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:39:12 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10 2026/07/08 11:39:33 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:39:52 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:39:52 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:40:02 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:40:21 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:40:42 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:41:01 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:41:23 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:41:42 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:42:01 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:42:22 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:42:44 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:42:44 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10 2026/07/08 11:43:02 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:43:22 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:43:22 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/08 11:43:31 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/08 11:43:55 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/08 11:44:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/08 11:44:33 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/08 11:44:53 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/08 11:45:13 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/08 11:45:34 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/08 11:45:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/08 11:46:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/08 11:46:12 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10 2026/07/08 11:46:32 DEBUG : pacer: Reducing sleep to 10s 2026/07/08 11:46:53 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/08 11:46:53 DEBUG : pacer: Rate limited, increasing sleep to 20s panic: test timed out after 2h0m0s running tests: TestServerSideMoveOverSelf (22m24s) goroutine 1338 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2802 +0x34b created by time.goFunc /usr/local/go/src/time/sleep.go:215 +0x2d goroutine 1 [chan receive, 22 minutes]: testing.(*T).Run(0x22ead52a4008, {0x2a74431?, 0x22ead4a69ae8?}, 0x2bbc650) /usr/local/go/src/testing/testing.go:2109 +0x4e5 testing.runTests.func1(0x22ead52a4008) /usr/local/go/src/testing/testing.go:2585 +0x37 testing.tRunner(0x22ead52a4008, 0x22ead4a69c10) /usr/local/go/src/testing/testing.go:2036 +0xea testing.runTests({0x2a6cdd3, 0x18}, {0x2a8dfd4, 0x20}, 0x22ead4f6db60, {0x4660300, 0x6c, 0x6c}, {0xc28bac0ce123b2c2, 0x69b42246964, ...}) /usr/local/go/src/testing/testing.go:2583 +0x505 testing.(*M).Run(0x22ead52fbb80) /usr/local/go/src/testing/testing.go:2443 +0x6ac github.com/rclone/rclone/fstest.TestMain(0x22ead52fbb80) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:74 +0xa6 github.com/rclone/rclone/fs/sync.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:45 main.main() _testmain.go:262 +0xa6 goroutine 13 [chan receive, 121 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7 goroutine 12 [syscall, 121 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x98 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:152 +0x1f goroutine 1049 [IO wait]: internal/poll.runtime_pollWait(0x79b0629bba00, 0x72) /usr/local/go/src/runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0x22ead5288380?, 0x22ead4f3c600?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0x22ead5288380, {0x22ead4f3c600, 0x1300, 0x1300}) /usr/local/go/src/internal/poll/fd_unix.go:165 +0x2ae net.(*netFD).Read(0x22ead5288380, {0x22ead4f3c600?, 0x22ead4a93918?, 0x43d07c?}) /usr/local/go/src/net/fd_posix.go:68 +0x25 net.(*conn).Read(0x22ead4a00318, {0x22ead4f3c600?, 0x431836?, 0x46a0200?}) /usr/local/go/src/net/net.go:196 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0x22ead4f6c378, {0x22ead4f3c600?, 0x79b0a965d4c0?, 0x79b0a96552f8?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x29 crypto/tls.(*atLeastReader).Read(0x22ead4a10288, {0x22ead4f3c600?, 0x22ead4f221e0?, 0x22ead4a93a48?}) /usr/local/go/src/crypto/tls/conn.go:815 +0x3b bytes.(*Buffer).ReadFrom(0x22ead51a7428, {0x2bd9e00, 0x22ead4a10288}) /usr/local/go/src/bytes/buffer.go:229 +0x98 crypto/tls.(*Conn).readFromUntil(0x22ead51a7188, {0x79b04ae32910, 0x22ead4f6c378}, 0x22ead4a93c08?) /usr/local/go/src/crypto/tls/conn.go:837 +0xde crypto/tls.(*Conn).readRecordOrCCS(0x22ead51a7188, 0x0) /usr/local/go/src/crypto/tls/conn.go:626 +0x3db crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:588 crypto/tls.(*Conn).Read(0x22ead51a7188, {0x22ead513f000, 0x1000, 0x7e63c0?}) /usr/local/go/src/crypto/tls/conn.go:1393 +0x145 bufio.(*Reader).Read(0x22ead4f5a960, {0x22ead4b964a4, 0x9, 0x802ece?}) /usr/local/go/src/bufio/bufio.go:245 +0x197 io.ReadAtLeast({0x2bd6c80, 0x22ead4f5a960}, {0x22ead4b964a4, 0x9, 0x9}, 0x9) /usr/local/go/src/io/io.go:335 +0x8e io.ReadFull(...) /usr/local/go/src/io/io.go:354 net/http.http2readFrameHeader({0x22ead4b964a4, 0x9, 0x22ea000000ab?}, {0x2bd6c80?, 0x22ead4f5a960?}) /usr/local/go/src/net/http/h2_bundle.go:1805 +0x65 net/http.(*http2Framer).ReadFrameHeader(0x22ead4b96460) /usr/local/go/src/net/http/h2_bundle.go:2071 +0x6b net/http.(*http2Framer).ReadFrame(0x22ead4b96460) /usr/local/go/src/net/http/h2_bundle.go:2130 +0x18 net/http.(*http2clientConnReadLoop).run(0x22ead4a93fa8) /usr/local/go/src/net/http/h2_bundle.go:9550 +0xca net/http.(*http2ClientConn).readLoop(0x22ead4ce8e00) /usr/local/go/src/net/http/h2_bundle.go:9419 +0x52 created by net/http.(*http2Transport).newClientConn in goroutine 1048 /usr/local/go/src/net/http/h2_bundle.go:8171 +0xda5 goroutine 1033 [sync.WaitGroup.Wait, 22 minutes]: sync.runtime_SemacquireWaitGroup(0x0?, 0x0?) /usr/local/go/src/runtime/sema.go:114 +0x2e sync.(*WaitGroup).Wait(0x22ead52d2398) /usr/local/go/src/sync/waitgroup.go:206 +0x85 github.com/rclone/rclone/fs/sync.(*syncCopyMove).stopTransfers(0x22ead52d2288) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:556 +0x6f github.com/rclone/rclone/fs/sync.(*syncCopyMove).run(0x22ead52d2288) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:987 +0x325 github.com/rclone/rclone/fs/sync.runSyncCopyMove({0x2c02a78, 0x22ead4c7c0f0}, {0x2c1e0f0, 0x22ead5286aa0}, {0x2c1e0f0, 0x22ead5248aa0}, 0x0, 0x0, 0x0, 0x0, ...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:1378 +0x225 github.com/rclone/rclone/fs/sync.CopyDir(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:1389 github.com/rclone/rclone/fs/sync.TestServerSideMoveOverSelf(0x22ead52a4248) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:704 +0x309 testing.tRunner(0x22ead52a4248, 0x2bbc650) /usr/local/go/src/testing/testing.go:2036 +0xea created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:2101 +0x4c5 goroutine 1284 [select]: github.com/rclone/rclone/fs/accounting.(*Account).averageLoop(0x22ead5280400) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:222 +0xec created by github.com/rclone/rclone/fs/accounting.newAccountSizeName in goroutine 1064 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:120 +0x43f goroutine 1090 [select]: github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0x22ead511e000, {0x2c02ab0, 0x22ead52902d0}) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:352 +0x145 created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 1064 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:389 +0x11d goroutine 1064 [select]: net/http.(*http2ClientConn).roundTrip(0x22ead4ce8e00, 0x22ead4e00140, 0x0) /usr/local/go/src/net/http/h2_bundle.go:8688 +0x525 net/http.(*http2ClientConn).RoundTrip(...) /usr/local/go/src/net/http/h2_bundle.go:8603 net/http.(*http2Transport).RoundTripOpt(0x22ead5286be0, 0x22ead4e00140, {0x40?, 0xa1?}) /usr/local/go/src/net/http/h2_bundle.go:7901 +0x1ed net/http.(*http2Transport).RoundTrip(...) /usr/local/go/src/net/http/h2_bundle.go:7852 net/http.http2noDialH2RoundTripper.RoundTrip({0x22ead4ea51e0?}, 0x22ead4e00140?) /usr/local/go/src/net/http/h2_bundle.go:10560 +0x1c net/http.(*Transport).roundTrip(0x22ead4ea51e0, 0x22ead4e00000) /usr/local/go/src/net/http/transport.go:623 +0x4ff net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:33 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0x22ead4e35140, 0x22ead4e00000) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:675 +0x5d4 net/http.send(0x22ead4e00000, {0x2bd83c0, 0x22ead4e35140}, {0x22ead4a68d40?, 0x4936a6?, 0x0?}) /usr/local/go/src/net/http/client.go:264 +0x64b net/http.(*Client).send(0x22ead519de00, 0x22ead4e00000, {0x431836?, 0x46a0200?, 0x0?}) /usr/local/go/src/net/http/client.go:185 +0x258 net/http.(*Client).do(0x22ead519de00, 0x22ead4e00000) /usr/local/go/src/net/http/client.go:733 +0x9d7 net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:592 github.com/rclone/rclone/lib/rest.(*Client).Call(0x22ead4eb8f50, {0x2c02a78, 0x22ead4e09620}, 0x22ead4a69430) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:371 +0xd85 github.com/rclone/rclone/lib/rest.(*Client).callCodec(0x22ead4eb8f50, {0x2c02a78, 0x22ead4e09620}, 0x22ead519e000?, {0x235d480?, 0x22ead4f7a4b0?}, {0x235d4c0, 0x22ead4f7a570}, 0x22ead4e4aa80?, 0x2bbde28, ...) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:579 +0x447 github.com/rclone/rclone/lib/rest.(*Client).CallJSON(...) /home/rclone/go/src/github.com/rclone/rclone/lib/rest/rest.go:522 github.com/rclone/rclone/backend/drime.(*Fs).copy.func1() /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:1032 +0x8d github.com/rclone/rclone/fs.pacerInvoker(0x2, 0xa, 0x2bd6f60?) /home/rclone/go/src/github.com/rclone/rclone/fs/pacer.go:86 +0x32 github.com/rclone/rclone/lib/pacer.(*Pacer).call(0x22ead4e351a0, 0x22ead4e7e0a0, 0xa) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:228 +0xd2 github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0x22ead4e351a0, 0x22ead4e7e0a0) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:247 +0x92 github.com/rclone/rclone/backend/drime.(*Fs).copy(0x22ead5286aa0, {0x2c02a78, 0x22ead4e09620}, {0x22ead4f4ee10, 0x9}, {0x22ead4e94f00, 0x9}) /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:1031 +0x40e github.com/rclone/rclone/backend/drime.(*Fs).copyTo(0x22ead5286aa0, {0x2c02a78, 0x22ead4e09620}, {0x22ead4f4ee10?, 0x46a0200?}, {0x22ead5129148, 0xb}, {0x22ead5129148, 0xb}, {0x22ead4e94f00, ...}) /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:1047 +0x55 github.com/rclone/rclone/backend/drime.(*Fs).Copy(0x22ead5286aa0, {0x2c02a78, 0x22ead4e09620}, {0x2c1e160?, 0x22ead4eb4900?}, {0x22ead5129140, 0x13}) /home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime.go:1105 +0x3fb github.com/rclone/rclone/fs/operations.(*copy).serverSideCopy(0x22ead5262b40, {0x2c02ab0, 0x22ead4eb9bd0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:155 +0x167 github.com/rclone/rclone/fs/operations.(*copy).copy(0x22ead5262b40, {0x2c02ab0, 0x22ead4eb9bd0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:318 +0xea github.com/rclone/rclone/fs/operations.Copy({0x2c02ab0, 0x22ead4eb9bd0}, {0x2c1e0f0, 0x22ead5286aa0}, {0x0, 0x0}, {0x22ead5129140, 0x13}, {0x2c1e160, 0x22ead4eb4900}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:424 +0x4dc github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0x22ead52d2288, {0x2c02ab0, 0x22ead4eb9bd0}, 0x22ead4eb9b30, {0x2c1e0f0, 0x22ead5286aa0}, 0x4b, 0x22ead531dfb8?) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:518 +0x1fe created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1033 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:548 +0x7d goroutine 1336 [sleep]: time.Sleep(0x4a817c800) /usr/local/go/src/runtime/time.go:363 +0x165 github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0x22ead5390000?) /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:178 +0x1c created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 1064 /home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:177 +0x17f goroutine 1073 [chan receive, 22 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:259 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 1033 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:257 +0x359 goroutine 1337 [select]: net/http.(*http2clientStream).writeRequest(0x22ead4f72000, 0x22ead4e00140, 0x0) /usr/local/go/src/net/http/h2_bundle.go:8857 +0xc68 net/http.(*http2clientStream).doRequest(0x22ead4f72000, 0x5c2c225c64756f6c?, 0x6c6664756f6c6322?) /usr/local/go/src/net/http/h2_bundle.go:8718 +0x18 created by net/http.(*http2ClientConn).roundTrip in goroutine 1064 /usr/local/go/src/net/http/h2_bundle.go:8624 +0x470 "./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMoveOverSelf)$'" - Finished ERROR in 2h1m3.916758121s (try 4/5): exit status 2: Failed [TestServerSideCopy TestServerSideCopyOverSelf]