"./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMoveOverSelf)$'" - Starting (try 5/5) 2026/07/02 11:52:36 DEBUG : Creating backend with remote "TestDrime:rclone-test-boyewap5quwa" 2026/07/02 11:52:36 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/07/02 11:52:41 DEBUG : Creating backend with remote "/tmp/rclone2324836259" === RUN TestServerSideCopy run.go:198: Remote "drime root 'rclone-test-boyewap5quwa'", Local "Local file system at /tmp/rclone2324836259", Modify Window "876000h0m0s" 2026/07/02 11:53:12 DEBUG : Creating backend with remote "TestDrime:rclone-test-darakam8gigi" sync_test.go:620: Server side copy (if possible) drime root 'rclone-test-boyewap5quwa' -> drime root 'rclone-test-darakam8gigi' 2026/07/02 11:53:30 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2026/07/02 11:53:30 DEBUG : drime root 'rclone-test-darakam8gigi': Waiting for checks to finish 2026/07/02 11:53:30 DEBUG : drime root 'rclone-test-darakam8gigi': Waiting for transfers to finish 2026/07/02 11:53:53 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 11:53:53 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/02 11:53:56 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 11:53:56 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/02 11:53:59 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 11:53:59 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/02 11:54:02 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 11:54:02 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/02 11:54:04 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 11:54:04 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/02 11:54:07 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 11:54:07 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/07/02 11:54:10 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 11:54:10 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/07/02 11:54:14 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 11:54:14 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/07/02 11:54:18 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 11:54:18 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/07/02 11:54:21 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 11:54:21 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/02 11:54:21 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10 2026/07/02 11:54:26 DEBUG : pacer: Reducing sleep to 5.12s 2026/07/02 11:54:36 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 11:54:36 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/02 11:54:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 11:54:41 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 11:54:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 11:55:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 11:55:36 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 11:55:58 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 11:56:11 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 11:56:34 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 11:56:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 11:57:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 11:57:12 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10 2026/07/02 11:57:31 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 11:57:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 11:57:51 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 11:58:02 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 11:58:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 11:58:41 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 11:59:01 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 11:59:22 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 11:59:42 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:00:03 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:00:23 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:00:41 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:00:41 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10 2026/07/02 12:01:03 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:01:24 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:01:24 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:01:33 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:01:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:02:12 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:02:34 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:02:52 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:03:12 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:03:32 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:03:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:04:11 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:04:11 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10 2026/07/02 12:04:31 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:04:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:04:51 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:05:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:05:21 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:05:41 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:06:56 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:06:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:07:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:07:40 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:07:59 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:08:19 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:08:19 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10 2026/07/02 12:08:39 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:09:01 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:09:01 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:09:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:09:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:09:49 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:10:10 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:10:28 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:10:49 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:11:10 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:11:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:11:49 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:11:49 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10 2026/07/02 12:12:09 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:12:31 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:12:31 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:12:40 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:12:59 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:13:19 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:13:38 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:14:56 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14d913ad8cd6999\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14d913ad8cd6999\",\"timestamp\":\"2026-07-02T12:14:56Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:15:01 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:15:18 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:15:55 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:16:00 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:16:00 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10 2026/07/02 12:17:17 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14d94a63d736999\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14d94a63d736999\",\"timestamp\":\"2026-07-02T12:17:17Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:17:23 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:17:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:17:41 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:17:50 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:18:10 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:18:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:18:51 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:20:07 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14d98d3095e6999\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14d98d3095e6999\",\"timestamp\":\"2026-07-02T12:20:07Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:20:11 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:20:33 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:20:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:21:10 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:21:10 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10 2026/07/02 12:21:30 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:21:55 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:21:55 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:22:57 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14d9cfa89206999\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14d9cfa89206999\",\"timestamp\":\"2026-07-02T12:22:57Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:23:00 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:23:21 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:23:40 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:24:00 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:24:20 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:24:41 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:25:00 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:25:21 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:25:21 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10 2026/07/02 12:25:40 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:26:00 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:26:00 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:27:08 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14da3155bef6999\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14da3155bef6999\",\"timestamp\":\"2026-07-02T12:27:08Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:27:17 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:27:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:28:01 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:28:10 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:28:30 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:28:50 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:29:13 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:29:34 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:29:34 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10 2026/07/02 12:29:34 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error" sync_test.go:624: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:624 Error: Received unexpected error: failed to copy item: Error "Server Error" Test: TestServerSideCopy 2026/07/02 12:29:34 DEBUG : drime root 'rclone-test-darakam8gigi': Purge remote 2026/07/02 12:29:51 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestServerSideCopy (2255.35s) === RUN TestServerSideCopyOverSelf run.go:198: Remote "drime root 'rclone-test-boyewap5quwa'", Local "Local file system at /tmp/rclone2324836259", Modify Window "876000h0m0s" 2026/07/02 12:30:41 DEBUG : Creating backend with remote "TestDrime:rclone-test-tovituh0nite" sync_test.go:656: Server side copy (if possible) drime root 'rclone-test-boyewap5quwa' -> drime root 'rclone-test-tovituh0nite' 2026/07/02 12:30:59 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2026/07/02 12:30:59 DEBUG : drime root 'rclone-test-tovituh0nite': Waiting for checks to finish 2026/07/02 12:30:59 DEBUG : drime root 'rclone-test-tovituh0nite': Waiting for transfers to finish 2026/07/02 12:31:18 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:31:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/02 12:31:25 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:31:25 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/02 12:31:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:31:31 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/02 12:31:33 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:31:33 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/02 12:31:36 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:31:36 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/02 12:31:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:31:39 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/07/02 12:31:42 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:31:42 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/07/02 12:31:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:31:44 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/07/02 12:31:48 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:31:48 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/07/02 12:31:54 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:31:54 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/02 12:31:54 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10 2026/07/02 12:31:57 DEBUG : pacer: Reducing sleep to 5.12s 2026/07/02 12:32:08 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:32:08 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/02 12:32:13 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:32:13 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:32:22 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:33:40 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14dacadba178dc5\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14dacadba178dc5\",\"timestamp\":\"2026-07-02T12:33:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:33:44 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:34:04 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:34:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:34:43 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:35:03 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:35:23 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:35:23 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10 2026/07/02 12:35:44 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:36:07 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:36:07 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:36:13 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:36:35 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:36:58 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:37:15 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:38:30 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14db3c29fbd8dc5\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14db3c29fbd8dc5\",\"timestamp\":\"2026-07-02T12:38:30Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:39:30 DEBUG : pacer: low level retry 7/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14db539f9e98dc5\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14db539f9e98dc5\",\"timestamp\":\"2026-07-02T12:39:30Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:39:34 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:39:57 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:40:13 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:40:13 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10 2026/07/02 12:40:36 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:40:53 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:40:53 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:42:00 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14db8e3ca5c8dc5\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14db8e3ca5c8dc5\",\"timestamp\":\"2026-07-02T12:42:00Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:42:05 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:42:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:42:45 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:43:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:44:20 DEBUG : pacer: low level retry 7/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14dbc4f2a048dc5\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14dbc4f2a048dc5\",\"timestamp\":\"2026-07-02T12:44:20Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 12:44:26 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:44:44 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:45:03 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:45:03 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10 2026/07/02 12:45:23 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:45:44 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:45:44 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:45:56 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:46:14 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:46:34 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:47:00 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:47:14 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:47:33 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:47:56 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:48:15 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:48:34 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:48:34 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10 2026/07/02 12:48:54 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:49:13 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:49:13 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:49:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:49:44 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:50:05 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:50:24 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:50:46 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:51:04 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:51:24 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:51:44 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:52:24 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:52:24 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10 2026/07/02 12:52:27 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:52:50 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:52:50 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:52:57 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:53:17 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:53:37 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:54:09 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:54:17 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:54:37 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:54:58 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:55:19 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:55:38 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:55:38 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10 2026/07/02 12:56:27 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 12:56:31 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 12:56:31 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 12:56:40 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 12:57:02 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 12:57:20 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 12:57:42 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 12:58:00 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 12:58:20 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 12:58:43 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 12:59:01 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 12:59:20 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 12:59:20 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10 2026/07/02 12:59:52 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:00:00 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:00:00 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:00:10 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:00:34 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:00:52 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:01:13 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:01:32 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:01:51 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:02:10 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:02:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:02:50 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:02:50 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10 2026/07/02 13:03:13 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:03:31 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:03:31 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:03:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:04:00 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:04:20 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:04:40 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:05:01 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:05:21 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:05:45 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:06:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:06:20 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:06:20 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10 2026/07/02 13:06:20 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error" sync_test.go:660: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:660 Error: Received unexpected error: failed to copy item: Error "Server Error" Test: TestServerSideCopyOverSelf 2026/07/02 13:06:20 DEBUG : drime root 'rclone-test-tovituh0nite': Purge remote 2026/07/02 13:06:44 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestServerSideCopyOverSelf (2206.57s) === RUN TestServerSideMoveOverSelf run.go:198: Remote "drime root 'rclone-test-boyewap5quwa'", Local "Local file system at /tmp/rclone2324836259", Modify Window "876000h0m0s" 2026/07/02 13:07:32 DEBUG : Creating backend with remote "TestDrime:rclone-test-jopujok0bumi" sync_test.go:701: Server side copy (if possible) drime root 'rclone-test-boyewap5quwa' -> drime root 'rclone-test-jopujok0bumi' 2026/07/02 13:07:47 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2026/07/02 13:07:47 DEBUG : drime root 'rclone-test-jopujok0bumi': Waiting for checks to finish 2026/07/02 13:07:47 DEBUG : drime root 'rclone-test-jopujok0bumi': Waiting for transfers to finish 2026/07/02 13:08:19 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:08:19 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/02 13:08:22 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:08:22 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/02 13:08:26 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:08:26 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/02 13:08:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:08:31 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/02 13:08:34 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:08:34 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/02 13:08:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:08:39 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2026/07/02 13:08:42 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:08:42 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2026/07/02 13:09:06 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:09:06 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2026/07/02 13:09:11 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:09:11 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2026/07/02 13:09:16 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:09:16 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2026/07/02 13:09:16 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10 2026/07/02 13:10:16 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14de249eba374ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14de249eba374ff\",\"timestamp\":\"2026-07-02T13:10:16Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 13:10:16 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:10:24 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:10:42 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:10:42 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:10:52 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:11:10 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:11:30 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:11:49 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:12:10 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:12:30 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:12:51 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:14:06 DEBUG : pacer: low level retry 9/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14de7e7b9c774ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14de7e7b9c774ff\",\"timestamp\":\"2026-07-02T13:14:06Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 13:14:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:14:12 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10 2026/07/02 13:14:31 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:14:52 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:14:52 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:15:02 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:15:19 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:15:39 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:16:04 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:16:25 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:16:39 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:17:03 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:17:21 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:17:39 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:17:39 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10 2026/07/02 13:17:59 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:18:19 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:18:19 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:18:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:18:50 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:19:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:19:30 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:19:51 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:20:10 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:20:37 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:20:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:21:17 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:21:17 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10 2026/07/02 13:21:29 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:21:49 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:21:49 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:21:59 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:22:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:22:40 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:23:00 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:23:19 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:23:40 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:24:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:25:16 DEBUG : pacer: low level retry 9/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14df843bad274ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14df843bad274ff\",\"timestamp\":\"2026-07-02T13:25:16Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 13:25:49 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:25:49 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10 2026/07/02 13:25:53 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:26:12 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:26:12 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:26:22 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:26:44 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:27:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:27:22 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:27:42 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:28:02 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:28:25 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:29:02 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:29:08 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:29:08 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10 2026/07/02 13:29:27 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:29:45 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:29:45 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:29:55 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:31:12 DEBUG : pacer: low level retry 3/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14e00f23aaa74ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14e00f23aaa74ff\",\"timestamp\":\"2026-07-02T13:31:12Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 13:31:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:31:36 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:31:55 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:32:17 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:33:27 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:33:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:33:51 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:33:51 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10 2026/07/02 13:34:11 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:34:31 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:34:31 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:34:43 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:35:03 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:35:22 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:35:41 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:36:02 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:36:42 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:36:46 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:37:05 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:37:31 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:37:31 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10 2026/07/02 13:37:49 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:38:06 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:38:06 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:38:18 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:38:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:38:55 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:39:15 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:39:35 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:39:58 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:40:16 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:40:37 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:40:55 DEBUG : pacer: low level retry 10/10 (error Error "Server Error") 2026/07/02 13:40:55 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10 2026/07/02 13:41:24 DEBUG : pacer: Reducing sleep to 10s 2026/07/02 13:41:37 DEBUG : pacer: low level retry 1/10 (error Error "Server Error") 2026/07/02 13:41:37 DEBUG : pacer: Rate limited, increasing sleep to 20s 2026/07/02 13:41:46 DEBUG : pacer: low level retry 2/10 (error Error "Server Error") 2026/07/02 13:42:06 DEBUG : pacer: low level retry 3/10 (error Error "Server Error") 2026/07/02 13:42:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error") 2026/07/02 13:42:49 DEBUG : pacer: low level retry 5/10 (error Error "Server Error") 2026/07/02 13:43:06 DEBUG : pacer: low level retry 6/10 (error Error "Server Error") 2026/07/02 13:43:26 DEBUG : pacer: low level retry 7/10 (error Error "Server Error") 2026/07/02 13:43:53 DEBUG : pacer: low level retry 8/10 (error Error "Server Error") 2026/07/02 13:44:07 DEBUG : pacer: low level retry 9/10 (error Error "Server Error") 2026/07/02 13:45:22 DEBUG : pacer: low level retry 10/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14e15b3d9e474ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14e15b3d9e474ff\",\"timestamp\":\"2026-07-02T13:45:22Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/02 13:45:22 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14e15b3d9e474ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14e15b3d9e474ff\",\"timestamp\":\"2026-07-02T13:45:22Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n" - low level retry 9/10 2026/07/02 13:45:22 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14e15b3d9e474ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14e15b3d9e474ff\",\"timestamp\":\"2026-07-02T13:45:22Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n" sync_test.go:705: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:705 Error: Received unexpected error: failed to copy item: Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14e15b3d9e474ff\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14e15b3d9e474ff\",\"timestamp\":\"2026-07-02T13:45:22Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n" Test: TestServerSideMoveOverSelf 2026/07/02 13:45:22 DEBUG : drime root 'rclone-test-jopujok0bumi': Purge remote 2026/07/02 13:45:30 DEBUG : pacer: Reducing sleep to 10s --- FAIL: TestServerSideMoveOverSelf (2341.95s) FAIL 2026/07/02 13:46:05 DEBUG : drime root 'rclone-test-boyewap5quwa': Purge remote "./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMoveOverSelf)$'" - Finished ERROR in 1h53m36.580353473s (try 5/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf]