"./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMoveOverSelf)$'" - Starting (try 3/5)
2026/07/01 08:52:00 DEBUG : Creating backend with remote "TestDrime:rclone-test-gaqawot5cice"
2026/07/01 08:52:00 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/07/01 08:52:07 DEBUG : Creating backend with remote "/tmp/rclone4119267444"
=== RUN   TestServerSideCopy
    run.go:198: Remote "drime root 'rclone-test-gaqawot5cice'", Local "Local file system at /tmp/rclone4119267444", Modify Window "876000h0m0s"
2026/07/01 08:52:33 DEBUG : Creating backend with remote "TestDrime:rclone-test-cazuziw0ziya"
2026/07/01 08:53:46 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a1442d25af4a33ca\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a1442d25af4a33ca\",\"timestamp\":\"2026-07-01T08:53:46Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 08:53:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/01 08:53:49 DEBUG : pacer: Reducing sleep to 10ms
    sync_test.go:620: Server side copy (if possible) drime root 'rclone-test-gaqawot5cice' -> drime root 'rclone-test-cazuziw0ziya'
2026/07/01 08:53:55 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2026/07/01 08:53:55 DEBUG : drime root 'rclone-test-cazuziw0ziya': Waiting for checks to finish
2026/07/01 08:53:55 DEBUG : drime root 'rclone-test-cazuziw0ziya': Waiting for transfers to finish
2026/07/01 08:54:17 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 08:54:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/01 08:54:20 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 08:54:20 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/07/01 08:54:24 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 08:54:24 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/07/01 08:54:27 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 08:54:27 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/07/01 08:54:29 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 08:54:29 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/07/01 08:54:32 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 08:54:32 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/07/01 08:54:35 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 08:54:35 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/07/01 08:54:38 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 08:54:38 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/07/01 08:54:43 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 08:54:43 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/07/01 08:54:45 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 08:54:45 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/01 08:54:45 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10
2026/07/01 08:54:52 DEBUG : pacer: Reducing sleep to 5.12s
2026/07/01 08:55:01 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 08:55:01 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/01 08:55:06 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 08:55:06 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 08:56:14 DEBUG : pacer: low level retry 3/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14430c73ba333ca\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14430c73ba333ca\",\"timestamp\":\"2026-07-01T08:56:14Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 08:56:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 08:56:39 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 08:56:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 08:57:17 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 08:57:37 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 08:57:56 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 08:58:16 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 08:58:16 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10
2026/07/01 08:59:35 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14435ab8a1733ca\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14435ab8a1733ca\",\"timestamp\":\"2026-07-01T08:59:35Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 08:59:38 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:00:00 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:00:00 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:00:08 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:00:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:00:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:01:09 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:01:28 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:01:47 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:02:08 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:02:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:02:47 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:02:47 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10
2026/07/01 09:04:05 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a1443c4a4dcd33ca\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a1443c4a4dcd33ca\",\"timestamp\":\"2026-07-01T09:04:05Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 09:04:10 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:04:27 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:04:27 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:04:38 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:05:01 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:05:18 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:05:38 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:05:57 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:06:18 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:06:38 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:06:59 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:07:18 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:07:18 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10
2026/07/01 09:07:38 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:08:06 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:08:06 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:08:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:08:28 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:08:50 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:09:18 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:09:28 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:09:51 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:10:09 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:10:29 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:10:49 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:10:49 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10
2026/07/01 09:11:09 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:11:28 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:11:28 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:11:39 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:11:58 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:12:18 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:12:39 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:12:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:13:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:13:41 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:14:00 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:14:18 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:14:18 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10
2026/07/01 09:14:38 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:15:00 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:15:00 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:15:08 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:15:29 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:15:50 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:16:11 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:16:30 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:16:48 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:17:09 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:17:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:17:48 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:17:48 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10
2026/07/01 09:18:10 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:18:28 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:18:28 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:18:39 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:18:59 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:19:21 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:19:42 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:19:59 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:20:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:20:39 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:21:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:22:16 DEBUG : pacer: low level retry 10/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14456ec884933ca\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14456ec884933ca\",\"timestamp\":\"2026-07-01T09:22:16Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 09:22:16 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a14456ec884933ca\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a14456ec884933ca\",\"timestamp\":\"2026-07-01T09:22:16Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n" - low level retry 7/10
2026/07/01 09:22:19 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:22:39 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:22:39 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:22:49 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:23:13 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:23:33 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:23:54 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:24:20 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:24:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:24:49 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:25:11 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:25:31 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:25:31 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10
2026/07/01 09:25:50 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:26:08 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:26:08 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:26:22 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:26:40 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:27:00 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:27:21 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:27:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:27:59 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:28:23 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:28:38 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:29:00 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:29:00 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10
2026/07/01 09:29:00 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error"
    sync_test.go:624: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:624
        	Error:      	Received unexpected error:
        	            	failed to copy item: Error "Server Error"
        	Test:       	TestServerSideCopy
2026/07/01 09:29:00 DEBUG : drime root 'rclone-test-cazuziw0ziya': Purge remote
2026/07/01 09:29:20 DEBUG : pacer: Reducing sleep to 10s
--- FAIL: TestServerSideCopy (2251.74s)
=== RUN   TestServerSideCopyOverSelf
    run.go:198: Remote "drime root 'rclone-test-gaqawot5cice'", Local "Local file system at /tmp/rclone4119267444", Modify Window "876000h0m0s"
2026/07/01 09:30:00 DEBUG : Creating backend with remote "TestDrime:rclone-test-tamaqes6kuqa"
    sync_test.go:656: Server side copy (if possible) drime root 'rclone-test-gaqawot5cice' -> drime root 'rclone-test-tamaqes6kuqa'
2026/07/01 09:30:18 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2026/07/01 09:30:18 DEBUG : drime root 'rclone-test-tamaqes6kuqa': Waiting for checks to finish
2026/07/01 09:30:18 DEBUG : drime root 'rclone-test-tamaqes6kuqa': Waiting for transfers to finish
2026/07/01 09:30:38 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:30:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/01 09:30:40 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:30:40 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/07/01 09:30:46 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:30:46 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/07/01 09:30:48 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:30:48 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/07/01 09:30:52 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:30:52 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/07/01 09:30:54 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:30:54 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/07/01 09:30:57 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:30:57 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/07/01 09:31:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:31:00 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/07/01 09:31:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:31:04 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/07/01 09:31:06 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:31:06 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/01 09:31:06 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10
2026/07/01 09:31:12 DEBUG : pacer: Reducing sleep to 5.12s
2026/07/01 09:31:24 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:31:24 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/01 09:31:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:31:28 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:31:50 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:31:57 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:32:18 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:32:38 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:33:00 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:33:18 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:33:39 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:33:58 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:33:58 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10
2026/07/01 09:34:19 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:34:38 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:34:38 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:35:45 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a1446aae891bf319\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a1446aae891bf319\",\"timestamp\":\"2026-07-01T09:35:45Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 09:35:51 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:36:09 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:36:28 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:36:49 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:37:10 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:38:26 DEBUG : pacer: low level retry 8/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a1446e9708e7f319\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a1446e9708e7f319\",\"timestamp\":\"2026-07-01T09:38:26Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 09:38:28 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:38:50 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:38:50 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10
2026/07/01 09:39:10 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:39:29 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:39:29 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:39:38 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:40:03 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:40:19 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:40:40 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:41:00 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:41:18 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:41:38 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:41:59 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:42:19 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:42:19 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10
2026/07/01 09:42:39 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:43:06 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:43:06 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:43:09 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:43:31 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:44:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:44:09 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:44:30 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:44:50 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:45:11 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:45:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:45:54 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:45:54 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10
2026/07/01 09:46:10 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:46:30 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:46:30 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:46:40 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:47:01 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:47:21 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:47:39 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:48:04 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:48:20 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:48:40 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:49:01 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:49:20 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:49:20 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10
2026/07/01 09:49:43 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:50:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:50:05 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:50:11 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:50:30 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:50:50 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:51:10 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:51:31 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:51:50 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:52:10 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:52:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:52:50 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:52:50 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10
2026/07/01 09:53:12 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:53:30 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:53:30 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:53:41 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:54:00 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:55:16 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a1448747b843f319\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a1448747b843f319\",\"timestamp\":\"2026-07-01T09:55:16Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 09:55:21 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:55:40 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:56:01 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:56:21 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 09:56:52 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 09:57:06 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 09:57:06 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10
2026/07/01 09:57:20 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 09:57:47 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 09:57:47 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 09:57:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 09:58:10 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 09:58:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 09:58:50 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 09:59:11 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 09:59:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 09:59:54 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:00:40 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:00:43 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:00:43 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10
2026/07/01 10:01:04 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:01:23 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:01:23 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:01:34 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:01:53 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:02:16 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:02:33 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:02:53 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:03:15 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:03:33 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:03:53 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:04:13 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:04:13 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10
2026/07/01 10:04:13 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error"
    sync_test.go:660: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:660
        	Error:      	Received unexpected error:
        	            	failed to copy item: Error "Server Error"
        	Test:       	TestServerSideCopyOverSelf
2026/07/01 10:04:13 DEBUG : drime root 'rclone-test-tamaqes6kuqa': Purge remote
2026/07/01 10:04:33 DEBUG : pacer: Reducing sleep to 10s
--- FAIL: TestServerSideCopyOverSelf (2115.60s)
=== RUN   TestServerSideMoveOverSelf
    run.go:198: Remote "drime root 'rclone-test-gaqawot5cice'", Local "Local file system at /tmp/rclone4119267444", Modify Window "876000h0m0s"
2026/07/01 10:05:23 DEBUG : Creating backend with remote "TestDrime:rclone-test-jiqawin4qeja"
    sync_test.go:701: Server side copy (if possible) drime root 'rclone-test-gaqawot5cice' -> drime root 'rclone-test-jiqawin4qeja'
2026/07/01 10:05:38 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination
2026/07/01 10:05:38 DEBUG : drime root 'rclone-test-jiqawin4qeja': Waiting for checks to finish
2026/07/01 10:05:38 DEBUG : drime root 'rclone-test-jiqawin4qeja': Waiting for transfers to finish
2026/07/01 10:06:01 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:06:01 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/01 10:06:04 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:06:04 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/07/01 10:06:07 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:06:07 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/07/01 10:06:09 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:06:09 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/07/01 10:06:13 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:06:13 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/07/01 10:06:16 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:06:16 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/07/01 10:06:19 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:06:19 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/07/01 10:06:24 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:06:24 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/07/01 10:06:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:06:30 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/07/01 10:06:34 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:06:34 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/01 10:06:34 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 0/10
2026/07/01 10:06:39 DEBUG : pacer: Reducing sleep to 5.12s
2026/07/01 10:06:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:06:51 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/01 10:06:54 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:06:54 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:07:04 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:07:23 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:07:45 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:08:04 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:08:25 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:08:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:09:04 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:09:24 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:09:24 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 1/10
2026/07/01 10:09:45 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:10:04 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:10:04 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:10:14 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:10:34 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:10:55 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:11:14 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:11:39 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:11:56 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:12:14 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:13:31 DEBUG : pacer: low level retry 9/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a144a201282a2c4c\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a144a201282a2c4c\",\"timestamp\":\"2026-07-01T10:13:31Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 10:13:35 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:13:35 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 2/10
2026/07/01 10:13:54 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:14:15 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:14:15 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:14:24 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:14:44 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:15:05 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:16:21 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a144a6281a622c4c\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a144a6281a622c4c\",\"timestamp\":\"2026-07-01T10:16:21Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 10:16:32 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:16:49 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:17:06 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:17:27 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:17:44 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:17:44 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 3/10
2026/07/01 10:18:05 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:18:24 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:18:24 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:18:36 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:18:54 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:19:14 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:19:34 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:19:54 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:20:14 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:20:34 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:20:54 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:21:15 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:21:15 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 4/10
2026/07/01 10:21:34 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:21:54 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:21:54 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:22:04 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:22:24 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:22:46 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:23:05 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:23:25 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:24:41 DEBUG : pacer: low level retry 7/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a144b25d8ac92c4c\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a144b25d8ac92c4c\",\"timestamp\":\"2026-07-01T10:24:41Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 10:24:44 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:25:05 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:25:25 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:25:25 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 5/10
2026/07/01 10:25:46 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:26:05 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:26:05 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:26:17 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:26:36 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:27:51 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a144b7017b572c4c\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a144b7017b572c4c\",\"timestamp\":\"2026-07-01T10:27:51Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 10:27:54 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:28:15 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:28:34 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:28:55 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:29:14 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:29:34 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:29:34 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 6/10
2026/07/01 10:29:59 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:30:21 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:30:21 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:30:28 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:30:44 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:31:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:31:24 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:31:47 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:32:04 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:32:25 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:32:45 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:33:05 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:33:05 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 7/10
2026/07/01 10:33:27 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:33:45 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:33:45 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:33:55 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:34:14 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:34:37 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:34:55 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/01 10:35:14 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:35:38 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:35:55 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:36:17 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:36:35 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:36:35 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 8/10
2026/07/01 10:36:55 DEBUG : pacer: Reducing sleep to 10s
2026/07/01 10:37:14 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/01 10:37:14 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/01 10:37:27 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/01 10:37:45 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/01 10:38:06 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/01 10:39:22 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a144c7da993c2c4c\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a144c7da993c2c4c\",\"timestamp\":\"2026-07-01T10:39:22Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/01 10:39:27 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/01 10:39:46 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/01 10:40:05 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/01 10:40:25 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/01 10:40:47 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/01 10:40:47 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "Server Error" - low level retry 9/10
2026/07/01 10:40:47 ERROR : sub dir/hello world: Failed to copy: failed to copy item: Error "Server Error"
    sync_test.go:705: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:705
        	Error:      	Received unexpected error:
        	            	failed to copy item: Error "Server Error"
        	Test:       	TestServerSideMoveOverSelf
2026/07/01 10:40:47 DEBUG : drime root 'rclone-test-jiqawin4qeja': Purge remote
2026/07/01 10:41:05 DEBUG : pacer: Reducing sleep to 10s
--- FAIL: TestServerSideMoveOverSelf (2200.18s)
FAIL
2026/07/01 10:41:34 DEBUG : drime root 'rclone-test-gaqawot5cice': Purge remote
"./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestServerSideCopy|TestServerSideCopyOverSelf|TestServerSideMoveOverSelf)$'" - Finished ERROR in 1h49m38.575102369s (try 3/5): exit status 1: Failed [TestServerSideCopy TestServerSideCopyOverSelf TestServerSideMoveOverSelf]