"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^TestCopyFileCopyDest$'" - Starting (try 4/5)
2026/07/06 07:33:17 DEBUG : Creating backend with remote "TestDrime:rclone-test-nanazeh4povi"
2026/07/06 07:33:17 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/07/06 07:33:25 DEBUG : Creating backend with remote "/tmp/rclone989612181"
=== RUN   TestCopyFileCopyDest
    run.go:198: Remote "drime root 'rclone-test-nanazeh4povi'", Local "Local file system at /tmp/rclone989612181", Modify Window "876000h0m0s"
2026/07/06 07:33:25 DEBUG : Creating backend with remote "TestDrime:rclone-test-nanazeh4povi/dst"
2026/07/06 07:33:41 DEBUG : Creating backend with remote "TestDrime:rclone-test-nanazeh4povi/CopyDest"
2026/07/06 07:33:46 DEBUG : one: Need to transfer - File not found at Destination
2026/07/06 07:34:15 DEBUG : one: size = 3 OK
2026/07/06 07:34:15 INFO  : one: Copied (new)
2026/07/06 07:34:31 DEBUG : one: size = 5 (Local file system at /tmp/rclone989612181)
2026/07/06 07:34:31 DEBUG : one: size = 3 (drime root 'rclone-test-nanazeh4povi/dst')
2026/07/06 07:34:31 DEBUG : one: Sizes differ
2026/07/06 07:34:40 DEBUG : one: Removing old object on successful upload
2026/07/06 07:34:42 DEBUG : one: Old object already deleted, safely ignoring
2026/07/06 07:34:42 DEBUG : one: size = 5 OK
2026/07/06 07:34:42 INFO  : one: Copied (replaced existing)
2026/07/06 07:35:03 DEBUG : dst/one: Removing old object on successful upload
2026/07/06 07:35:05 DEBUG : dst/one: Old object already deleted, safely ignoring
2026/07/06 07:35:29 DEBUG : Creating backend with remote "TestDrime:rclone-test-nanazeh4povi/BackupDir"
2026/07/06 07:35:40 DEBUG : one: size = 5 (Local file system at /tmp/rclone989612181)
2026/07/06 07:35:40 DEBUG : one: size = 3 (drime root 'rclone-test-nanazeh4povi/dst')
2026/07/06 07:35:40 DEBUG : one: Sizes differ
2026/07/06 07:35:53 DEBUG : one: size = 5 OK
2026/07/06 07:35:53 DEBUG : one: Sizes identical
2026/07/06 07:35:53 DEBUG : one: size = 5 (Local file system at /tmp/rclone989612181)
2026/07/06 07:35:53 DEBUG : one: size = 3 (drime root 'rclone-test-nanazeh4povi/dst')
2026/07/06 07:35:53 DEBUG : one: Sizes differ
2026/07/06 07:36:10 INFO  : one: Moved (server-side)
2026/07/06 07:36:17 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:36:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/06 07:36:20 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:36:20 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/07/06 07:36:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:36:23 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/07/06 07:36:26 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:36:26 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/07/06 07:36:32 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:36:32 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/07/06 07:36:36 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:36:36 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/07/06 07:36:43 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 07:36:43 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/07/06 07:36:46 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 07:36:46 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/07/06 07:36:49 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:36:49 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/07/06 07:36:53 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:36:53 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/06 07:36:53 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 0/10
2026/07/06 07:36:58 DEBUG : pacer: Reducing sleep to 5.12s
2026/07/06 07:37:07 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:37:07 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/06 07:37:12 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:37:12 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 07:37:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:37:42 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:38:02 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:38:24 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:38:42 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 07:39:07 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 07:39:23 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:39:43 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:39:43 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 1/10
2026/07/06 07:40:02 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 07:40:23 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:40:23 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 07:40:32 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:40:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:41:12 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:41:32 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:41:54 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:42:20 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 07:42:32 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 07:42:52 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:43:13 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:43:13 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 2/10
2026/07/06 07:43:33 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 07:43:52 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:43:52 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 07:44:04 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:44:23 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:44:42 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:45:02 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:45:24 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:46:40 DEBUG : pacer: low level retry 7/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a16cfdc0e818a103\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a16cfdc0e818a103\",\"timestamp\":\"2026-07-06T07:46:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/06 07:47:40 DEBUG : pacer: low level retry 8/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a16cff3838f6a103\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a16cff3838f6a103\",\"timestamp\":\"2026-07-06T07:47:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/06 07:47:43 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:48:02 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:48:02 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 3/10
2026/07/06 07:48:23 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 07:48:46 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:48:46 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 07:48:52 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:49:12 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:49:40 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:50:48 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:50:50 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:51:10 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 07:51:30 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 07:51:50 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:52:10 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:52:10 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 4/10
2026/07/06 07:52:30 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 07:52:54 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:52:54 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 07:53:00 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:53:24 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:53:40 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:54:04 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:54:20 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:54:40 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 07:55:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 07:55:20 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:55:42 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:55:42 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 5/10
2026/07/06 07:56:03 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 07:56:20 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 07:56:20 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 07:56:31 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 07:56:50 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 07:57:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 07:58:22 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 07:58:25 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 07:58:44 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 07:59:05 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 07:59:25 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 07:59:45 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 07:59:45 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 6/10
2026/07/06 08:00:05 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 08:00:25 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 08:00:25 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 08:00:36 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 08:00:56 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 08:01:15 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 08:01:35 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 08:01:55 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 08:02:16 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 08:02:36 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 08:02:57 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 08:03:15 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 08:03:15 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 7/10
2026/07/06 08:03:35 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 08:03:55 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 08:03:55 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 08:04:05 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 08:04:25 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 08:04:45 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 08:05:07 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 08:05:41 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 08:05:45 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 08:06:09 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 08:06:31 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 08:06:46 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 08:06:46 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 8/10
2026/07/06 08:07:05 DEBUG : pacer: Reducing sleep to 10s
2026/07/06 08:07:25 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/07/06 08:07:25 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/07/06 08:07:42 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/07/06 08:07:55 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/07/06 08:08:18 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/07/06 08:08:38 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/07/06 08:08:55 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/07/06 08:09:15 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/07/06 08:09:35 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/07/06 08:09:55 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/07/06 08:10:15 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/07/06 08:10:15 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 9/10
2026/07/06 08:10:15 ERROR : one: Failed to copy: failed to copy item: Error "Server Error"
2026/07/06 08:10:15 ERROR : one: Destination found in --copy-dest, error copying
2026/07/06 08:10:22 INFO  : one: Deleted
2026/07/06 08:10:25 ERROR : one: Couldn't move: failed to move item: Error "No valid entries to move"
    copy_test.go:321: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:321
        	Error:      	Received unexpected error:
        	            	moving to --backup-dir failed: failed to move item: Error "No valid entries to move"
        	Test:       	TestCopyFileCopyDest
2026/07/06 08:11:40 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a16d2264bb1015dc\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a16d2264bb1015dc\",\"timestamp\":\"2026-07-06T08:11:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/07/06 08:11:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/06 08:11:43 DEBUG : pacer: Reducing sleep to 10ms
--- FAIL: TestCopyFileCopyDest (2312.51s)
FAIL
2026/07/06 08:11:57 DEBUG : drime root 'rclone-test-nanazeh4povi': Purge remote
"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^TestCopyFileCopyDest$'" - Finished ERROR in 38m44.078023818s (try 4/5): exit status 1: Failed [TestCopyFileCopyDest]