"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^TestCopyFileCopyDest$'" - Starting (try 2/5)
2026/06/30 04:36:30 DEBUG : Creating backend with remote "TestDrime:rclone-test-ruyehit8yomu"
2026/06/30 04:36:30 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/06/30 04:36:40 DEBUG : Creating backend with remote "/tmp/rclone1960435430"
=== RUN   TestCopyFileCopyDest
    run.go:198: Remote "drime root 'rclone-test-ruyehit8yomu'", Local "Local file system at /tmp/rclone1960435430", Modify Window "876000h0m0s"
2026/06/30 04:36:40 DEBUG : Creating backend with remote "TestDrime:rclone-test-ruyehit8yomu/dst"
2026/06/30 04:36:51 DEBUG : Creating backend with remote "TestDrime:rclone-test-ruyehit8yomu/CopyDest"
2026/06/30 04:36:58 DEBUG : one: Need to transfer - File not found at Destination
2026/06/30 04:37:24 DEBUG : one: size = 3 OK
2026/06/30 04:37:24 INFO  : one: Copied (new)
2026/06/30 04:37:42 DEBUG : one: size = 5 (Local file system at /tmp/rclone1960435430)
2026/06/30 04:37:42 DEBUG : one: size = 3 (drime root 'rclone-test-ruyehit8yomu/dst')
2026/06/30 04:37:42 DEBUG : one: Sizes differ
2026/06/30 04:37:51 DEBUG : one: Removing old object on successful upload
2026/06/30 04:37:56 DEBUG : one: Old object already deleted, safely ignoring
2026/06/30 04:37:56 DEBUG : one: size = 5 OK
2026/06/30 04:37:56 INFO  : one: Copied (replaced existing)
2026/06/30 04:38:10 DEBUG : dst/one: Removing old object on successful upload
2026/06/30 04:38:13 DEBUG : dst/one: Old object already deleted, safely ignoring
2026/06/30 04:38:39 DEBUG : Creating backend with remote "TestDrime:rclone-test-ruyehit8yomu/BackupDir"
2026/06/30 04:38:56 DEBUG : one: size = 5 (Local file system at /tmp/rclone1960435430)
2026/06/30 04:38:56 DEBUG : one: size = 3 (drime root 'rclone-test-ruyehit8yomu/dst')
2026/06/30 04:38:56 DEBUG : one: Sizes differ
2026/06/30 04:39:07 DEBUG : one: size = 5 OK
2026/06/30 04:39:07 DEBUG : one: Sizes identical
2026/06/30 04:39:07 DEBUG : one: size = 5 (Local file system at /tmp/rclone1960435430)
2026/06/30 04:39:07 DEBUG : one: size = 3 (drime root 'rclone-test-ruyehit8yomu/dst')
2026/06/30 04:39:07 DEBUG : one: Sizes differ
2026/06/30 04:40:36 INFO  : one: Moved (server-side)
2026/06/30 04:40:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:40:41 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/06/30 04:40:44 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:40:44 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/06/30 04:40:47 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:40:47 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/06/30 04:40:51 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:40:51 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/06/30 04:40:55 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 04:40:55 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/06/30 04:40:58 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 04:40:58 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/06/30 04:41:01 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 04:41:01 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/06/30 04:41:04 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 04:41:04 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/06/30 04:41:07 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 04:41:07 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/06/30 04:41:09 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 04:41:09 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/06/30 04:41:09 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 0/10
2026/06/30 04:41:15 DEBUG : pacer: Reducing sleep to 5.12s
2026/06/30 04:41:25 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:41:25 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/06/30 04:41:31 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:41:31 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 04:41:40 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:42:01 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:42:21 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 04:42:40 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 04:43:00 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 04:43:21 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 04:43:40 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 04:44:04 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 04:44:04 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 1/10
2026/06/30 04:44:21 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 04:44:41 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:44:41 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 04:44:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:45:11 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:45:30 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:45:50 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 04:46:11 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 04:46:30 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 04:46:51 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 04:47:10 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 04:47:31 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 04:47:31 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 2/10
2026/06/30 04:47:50 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 04:48:10 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:48:10 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 04:48:21 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:48:41 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:49:00 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:49:22 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 04:49:42 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 04:50:00 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 04:50:20 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 04:50:40 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 04:51:00 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 04:51:00 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 3/10
2026/06/30 04:51:22 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 04:51:40 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:51:40 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 04:51:50 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:52:10 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:52:31 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:52:50 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 04:53:11 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 04:53:30 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 04:53:50 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 04:54:10 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 04:54:30 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 04:54:30 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 4/10
2026/06/30 04:54:52 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 04:55:11 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:55:11 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 04:55:21 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:55:41 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:56:01 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:56:20 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 04:56:40 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 04:57:01 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 04:57:20 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 04:57:46 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 04:58:00 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 04:58:00 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 5/10
2026/06/30 04:58:20 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 04:58:40 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 04:58:40 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 04:58:51 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 04:59:10 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 04:59:30 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 04:59:50 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 05:00:10 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 05:00:31 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 05:00:50 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 05:01:10 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 05:01:33 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 05:01:33 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 6/10
2026/06/30 05:01:50 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 05:02:10 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 05:02:10 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 05:02:20 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 05:02:41 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 05:03:01 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 05:03:22 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 05:04:37 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a13aa0262e1870dd\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a13aa0262e1870dd\",\"timestamp\":\"2026-06-30T05:04:37Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n")
2026/06/30 05:04:41 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 05:05:00 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 05:05:20 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 05:05:40 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 05:05:40 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 7/10
2026/06/30 05:06:02 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 05:06:21 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 05:06:21 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 05:06:30 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 05:06:52 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 05:07:11 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 05:07:31 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 05:07:51 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 05:08:11 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 05:08:31 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 05:08:51 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 05:09:12 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 05:09:12 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 8/10
2026/06/30 05:09:31 DEBUG : pacer: Reducing sleep to 10s
2026/06/30 05:09:51 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/06/30 05:09:51 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/06/30 05:10:01 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/06/30 05:10:21 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/06/30 05:10:41 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/06/30 05:11:00 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/06/30 05:11:22 DEBUG : pacer: low level retry 6/10 (error Error "Server Error")
2026/06/30 05:11:40 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/06/30 05:12:06 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/06/30 05:12:22 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/06/30 05:12:42 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/06/30 05:12:42 DEBUG : one: Received error: failed to copy item: Error "Server Error" - low level retry 9/10
2026/06/30 05:12:42 ERROR : one: Failed to copy: failed to copy item: Error "Server Error"
2026/06/30 05:12:42 ERROR : one: Destination found in --copy-dest, error copying
2026/06/30 05:12:47 INFO  : one: Deleted
2026/06/30 05:12:50 ERROR : one: Couldn't move: failed to move item: Error "No valid entries to move"
    copy_test.go:321: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:321
        	Error:      	Received unexpected error:
        	            	moving to --backup-dir failed: failed to move item: Error "No valid entries to move"
        	Test:       	TestCopyFileCopyDest
--- FAIL: TestCopyFileCopyDest (2203.70s)
FAIL
2026/06/30 05:13:23 DEBUG : drime root 'rclone-test-ruyehit8yomu': Purge remote
"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^TestCopyFileCopyDest$'" - Finished ERROR in 36m56.33961563s (try 2/5): exit status 1: Failed [TestCopyFileCopyDest]