"./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestCopyFileBackupDir|TestCopyFileCopyDest|TestDirMove|TestMaxDelete|TestMaxDeleteSize|TestMoveFileBackupDir|TestRmdirsNoLeaveRoot)$'" - Starting (try 2/5) 2026/07/11 02:41:42 DEBUG : Creating backend with remote "TestDrime:rclone-test-pukokis6kake" 2026/07/11 02:41:42 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/07/11 02:41:44 DEBUG : Creating backend with remote "/tmp/rclone1243318947" === RUN TestCopyFileBackupDir run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:41:58 DEBUG : Creating backend with remote "TestDrime:rclone-test-pukokis6kake/backup" 2026/07/11 02:42:02 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone1243318947) 2026/07/11 02:42:02 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-pukokis6kake') 2026/07/11 02:42:02 DEBUG : dst/file1: Sizes differ 2026/07/11 02:44:11 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a194741429e5266f\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a194741429e5266f\",\"timestamp\":\"2026-07-11T02:44:11Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:44:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/11 02:44:12 DEBUG : pacer: Reducing sleep to 10ms 2026/07/11 02:44:12 ERROR : dst/file1: Couldn't move: failed to move item: Error "No valid entries to move" copy_test.go:186: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:186 Error: Received unexpected error: moving to --backup-dir failed: failed to move item: Error "No valid entries to move" Test: TestCopyFileBackupDir --- FAIL: TestCopyFileBackupDir (160.97s) === RUN TestCopyFileCopyDest run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:44:25 DEBUG : Creating backend with remote "TestDrime:rclone-test-pukokis6kake/dst" 2026/07/11 02:44:29 DEBUG : Creating backend with remote "TestDrime:rclone-test-pukokis6kake/CopyDest" 2026/07/11 02:44:32 DEBUG : one: Need to transfer - File not found at Destination 2026/07/11 02:44:36 DEBUG : one: size = 3 OK 2026/07/11 02:44:36 INFO : one: Copied (new) 2026/07/11 02:44:40 DEBUG : one: size = 5 (Local file system at /tmp/rclone1243318947) 2026/07/11 02:44:40 DEBUG : one: size = 3 (drime root 'rclone-test-pukokis6kake/dst') 2026/07/11 02:44:40 DEBUG : one: Sizes differ 2026/07/11 02:44:42 DEBUG : one: Removing old object on successful upload 2026/07/11 02:44:42 DEBUG : one: Old object already deleted, safely ignoring 2026/07/11 02:44:42 DEBUG : one: size = 5 OK 2026/07/11 02:44:42 INFO : one: Copied (replaced existing) 2026/07/11 02:44:44 DEBUG : dst/one: Removing old object on successful upload 2026/07/11 02:44:44 DEBUG : dst/one: Old object already deleted, safely ignoring 2026/07/11 02:44:47 DEBUG : Creating backend with remote "TestDrime:rclone-test-pukokis6kake/BackupDir" 2026/07/11 02:44:52 DEBUG : one: size = 5 (Local file system at /tmp/rclone1243318947) 2026/07/11 02:44:52 DEBUG : one: size = 3 (drime root 'rclone-test-pukokis6kake/dst') 2026/07/11 02:44:52 DEBUG : one: Sizes differ 2026/07/11 02:44:55 DEBUG : one: size = 5 OK 2026/07/11 02:44:55 DEBUG : one: Sizes identical 2026/07/11 02:44:55 DEBUG : one: size = 5 (Local file system at /tmp/rclone1243318947) 2026/07/11 02:44:55 DEBUG : one: size = 3 (drime root 'rclone-test-pukokis6kake/dst') 2026/07/11 02:44:55 DEBUG : one: Sizes differ 2026/07/11 02:46:58 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a19478265e5babc5\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a19478265e5babc5\",\"timestamp\":\"2026-07-11T02:46:58Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:46:58 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/11 02:46:59 DEBUG : pacer: Reducing sleep to 10ms 2026/07/11 02:46:59 ERROR : one: Couldn't move: failed to move item: Error "No valid entries to move" copy_test.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy_test.go:321 Error: Received unexpected error: moving to --backup-dir failed: failed to move item: Error "No valid entries to move" Test: TestCopyFileCopyDest --- FAIL: TestCopyFileCopyDest (168.93s) === RUN TestMaxDelete run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:47:26 DEBUG : Waiting for deletions to finish 2026/07/11 02:47:28 ERROR : small: Got fatal error on delete: --max-delete threshold reached 2026/07/11 02:47:28 INFO : large: Deleted 2026/07/11 02:47:28 INFO : medium: Deleted operations_test.go:453: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:453 Error: Not equal: expected: 1 actual : 3 Test: TestMaxDelete fstest.go:298: Sleeping for 1s for list eventual consistency: 1/5 fstest.go:301: Flushing the directory cache fstest.go:292: Sleeping for 6s just to make sure --- FAIL: TestMaxDelete (27.62s) === RUN TestMaxDeleteSize run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:47:51 DEBUG : Waiting for deletions to finish 2026/07/11 02:47:52 ERROR : small: Got fatal error on delete: --max-delete-size threshold reached 2026/07/11 02:47:53 INFO : large: Deleted 2026/07/11 02:47:53 INFO : medium: Deleted --- PASS: TestMaxDeleteSize (20.21s) === RUN TestRmdirsNoLeaveRoot run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:48:14 INFO : A2: Making directory 2026/07/11 02:48:16 INFO : A1/B2: Making directory 2026/07/11 02:48:18 INFO : A1/B2/C2: Making directory 2026/07/11 02:48:21 INFO : A1/B1/C3: Making directory 2026/07/11 02:48:23 INFO : A3: Making directory 2026/07/11 02:48:25 INFO : A3/B3: Making directory 2026/07/11 02:48:27 INFO : A3/B3/C4: Making directory 2026/07/11 02:48:37 DEBUG : removing 1 level 3 directories 2026/07/11 02:48:37 INFO : A3/B3/C4: Removing directory 2026/07/11 02:48:51 DEBUG : removing 2 level 3 directories 2026/07/11 02:48:51 INFO : A1/B2/C2: Removing directory 2026/07/11 02:48:51 INFO : A1/B1/C3: Removing directory 2026/07/11 02:48:53 DEBUG : removing 2 level 2 directories 2026/07/11 02:48:53 INFO : A3/B3: Removing directory 2026/07/11 02:48:53 INFO : A1/B2: Removing directory 2026/07/11 02:48:54 DEBUG : removing 2 level 1 directories 2026/07/11 02:48:54 INFO : A3: Removing directory 2026/07/11 02:48:54 INFO : A2: Removing directory 2026/07/11 02:49:04 DEBUG : removing 1 level 3 directories 2026/07/11 02:49:04 INFO : A1/B1/C1: Removing directory 2026/07/11 02:49:06 DEBUG : removing 1 level 2 directories 2026/07/11 02:49:06 INFO : A1/B1: Removing directory 2026/07/11 02:49:08 DEBUG : removing 1 level 1 directories 2026/07/11 02:49:08 INFO : A1: Removing directory 2026/07/11 02:49:11 DEBUG : removing 1 level 0 directories 2026/07/11 02:49:11 INFO : drime root 'rclone-test-pukokis6kake': Removing directory 2026/07/11 02:49:14 ERROR : error listing: directory not found 2026/07/11 02:49:15 ERROR : error listing: directory not found --- PASS: TestRmdirsNoLeaveRoot (73.62s) === RUN TestMoveFileBackupDir run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:49:24 DEBUG : Creating backend with remote "TestDrime:rclone-test-pukokis6kake/backup" 2026/07/11 02:49:24 DEBUG : Config file has changed externally - reloading 2026/07/11 02:49:29 DEBUG : dst/file1: size = 14 (Local file system at /tmp/rclone1243318947) 2026/07/11 02:49:29 DEBUG : dst/file1: size = 18 (drime root 'rclone-test-pukokis6kake') 2026/07/11 02:49:29 DEBUG : dst/file1: Sizes differ 2026/07/11 02:51:35 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a1947eefab67dfd7\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a1947eefab67dfd7\",\"timestamp\":\"2026-07-11T02:51:35Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:51:35 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/11 02:51:36 DEBUG : pacer: Reducing sleep to 10ms 2026/07/11 02:51:36 ERROR : dst/file1: Couldn't move: failed to move item: Error "No valid entries to move" operations_test.go:1075: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1075 Error: Received unexpected error: moving to --backup-dir failed: failed to move item: Error "No valid entries to move" Test: TestMoveFileBackupDir --- FAIL: TestMoveFileBackupDir (152.52s) === RUN TestDirMove run.go:198: Remote "drime root 'rclone-test-pukokis6kake'", Local "Local file system at /tmp/rclone1243318947", Modify Window "876000h0m0s" 2026/07/11 02:52:07 INFO : A1/B2: Making directory 2026/07/11 02:52:10 INFO : A1/B1/C3: Making directory 2026/07/11 02:54:21 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a19482faced0b69e\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a19482faced0b69e\",\"timestamp\":\"2026-07-11T02:54:21Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:54:21 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2026/07/11 02:54:21 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a19482faded5b69e\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a19482faded5b69e\",\"timestamp\":\"2026-07-11T02:54:21Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:54:21 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2026/07/11 02:54:21 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a19482faeee4b69e\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a19482faeee4b69e\",\"timestamp\":\"2026-07-11T02:54:21Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:54:21 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2026/07/11 02:54:21 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a19482fafeebb69e\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a19482fafeebb69e\",\"timestamp\":\"2026-07-11T02:54:21Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:54:21 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2026/07/11 02:54:21 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"a19482fb0ef8b69e\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"a19482fb0ef8b69e\",\"timestamp\":\"2026-07-11T02:54:21Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}\n") 2026/07/11 02:54:21 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2026/07/11 02:54:22 DEBUG : pacer: Reducing sleep to 160ms 2026/07/11 02:54:22 ERROR : A2/B1/C1/four: Couldn't move: failed to move item: Error "No valid entries to move" 2026/07/11 02:54:22 DEBUG : pacer: Reducing sleep to 80ms 2026/07/11 02:54:22 ERROR : A2/two: Couldn't move: failed to move item: Post "https://app.drime.cloud/api/v1/file-entries/move": context canceled 2026/07/11 02:54:22 DEBUG : pacer: Reducing sleep to 40ms 2026/07/11 02:54:22 ERROR : A2/one: Couldn't move: failed to move item: Post "https://app.drime.cloud/api/v1/file-entries/move": context canceled 2026/07/11 02:54:22 DEBUG : pacer: Reducing sleep to 20ms 2026/07/11 02:54:22 ERROR : A2/B1/three: Couldn't move: failed to move item: Post "https://app.drime.cloud/api/v1/file-entries/move": context canceled 2026/07/11 02:54:22 DEBUG : pacer: Reducing sleep to 10ms 2026/07/11 02:54:22 ERROR : A2/B1/C2/five: Couldn't move: failed to move item: Post "https://app.drime.cloud/api/v1/file-entries/move": context canceled operations_test.go:1436: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1436 Error: Received unexpected error: RenameDir renames: failed to move item: Error "No valid entries to move" Test: TestDirMove --- FAIL: TestDirMove (195.56s) FAIL 2026/07/11 02:55:04 DEBUG : drime root 'rclone-test-pukokis6kake': Purge remote "./operations.test -test.v -test.timeout 2h0m0s -remote TestDrime: -list-retries 5 -verbose -test.run '^(TestCopyFileBackupDir|TestCopyFileCopyDest|TestDirMove|TestMaxDelete|TestMaxDeleteSize|TestMoveFileBackupDir|TestRmdirsNoLeaveRoot)$'" - Finished ERROR in 13m23.232228251s (try 2/5): exit status 1: Failed [TestCopyFileBackupDir TestCopyFileCopyDest TestMaxDelete TestMoveFileBackupDir TestDirMove]