"./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose" - Starting (try 3/5)
2026/04/30 04:47:35 DEBUG : Creating backend with remote "TestDrime:rclone-test-morosub0tice"
2026/04/30 04:47:35 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/04/30 04:48:24 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/04/30 04:48:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/30 04:49:26 DEBUG : pacer: low level retry 2/10 (error Error "Server Error")
2026/04/30 04:49:26 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/30 04:50:26 DEBUG : pacer: low level retry 3/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43eb7b4907d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43eb7b4907d3c1\",\"timestamp\":\"2026-04-30T04:50:26Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 04:50:26 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/30 04:51:32 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/04/30 04:51:32 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/04/30 04:52:32 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43ee8f9ca0d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43ee8f9ca0d3c1\",\"timestamp\":\"2026-04-30T04:52:32Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 04:52:32 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/04/30 04:53:32 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43f0079cd0d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43f0079cd0d3c1\",\"timestamp\":\"2026-04-30T04:53:32Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 04:53:32 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/04/30 04:54:52 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/04/30 04:54:52 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/04/30 04:55:40 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/04/30 04:55:40 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/04/30 04:56:40 DEBUG : pacer: low level retry 9/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43f49bf873d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43f49bf873d3c1\",\"timestamp\":\"2026-04-30T04:56:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 04:56:40 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/04/30 04:57:40 DEBUG : pacer: low level retry 10/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43f614be65d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43f614be65d3c1\",\"timestamp\":\"2026-04-30T04:57:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 04:57:40 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/04/30 04:58:40 DEBUG : pacer: low level retry 1/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43f78dd8f2d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43f78dd8f2d3c1\",\"timestamp\":\"2026-04-30T04:58:40Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 04:58:40 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/04/30 04:59:41 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43f9060ea9d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43f9060ea9d3c1\",\"timestamp\":\"2026-04-30T04:59:41Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:00:36 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/04/30 05:01:36 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43fbd5dfebd3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43fbd5dfebd3c1\",\"timestamp\":\"2026-04-30T05:01:36Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:02:41 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/04/30 05:03:41 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f43fee35dffd3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f43fee35dffd3c1\",\"timestamp\":\"2026-04-30T05:03:41Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:04:32 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/04/30 05:05:32 DEBUG : pacer: low level retry 8/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f44019c0cdbd3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f44019c0cdbd3c1\",\"timestamp\":\"2026-04-30T05:05:32Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:06:32 DEBUG : pacer: low level retry 9/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f440313cf06d3c1\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f440313cf06d3c1\",\"timestamp\":\"2026-04-30T05:06:32Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:07:31 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
2026/04/30 05:07:31 NOTICE: Failed to open remote "TestDrime:": couldn't list files: Error "Server Error"
"./sync.test -test.v -test.timeout 2h0m0s -remote TestDrime: -verbose" - Finished ERROR in 19m55.888091765s (try 3/5): exit status 1: Failed []