"go test -v -timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestIntegration$'" - Starting (try 3/5)
=== RUN TestIntegration
fstests.go:438: Using remote "TestDrime:"
2026/04/30 05:47:42 DEBUG : Creating backend with remote "TestDrime:rclone-test-zaxohol8qaru"
2026/04/30 05:47:42 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/04/30 05:47:42 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value
2026/04/30 05:47:42 DEBUG : pacer: low level retry 1/10 (error Error "500 Internal Server Error (500): \r\n
500 Internal Server Error\r\n\r\n500 Internal Server Error
\r\n
nginx\r\n\r\n\r\n")
2026/04/30 05:47:42 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/04/30 05:48:42 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f4440d4fa8437fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f4440d4fa8437fe\",\"timestamp\":\"2026-04-30T05:48:42Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:48:42 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/04/30 05:49:42 DEBUG : pacer: low level retry 3/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f44424c6f7837fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f44424c6f7837fe\",\"timestamp\":\"2026-04-30T05:49:42Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:49:42 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/04/30 05:50:42 DEBUG : pacer: low level retry 4/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f4443c3dfba37fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f4443c3dfba37fe\",\"timestamp\":\"2026-04-30T05:50:42Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:50:42 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/04/30 05:51:42 DEBUG : pacer: low level retry 5/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f44453b3bec37fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f44453b3bec37fe\",\"timestamp\":\"2026-04-30T05:51:42Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:51:42 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/04/30 05:52:42 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f4446b33b0a37fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f4446b33b0a37fe\",\"timestamp\":\"2026-04-30T05:52:42Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:52:42 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/04/30 05:53:43 DEBUG : pacer: low level retry 7/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f44482aed5537fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f44482aed5537fe\",\"timestamp\":\"2026-04-30T05:53:43Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:53:43 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/04/30 05:54:43 DEBUG : pacer: low level retry 8/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f4449a3fc5d37fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f4449a3fc5d37fe\",\"timestamp\":\"2026-04-30T05:54:43Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:54:43 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/04/30 05:55:30 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/04/30 05:55:30 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/04/30 05:56:30 DEBUG : pacer: low level retry 10/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f444c438b5937fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f444c438b5937fe\",\"timestamp\":\"2026-04-30T05:56:30Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:56:30 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/04/30 05:57:45 DEBUG : pacer: low level retry 1/10 (error Error "Server Error")
2026/04/30 05:57:45 DEBUG : pacer: Rate limited, increasing sleep to 20s
2026/04/30 05:58:45 DEBUG : pacer: low level retry 2/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f444f91cac037fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f444f91cac037fe\",\"timestamp\":\"2026-04-30T05:58:45Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 05:59:46 DEBUG : pacer: low level retry 3/10 (error Error "Server Error")
2026/04/30 06:00:37 DEBUG : pacer: low level retry 4/10 (error Error "Server Error")
2026/04/30 06:01:31 DEBUG : pacer: low level retry 5/10 (error Error "Server Error")
2026/04/30 06:02:31 DEBUG : pacer: low level retry 6/10 (error Error "504 Gateway Timeout (504): {\"type\":\"https://developers.cloudflare.com/support/troubleshooting/http-status-codes/cloudflare-5xx-errors/error-504/\",\"title\":\"Error 504: Gateway time-out\",\"status\":504,\"detail\":\"The origin web server did not respond to Cloudflare within the allowed time. This typically means the origin is overloaded or a backend process is taking too long.\",\"instance\":\"9f445513484a37fe\",\"error_code\":504,\"error_name\":\"origin_gateway_timeout\",\"error_category\":\"origin\",\"ray_id\":\"9f445513484a37fe\",\"timestamp\":\"2026-04-30T06:02:31Z\",\"zone\":\"app.drime.cloud\",\"cloudflare_error\":true,\"retryable\":true,\"retry_after\":120,\"owner_action_required\":true,\"what_you_should_do\":\"**Wait and retry.** Back off for at least 120 seconds. If the error persists, the website operator should investigate long-running processes on the origin server.\",\"footer\":\"This error was generated by Cloudflare on behalf of the website owner.\"}")
2026/04/30 06:03:43 DEBUG : pacer: low level retry 7/10 (error Error "Server Error")
2026/04/30 06:04:35 DEBUG : pacer: low level retry 8/10 (error Error "Server Error")
2026/04/30 06:05:34 DEBUG : pacer: low level retry 9/10 (error Error "Server Error")
2026/04/30 06:06:25 DEBUG : pacer: low level retry 10/10 (error Error "Server Error")
fstests.go:462:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:462
/home/rclone/go/src/github.com/rclone/rclone/backend/drime/drime_test.go:13
Error: Received unexpected error:
couldn't list files: Error "Server Error"
Test: TestIntegration
Messages: unexpected error: couldn't list files: Error "Server Error"
--- FAIL: TestIntegration (1123.03s)
FAIL
exit status 1
FAIL github.com/rclone/rclone/backend/drime 1123.048s
"go test -v -timeout 2h0m0s -remote TestDrime: -verbose -test.run '^TestIntegration$'" - Finished ERROR in 18m43.743356762s (try 3/5): exit status 1: Failed [TestIntegration]