"./sync.test -test.v -test.timeout 1h0m0s -remote TestGoFile: -verbose -fast-list -test.run '^TestSyncWithUpdateOlder$'" - Starting (try 3/5) 2025/09/09 03:50:18 DEBUG : Creating backend with remote "TestGoFile:rclone-test-cayuduv1nuke" 2025/09/09 03:50:18 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/09/09 03:50:18 DEBUG : Creating backend with remote "/tmp/rclone3966524117" === RUN TestSyncWithUpdateOlder run.go:180: Remote "gofile root 'rclone-test-cayuduv1nuke'", Local "Local file system at /tmp/rclone3966524117", Modify Window "1s" 2025/09/09 03:52:28 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 03:52:28 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:52:28 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "one" to gofile root 'rclone-test-cayuduv1nuke': 1/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:52:30 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 03:54:41 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 03:54:41 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:54:41 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "two" to gofile root 'rclone-test-cayuduv1nuke': 1/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:54:43 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 03:56:54 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 03:56:54 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:56:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "three" to gofile root 'rclone-test-cayuduv1nuke': 1/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:56:56 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 03:59:07 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 03:59:07 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:59:07 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "three" to gofile root 'rclone-test-cayuduv1nuke': 2/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 03:59:09 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 04:01:20 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:01:20 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:01:20 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "three" to gofile root 'rclone-test-cayuduv1nuke': 3/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:01:22 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 04:03:33 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:03:33 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:03:33 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "three" to gofile root 'rclone-test-cayuduv1nuke': 4/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:03:35 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 04:05:46 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:05:46 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:05:46 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "three" to gofile root 'rclone-test-cayuduv1nuke': 5/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:05:48 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 04:07:59 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:07:59 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:07:59 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "three" to gofile root 'rclone-test-cayuduv1nuke': 6/10 (failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:08:02 DEBUG : pacer: Reducing sleep to 10ms 2025/09/09 04:08:02 DEBUG : five: Need to transfer - File not found at Destination 2025/09/09 04:08:02 DEBUG : gofile root 'rclone-test-cayuduv1nuke': Waiting for checks to finish 2025/09/09 04:08:02 DEBUG : one: Destination is newer than source, skipping 2025/09/09 04:08:02 DEBUG : four: Sizes differ (src 4 vs dst 8) 2025/09/09 04:08:02 DEBUG : three: Sizes identical 2025/09/09 04:08:02 DEBUG : four: Destination mod time is within 1s of source but files differ, transferring 2025/09/09 04:08:02 DEBUG : three: Destination mod time is within 1s of source and files identical, skipping 2025/09/09 04:08:02 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 (Local file system at /tmp/rclone3966524117) 2025/09/09 04:08:02 DEBUG : two: md5 = 0f82d86afa0f5dc965c5c15aca58dcfb (gofile root 'rclone-test-cayuduv1nuke') 2025/09/09 04:08:02 DEBUG : two: md5 differ 2025/09/09 04:08:02 DEBUG : gofile root 'rclone-test-cayuduv1nuke': Waiting for transfers to finish 2025/09/09 04:08:02 DEBUG : two: Removing old object on successful upload 2025/09/09 04:08:02 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/09/09 04:08:02 INFO : two: Copied (replaced existing) 2025/09/09 04:08:02 DEBUG : five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/09/09 04:08:02 INFO : five: Copied (new) 2025/09/09 04:10:13 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:10:13 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:10:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/09/09 04:10:13 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 0/10 2025/09/09 04:12:24 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:12:24 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:12:24 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/09/09 04:12:24 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 1/10 2025/09/09 04:14:35 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:14:35 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:14:35 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/09/09 04:14:35 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 2/10 2025/09/09 04:16:46 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:16:46 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:16:46 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/09/09 04:16:46 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 3/10 2025/09/09 04:18:57 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:18:57 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:18:57 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/09/09 04:18:57 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 4/10 2025/09/09 04:21:08 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:21:08 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:21:08 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/09/09 04:21:08 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 5/10 2025/09/09 04:23:19 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:23:19 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:23:19 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/09/09 04:23:19 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 6/10 2025/09/09 04:25:30 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:25:30 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:25:30 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2025/09/09 04:25:30 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 7/10 2025/09/09 04:27:41 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:27:41 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:27:41 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2025/09/09 04:27:41 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 8/10 2025/09/09 04:29:52 DEBUG : Couldn't decode error response: invalid character 'E' looking for beginning of value 2025/09/09 04:29:52 DEBUG : pacer: low level retry 1/1 (error Error "502 Bad Gateway (502): Error forwarding request to upload server\n") 2025/09/09 04:29:52 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2025/09/09 04:29:52 DEBUG : four: Received error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" - low level retry 9/10 2025/09/09 04:29:52 ERROR : four: Failed to copy: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" 2025/09/09 04:29:52 ERROR : gofile root 'rclone-test-cayuduv1nuke': not deleting files as there were IO errors 2025/09/09 04:29:52 ERROR : gofile root 'rclone-test-cayuduv1nuke': not deleting directories as there were IO errors sync_test.go:1474: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1474 Error: Received unexpected error: failed to upload file: Error "502 Bad Gateway (502): Error forwarding request to upload server\n" Test: TestSyncWithUpdateOlder 2025/09/09 04:29:52 DEBUG : pacer: Reducing sleep to 5.12s 2025/09/09 04:30:03 DEBUG : pacer: Reducing sleep to 2.56s 2025/09/09 04:30:08 DEBUG : pacer: Reducing sleep to 1.28s 2025/09/09 04:30:10 DEBUG : pacer: Reducing sleep to 640ms 2025/09/09 04:30:11 DEBUG : pacer: Reducing sleep to 320ms 2025/09/09 04:30:12 DEBUG : pacer: Reducing sleep to 160ms 2025/09/09 04:30:12 DEBUG : pacer: Reducing sleep to 80ms --- FAIL: TestSyncWithUpdateOlder (2394.68s) FAIL 2025/09/09 04:30:12 DEBUG : gofile root 'rclone-test-cayuduv1nuke': Purge remote 2025/09/09 04:30:13 DEBUG : pacer: Reducing sleep to 40ms "./sync.test -test.v -test.timeout 1h0m0s -remote TestGoFile: -verbose -fast-list -test.run '^TestSyncWithUpdateOlder$'" - Finished ERROR in 39m55.312874872s (try 3/5): exit status 1: Failed [TestSyncWithUpdateOlder]