"./sync.test -test.v -test.timeout 1h0m0s -remote TestYandex: -verbose -test.run '^(TestSyncAfterAddingAFile|TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Starting (try 2/5) 2025/03/10 11:32:21 DEBUG : Creating backend with remote "TestYandex:rclone-test-xufayem1qivo" 2025/03/10 11:32:21 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/03/10 11:32:21 DEBUG : Creating backend with remote "/tmp/rclone944187686" === RUN TestSyncAfterAddingAFile run.go:180: Remote "Yandex rclone-test-xufayem1qivo", Local "Local file system at /tmp/rclone944187686", Modify Window "1ns" 2025/03/10 11:32:24 DEBUG : potato: Need to transfer - File not found at Destination 2025/03/10 11:32:24 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:32:24 DEBUG : Yandex rclone-test-xufayem1qivo: Waiting for checks to finish 2025/03/10 11:32:24 DEBUG : empty space: Unchanged skipping 2025/03/10 11:32:24 DEBUG : Yandex rclone-test-xufayem1qivo: Waiting for transfers to finish 2025/03/10 11:32:26 DEBUG : potato: md5 = d6548b156ea68a4e003e786df99eee76 OK 2025/03/10 11:32:26 INFO : potato: Copied (new) 2025/03/10 11:32:26 DEBUG : Waiting for deletions to finish run.go:180: Remote "Yandex rclone-test-xufayem1qivo", Local "Local file system at /tmp/rclone944187686", Modify Window "1ns" --- PASS: TestSyncAfterAddingAFile (14.92s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Yandex rclone-test-xufayem1qivo", Local "Local file system at /tmp/rclone944187686", Modify Window "1ns" 2025/03/10 11:32:52 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/03/10 11:32:52 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/03/10 11:32:54 DEBUG : pacer: Reducing sleep to 15ms 2025/03/10 11:32:54 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/10 11:32:55 DEBUG : pacer: Reducing sleep to 10ms 2025/03/10 11:38:11 DEBUG : pacer: low level retry 1/1 (error Put "https://uploader-1standalone579klg.disk.yandex.net:443/upload-target/20250310T143311.154.utd.4u740v6lekjjpvbvjnfajdfvd-k.16599": net/http: timeout awaiting response headers) 2025/03/10 11:38:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "both6" to Yandex rclone-test-xufayem1qivo: 1/10 (Put "https://uploader-1standalone579klg.disk.yandex.net:443/upload-target/20250310T143311.154.utd.4u740v6lekjjpvbvjnfajdfvd-k.16599": net/http: timeout awaiting response headers) 2025/03/10 11:38:13 DEBUG : pacer: Reducing sleep to 15ms 2025/03/10 11:38:14 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/10 11:38:14 DEBUG : pacer: Reducing sleep to 10ms 2025/03/10 11:39:25 DEBUG : Couldn't decode error response: invalid character '<' looking for beginning of value 2025/03/10 11:39:25 DEBUG : pacer: low level retry 1/1 (error [502 - ] (502 Bad Gateway)) 2025/03/10 11:39:25 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "both19" to Yandex rclone-test-xufayem1qivo: 1/10 ([502 - ] (502 Bad Gateway)) 2025/03/10 11:39:28 DEBUG : pacer: Reducing sleep to 15ms 2025/03/10 11:39:29 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/10 11:39:29 DEBUG : pacer: Reducing sleep to 10ms 2025/03/10 11:39:33 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : Yandex rclone-test-xufayem1qivo: Waiting for checks to finish 2025/03/10 11:39:33 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both0: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both12: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both13: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both14: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both15: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both16: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both17: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both18: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both1: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both2: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both3: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both11: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both10: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both4: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both19: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both5: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:39:33 DEBUG : both9: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both6: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both7: Unchanged skipping 2025/03/10 11:39:33 DEBUG : both8: Unchanged skipping 2025/03/10 11:39:33 DEBUG : Yandex rclone-test-xufayem1qivo: Waiting for transfers to finish 2025/03/10 11:39:33 DEBUG : Waiting for deletions to finish 2025/03/10 11:39:39 INFO : only10: Deleted 2025/03/10 11:39:39 INFO : only12: Deleted 2025/03/10 11:39:39 INFO : only16: Deleted 2025/03/10 11:39:40 INFO : only9: Deleted 2025/03/10 11:39:43 INFO : only5: Deleted 2025/03/10 11:39:43 INFO : only18: Deleted 2025/03/10 11:39:43 INFO : only17: Deleted 2025/03/10 11:39:44 INFO : only4: Deleted 2025/03/10 11:39:47 INFO : only14: Deleted 2025/03/10 11:39:47 INFO : only0: Deleted 2025/03/10 11:39:47 INFO : only13: Deleted 2025/03/10 11:39:48 INFO : only15: Deleted 2025/03/10 11:39:50 INFO : only2: Deleted 2025/03/10 11:39:51 INFO : only3: Deleted 2025/03/10 11:39:51 INFO : only19: Deleted 2025/03/10 11:39:54 INFO : only11: Deleted 2025/03/10 11:39:55 INFO : only8: Deleted 2025/03/10 11:39:55 INFO : only7: Deleted 2025/03/10 11:39:55 INFO : only1: Deleted 2025/03/10 11:39:58 INFO : only6: Deleted run.go:180: Remote "Yandex rclone-test-xufayem1qivo", Local "Local file system at /tmp/rclone944187686", Modify Window "1ns" --- PASS: TestSyncConcurrentDelete (524.42s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Yandex rclone-test-xufayem1qivo", Local "Local file system at /tmp/rclone944187686", Modify Window "1ns" 2025/03/10 11:42:44 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/03/10 11:42:44 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/03/10 11:42:45 DEBUG : pacer: Reducing sleep to 15ms 2025/03/10 11:42:45 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/10 11:42:46 DEBUG : pacer: Reducing sleep to 10ms 2025/03/10 11:43:13 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/03/10 11:43:13 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/03/10 11:43:14 DEBUG : pacer: Reducing sleep to 15ms 2025/03/10 11:43:14 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/10 11:43:15 DEBUG : pacer: Reducing sleep to 10ms 2025/03/10 11:43:19 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : Yandex rclone-test-xufayem1qivo: Waiting for checks to finish 2025/03/10 11:43:19 DEBUG : both1: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both12: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both13: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both14: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both15: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both16: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both17: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both18: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both19: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both2: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both0: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both4: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both5: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both10: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both11: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both3: Unchanged skipping 2025/03/10 11:43:19 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/10 11:43:19 DEBUG : both6: Unchanged skipping 2025/03/10 11:43:19 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : both7: Unchanged skipping 2025/03/10 11:43:19 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : both8: Unchanged skipping 2025/03/10 11:43:19 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : both9: Unchanged skipping 2025/03/10 11:43:19 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/03/10 11:43:19 DEBUG : Yandex rclone-test-xufayem1qivo: Waiting for transfers to finish 2025/03/10 11:43:23 DEBUG : only10: Dst hash empty - aborting Src hash check 2025/03/10 11:43:23 INFO : only10: Copied (replaced existing) 2025/03/10 11:43:23 DEBUG : only11: Dst hash empty - aborting Src hash check 2025/03/10 11:43:23 INFO : only11: Copied (replaced existing) 2025/03/10 11:43:23 DEBUG : only1: Dst hash empty - aborting Src hash check 2025/03/10 11:43:23 INFO : only1: Copied (replaced existing) 2025/03/10 11:43:23 DEBUG : only0: Dst hash empty - aborting Src hash check 2025/03/10 11:43:23 INFO : only0: Copied (replaced existing) 2025/03/10 11:43:25 DEBUG : only13: Dst hash empty - aborting Src hash check 2025/03/10 11:43:25 INFO : only13: Copied (replaced existing) 2025/03/10 11:43:25 DEBUG : only15: Dst hash empty - aborting Src hash check 2025/03/10 11:43:25 INFO : only15: Copied (replaced existing) 2025/03/10 11:43:26 DEBUG : only12: Dst hash empty - aborting Src hash check 2025/03/10 11:43:26 INFO : only12: Copied (replaced existing) 2025/03/10 11:43:26 DEBUG : only16: Dst hash empty - aborting Src hash check 2025/03/10 11:43:26 INFO : only16: Copied (replaced existing) 2025/03/10 11:43:27 DEBUG : only18: Dst hash empty - aborting Src hash check 2025/03/10 11:43:27 INFO : only18: Copied (replaced existing) 2025/03/10 11:43:28 DEBUG : only3: Dst hash empty - aborting Src hash check 2025/03/10 11:43:28 INFO : only3: Copied (replaced existing) 2025/03/10 11:43:29 DEBUG : only14: Dst hash empty - aborting Src hash check 2025/03/10 11:43:29 INFO : only14: Copied (replaced existing) 2025/03/10 11:43:29 DEBUG : only6: Dst hash empty - aborting Src hash check 2025/03/10 11:43:29 INFO : only6: Copied (replaced existing) 2025/03/10 11:43:31 DEBUG : only7: Dst hash empty - aborting Src hash check 2025/03/10 11:43:31 INFO : only7: Copied (replaced existing) 2025/03/10 11:43:33 DEBUG : only9: Dst hash empty - aborting Src hash check 2025/03/10 11:43:33 INFO : only9: Copied (replaced existing) 2025/03/10 11:43:35 DEBUG : only2: Dst hash empty - aborting Src hash check 2025/03/10 11:43:35 INFO : only2: Copied (replaced existing) 2025/03/10 11:43:36 DEBUG : only8: Dst hash empty - aborting Src hash check 2025/03/10 11:43:36 INFO : only8: Copied (replaced existing) 2025/03/10 11:43:37 DEBUG : only4: Dst hash empty - aborting Src hash check 2025/03/10 11:43:37 INFO : only4: Copied (replaced existing) 2025/03/10 11:43:38 DEBUG : only5: Dst hash empty - aborting Src hash check 2025/03/10 11:43:38 INFO : only5: Copied (replaced existing) 2025/03/10 11:43:39 DEBUG : only19: Dst hash empty - aborting Src hash check 2025/03/10 11:43:39 INFO : only19: Copied (replaced existing) 2025/03/10 11:44:28 DEBUG : only17: Dst hash empty - aborting Src hash check 2025/03/10 11:44:28 INFO : only17: Copied (replaced existing) 2025/03/10 11:44:28 DEBUG : Waiting for deletions to finish run.go:180: Remote "Yandex rclone-test-xufayem1qivo", Local "Local file system at /tmp/rclone944187686", Modify Window "1ns" --- PASS: TestSyncConcurrentTruncate (357.46s) PASS 2025/03/10 11:47:18 DEBUG : Yandex rclone-test-xufayem1qivo: Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestYandex: -verbose -test.run '^(TestSyncAfterAddingAFile|TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Finished OK in 15m1.349794987s (try 2/5)