"./sync.test -test.v -test.timeout 1h0m0s -remote TestYandex: -verbose -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Starting (try 3/5) 2025/04/16 02:27:13 DEBUG : Creating backend with remote "TestYandex:rclone-test-bovaviy4ruki" 2025/04/16 02:27:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/04/16 02:27:13 DEBUG : Creating backend with remote "/tmp/rclone2463073353" === RUN TestSyncConcurrentDelete run.go:180: Remote "Yandex rclone-test-bovaviy4ruki", Local "Local file system at /tmp/rclone2463073353", Modify Window "1ns" fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: only15: Modification time difference too big |-212110h23m25.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-04-16 02:28:32 +0000 UTC) (precision 1ns) 2025/04/16 02:28:51 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : Yandex rclone-test-bovaviy4ruki: Waiting for checks to finish 2025/04/16 02:28:51 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both0: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both12: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both13: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both14: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both15: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both1: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both10: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both11: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both16: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both19: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both3: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both4: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both5: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both6: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both7: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both8: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:28:51 DEBUG : both9: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both2: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both18: Unchanged skipping 2025/04/16 02:28:51 DEBUG : both17: Unchanged skipping 2025/04/16 02:28:51 DEBUG : Yandex rclone-test-bovaviy4ruki: Waiting for transfers to finish 2025/04/16 02:28:51 DEBUG : Waiting for deletions to finish 2025/04/16 02:28:55 INFO : only17: Deleted 2025/04/16 02:28:55 INFO : only16: Deleted 2025/04/16 02:28:55 INFO : only5: Deleted 2025/04/16 02:28:56 INFO : only19: Deleted 2025/04/16 02:28:59 INFO : only6: Deleted 2025/04/16 02:28:59 INFO : only10: Deleted 2025/04/16 02:29:00 INFO : only13: Deleted 2025/04/16 02:29:01 INFO : only15: Deleted 2025/04/16 02:29:03 INFO : only7: Deleted 2025/04/16 02:29:03 INFO : only9: Deleted 2025/04/16 02:29:04 INFO : only8: Deleted 2025/04/16 02:29:06 INFO : only3: Deleted 2025/04/16 02:29:07 INFO : only0: Deleted 2025/04/16 02:29:08 INFO : only14: Deleted 2025/04/16 02:29:08 INFO : only1: Deleted 2025/04/16 02:29:11 INFO : only18: Deleted 2025/04/16 02:29:11 INFO : only4: Deleted 2025/04/16 02:29:12 INFO : only11: Deleted 2025/04/16 02:29:13 INFO : only12: Deleted 2025/04/16 02:29:16 INFO : only2: Deleted 2025/04/16 02:29:16 INFO : There was nothing to transfer run.go:180: Remote "Yandex rclone-test-bovaviy4ruki", Local "Local file system at /tmp/rclone2463073353", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (214.01s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Yandex rclone-test-bovaviy4ruki", Local "Local file system at /tmp/rclone2463073353", Modify Window "1ns" fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2762 Error: Should be true Test: TestSyncConcurrentTruncate Messages: both19: Modification time difference too big |-212110h27m11.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-04-16 02:32:18 +0000 UTC) (precision 1ns) fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2762 Error: Should be true Test: TestSyncConcurrentTruncate Messages: both3: Modification time difference too big |-212110h25m56.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-04-16 02:31:03 +0000 UTC) (precision 1ns) 2025/04/16 02:32:22 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : Yandex rclone-test-bovaviy4ruki: Waiting for checks to finish 2025/04/16 02:32:22 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both1: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both12: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both13: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both14: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both15: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both16: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both17: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both18: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both19: Modification times differ by 212110h27m11.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-04-16 02:32:18 +0000 UTC 2025/04/16 02:32:22 DEBUG : both0: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both11: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both3: Modification times differ by 212110h25m56.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-04-16 02:31:03 +0000 UTC 2025/04/16 02:32:22 DEBUG : both10: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both2: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both3: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/04/16 02:32:22 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both19: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/04/16 02:32:22 DEBUG : both5: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both6: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both4: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both8: Unchanged skipping 2025/04/16 02:32:22 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/16 02:32:22 DEBUG : both9: Unchanged skipping 2025/04/16 02:32:22 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : both7: Unchanged skipping 2025/04/16 02:32:22 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/04/16 02:32:22 INFO : both3: Updated modification time in destination 2025/04/16 02:32:22 DEBUG : both3: Unchanged skipping 2025/04/16 02:32:23 INFO : both19: Updated modification time in destination 2025/04/16 02:32:23 DEBUG : both19: Unchanged skipping 2025/04/16 02:32:23 DEBUG : Yandex rclone-test-bovaviy4ruki: Waiting for transfers to finish 2025/04/16 02:32:24 DEBUG : Couldn't decode error response: EOF 2025/04/16 02:32:24 DEBUG : pacer: low level retry 1/1 (error [503 - ] (503 Service Unavailable)) 2025/04/16 02:32:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/04/16 02:32:24 DEBUG : only11: Received error: [503 - ] (503 Service Unavailable) - low level retry 0/10 2025/04/16 02:32:24 DEBUG : pacer: Reducing sleep to 15ms 2025/04/16 02:32:24 DEBUG : pacer: Reducing sleep to 11.25ms 2025/04/16 02:32:24 DEBUG : pacer: Reducing sleep to 10ms 2025/04/16 02:32:24 DEBUG : only12: Dst hash empty - aborting Src hash check 2025/04/16 02:32:24 INFO : only12: Copied (replaced existing) 2025/04/16 02:32:25 DEBUG : only10: Dst hash empty - aborting Src hash check 2025/04/16 02:32:25 INFO : only10: Copied (replaced existing) 2025/04/16 02:32:26 DEBUG : only11: Dst hash empty - aborting Src hash check 2025/04/16 02:32:26 INFO : only11: Copied (replaced existing) 2025/04/16 02:32:27 DEBUG : only13: Dst hash empty - aborting Src hash check 2025/04/16 02:32:27 INFO : only13: Copied (replaced existing) 2025/04/16 02:32:27 DEBUG : only14: Dst hash empty - aborting Src hash check 2025/04/16 02:32:27 INFO : only14: Copied (replaced existing) 2025/04/16 02:32:29 DEBUG : only1: Dst hash empty - aborting Src hash check 2025/04/16 02:32:29 INFO : only1: Copied (replaced existing) 2025/04/16 02:32:29 DEBUG : only15: Dst hash empty - aborting Src hash check 2025/04/16 02:32:29 INFO : only15: Copied (replaced existing) 2025/04/16 02:32:30 DEBUG : only16: Dst hash empty - aborting Src hash check 2025/04/16 02:32:30 INFO : only16: Copied (replaced existing) 2025/04/16 02:32:31 DEBUG : only18: Dst hash empty - aborting Src hash check 2025/04/16 02:32:31 INFO : only18: Copied (replaced existing) 2025/04/16 02:32:32 DEBUG : only19: Dst hash empty - aborting Src hash check 2025/04/16 02:32:32 INFO : only19: Copied (replaced existing) 2025/04/16 02:32:32 DEBUG : only2: Dst hash empty - aborting Src hash check 2025/04/16 02:32:32 INFO : only2: Copied (replaced existing) 2025/04/16 02:32:33 DEBUG : only17: Dst hash empty - aborting Src hash check 2025/04/16 02:32:33 INFO : only17: Copied (replaced existing) 2025/04/16 02:32:34 DEBUG : only4: Dst hash empty - aborting Src hash check 2025/04/16 02:32:34 INFO : only4: Copied (replaced existing) 2025/04/16 02:32:35 DEBUG : only5: Dst hash empty - aborting Src hash check 2025/04/16 02:32:35 INFO : only5: Copied (replaced existing) 2025/04/16 02:32:36 DEBUG : only7: Dst hash empty - aborting Src hash check 2025/04/16 02:32:36 INFO : only7: Copied (replaced existing) 2025/04/16 02:32:36 DEBUG : only6: Dst hash empty - aborting Src hash check 2025/04/16 02:32:36 INFO : only6: Copied (replaced existing) 2025/04/16 02:32:38 DEBUG : only8: Dst hash empty - aborting Src hash check 2025/04/16 02:32:38 INFO : only8: Copied (replaced existing) 2025/04/16 02:32:38 DEBUG : only3: Dst hash empty - aborting Src hash check 2025/04/16 02:32:38 INFO : only3: Copied (replaced existing) 2025/04/16 02:32:38 DEBUG : only9: Dst hash empty - aborting Src hash check 2025/04/16 02:32:38 INFO : only9: Copied (replaced existing) 2025/04/16 02:32:51 DEBUG : only0: Dst hash empty - aborting Src hash check 2025/04/16 02:32:51 INFO : only0: Copied (replaced existing) 2025/04/16 02:32:51 DEBUG : Waiting for deletions to finish run.go:180: Remote "Yandex rclone-test-bovaviy4ruki", Local "Local file system at /tmp/rclone2463073353", Modify Window "1ns" --- FAIL: TestSyncConcurrentTruncate (305.41s) FAIL 2025/04/16 02:35:53 DEBUG : Yandex rclone-test-bovaviy4ruki: Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestYandex: -verbose -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Finished ERROR in 8m44.552768734s (try 3/5): exit status 1: Failed [TestSyncConcurrentDelete TestSyncConcurrentTruncate]