"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestCopyDeleteBefore|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncConcurrentDelete|TestSyncImmutable)$'" - Starting (try 2/5) 2025/04/02 05:37:58 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-hojahih6cohe" 2025/04/02 05:37:58 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/04/02 05:37:58 DEBUG : Creating backend with remote "TestYandex:rclone-test-hojahih6cohe" 2025/04/02 05:37:58 DEBUG : Reset feature "ListR" 2025/04/02 05:37:58 DEBUG : Creating backend with remote "/tmp/rclone1406218366" === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDir run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" 2025/04/02 05:38:04 INFO : b/potato.rclone_chunk.001_2yl5xj: Moved (server-side) to: b/potato 2025/04/02 05:38:09 INFO : c/non empty space.rclone_chunk.001_2ylapf: Moved (server-side) to: c/non empty space 2025/04/02 05:38:09 INFO : d: Making directory 2025/04/02 05:38:10 INFO : d/e: Making directory 2025/04/02 05:38:12 DEBUG : a/potato2: Need to transfer - File not found at Destination 2025/04/02 05:38:12 DEBUG : c/non empty space: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:38:12 DEBUG : c/non empty space: Unchanged skipping 2025/04/02 05:38:12 DEBUG : a/potato2: skip slow MD5 on source file, hashing in-transit 2025/04/02 05:38:13 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for checks to finish 2025/04/02 05:38:13 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for transfers to finish 2025/04/02 05:38:19 INFO : a/potato2.rclone_chunk.001_2yliuk: Moved (server-side) to: a/potato2.rclone_chunk.001 2025/04/02 05:38:21 INFO : a/potato2.rclone_chunk.002_2yliuk: Moved (server-side) to: a/potato2.rclone_chunk.002 2025/04/02 05:38:25 DEBUG : a/potato2: md5 = d6548b156ea68a4e003e786df99eee76 OK 2025/04/02 05:38:25 INFO : a/potato2: Copied (new) 2025/04/02 05:38:25 DEBUG : Waiting for deletions to finish 2025/04/02 05:38:29 INFO : b/potato: Deleted 2025/04/02 05:38:29 INFO : d/e: Removing directory 2025/04/02 05:38:35 INFO : d: Removing directory 2025/04/02 05:38:40 INFO : b: Removing directory 2025/04/02 05:38:44 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': deleted 3 directories run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" --- PASS: TestSyncAfterRemovingAFileAndAddingAFileSubDir (78.10s) === RUN TestCopyDeleteBefore run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" 2025/04/02 05:39:21 INFO : potato.rclone_chunk.001_2ynbku: Moved (server-side) to: potato 2025/04/02 05:39:25 DEBUG : potato2: Need to transfer - File not found at Destination 2025/04/02 05:39:25 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for checks to finish 2025/04/02 05:39:25 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for transfers to finish 2025/04/02 05:39:25 DEBUG : potato2: skip slow MD5 on source file, hashing in-transit 2025/04/02 05:39:31 INFO : potato2.rclone_chunk.001_2ynjx6: Moved (server-side) to: potato2 2025/04/02 05:39:31 DEBUG : potato2: md5 = 9519bc2e940e1696ea7365b4b81adedc OK 2025/04/02 05:39:31 INFO : potato2: Copied (new) run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" --- PASS: TestCopyDeleteBefore (25.53s) === RUN TestSyncImmutable run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" 2025/04/02 05:39:43 DEBUG : existing: Need to transfer - File not found at Destination 2025/04/02 05:39:43 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for checks to finish 2025/04/02 05:39:43 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for transfers to finish 2025/04/02 05:39:44 DEBUG : existing: skip slow MD5 on source file, hashing in-transit 2025/04/02 05:39:49 INFO : existing.rclone_chunk.001_2yo2ad: Moved (server-side) to: existing 2025/04/02 05:39:49 DEBUG : existing: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/04/02 05:39:49 INFO : existing: Copied (new) 2025/04/02 05:39:49 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" 2025/04/02 05:39:51 DEBUG : existing: Sizes differ (src 8 vs dst 6) 2025/04/02 05:39:51 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for checks to finish 2025/04/02 05:39:51 ERROR : existing: Source and destination exist but do not match: immutable file modified 2025/04/02 05:39:51 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for transfers to finish 2025/04/02 05:39:51 ERROR : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': not deleting files as there were IO errors 2025/04/02 05:39:51 ERROR : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': not deleting directories as there were IO errors run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" --- PASS: TestSyncImmutable (15.77s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" 2025/04/02 05:40:02 INFO : both0.rclone_chunk.001_2yogfd: Moved (server-side) to: both0 2025/04/02 05:40:09 INFO : only0.rclone_chunk.001_2yoleq: Moved (server-side) to: only0 2025/04/02 05:40:12 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/04/02 05:40:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/04/02 05:40:12 DEBUG : pacer: Reducing sleep to 15ms 2025/04/02 05:40:13 DEBUG : pacer: Reducing sleep to 11.25ms 2025/04/02 05:40:13 DEBUG : pacer: Reducing sleep to 10ms 2025/04/02 05:40:14 INFO : both1.rclone_chunk.001_2yorkc: Moved (server-side) to: both1 2025/04/02 05:40:20 INFO : only1.rclone_chunk.001_2yoxxo: Moved (server-side) to: only1 2025/04/02 05:40:26 INFO : both2.rclone_chunk.001_2yp2uy: Moved (server-side) to: both2 2025/04/02 05:40:31 INFO : only2.rclone_chunk.001_2yp8n9: Moved (server-side) to: only2 2025/04/02 05:40:37 INFO : both3.rclone_chunk.001_2ypdhd: Moved (server-side) to: both3 2025/04/02 05:40:42 INFO : only3.rclone_chunk.001_2ypjma: Moved (server-side) to: only3 2025/04/02 05:40:47 INFO : both4.rclone_chunk.001_2ypo2u: Moved (server-side) to: both4 2025/04/02 05:40:53 INFO : only4.rclone_chunk.001_2ypunr: Moved (server-side) to: only4 2025/04/02 05:40:59 INFO : both5.rclone_chunk.001_2yq0he: Moved (server-side) to: both5 2025/04/02 05:41:05 INFO : only5.rclone_chunk.001_2yq6td: Moved (server-side) to: only5 2025/04/02 05:41:10 INFO : both6.rclone_chunk.001_2yqbi5: Moved (server-side) to: both6 2025/04/02 05:41:16 INFO : only6.rclone_chunk.001_2yqg4l: Moved (server-side) to: only6 2025/04/02 05:41:21 INFO : both7.rclone_chunk.001_2yqmro: Moved (server-side) to: both7 2025/04/02 05:41:27 INFO : only7.rclone_chunk.001_2yqrw1: Moved (server-side) to: only7 2025/04/02 05:41:32 INFO : both8.rclone_chunk.001_2yqx2b: Moved (server-side) to: both8 2025/04/02 05:41:38 INFO : only8.rclone_chunk.001_2yr2mb: Moved (server-side) to: only8 2025/04/02 05:41:44 INFO : both9.rclone_chunk.001_2yr8hi: Moved (server-side) to: both9 2025/04/02 05:41:50 INFO : only9.rclone_chunk.001_2yreck: Moved (server-side) to: only9 2025/04/02 05:41:56 INFO : both10.rclone_chunk.001_2yrloj: Moved (server-side) to: both10 2025/04/02 05:42:02 INFO : only10.rclone_chunk.001_2yrqg6: Moved (server-side) to: only10 2025/04/02 05:42:07 INFO : both11.rclone_chunk.001_2yrxah: Moved (server-side) to: both11 2025/04/02 05:42:13 INFO : only11.rclone_chunk.001_2ys17g: Moved (server-side) to: only11 2025/04/02 05:42:18 INFO : both12.rclone_chunk.001_2ys73r: Moved (server-side) to: both12 2025/04/02 05:42:23 INFO : only12.rclone_chunk.001_2yscrq: Moved (server-side) to: only12 2025/04/02 05:42:33 INFO : both13.rclone_chunk.001_2yshcl: Moved (server-side) to: both13 2025/04/02 05:42:38 INFO : only13.rclone_chunk.001_2ysrff: Moved (server-side) to: only13 2025/04/02 05:42:43 INFO : both14.rclone_chunk.001_2ysw90: Moved (server-side) to: both14 2025/04/02 05:42:51 INFO : only14.rclone_chunk.001_2yt1k3: Moved (server-side) to: only14 2025/04/02 05:42:56 INFO : both15.rclone_chunk.001_2yt9go: Moved (server-side) to: both15 2025/04/02 05:43:04 INFO : only15.rclone_chunk.001_2ytf2x: Moved (server-side) to: only15 2025/04/02 05:43:09 INFO : both16.rclone_chunk.001_2ytm75: Moved (server-side) to: both16 2025/04/02 05:43:16 INFO : only16.rclone_chunk.001_2yts7a: Moved (server-side) to: only16 2025/04/02 05:43:23 INFO : both17.rclone_chunk.001_2ytyje: Moved (server-side) to: both17 2025/04/02 05:43:33 INFO : only17.rclone_chunk.001_2yu5an: Moved (server-side) to: only17 2025/04/02 05:43:39 INFO : both18.rclone_chunk.001_2yufb4: Moved (server-side) to: both18 2025/04/02 05:43:49 INFO : only18.rclone_chunk.001_2yulbq: Moved (server-side) to: only18 2025/04/02 05:43:56 INFO : both19.rclone_chunk.001_2yuviu: Moved (server-side) to: both19 2025/04/02 05:44:01 INFO : only19.rclone_chunk.001_2yv2f2: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: both9: Modification time difference too big |-211777h36m36.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-04-02 05:41:43 +0000 UTC) (precision 1ns) 2025/04/02 05:44:02 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both0: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both1: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both10: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both11: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both12: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both13: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both14: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both15: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both16: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both17: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both18: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both19: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for checks to finish 2025/04/02 05:44:02 DEBUG : both2: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both6: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both7: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/04/02 05:44:02 DEBUG : both8: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both9: Modification times differ by 211777h36m36.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-04-02 05:41:43 +0000 UTC 2025/04/02 05:44:02 DEBUG : both3: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both4: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both5: Unchanged skipping 2025/04/02 05:44:02 DEBUG : both9: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/04/02 05:44:02 INFO : both9: Updated modification time in destination 2025/04/02 05:44:02 DEBUG : both9: Unchanged skipping 2025/04/02 05:44:02 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Waiting for transfers to finish 2025/04/02 05:44:02 DEBUG : Waiting for deletions to finish 2025/04/02 05:44:07 INFO : only17: Deleted 2025/04/02 05:44:07 INFO : only6: Deleted 2025/04/02 05:44:07 INFO : only0: Deleted 2025/04/02 05:44:07 INFO : only8: Deleted 2025/04/02 05:44:11 INFO : only15: Deleted 2025/04/02 05:44:11 INFO : only18: Deleted 2025/04/02 05:44:11 INFO : only7: Deleted 2025/04/02 05:44:11 INFO : only2: Deleted 2025/04/02 05:44:15 INFO : only4: Deleted 2025/04/02 05:44:15 INFO : only9: Deleted 2025/04/02 05:44:15 INFO : only11: Deleted 2025/04/02 05:44:16 INFO : only1: Deleted 2025/04/02 05:44:19 INFO : only13: Deleted 2025/04/02 05:44:20 INFO : only10: Deleted 2025/04/02 05:44:20 INFO : only16: Deleted 2025/04/02 05:44:21 INFO : only19: Deleted 2025/04/02 05:44:23 INFO : only14: Deleted 2025/04/02 05:44:24 INFO : only3: Deleted 2025/04/02 05:44:25 INFO : only12: Deleted 2025/04/02 05:44:26 INFO : only5: Deleted 2025/04/02 05:44:26 INFO : There was nothing to transfer run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe'", Local "Local file system at /tmp/rclone1406218366", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (411.80s) FAIL 2025/04/02 05:46:49 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hojahih6cohe': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestCopyDeleteBefore|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncConcurrentDelete|TestSyncImmutable)$'" - Finished ERROR in 8m56.727512951s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete]