"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestCopyWithFilesFrom|TestSyncConcurrentDelete|TestSyncWithUpdateOlder)$'" - Starting (try 2/5) 2025/03/19 03:37:27 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-powoguq5bagi" 2025/03/19 03:37:27 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/03/19 03:37:27 DEBUG : Creating backend with remote "TestYandex:rclone-test-powoguq5bagi" 2025/03/19 03:37:27 DEBUG : Reset feature "ListR" 2025/03/19 03:37:27 DEBUG : Creating backend with remote "/tmp/rclone1675696296" === RUN TestCopyWithFilesFrom run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi'", Local "Local file system at /tmp/rclone1675696296", Modify Window "1ns" 2025/03/19 03:37:27 DEBUG : potato2: Need to transfer - File not found at Destination 2025/03/19 03:37:27 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for checks to finish 2025/03/19 03:37:27 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for transfers to finish 2025/03/19 03:37:27 DEBUG : potato2: skip slow MD5 on source file, hashing in-transit 2025/03/19 03:37:32 INFO : potato2.rclone_chunk.001_cvo2oa: Moved (server-side) to: potato2 2025/03/19 03:37:32 DEBUG : potato2: md5 = 5eb63bbbe01eeed093cb22bb8f5acdc3 OK 2025/03/19 03:37:32 INFO : potato2: Copied (new) run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi'", Local "Local file system at /tmp/rclone1675696296", Modify Window "1ns" --- PASS: TestCopyWithFilesFrom (11.09s) === RUN TestSyncWithUpdateOlder run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi'", Local "Local file system at /tmp/rclone1675696296", Modify Window "1ns" 2025/03/19 03:37:43 INFO : one.rclone_chunk.001_cvodwf: Moved (server-side) to: one 2025/03/19 03:37:49 INFO : two.rclone_chunk.001_cvoiuk: Moved (server-side) to: two 2025/03/19 03:37:53 INFO : three.rclone_chunk.001_cvootm: Moved (server-side) to: three 2025/03/19 03:37:59 INFO : four.rclone_chunk.001_cvotsn: Moved (server-side) to: four 2025/03/19 03:37:59 DEBUG : five: Need to transfer - File not found at Destination 2025/03/19 03:37:59 DEBUG : four: Sizes differ (src 4 vs dst 8) 2025/03/19 03:37:59 DEBUG : one: Destination is newer than source, skipping 2025/03/19 03:37:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for checks to finish 2025/03/19 03:37:59 DEBUG : three: Sizes identical 2025/03/19 03:37:59 DEBUG : four: Destination mod time is within 1s of source but files differ, transferring 2025/03/19 03:37:59 DEBUG : four: skip slow MD5 on source file, hashing in-transit 2025/03/19 03:37:59 DEBUG : three: Destination mod time is within 1s of source and files identical, skipping 2025/03/19 03:37:59 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 (Local file system at /tmp/rclone1675696296) 2025/03/19 03:37:59 DEBUG : two: md5 = 0f82d86afa0f5dc965c5c15aca58dcfb (Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi') 2025/03/19 03:37:59 DEBUG : two: md5 differ 2025/03/19 03:37:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for transfers to finish 2025/03/19 03:37:59 DEBUG : two: skip slow MD5 on source file, hashing in-transit 2025/03/19 03:38:00 DEBUG : five: skip slow MD5 on source file, hashing in-transit 2025/03/19 03:38:04 INFO : five.rclone_chunk.001_cvoz5q: Moved (server-side) to: five 2025/03/19 03:38:04 DEBUG : five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/03/19 03:38:04 INFO : five: Copied (new) 2025/03/19 03:38:06 INFO : four: Deleted 2025/03/19 03:38:06 INFO : two: Deleted 2025/03/19 03:38:08 INFO : two.rclone_chunk.001_cvoynk: Moved (server-side) to: two 2025/03/19 03:38:08 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/03/19 03:38:08 INFO : two: Copied (replaced existing) 2025/03/19 03:38:08 INFO : four.rclone_chunk.001_cvoyjc: Moved (server-side) to: four 2025/03/19 03:38:08 DEBUG : four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/03/19 03:38:08 INFO : four: Copied (replaced existing) 2025/03/19 03:38:08 DEBUG : Waiting for deletions to finish 2025/03/19 03:38:08 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for checks to finish 2025/03/19 03:38:08 DEBUG : one: Destination is newer than source, skipping 2025/03/19 03:38:08 DEBUG : five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/03/19 03:38:08 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/03/19 03:38:08 DEBUG : five: Size and md5 of src and dst objects identical 2025/03/19 03:38:08 DEBUG : two: Size and md5 of src and dst objects identical 2025/03/19 03:38:08 DEBUG : five: Destination mod time is within 1s of source and files identical, skipping 2025/03/19 03:38:08 DEBUG : three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 (Local file system at /tmp/rclone1675696296) 2025/03/19 03:38:08 DEBUG : two: Destination mod time is within 1s of source and files identical, skipping 2025/03/19 03:38:08 DEBUG : three: md5 = 413af0de1f97a2155acf2b8b26ab36e2 (Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi') 2025/03/19 03:38:08 DEBUG : three: md5 differ 2025/03/19 03:38:08 DEBUG : four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/03/19 03:38:08 DEBUG : three: Destination mod time is within 1s of source but files differ, transferring 2025/03/19 03:38:08 DEBUG : four: Size and md5 of src and dst objects identical 2025/03/19 03:38:08 DEBUG : four: Destination mod time is within 1s of source and files identical, skipping 2025/03/19 03:38:08 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for transfers to finish 2025/03/19 03:38:08 DEBUG : three: skip slow MD5 on source file, hashing in-transit 2025/03/19 03:38:15 INFO : three: Deleted 2025/03/19 03:38:17 INFO : three.rclone_chunk.001_cvp7dv: Moved (server-side) to: three 2025/03/19 03:38:17 DEBUG : three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/03/19 03:38:17 INFO : three: Copied (replaced existing) 2025/03/19 03:38:17 DEBUG : Waiting for deletions to finish --- PASS: TestSyncWithUpdateOlder (58.02s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi'", Local "Local file system at /tmp/rclone1675696296", Modify Window "1ns" 2025/03/19 03:38:46 INFO : both0.rclone_chunk.001_cvpz0x: Moved (server-side) to: both0 2025/03/19 03:38:50 INFO : only0.rclone_chunk.001_cvq97e: Moved (server-side) to: only0 2025/03/19 03:38:55 INFO : both1.rclone_chunk.001_cvqdgo: Moved (server-side) to: both1 2025/03/19 03:38:59 INFO : only1.rclone_chunk.001_cvqi0e: Moved (server-side) to: only1 2025/03/19 03:39:04 INFO : both2.rclone_chunk.001_cvqm0a: Moved (server-side) to: both2 2025/03/19 03:39:10 INFO : only2.rclone_chunk.001_cvqr1v: Moved (server-side) to: only2 2025/03/19 03:39:15 INFO : both3.rclone_chunk.001_cvqxyk: Moved (server-side) to: both3 2025/03/19 03:39:19 INFO : only3.rclone_chunk.001_cvr2ll: Moved (server-side) to: only3 2025/03/19 03:39:25 INFO : both4.rclone_chunk.001_cvr8mm: Moved (server-side) to: both4 2025/03/19 03:39:30 INFO : only4.rclone_chunk.001_cvrcn8: Moved (server-side) to: only4 2025/03/19 03:39:35 INFO : both5.rclone_chunk.001_cvrh5z: Moved (server-side) to: both5 2025/03/19 03:39:40 INFO : only5.rclone_chunk.001_cvrm66: Moved (server-side) to: only5 2025/03/19 03:39:44 INFO : both6.rclone_chunk.001_cvrrck: Moved (server-side) to: both6 2025/03/19 03:39:50 INFO : only6.rclone_chunk.001_cvrwz8: Moved (server-side) to: only6 2025/03/19 03:39:59 INFO : both7.rclone_chunk.001_cvs1iv: Moved (server-side) to: both7 2025/03/19 03:40:04 INFO : only7.rclone_chunk.001_cvsal9: Moved (server-side) to: only7 2025/03/19 03:40:09 INFO : both8.rclone_chunk.001_cvsg9q: Moved (server-side) to: both8 2025/03/19 03:40:14 INFO : only8.rclone_chunk.001_cvskmp: Moved (server-side) to: only8 2025/03/19 03:40:20 INFO : both9.rclone_chunk.001_cvspg7: Moved (server-side) to: both9 2025/03/19 03:40:24 INFO : only9.rclone_chunk.001_cvswju: Moved (server-side) to: only9 2025/03/19 03:40:30 INFO : both10.rclone_chunk.001_cvt0n2: Moved (server-side) to: both10 2025/03/19 03:40:34 INFO : only10.rclone_chunk.001_cvt5ll: Moved (server-side) to: only10 2025/03/19 03:40:39 INFO : both11.rclone_chunk.001_cvtajx: Moved (server-side) to: both11 2025/03/19 03:40:42 INFO : only11.rclone_chunk.001_cvtekv: Moved (server-side) to: only11 2025/03/19 03:40:49 INFO : both12.rclone_chunk.001_cvtif0: Moved (server-side) to: both12 2025/03/19 03:40:53 INFO : only12.rclone_chunk.001_cvtoi8: Moved (server-side) to: only12 2025/03/19 03:40:58 INFO : both13.rclone_chunk.001_cvtse0: Moved (server-side) to: both13 2025/03/19 03:41:03 INFO : only13.rclone_chunk.001_cvtxt5: Moved (server-side) to: only13 2025/03/19 03:41:07 INFO : both14.rclone_chunk.001_cvu2hf: Moved (server-side) to: both14 2025/03/19 03:41:12 INFO : only14.rclone_chunk.001_cvu6ab: Moved (server-side) to: only14 2025/03/19 03:41:16 INFO : both15.rclone_chunk.001_cvub9e: Moved (server-side) to: both15 2025/03/19 03:41:20 INFO : only15.rclone_chunk.001_cvugfd: Moved (server-side) to: only15 2025/03/19 03:41:27 INFO : both16.rclone_chunk.001_cvujq1: Moved (server-side) to: both16 2025/03/19 03:41:32 INFO : only16.rclone_chunk.001_cvuq2w: Moved (server-side) to: only16 2025/03/19 03:41:37 INFO : both17.rclone_chunk.001_cvuvvc: Moved (server-side) to: both17 2025/03/19 03:41:43 INFO : only17.rclone_chunk.001_cvv0xq: Moved (server-side) to: only17 2025/03/19 03:41:52 INFO : both18.rclone_chunk.001_cvv67h: Moved (server-side) to: both18 2025/03/19 03:41:58 INFO : only18.rclone_chunk.001_cvvfk3: Moved (server-side) to: only18 2025/03/19 03:42:03 INFO : both19.rclone_chunk.001_cvvl29: Moved (server-side) to: both19 2025/03/19 03:42:09 INFO : only19.rclone_chunk.001_cvvrtw: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: only17: Modification time difference too big |-211439h36m35.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-03-19 03:41:42 +0000 UTC) (precision 1ns) 2025/03/19 03:42:10 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for checks to finish 2025/03/19 03:42:10 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both1: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both12: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both13: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both14: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both10: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both16: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both17: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both11: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both19: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both2: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both3: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both4: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both5: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both6: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both7: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both8: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/19 03:42:10 DEBUG : both9: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both0: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both15: Unchanged skipping 2025/03/19 03:42:10 DEBUG : both18: Unchanged skipping 2025/03/19 03:42:10 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Waiting for transfers to finish 2025/03/19 03:42:10 DEBUG : Waiting for deletions to finish 2025/03/19 03:42:13 INFO : only13: Deleted 2025/03/19 03:42:13 INFO : only11: Deleted 2025/03/19 03:42:13 INFO : only4: Deleted 2025/03/19 03:42:14 INFO : only19: Deleted 2025/03/19 03:42:16 INFO : only14: Deleted 2025/03/19 03:42:17 INFO : only18: Deleted 2025/03/19 03:42:17 INFO : only2: Deleted 2025/03/19 03:42:18 INFO : only16: Deleted 2025/03/19 03:42:20 INFO : only3: Deleted 2025/03/19 03:42:20 INFO : only5: Deleted 2025/03/19 03:42:20 INFO : only1: Deleted 2025/03/19 03:42:22 INFO : only10: Deleted 2025/03/19 03:42:23 INFO : only6: Deleted 2025/03/19 03:42:23 INFO : only7: Deleted 2025/03/19 03:42:25 INFO : only17: Deleted 2025/03/19 03:42:26 INFO : only8: Deleted 2025/03/19 03:42:26 INFO : only9: Deleted 2025/03/19 03:42:27 INFO : only12: Deleted 2025/03/19 03:42:28 INFO : only0: Deleted 2025/03/19 03:42:30 INFO : only15: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi'", Local "Local file system at /tmp/rclone1675696296", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (303.88s) FAIL 2025/03/19 03:43:40 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-powoguq5bagi': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestCopyWithFilesFrom|TestSyncConcurrentDelete|TestSyncWithUpdateOlder)$'" - Finished ERROR in 6m17.24650699s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete]