"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncSuffixKeepExtension)$'" - Starting (try 3/5) 2025/01/19 02:08:48 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-piqatub1sesa" 2025/01/19 02:08:48 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/19 02:08:48 DEBUG : Creating backend with remote "TestYandex:rclone-test-piqatub1sesa" 2025/01/19 02:08:48 DEBUG : Reset feature "ListR" 2025/01/19 02:08:48 DEBUG : Creating backend with remote "/tmp/rclone1594259840" === RUN TestSyncSuffixKeepExtension run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-piqatub1sesa'", Local "Local file system at /tmp/rclone1594259840", Modify Window "1ns" 2025/01/19 02:08:55 INFO : dst/one.rclone_chunk.001_bi7rr2: Moved (server-side) to: dst/one 2025/01/19 02:09:01 INFO : dst/two.rclone_chunk.001_bi7xsy: Moved (server-side) to: dst/two 2025/01/19 02:09:05 INFO : dst/three.txt.rclone_chunk.001_bi832u: Moved (server-side) to: dst/three.txt 2025/01/19 02:09:06 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-piqatub1sesa/dst" 2025/01/19 02:09:06 DEBUG : Creating backend with remote "TestYandex:rclone-test-piqatub1sesa/dst" 2025/01/19 02:09:06 DEBUG : Reset feature "ListR" 2025/01/19 02:09:07 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/01/19 02:09:08 DEBUG : one: move non-chunked object... 2025/01/19 02:09:09 INFO : one: Moved (server-side) to: one-2019-01-01 2025/01/19 02:09:09 INFO : one: Moved (server-side) to: one-2019-01-01 2025/01/19 02:09:09 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/19 02:09:12 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/19 02:09:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/19 02:09:12 DEBUG : pacer: Reducing sleep to 15ms 2025/01/19 02:09:12 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/19 02:09:13 DEBUG : pacer: Reducing sleep to 10ms 2025/01/19 02:09:14 INFO : one.rclone_chunk.001_bi8b79: Moved (server-side) to: one 2025/01/19 02:09:14 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/01/19 02:09:14 INFO : one: Copied (new) 2025/01/19 02:09:15 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:09:15 DEBUG : two: Unchanged skipping 2025/01/19 02:09:16 DEBUG : three.txt: Sizes differ (src 6 vs dst 5) 2025/01/19 02:09:16 DEBUG : three.txt: move non-chunked object... 2025/01/19 02:09:18 INFO : three.txt: Moved (server-side) to: three-2019-01-01.txt 2025/01/19 02:09:18 INFO : three.txt: Moved (server-side) to: three-2019-01-01.txt 2025/01/19 02:09:18 DEBUG : three.txt: skip slow MD5 on source file, hashing in-transit 2025/01/19 02:09:22 INFO : three.txt.rclone_chunk.001_bi8kul: Moved (server-side) to: three.txt 2025/01/19 02:09:22 DEBUG : three.txt: md5 = 91341eed84691a83caea73aa785736d5 OK 2025/01/19 02:09:22 INFO : three.txt: Copied (new) 2025/01/19 02:09:25 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/01/19 02:09:31 INFO : one-2019-01-01: Deleted 2025/01/19 02:09:31 DEBUG : one: move non-chunked object... 2025/01/19 02:09:32 INFO : one: Moved (server-side) to: one-2019-01-01 2025/01/19 02:09:32 INFO : one: Moved (server-side) to: one-2019-01-01 2025/01/19 02:09:32 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/19 02:09:37 INFO : one.rclone_chunk.001_bi8yjo: Moved (server-side) to: one 2025/01/19 02:09:37 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/01/19 02:09:37 INFO : one: Copied (new) 2025/01/19 02:09:37 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:09:37 DEBUG : two: Unchanged skipping 2025/01/19 02:09:38 DEBUG : three.txt: Sizes differ (src 19 vs dst 6) 2025/01/19 02:09:42 INFO : three-2019-01-01.txt: Deleted 2025/01/19 02:09:42 DEBUG : three.txt: move non-chunked object... 2025/01/19 02:09:43 INFO : three.txt: Moved (server-side) to: three-2019-01-01.txt 2025/01/19 02:09:43 INFO : three.txt: Moved (server-side) to: three-2019-01-01.txt 2025/01/19 02:09:43 DEBUG : three.txt: skip slow MD5 on source file, hashing in-transit 2025/01/19 02:09:47 INFO : three.txt.rclone_chunk.001_bi99yv: Moved (server-side) to: three.txt 2025/01/19 02:09:47 DEBUG : three.txt: md5 = 423e01c5e84a30d129b97aedb6e219a9 OK 2025/01/19 02:09:47 INFO : three.txt: Copied (new) --- PASS: TestSyncSuffixKeepExtension (78.71s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-piqatub1sesa'", Local "Local file system at /tmp/rclone1594259840", Modify Window "1ns" 2025/01/19 02:10:12 INFO : both0.rclone_chunk.001_bi9xa7: Moved (server-side) to: both0 2025/01/19 02:10:18 INFO : only0.rclone_chunk.001_bia3l1: Moved (server-side) to: only0 2025/01/19 02:10:27 INFO : both1.rclone_chunk.001_bia8na: Moved (server-side) to: both1 2025/01/19 02:10:32 INFO : only1.rclone_chunk.001_biaiot: Moved (server-side) to: only1 2025/01/19 02:10:37 INFO : both2.rclone_chunk.001_biam67: Moved (server-side) to: both2 2025/01/19 02:10:41 INFO : only2.rclone_chunk.001_biartb: Moved (server-side) to: only2 2025/01/19 02:10:46 INFO : both3.rclone_chunk.001_biawn9: Moved (server-side) to: both3 2025/01/19 02:10:51 INFO : only3.rclone_chunk.001_bib1c9: Moved (server-side) to: only3 2025/01/19 02:10:56 INFO : both4.rclone_chunk.001_bib645: Moved (server-side) to: both4 2025/01/19 02:11:01 INFO : only4.rclone_chunk.001_bibbat: Moved (server-side) to: only4 2025/01/19 02:11:06 INFO : both5.rclone_chunk.001_bibf6s: Moved (server-side) to: both5 2025/01/19 02:11:11 INFO : only5.rclone_chunk.001_bibkp8: Moved (server-side) to: only5 2025/01/19 02:11:17 INFO : both6.rclone_chunk.001_bibqnd: Moved (server-side) to: both6 2025/01/19 02:11:22 INFO : only6.rclone_chunk.001_bibws5: Moved (server-side) to: only6 2025/01/19 02:11:31 INFO : both7.rclone_chunk.001_bic1cf: Moved (server-side) to: both7 2025/01/19 02:11:36 INFO : only7.rclone_chunk.001_bic9vj: Moved (server-side) to: only7 2025/01/19 02:11:41 INFO : both8.rclone_chunk.001_bicfd9: Moved (server-side) to: both8 2025/01/19 02:11:48 INFO : only8.rclone_chunk.001_bickvg: Moved (server-side) to: only8 2025/01/19 02:11:53 INFO : both9.rclone_chunk.001_bicq5w: Moved (server-side) to: both9 2025/01/19 02:11:59 INFO : only9.rclone_chunk.001_bicvti: Moved (server-side) to: only9 2025/01/19 02:12:04 INFO : both10.rclone_chunk.001_bid14s: Moved (server-side) to: both10 2025/01/19 02:12:09 INFO : only10.rclone_chunk.001_bid6f9: Moved (server-side) to: only10 2025/01/19 02:12:14 INFO : both11.rclone_chunk.001_bidc1f: Moved (server-side) to: both11 2025/01/19 02:12:19 INFO : only11.rclone_chunk.001_bidgw1: Moved (server-side) to: only11 2025/01/19 02:12:24 INFO : both12.rclone_chunk.001_bidl2p: Moved (server-side) to: both12 2025/01/19 02:12:29 INFO : only12.rclone_chunk.001_bidrox: Moved (server-side) to: only12 2025/01/19 02:12:34 INFO : both13.rclone_chunk.001_bidv62: Moved (server-side) to: both13 2025/01/19 02:12:38 INFO : only13.rclone_chunk.001_bie0gg: Moved (server-side) to: only13 2025/01/19 02:12:44 INFO : both14.rclone_chunk.001_bie4av: Moved (server-side) to: both14 2025/01/19 02:12:51 INFO : only14.rclone_chunk.001_bieakl: Moved (server-side) to: only14 2025/01/19 02:12:56 INFO : both15.rclone_chunk.001_bieibv: Moved (server-side) to: both15 2025/01/19 02:13:00 INFO : only15.rclone_chunk.001_biemr2: Moved (server-side) to: only15 2025/01/19 02:13:04 INFO : both16.rclone_chunk.001_bieqw9: Moved (server-side) to: both16 2025/01/19 02:13:09 INFO : only16.rclone_chunk.001_bieulz: Moved (server-side) to: only16 2025/01/19 02:13:14 INFO : both17.rclone_chunk.001_bif0iy: Moved (server-side) to: both17 2025/01/19 02:13:19 INFO : only17.rclone_chunk.001_bif5n3: Moved (server-side) to: only17 2025/01/19 02:13:25 INFO : both18.rclone_chunk.001_bifanr: Moved (server-side) to: both18 2025/01/19 02:13:30 INFO : only18.rclone_chunk.001_biffnv: Moved (server-side) to: only18 2025/01/19 02:13:35 INFO : both19.rclone_chunk.001_bifku1: Moved (server-side) to: both19 2025/01/19 02:13:39 INFO : only19.rclone_chunk.001_bifph6: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: only19: Modification time difference too big |-210022h8m32.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-19 02:13:39 +0000 UTC) (precision 1ns) 2025/01/19 02:13:40 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-piqatub1sesa': Waiting for checks to finish 2025/01/19 02:13:40 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both1: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both12: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both0: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both14: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both10: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both11: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both13: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both15: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both19: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both2: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both3: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both17: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both18: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both16: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both4: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both8: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/19 02:13:40 DEBUG : both9: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both5: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both6: Unchanged skipping 2025/01/19 02:13:40 DEBUG : both7: Unchanged skipping 2025/01/19 02:13:40 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-piqatub1sesa': Waiting for transfers to finish 2025/01/19 02:13:40 DEBUG : Waiting for deletions to finish 2025/01/19 02:13:43 INFO : only11: Deleted 2025/01/19 02:13:43 INFO : only19: Deleted 2025/01/19 02:13:44 INFO : only14: Deleted 2025/01/19 02:13:45 INFO : only17: Deleted 2025/01/19 02:13:46 INFO : only7: Deleted 2025/01/19 02:13:46 INFO : only9: Deleted 2025/01/19 02:13:47 INFO : only15: Deleted 2025/01/19 02:13:48 INFO : only16: Deleted 2025/01/19 02:13:49 INFO : only18: Deleted 2025/01/19 02:13:50 INFO : only2: Deleted 2025/01/19 02:13:50 INFO : only3: Deleted 2025/01/19 02:13:51 INFO : only8: Deleted 2025/01/19 02:13:52 INFO : only0: Deleted 2025/01/19 02:13:53 INFO : only4: Deleted 2025/01/19 02:13:53 INFO : only1: Deleted 2025/01/19 02:13:53 INFO : only5: Deleted 2025/01/19 02:13:55 INFO : only10: Deleted 2025/01/19 02:13:56 INFO : only6: Deleted 2025/01/19 02:13:56 INFO : only12: Deleted 2025/01/19 02:13:56 INFO : only13: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-piqatub1sesa'", Local "Local file system at /tmp/rclone1594259840", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (287.94s) FAIL 2025/01/19 02:14:55 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-piqatub1sesa': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncSuffixKeepExtension)$'" - Finished ERROR in 6m10.334342526s (try 3/5): exit status 1: Failed [TestSyncConcurrentDelete]