"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^TestSyncConcurrentDelete$'" - Starting (try 2/5) 2024/11/15 02:28:03 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-towoqow5waqi" 2024/11/15 02:28:03 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/15 02:28:03 DEBUG : Creating backend with remote "TestYandex:rclone-test-towoqow5waqi" 2024/11/15 02:28:03 DEBUG : Reset feature "ListR" 2024/11/15 02:28:03 DEBUG : Creating backend with remote "/tmp/rclone4073009128" === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-towoqow5waqi'", Local "Local file system at /tmp/rclone4073009128", Modify Window "1ns" 2024/11/15 02:28:08 INFO : both0.rclone_chunk.001_z5r29w: Moved (server-side) to: both0 2024/11/15 02:28:14 INFO : only0.rclone_chunk.001_z5r7pe: Moved (server-side) to: only0 2024/11/15 02:28:20 INFO : both1.rclone_chunk.001_z5rc15: Moved (server-side) to: both1 2024/11/15 02:28:25 INFO : only1.rclone_chunk.001_z5ri6x: Moved (server-side) to: only1 2024/11/15 02:28:32 INFO : both2.rclone_chunk.001_z5rnk7: Moved (server-side) to: both2 2024/11/15 02:28:37 INFO : only2.rclone_chunk.001_z5ruap: Moved (server-side) to: only2 2024/11/15 02:28:42 INFO : both3.rclone_chunk.001_z5rzro: Moved (server-side) to: both3 2024/11/15 02:28:47 INFO : only3.rclone_chunk.001_z5s4as: Moved (server-side) to: only3 2024/11/15 02:28:52 INFO : both4.rclone_chunk.001_z5s99o: Moved (server-side) to: both4 2024/11/15 02:28:58 INFO : only4.rclone_chunk.001_z5sfyg: Moved (server-side) to: only4 2024/11/15 02:29:07 INFO : both5.rclone_chunk.001_z5slop: Moved (server-side) to: both5 2024/11/15 02:29:12 INFO : only5.rclone_chunk.001_z5stj3: Moved (server-side) to: only5 2024/11/15 02:29:17 INFO : both6.rclone_chunk.001_z5syn4: Moved (server-side) to: both6 2024/11/15 02:29:22 INFO : only6.rclone_chunk.001_z5t3vz: Moved (server-side) to: only6 2024/11/15 02:29:27 INFO : both7.rclone_chunk.001_z5t8a2: Moved (server-side) to: both7 2024/11/15 02:29:32 INFO : only7.rclone_chunk.001_z5tdy9: Moved (server-side) to: only7 2024/11/15 02:29:37 INFO : both8.rclone_chunk.001_z5tix3: Moved (server-side) to: both8 2024/11/15 02:29:42 INFO : only8.rclone_chunk.001_z5tncp: Moved (server-side) to: only8 2024/11/15 02:29:48 INFO : both9.rclone_chunk.001_z5tsic: Moved (server-side) to: both9 2024/11/15 02:29:54 INFO : only9.rclone_chunk.001_z5tylb: Moved (server-side) to: only9 2024/11/15 02:30:00 INFO : both10.rclone_chunk.001_z5u5bk: Moved (server-side) to: both10 2024/11/15 02:30:10 INFO : only10.rclone_chunk.001_z5uadp: Moved (server-side) to: only10 2024/11/15 02:30:19 INFO : both11.rclone_chunk.001_z5uk4q: Moved (server-side) to: both11 2024/11/15 02:30:26 INFO : only11.rclone_chunk.001_z5uuql: Moved (server-side) to: only11 2024/11/15 02:30:31 INFO : both12.rclone_chunk.001_z5v0xe: Moved (server-side) to: both12 2024/11/15 02:30:36 INFO : only12.rclone_chunk.001_z5v51w: Moved (server-side) to: only12 2024/11/15 02:30:41 INFO : both13.rclone_chunk.001_z5vacn: Moved (server-side) to: both13 2024/11/15 02:30:46 INFO : only13.rclone_chunk.001_z5vf17: Moved (server-side) to: only13 2024/11/15 02:30:52 INFO : both14.rclone_chunk.001_z5vktg: Moved (server-side) to: both14 2024/11/15 02:30:56 INFO : only14.rclone_chunk.001_z5vq09: Moved (server-side) to: only14 2024/11/15 02:31:01 INFO : both15.rclone_chunk.001_z5vup1: Moved (server-side) to: both15 2024/11/15 02:31:06 INFO : only15.rclone_chunk.001_z5vzym: Moved (server-side) to: only15 2024/11/15 02:31:09 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2024/11/15 02:31:09 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/15 02:31:10 DEBUG : pacer: Reducing sleep to 15ms 2024/11/15 02:31:10 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/15 02:31:10 DEBUG : pacer: Reducing sleep to 10ms 2024/11/15 02:31:12 INFO : both16.rclone_chunk.001_z5w4eq: Moved (server-side) to: both16 2024/11/15 02:31:18 INFO : only16.rclone_chunk.001_z5wbbv: Moved (server-side) to: only16 2024/11/15 02:31:23 INFO : both17.rclone_chunk.001_z5wg78: Moved (server-side) to: both17 2024/11/15 02:31:29 INFO : only17.rclone_chunk.001_z5wmg4: Moved (server-side) to: only17 2024/11/15 02:31:33 INFO : both18.rclone_chunk.001_z5wrfc: Moved (server-side) to: both18 2024/11/15 02:31:38 INFO : only18.rclone_chunk.001_z5wvp0: Moved (server-side) to: only18 2024/11/15 02:31:44 INFO : both19.rclone_chunk.001_z5x0fc: Moved (server-side) to: both19 2024/11/15 02:31:48 INFO : only19.rclone_chunk.001_z5x6s8: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: both18: Modification time difference too big |-208462h26m25.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2024-11-15 02:31:32 +0000 UTC) (precision 1ns) 2024/11/15 02:31:49 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-towoqow5waqi': Waiting for checks to finish 2024/11/15 02:31:49 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both1: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both12: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both13: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both11: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both15: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both16: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both17: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both18: Modification times differ by 208462h26m25.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2024-11-15 02:31:32 +0000 UTC 2024/11/15 02:31:49 DEBUG : both18: md5 = 8ee2027983915ec78acc45027d874316 OK 2024/11/15 02:31:49 DEBUG : both10: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both19: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both0: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both14: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both4: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both5: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both6: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both2: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both3: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/15 02:31:49 DEBUG : both7: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both8: Unchanged skipping 2024/11/15 02:31:49 DEBUG : both9: Unchanged skipping 2024/11/15 02:31:50 INFO : both18: Updated modification time in destination 2024/11/15 02:31:50 DEBUG : both18: Unchanged skipping 2024/11/15 02:31:50 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-towoqow5waqi': Waiting for transfers to finish 2024/11/15 02:31:50 DEBUG : Waiting for deletions to finish 2024/11/15 02:31:52 INFO : only7: Deleted 2024/11/15 02:31:52 INFO : only16: Deleted 2024/11/15 02:31:52 INFO : only19: Deleted 2024/11/15 02:31:52 INFO : only14: Deleted 2024/11/15 02:31:53 INFO : only8: Deleted 2024/11/15 02:31:53 INFO : only12: Deleted 2024/11/15 02:31:54 INFO : only13: Deleted 2024/11/15 02:31:54 INFO : only3: Deleted 2024/11/15 02:31:54 INFO : only0: Deleted 2024/11/15 02:31:55 INFO : only1: Deleted 2024/11/15 02:31:55 INFO : only5: Deleted 2024/11/15 02:31:55 INFO : only6: Deleted 2024/11/15 02:31:56 INFO : only9: Deleted 2024/11/15 02:31:57 INFO : only15: Deleted 2024/11/15 02:31:57 INFO : only18: Deleted 2024/11/15 02:31:58 INFO : only2: Deleted 2024/11/15 02:31:58 INFO : only4: Deleted 2024/11/15 02:31:58 INFO : only10: Deleted 2024/11/15 02:31:59 INFO : only11: Deleted 2024/11/15 02:31:59 INFO : only17: Deleted 2024/11/15 02:31:59 INFO : There was nothing to transfer run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-towoqow5waqi'", Local "Local file system at /tmp/rclone4073009128", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (269.92s) FAIL 2024/11/15 02:32:33 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-towoqow5waqi': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^TestSyncConcurrentDelete$'" - Finished ERROR in 4m32.417998918s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete]