"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncWithUpdateOlder)$'" - Starting (try 2/5) 2024/12/25 04:46:08 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-roneluj3howe" 2024/12/25 04:46:08 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/12/25 04:46:08 DEBUG : Creating backend with remote "TestYandex:rclone-test-roneluj3howe" 2024/12/25 04:46:08 DEBUG : Reset feature "ListR" 2024/12/25 04:46:08 DEBUG : Creating backend with remote "/tmp/rclone1745469238" === RUN TestSyncWithUpdateOlder run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe'", Local "Local file system at /tmp/rclone1745469238", Modify Window "1ns" 2024/12/25 04:46:13 INFO : one.rclone_chunk.001_1etsit: Moved (server-side) to: one 2024/12/25 04:46:18 INFO : two.rclone_chunk.001_1etwlq: Moved (server-side) to: two 2024/12/25 04:46:23 INFO : three.rclone_chunk.001_1eu2ie: Moved (server-side) to: three 2024/12/25 04:46:28 INFO : four.rclone_chunk.001_1eu6ju: Moved (server-side) to: four 2024/12/25 04:46:29 DEBUG : five: Need to transfer - File not found at Destination 2024/12/25 04:46:29 DEBUG : four: Sizes differ (src 4 vs dst 8) 2024/12/25 04:46:29 DEBUG : one: Destination is newer than source, skipping 2024/12/25 04:46:29 DEBUG : three: Sizes identical 2024/12/25 04:46:29 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Waiting for checks to finish 2024/12/25 04:46:29 DEBUG : four: Destination mod time is within 1s of source but files differ, transferring 2024/12/25 04:46:29 DEBUG : four: skip slow MD5 on source file, hashing in-transit 2024/12/25 04:46:29 DEBUG : three: Destination mod time is within 1s of source and files identical, skipping 2024/12/25 04:46:29 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 (Local file system at /tmp/rclone1745469238) 2024/12/25 04:46:29 DEBUG : two: md5 = 0f82d86afa0f5dc965c5c15aca58dcfb (Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe') 2024/12/25 04:46:29 DEBUG : two: md5 differ 2024/12/25 04:46:29 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Waiting for transfers to finish 2024/12/25 04:46:29 DEBUG : two: skip slow MD5 on source file, hashing in-transit 2024/12/25 04:46:29 DEBUG : five: skip slow MD5 on source file, hashing in-transit 2024/12/25 04:46:33 INFO : five.rclone_chunk.001_1euclx: Moved (server-side) to: five 2024/12/25 04:46:33 DEBUG : five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2024/12/25 04:46:33 INFO : five: Copied (new) 2024/12/25 04:46:33 INFO : four: Deleted 2024/12/25 04:46:35 INFO : two: Deleted 2024/12/25 04:46:35 INFO : four.rclone_chunk.001_1eucjj: Moved (server-side) to: four 2024/12/25 04:46:35 DEBUG : four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2024/12/25 04:46:35 INFO : four: Copied (replaced existing) 2024/12/25 04:46:37 INFO : two.rclone_chunk.001_1eucp6: Moved (server-side) to: two 2024/12/25 04:46:37 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2024/12/25 04:46:37 INFO : two: Copied (replaced existing) 2024/12/25 04:46:37 DEBUG : Waiting for deletions to finish fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1445 Error: Should be true Test: TestSyncWithUpdateOlder Messages: five: Modification time difference too big |-113967h46m33.876543211s| > 1ns (want 2011-12-25 12:59:59.123456789 +0000 UTC vs got 2024-12-25 04:46:33 +0000 UTC) (precision 1ns) 2024/12/25 04:46:37 DEBUG : five: Destination is newer than source, skipping 2024/12/25 04:46:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Waiting for checks to finish 2024/12/25 04:46:37 DEBUG : one: Destination is newer than source, skipping 2024/12/25 04:46:37 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2024/12/25 04:46:37 DEBUG : two: Size and md5 of src and dst objects identical 2024/12/25 04:46:37 DEBUG : four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2024/12/25 04:46:37 DEBUG : three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 (Local file system at /tmp/rclone1745469238) 2024/12/25 04:46:37 DEBUG : four: Size and md5 of src and dst objects identical 2024/12/25 04:46:37 DEBUG : three: md5 = 413af0de1f97a2155acf2b8b26ab36e2 (Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe') 2024/12/25 04:46:37 DEBUG : two: Destination mod time is within 1s of source and files identical, skipping 2024/12/25 04:46:37 DEBUG : three: md5 differ 2024/12/25 04:46:37 DEBUG : four: Destination mod time is within 1s of source and files identical, skipping 2024/12/25 04:46:37 DEBUG : three: Destination mod time is within 1s of source but files differ, transferring 2024/12/25 04:46:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Waiting for transfers to finish 2024/12/25 04:46:37 DEBUG : three: skip slow MD5 on source file, hashing in-transit 2024/12/25 04:46:43 INFO : three: Deleted 2024/12/25 04:46:45 INFO : three.rclone_chunk.001_1euk82: Moved (server-side) to: three 2024/12/25 04:46:45 DEBUG : three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2024/12/25 04:46:45 INFO : three: Copied (replaced existing) 2024/12/25 04:46:45 DEBUG : Waiting for deletions to finish fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1458 Error: Should be true Test: TestSyncWithUpdateOlder Messages: five: Modification time difference too big |-113967h46m33.876543211s| > 1ns (want 2011-12-25 12:59:59.123456789 +0000 UTC vs got 2024-12-25 04:46:33 +0000 UTC) (precision 1ns) --- FAIL: TestSyncWithUpdateOlder (47.99s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe'", Local "Local file system at /tmp/rclone1745469238", Modify Window "1ns" 2024/12/25 04:47:02 INFO : both0.rclone_chunk.001_1ev394: Moved (server-side) to: both0 2024/12/25 04:47:08 INFO : only0.rclone_chunk.001_1evak4: Moved (server-side) to: only0 2024/12/25 04:47:12 INFO : both1.rclone_chunk.001_1evfi2: Moved (server-side) to: both1 2024/12/25 04:47:18 INFO : only1.rclone_chunk.001_1evkq2: Moved (server-side) to: only1 2024/12/25 04:47:23 INFO : both2.rclone_chunk.001_1evqlm: Moved (server-side) to: both2 2024/12/25 04:47:28 INFO : only2.rclone_chunk.001_1evubb: Moved (server-side) to: only2 2024/12/25 04:47:32 INFO : both3.rclone_chunk.001_1evzzk: Moved (server-side) to: both3 2024/12/25 04:47:37 INFO : only3.rclone_chunk.001_1ew456: Moved (server-side) to: only3 2024/12/25 04:47:43 INFO : both4.rclone_chunk.001_1ew8uc: Moved (server-side) to: both4 2024/12/25 04:47:48 INFO : only4.rclone_chunk.001_1ewei0: Moved (server-side) to: only4 2024/12/25 04:47:52 INFO : both5.rclone_chunk.001_1ewjh0: Moved (server-side) to: both5 2024/12/25 04:47:56 INFO : only5.rclone_chunk.001_1ewnma: Moved (server-side) to: only5 2024/12/25 04:48:01 INFO : both6.rclone_chunk.001_1ewret: Moved (server-side) to: both6 2024/12/25 04:48:06 INFO : only6.rclone_chunk.001_1ewwhd: Moved (server-side) to: only6 2024/12/25 04:48:11 INFO : both7.rclone_chunk.001_1ex14z: Moved (server-side) to: both7 2024/12/25 04:48:16 INFO : only7.rclone_chunk.001_1ex6xa: Moved (server-side) to: only7 2024/12/25 04:48:21 INFO : both8.rclone_chunk.001_1exb2r: Moved (server-side) to: both8 2024/12/25 04:48:24 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2024/12/25 04:48:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/12/25 04:48:24 DEBUG : pacer: Reducing sleep to 15ms 2024/12/25 04:48:25 DEBUG : pacer: Reducing sleep to 11.25ms 2024/12/25 04:48:25 DEBUG : pacer: Reducing sleep to 10ms 2024/12/25 04:48:27 INFO : only8.rclone_chunk.001_1exhs3: Moved (server-side) to: only8 2024/12/25 04:48:32 INFO : both9.rclone_chunk.001_1exmhm: Moved (server-side) to: both9 2024/12/25 04:48:38 INFO : only9.rclone_chunk.001_1exsj8: Moved (server-side) to: only9 2024/12/25 04:48:42 INFO : both10.rclone_chunk.001_1exxf0: Moved (server-side) to: both10 2024/12/25 04:48:48 INFO : only10.rclone_chunk.001_1ey1w4: Moved (server-side) to: only10 2024/12/25 04:48:53 INFO : both11.rclone_chunk.001_1ey7en: Moved (server-side) to: both11 2024/12/25 04:48:59 INFO : only11.rclone_chunk.001_1eydz6: Moved (server-side) to: only11 2024/12/25 04:49:09 INFO : both12.rclone_chunk.001_1eynog: Moved (server-side) to: both12 2024/12/25 04:49:16 INFO : only12.rclone_chunk.001_1eytzh: Moved (server-side) to: only12 2024/12/25 04:49:21 INFO : both13.rclone_chunk.001_1ez0av: Moved (server-side) to: both13 2024/12/25 04:50:04 INFO : only13.rclone_chunk.001_1ez4l1: Moved (server-side) to: only13 2024/12/25 04:50:10 INFO : both14.rclone_chunk.001_1f0bzb: Moved (server-side) to: both14 2024/12/25 04:50:15 INFO : only14.rclone_chunk.001_1f0hsd: Moved (server-side) to: only14 2024/12/25 04:50:20 INFO : both15.rclone_chunk.001_1f0mzm: Moved (server-side) to: both15 2024/12/25 04:50:25 INFO : only15.rclone_chunk.001_1f0rpc: Moved (server-side) to: only15 2024/12/25 04:50:29 INFO : both16.rclone_chunk.001_1f0wgv: Moved (server-side) to: both16 2024/12/25 04:50:35 INFO : only16.rclone_chunk.001_1f10nd: Moved (server-side) to: only16 2024/12/25 04:50:40 INFO : both17.rclone_chunk.001_1f16ob: Moved (server-side) to: both17 2024/12/25 04:50:45 INFO : only17.rclone_chunk.001_1f1b6q: Moved (server-side) to: only17 2024/12/25 04:50:51 INFO : both18.rclone_chunk.001_1f1hlt: Moved (server-side) to: both18 2024/12/25 04:50:56 INFO : only18.rclone_chunk.001_1f1miv: Moved (server-side) to: only18 2024/12/25 04:51:02 INFO : both19.rclone_chunk.001_1f1ry7: Moved (server-side) to: both19 2024/12/25 04:51:07 INFO : only19.rclone_chunk.001_1f1y73: Moved (server-side) to: only19 2024/12/25 04:51:08 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Waiting for checks to finish 2024/12/25 04:51:08 DEBUG : both0: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both12: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both13: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both14: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both1: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both10: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both16: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both18: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both19: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both15: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both11: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both2: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both5: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both6: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both7: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both8: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/12/25 04:51:08 DEBUG : both3: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both4: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both17: Unchanged skipping 2024/12/25 04:51:08 DEBUG : both9: Unchanged skipping 2024/12/25 04:51:08 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Waiting for transfers to finish 2024/12/25 04:51:08 DEBUG : Waiting for deletions to finish 2024/12/25 04:51:09 INFO : only16: Deleted 2024/12/25 04:51:09 INFO : only7: Deleted 2024/12/25 04:51:10 INFO : only14: Deleted 2024/12/25 04:51:10 INFO : only9: Deleted 2024/12/25 04:51:11 INFO : only0: Deleted 2024/12/25 04:51:11 INFO : only15: Deleted 2024/12/25 04:51:11 INFO : only4: Deleted 2024/12/25 04:51:11 INFO : only17: Deleted 2024/12/25 04:51:12 INFO : only18: Deleted 2024/12/25 04:51:12 INFO : only19: Deleted 2024/12/25 04:51:12 INFO : only3: Deleted 2024/12/25 04:51:12 INFO : only6: Deleted 2024/12/25 04:51:13 INFO : only10: Deleted 2024/12/25 04:51:13 INFO : only12: Deleted 2024/12/25 04:51:13 INFO : only13: Deleted 2024/12/25 04:51:15 INFO : only2: Deleted 2024/12/25 04:51:15 INFO : only8: Deleted 2024/12/25 04:51:15 INFO : only1: Deleted 2024/12/25 04:51:15 INFO : only5: Deleted 2024/12/25 04:51:16 INFO : only11: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe'", Local "Local file system at /tmp/rclone1745469238", Modify Window "1ns" --- PASS: TestSyncConcurrentDelete (293.13s) FAIL 2024/12/25 04:51:49 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-roneluj3howe': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncWithUpdateOlder)$'" - Finished ERROR in 5m43.833368266s (try 2/5): exit status 1: Failed [TestSyncWithUpdateOlder]