"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncCopyDest|TestSyncWithTrackRenamesStrategyModtime)$'" - Starting (try 2/5) 2025/03/14 06:55:42 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-nidahaj1davu" 2025/03/14 06:55:42 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/03/14 06:55:42 DEBUG : Creating backend with remote "TestYandex:rclone-test-nidahaj1davu" 2025/03/14 06:55:42 DEBUG : Reset feature "ListR" 2025/03/14 06:55:42 DEBUG : Creating backend with remote "/tmp/rclone3233884625" === RUN TestSyncWithTrackRenamesStrategyModtime run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" sync_test.go:1610: Can track renames: true 2025/03/14 06:55:42 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Making map for --track-renames 2025/03/14 06:55:42 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Finished making map for --track-renames 2025/03/14 06:55:42 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for checks to finish 2025/03/14 06:55:42 DEBUG : potato: Need to transfer - No matching file found at Destination 2025/03/14 06:55:42 DEBUG : yam: Need to transfer - No matching file found at Destination 2025/03/14 06:55:42 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for renames to finish 2025/03/14 06:55:42 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for transfers to finish 2025/03/14 06:55:43 DEBUG : potato: skip slow MD5 on source file, hashing in-transit 2025/03/14 06:55:43 DEBUG : yam: skip slow MD5 on source file, hashing in-transit 2025/03/14 06:55:47 INFO : potato.rclone_chunk.001_3vii9c: Moved (server-side) to: potato 2025/03/14 06:55:47 DEBUG : potato: md5 = 7f6fa9ddec9bfebda9510af0323fd696 OK 2025/03/14 06:55:47 INFO : potato: Copied (new) 2025/03/14 06:55:48 INFO : yam.rclone_chunk.001_3viiyg: Moved (server-side) to: yam 2025/03/14 06:55:48 DEBUG : yam: md5 = 48dc443644c4b89556dc06834b46451d OK 2025/03/14 06:55:48 INFO : yam: Copied (new) 2025/03/14 06:55:48 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" 2025/03/14 06:55:49 DEBUG : potato: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:55:49 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Making map for --track-renames 2025/03/14 06:55:49 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Finished making map for --track-renames 2025/03/14 06:55:49 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for checks to finish 2025/03/14 06:55:49 DEBUG : potato: Unchanged skipping 2025/03/14 06:55:49 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for renames to finish 2025/03/14 06:55:49 DEBUG : yam: move non-chunked object... 2025/03/14 06:55:50 INFO : yam: Moved (server-side) to: yaml 2025/03/14 06:55:50 INFO : yam: Moved (server-side) to: yaml 2025/03/14 06:55:50 INFO : yaml: Renamed from "yam" 2025/03/14 06:55:50 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for transfers to finish 2025/03/14 06:55:50 DEBUG : Waiting for deletions to finish 2025/03/14 06:55:50 INFO : There was nothing to transfer run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" --- PASS: TestSyncWithTrackRenamesStrategyModtime (19.04s) === RUN TestSyncCopyDest run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" 2025/03/14 06:56:01 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst" 2025/03/14 06:56:01 DEBUG : Creating backend with remote "TestYandex:rclone-test-nidahaj1davu/dst" 2025/03/14 06:56:02 DEBUG : Reset feature "ListR" 2025/03/14 06:56:02 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/CopyDest" 2025/03/14 06:56:02 DEBUG : Creating backend with remote "TestYandex:rclone-test-nidahaj1davu/CopyDest" 2025/03/14 06:56:02 DEBUG : Reset feature "ListR" 2025/03/14 06:56:02 DEBUG : one: Need to transfer - File not found at Destination 2025/03/14 06:56:02 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for checks to finish 2025/03/14 06:56:02 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for transfers to finish 2025/03/14 06:56:03 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/03/14 06:56:07 INFO : one.rclone_chunk.001_3vj2do: Moved (server-side) to: one 2025/03/14 06:56:07 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/03/14 06:56:07 INFO : one: Copied (new) 2025/03/14 06:56:07 DEBUG : Waiting for deletions to finish 2025/03/14 06:56:09 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/03/14 06:56:09 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for checks to finish 2025/03/14 06:56:09 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for transfers to finish 2025/03/14 06:56:09 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/03/14 06:56:16 INFO : one: Deleted 2025/03/14 06:56:17 INFO : one.rclone_chunk.001_3vj8ac: Moved (server-side) to: one 2025/03/14 06:56:17 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/03/14 06:56:17 INFO : one: Copied (replaced existing) 2025/03/14 06:56:17 DEBUG : Waiting for deletions to finish 2025/03/14 06:56:27 INFO : dst/one: Deleted 2025/03/14 06:56:28 INFO : dst/one.rclone_chunk.001_3vjjwi: Moved (server-side) to: dst/one 2025/03/14 06:56:34 INFO : CopyDest/one.rclone_chunk.001_3vjrxh: Moved (server-side) to: CopyDest/one 2025/03/14 06:56:36 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/BackupDir" 2025/03/14 06:56:36 DEBUG : Creating backend with remote "TestYandex:rclone-test-nidahaj1davu/BackupDir" 2025/03/14 06:56:36 DEBUG : Reset feature "ListR" 2025/03/14 06:56:37 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/03/14 06:56:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for checks to finish 2025/03/14 06:56:37 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:56:37 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/03/14 06:56:38 DEBUG : one: move non-chunked object... 2025/03/14 06:56:39 INFO : one: Moved (server-side) 2025/03/14 06:56:39 INFO : one: Moved (server-side) 2025/03/14 06:56:39 DEBUG : one: copy non-chunked object... 2025/03/14 06:56:41 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/03/14 06:56:41 INFO : one: Copied (server-side copy) 2025/03/14 06:56:41 DEBUG : one: Destination found in --copy-dest, using server-side copy 2025/03/14 06:56:41 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for transfers to finish 2025/03/14 06:56:41 DEBUG : Waiting for deletions to finish 2025/03/14 06:56:48 INFO : CopyDest/two.rclone_chunk.001_3vk5n4: Moved (server-side) to: CopyDest/two 2025/03/14 06:56:50 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:56:50 DEBUG : two: copy non-chunked object... 2025/03/14 06:56:52 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/03/14 06:56:52 INFO : two: Copied (server-side copy) 2025/03/14 06:56:52 DEBUG : two: Destination found in --copy-dest, using server-side copy 2025/03/14 06:56:52 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:56:52 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for checks to finish 2025/03/14 06:56:52 DEBUG : one: Unchanged skipping 2025/03/14 06:56:52 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for transfers to finish 2025/03/14 06:56:52 DEBUG : Waiting for deletions to finish 2025/03/14 06:56:53 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:56:53 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:56:53 DEBUG : two: Unchanged skipping 2025/03/14 06:56:53 DEBUG : one: Unchanged skipping 2025/03/14 06:56:53 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for checks to finish 2025/03/14 06:56:53 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for transfers to finish 2025/03/14 06:56:53 DEBUG : Waiting for deletions to finish 2025/03/14 06:56:53 INFO : There was nothing to transfer 2025/03/14 06:57:03 INFO : CopyDest/three.rclone_chunk.001_3vki45: Moved (server-side) to: CopyDest/three 2025/03/14 06:57:05 DEBUG : three: Sizes differ (src 7 vs dst 5) 2025/03/14 06:57:05 DEBUG : three: Destination not found in --copy-dest 2025/03/14 06:57:05 DEBUG : three: Need to transfer - File not found at Destination 2025/03/14 06:57:05 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:57:05 DEBUG : one: Unchanged skipping 2025/03/14 06:57:05 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 06:57:05 DEBUG : two: Unchanged skipping 2025/03/14 06:57:05 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for checks to finish 2025/03/14 06:57:05 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu/dst': Waiting for transfers to finish 2025/03/14 06:57:06 DEBUG : three: skip slow MD5 on source file, hashing in-transit 2025/03/14 06:57:10 INFO : three.rclone_chunk.001_3vktdo: Moved (server-side) to: three 2025/03/14 06:57:10 DEBUG : three: md5 = 1bccb9dccb3e9f6a3f9d2a8bdb54b7f5 OK 2025/03/14 06:57:10 INFO : three: Copied (new) 2025/03/14 06:57:10 DEBUG : Waiting for deletions to finish --- PASS: TestSyncCopyDest (112.04s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" 2025/03/14 06:57:58 INFO : both0.rclone_chunk.001_3vm45x: Moved (server-side) to: both0 2025/03/14 06:58:03 INFO : only0.rclone_chunk.001_3vmarv: Moved (server-side) to: only0 2025/03/14 06:58:10 INFO : both1.rclone_chunk.001_3vme46: Moved (server-side) to: both1 2025/03/14 06:58:19 INFO : only1.rclone_chunk.001_3vmlcf: Moved (server-side) to: only1 2025/03/14 06:58:24 INFO : both2.rclone_chunk.001_3vmuzo: Moved (server-side) to: both2 2025/03/14 06:58:28 INFO : only2.rclone_chunk.001_3vmzvc: Moved (server-side) to: only2 2025/03/14 06:58:33 INFO : both3.rclone_chunk.001_3vn4ot: Moved (server-side) to: both3 2025/03/14 06:58:38 INFO : only3.rclone_chunk.001_3vn90v: Moved (server-side) to: only3 2025/03/14 06:58:43 INFO : both4.rclone_chunk.001_3vndf1: Moved (server-side) to: both4 2025/03/14 06:58:52 INFO : only4.rclone_chunk.001_3vnjbi: Moved (server-side) to: only4 2025/03/14 06:58:57 INFO : both5.rclone_chunk.001_3vnrbh: Moved (server-side) to: both5 2025/03/14 06:59:02 INFO : only5.rclone_chunk.001_3vnwdr: Moved (server-side) to: only5 2025/03/14 06:59:07 INFO : both6.rclone_chunk.001_3vo1m7: Moved (server-side) to: both6 2025/03/14 06:59:12 INFO : only6.rclone_chunk.001_3vo7u1: Moved (server-side) to: only6 2025/03/14 06:59:22 INFO : both7.rclone_chunk.001_3vocqt: Moved (server-side) to: both7 2025/03/14 06:59:33 INFO : only7.rclone_chunk.001_3volrb: Moved (server-side) to: only7 2025/03/14 06:59:37 INFO : both8.rclone_chunk.001_3voxyc: Moved (server-side) to: both8 2025/03/14 06:59:42 INFO : only8.rclone_chunk.001_3vp1nh: Moved (server-side) to: only8 2025/03/14 06:59:47 INFO : both9.rclone_chunk.001_3vp5la: Moved (server-side) to: both9 2025/03/14 06:59:51 INFO : only9.rclone_chunk.001_3vpadq: Moved (server-side) to: only9 2025/03/14 06:59:58 INFO : both10.rclone_chunk.001_3vpfn6: Moved (server-side) to: both10 2025/03/14 07:00:05 INFO : only10.rclone_chunk.001_3vpmk4: Moved (server-side) to: only10 2025/03/14 07:00:11 INFO : both11.rclone_chunk.001_3vptwb: Moved (server-side) to: both11 2025/03/14 07:00:18 INFO : only11.rclone_chunk.001_3vpyis: Moved (server-side) to: only11 2025/03/14 07:00:24 INFO : both12.rclone_chunk.001_3vq6xq: Moved (server-side) to: both12 2025/03/14 07:00:30 INFO : only12.rclone_chunk.001_3vqbm5: Moved (server-side) to: only12 2025/03/14 07:00:35 INFO : both13.rclone_chunk.001_3vqhog: Moved (server-side) to: both13 2025/03/14 07:00:41 INFO : only13.rclone_chunk.001_3vqnid: Moved (server-side) to: only13 2025/03/14 07:00:46 INFO : both14.rclone_chunk.001_3vqsnj: Moved (server-side) to: both14 2025/03/14 07:00:51 INFO : only14.rclone_chunk.001_3vqx9d: Moved (server-side) to: only14 2025/03/14 07:00:56 DEBUG : pacer: low level retry 1/10 (error [503 - DiskServiceUnavailableError] Service Unavailable (Сервис временно недоступен.)) 2025/03/14 07:00:56 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/03/14 07:00:57 DEBUG : pacer: Reducing sleep to 15ms 2025/03/14 07:00:57 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/14 07:00:58 DEBUG : pacer: Reducing sleep to 10ms 2025/03/14 07:01:02 INFO : both15.rclone_chunk.001_3vr2kx: Moved (server-side) to: both15 2025/03/14 07:01:06 INFO : only15.rclone_chunk.001_3vrdd0: Moved (server-side) to: only15 2025/03/14 07:01:12 INFO : both16.rclone_chunk.001_3vrh71: Moved (server-side) to: both16 2025/03/14 07:01:19 INFO : only16.rclone_chunk.001_3vro7i: Moved (server-side) to: only16 2025/03/14 07:01:23 INFO : both17.rclone_chunk.001_3vru7o: Moved (server-side) to: both17 2025/03/14 07:01:28 INFO : only17.rclone_chunk.001_3vry8v: Moved (server-side) to: only17 2025/03/14 07:01:37 INFO : both18.rclone_chunk.001_3vs7zl: Moved (server-side) to: both18 2025/03/14 07:01:42 INFO : only18.rclone_chunk.001_3vsdyc: Moved (server-side) to: only18 2025/03/14 07:01:48 INFO : both19.rclone_chunk.001_3vsh0w: Moved (server-side) to: both19 2025/03/14 07:01:52 INFO : only19.rclone_chunk.001_3vsnah: Moved (server-side) to: only19 2025/03/14 07:01:53 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for checks to finish 2025/03/14 07:01:53 DEBUG : both0: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both1: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both13: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both14: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both10: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both16: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both17: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both18: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both19: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both2: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both3: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both4: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both5: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both6: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both7: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both8: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:01:53 DEBUG : both9: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both11: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both12: Unchanged skipping 2025/03/14 07:01:53 DEBUG : both15: Unchanged skipping 2025/03/14 07:01:53 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for transfers to finish 2025/03/14 07:01:53 DEBUG : Waiting for deletions to finish 2025/03/14 07:01:56 INFO : only13: Deleted 2025/03/14 07:01:57 INFO : only15: Deleted 2025/03/14 07:01:57 INFO : only17: Deleted 2025/03/14 07:02:00 INFO : only19: Deleted 2025/03/14 07:02:01 INFO : only4: Deleted 2025/03/14 07:02:01 INFO : only7: Deleted 2025/03/14 07:02:03 INFO : only16: Deleted 2025/03/14 07:02:04 INFO : only10: Deleted 2025/03/14 07:02:05 INFO : only12: Deleted 2025/03/14 07:02:05 INFO : only14: Deleted 2025/03/14 07:02:07 INFO : only11: Deleted 2025/03/14 07:02:07 INFO : only18: Deleted 2025/03/14 07:02:09 INFO : only3: Deleted 2025/03/14 07:02:09 INFO : only2: Deleted 2025/03/14 07:02:11 INFO : only5: Deleted 2025/03/14 07:02:11 INFO : only8: Deleted 2025/03/14 07:02:12 INFO : only0: Deleted 2025/03/14 07:02:14 INFO : only6: Deleted 2025/03/14 07:02:14 INFO : only1: Deleted 2025/03/14 07:02:16 INFO : only9: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" --- PASS: TestSyncConcurrentDelete (351.25s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" 2025/03/14 07:03:49 INFO : both0.rclone_chunk.001_3vvw1x: Moved (server-side) to: both0 2025/03/14 07:03:54 INFO : only0.rclone_chunk.001_3vw0dt: Moved (server-side) to: only0 2025/03/14 07:03:59 INFO : both1.rclone_chunk.001_3vw5ij: Moved (server-side) to: both1 2025/03/14 07:04:04 INFO : only1.rclone_chunk.001_3vwahc: Moved (server-side) to: only1 2025/03/14 07:04:10 INFO : both2.rclone_chunk.001_3vwfz3: Moved (server-side) to: both2 2025/03/14 07:04:14 INFO : only2.rclone_chunk.001_3vwlpg: Moved (server-side) to: only2 2025/03/14 07:04:20 INFO : both3.rclone_chunk.001_3vwpdw: Moved (server-side) to: both3 2025/03/14 07:04:28 INFO : only3.rclone_chunk.001_3vwwz9: Moved (server-side) to: only3 2025/03/14 07:04:33 INFO : both4.rclone_chunk.001_3vx36i: Moved (server-side) to: both4 2025/03/14 07:04:38 INFO : only4.rclone_chunk.001_3vx91u: Moved (server-side) to: only4 2025/03/14 07:04:45 INFO : both5.rclone_chunk.001_3vxd1z: Moved (server-side) to: both5 2025/03/14 07:04:55 INFO : only5.rclone_chunk.001_3vxl08: Moved (server-side) to: only5 2025/03/14 07:05:00 INFO : both6.rclone_chunk.001_3vxu2d: Moved (server-side) to: both6 2025/03/14 07:05:05 INFO : only6.rclone_chunk.001_3vxzrw: Moved (server-side) to: only6 2025/03/14 07:05:10 INFO : both7.rclone_chunk.001_3vy5fm: Moved (server-side) to: both7 2025/03/14 07:05:20 INFO : only7.rclone_chunk.001_3vy9k7: Moved (server-side) to: only7 2025/03/14 07:05:24 INFO : both8.rclone_chunk.001_3vyjl8: Moved (server-side) to: both8 2025/03/14 07:05:29 INFO : only8.rclone_chunk.001_3vyojh: Moved (server-side) to: only8 2025/03/14 07:05:35 INFO : both9.rclone_chunk.001_3vytiw: Moved (server-side) to: both9 2025/03/14 07:05:39 INFO : only9.rclone_chunk.001_3vyy14: Moved (server-side) to: only9 2025/03/14 07:05:46 INFO : both10.rclone_chunk.001_3vz3gj: Moved (server-side) to: both10 2025/03/14 07:05:55 INFO : only10.rclone_chunk.001_3vz926: Moved (server-side) to: only10 2025/03/14 07:06:00 INFO : both11.rclone_chunk.001_3vzi00: Moved (server-side) to: both11 2025/03/14 07:06:07 INFO : only11.rclone_chunk.001_3vzn7i: Moved (server-side) to: only11 2025/03/14 07:06:13 INFO : both12.rclone_chunk.001_3vzvk7: Moved (server-side) to: both12 2025/03/14 07:06:19 INFO : only12.rclone_chunk.001_3w00bt: Moved (server-side) to: only12 2025/03/14 07:06:24 INFO : both13.rclone_chunk.001_3w067f: Moved (server-side) to: both13 2025/03/14 07:06:28 INFO : only13.rclone_chunk.001_3w0bps: Moved (server-side) to: only13 2025/03/14 07:06:34 INFO : both14.rclone_chunk.001_3w0gtk: Moved (server-side) to: both14 2025/03/14 07:06:39 INFO : only14.rclone_chunk.001_3w0l73: Moved (server-side) to: only14 2025/03/14 07:06:44 INFO : both15.rclone_chunk.001_3w0q82: Moved (server-side) to: both15 2025/03/14 07:06:49 INFO : only15.rclone_chunk.001_3w0wmr: Moved (server-side) to: only15 2025/03/14 07:06:55 INFO : both16.rclone_chunk.001_3w11si: Moved (server-side) to: both16 2025/03/14 07:07:00 INFO : only16.rclone_chunk.001_3w16o4: Moved (server-side) to: only16 2025/03/14 07:07:06 INFO : both17.rclone_chunk.001_3w1bc1: Moved (server-side) to: both17 2025/03/14 07:07:14 INFO : only17.rclone_chunk.001_3w1hj3: Moved (server-side) to: only17 2025/03/14 07:07:20 INFO : both18.rclone_chunk.001_3w1qp1: Moved (server-side) to: both18 2025/03/14 07:07:22 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/03/14 07:07:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/03/14 07:07:23 DEBUG : pacer: Reducing sleep to 15ms 2025/03/14 07:07:23 DEBUG : pacer: Reducing sleep to 11.25ms 2025/03/14 07:07:23 DEBUG : pacer: Reducing sleep to 10ms 2025/03/14 07:07:25 INFO : only18.rclone_chunk.001_3w1vyd: Moved (server-side) to: only18 2025/03/14 07:07:30 INFO : both19.rclone_chunk.001_3w209l: Moved (server-side) to: both19 2025/03/14 07:07:35 INFO : only19.rclone_chunk.001_3w25cp: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2762 Error: Should be true Test: TestSyncConcurrentTruncate Messages: only16: Modification time difference too big |-211323h1m52.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-03-14 07:06:59 +0000 UTC) (precision 1ns) 2025/03/14 07:07:36 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for checks to finish 2025/03/14 07:07:36 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both0: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both12: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both13: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both14: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both10: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both16: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both1: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both18: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both19: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both2: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both3: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both4: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both5: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both6: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both7: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both8: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/03/14 07:07:36 DEBUG : both9: Unchanged skipping 2025/03/14 07:07:36 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/03/14 07:07:36 DEBUG : both11: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both15: Unchanged skipping 2025/03/14 07:07:36 DEBUG : both17: Unchanged skipping 2025/03/14 07:07:36 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Waiting for transfers to finish 2025/03/14 07:07:36 DEBUG : only0: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:36 DEBUG : only1: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:36 DEBUG : only10: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:36 DEBUG : only11: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:44 INFO : only10: Deleted 2025/03/14 07:07:44 INFO : only11: Deleted 2025/03/14 07:07:45 INFO : only11.rclone_chunk.001_3w2btx: Moved (server-side) to: only11 2025/03/14 07:07:45 DEBUG : only11: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:45 INFO : only11: Copied (replaced existing) 2025/03/14 07:07:45 DEBUG : only12: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:46 INFO : only1: Deleted 2025/03/14 07:07:46 INFO : only10.rclone_chunk.001_3w2b94: Moved (server-side) to: only10 2025/03/14 07:07:46 DEBUG : only10: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:46 INFO : only10: Copied (replaced existing) 2025/03/14 07:07:46 DEBUG : only13: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:48 INFO : only0: Deleted 2025/03/14 07:07:48 INFO : only1.rclone_chunk.001_3w2bk6: Moved (server-side) to: only1 2025/03/14 07:07:48 DEBUG : only1: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:48 INFO : only1: Copied (replaced existing) 2025/03/14 07:07:48 DEBUG : only14: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:49 INFO : only0.rclone_chunk.001_3w2brm: Moved (server-side) to: only0 2025/03/14 07:07:49 DEBUG : only0: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:49 INFO : only0: Copied (replaced existing) 2025/03/14 07:07:49 DEBUG : only15: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:53 INFO : only12: Deleted 2025/03/14 07:07:54 INFO : only13: Deleted 2025/03/14 07:07:55 INFO : only12.rclone_chunk.001_3w2kya: Moved (server-side) to: only12 2025/03/14 07:07:55 DEBUG : only12: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:55 INFO : only12: Copied (replaced existing) 2025/03/14 07:07:55 DEBUG : only16: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:56 INFO : only13.rclone_chunk.001_3w2lbb: Moved (server-side) to: only13 2025/03/14 07:07:56 DEBUG : only13: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:56 INFO : only13: Copied (replaced existing) 2025/03/14 07:07:56 DEBUG : only17: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:56 INFO : only15: Deleted 2025/03/14 07:07:57 INFO : only14: Deleted 2025/03/14 07:07:59 INFO : only14.rclone_chunk.001_3w2np2: Moved (server-side) to: only14 2025/03/14 07:07:59 DEBUG : only14: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:59 INFO : only14: Copied (replaced existing) 2025/03/14 07:07:59 DEBUG : only18: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:07:59 INFO : only15.rclone_chunk.001_3w2o96: Moved (server-side) to: only15 2025/03/14 07:07:59 DEBUG : only15: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:07:59 INFO : only15: Copied (replaced existing) 2025/03/14 07:07:59 DEBUG : only19: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:04 INFO : only17: Deleted 2025/03/14 07:08:05 INFO : only16: Deleted 2025/03/14 07:08:06 INFO : only19: Deleted 2025/03/14 07:08:06 INFO : only18: Deleted 2025/03/14 07:08:06 INFO : only16.rclone_chunk.001_3w2u3a: Moved (server-side) to: only16 2025/03/14 07:08:06 DEBUG : only16: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:06 INFO : only16: Copied (replaced existing) 2025/03/14 07:08:06 DEBUG : only2: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:06 INFO : only17.rclone_chunk.001_3w2v4b: Moved (server-side) to: only17 2025/03/14 07:08:06 DEBUG : only17: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:06 INFO : only17: Copied (replaced existing) 2025/03/14 07:08:06 DEBUG : only3: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:07 INFO : only19.rclone_chunk.001_3w2yhu: Moved (server-side) to: only19 2025/03/14 07:08:07 DEBUG : only19: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:07 INFO : only19: Copied (replaced existing) 2025/03/14 07:08:07 DEBUG : only4: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:08 INFO : only18.rclone_chunk.001_3w2y8d: Moved (server-side) to: only18 2025/03/14 07:08:08 DEBUG : only18: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:08 INFO : only18: Copied (replaced existing) 2025/03/14 07:08:08 DEBUG : only5: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:13 INFO : only2: Deleted 2025/03/14 07:08:13 INFO : only4: Deleted 2025/03/14 07:08:14 INFO : only3: Deleted 2025/03/14 07:08:15 INFO : only3.rclone_chunk.001_3w35r7: Moved (server-side) to: only3 2025/03/14 07:08:15 DEBUG : only3: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:15 INFO : only3: Copied (replaced existing) 2025/03/14 07:08:15 DEBUG : only6: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:15 INFO : only4.rclone_chunk.001_3w3676: Moved (server-side) to: only4 2025/03/14 07:08:15 DEBUG : only4: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:15 INFO : only4: Copied (replaced existing) 2025/03/14 07:08:15 DEBUG : only7: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:15 INFO : only2.rclone_chunk.001_3w3590: Moved (server-side) to: only2 2025/03/14 07:08:15 DEBUG : only2: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:15 INFO : only2: Copied (replaced existing) 2025/03/14 07:08:15 DEBUG : only8: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:16 INFO : only5: Deleted 2025/03/14 07:08:19 INFO : only5.rclone_chunk.001_3w37yl: Moved (server-side) to: only5 2025/03/14 07:08:19 DEBUG : only5: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:19 INFO : only5: Copied (replaced existing) 2025/03/14 07:08:19 DEBUG : only9: skip slow MD5 on source file, hashing in-transit 2025/03/14 07:08:22 INFO : only7: Deleted 2025/03/14 07:08:22 INFO : only8: Deleted 2025/03/14 07:08:24 INFO : only8.rclone_chunk.001_3w3e20: Moved (server-side) to: only8 2025/03/14 07:08:24 DEBUG : only8: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:24 INFO : only8: Copied (replaced existing) 2025/03/14 07:08:24 INFO : only7.rclone_chunk.001_3w3em4: Moved (server-side) to: only7 2025/03/14 07:08:24 DEBUG : only7: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:24 INFO : only7: Copied (replaced existing) 2025/03/14 07:08:27 INFO : only6: Deleted 2025/03/14 07:08:30 INFO : only9: Deleted 2025/03/14 07:08:32 INFO : only9.rclone_chunk.001_3w3in8: Moved (server-side) to: only9 2025/03/14 07:08:32 DEBUG : only9: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:32 INFO : only9: Copied (replaced existing) 2025/03/14 07:08:33 INFO : only6.rclone_chunk.001_3w3exi: Moved (server-side) to: only6 2025/03/14 07:08:33 DEBUG : only6: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/03/14 07:08:33 INFO : only6: Copied (replaced existing) 2025/03/14 07:08:33 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu'", Local "Local file system at /tmp/rclone3233884625", Modify Window "1ns" --- FAIL: TestSyncConcurrentTruncate (451.33s) FAIL 2025/03/14 07:11:16 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-nidahaj1davu': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncCopyDest|TestSyncWithTrackRenamesStrategyModtime)$'" - Finished ERROR in 15m38.699887868s (try 2/5): exit status 1: Failed [TestSyncConcurrentTruncate]