"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncBackupDir|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Starting (try 2/5) 2025/01/18 04:48:25 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-jegekec1jura" 2025/01/18 04:48:25 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/18 04:48:25 DEBUG : Creating backend with remote "TestYandex:rclone-test-jegekec1jura" 2025/01/18 04:48:26 DEBUG : Reset feature "ListR" 2025/01/18 04:48:26 DEBUG : Creating backend with remote "/tmp/rclone4099020612" === RUN TestSyncCompareDest run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura'", Local "Local file system at /tmp/rclone4099020612", Modify Window "1ns" 2025/01/18 04:48:26 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst" 2025/01/18 04:48:26 DEBUG : Creating backend with remote "TestYandex:rclone-test-jegekec1jura/dst" 2025/01/18 04:48:26 DEBUG : Reset feature "ListR" 2025/01/18 04:48:26 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-jegekec1jura/CompareDest" 2025/01/18 04:48:26 DEBUG : Creating backend with remote "TestYandex:rclone-test-jegekec1jura/CompareDest" 2025/01/18 04:48:27 DEBUG : Reset feature "ListR" 2025/01/18 04:48:28 DEBUG : one: Need to transfer - File not found at Destination 2025/01/18 04:48:28 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:48:28 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:48:28 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/18 04:48:34 INFO : one.rclone_chunk.001_9uxux1: Moved (server-side) to: one 2025/01/18 04:48:34 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/01/18 04:48:34 INFO : one: Copied (new) 2025/01/18 04:48:34 DEBUG : Waiting for deletions to finish 2025/01/18 04:48:37 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/18 04:48:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:48:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:48:37 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/18 04:48:45 INFO : one: Deleted 2025/01/18 04:48:47 INFO : one.rclone_chunk.001_9uy3as: Moved (server-side) to: one 2025/01/18 04:48:47 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/01/18 04:48:47 INFO : one: Copied (replaced existing) 2025/01/18 04:48:47 DEBUG : Waiting for deletions to finish 2025/01/18 04:48:56 INFO : dst/one: Deleted 2025/01/18 04:48:57 INFO : dst/one.rclone_chunk.001_9uyfoe: Moved (server-side) to: dst/one 2025/01/18 04:49:03 INFO : CompareDest/one.rclone_chunk.001_9uynxo: Moved (server-side) to: CompareDest/one 2025/01/18 04:49:05 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/18 04:49:05 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:49:05 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:05 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/18 04:49:05 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:49:05 DEBUG : Waiting for deletions to finish 2025/01/18 04:49:05 INFO : There was nothing to transfer 2025/01/18 04:49:12 INFO : CompareDest/two.rclone_chunk.001_9uywam: Moved (server-side) to: CompareDest/two 2025/01/18 04:49:14 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:14 DEBUG : two: Destination found in --compare-dest, skipping 2025/01/18 04:49:14 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/18 04:49:14 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:49:15 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:15 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/18 04:49:15 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:49:15 DEBUG : Waiting for deletions to finish 2025/01/18 04:49:15 INFO : There was nothing to transfer 2025/01/18 04:49:17 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:17 DEBUG : two: Destination found in --compare-dest, skipping 2025/01/18 04:49:17 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/18 04:49:17 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:49:18 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:18 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/18 04:49:18 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:49:18 DEBUG : Waiting for deletions to finish 2025/01/18 04:49:18 INFO : There was nothing to transfer 2025/01/18 04:49:21 DEBUG : two: Modification times differ by -119h59m59.876543211s: 2011-12-30 12:59:59 +0000 UTC, 2011-12-25 12:59:59.123456789 +0000 UTC 2025/01/18 04:49:21 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/18 04:49:21 DEBUG : two: Destination found in --compare-dest, skipping 2025/01/18 04:49:21 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/18 04:49:21 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:49:22 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:22 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/18 04:49:22 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:49:22 DEBUG : Waiting for deletions to finish 2025/01/18 04:49:22 INFO : There was nothing to transfer 2025/01/18 04:49:24 DEBUG : two: Sizes differ (src 5 vs dst 3) 2025/01/18 04:49:24 DEBUG : two: Need to transfer - File not found at Destination 2025/01/18 04:49:24 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/18 04:49:24 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:49:25 DEBUG : two: skip slow MD5 on source file, hashing in-transit 2025/01/18 04:49:25 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:49:25 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/18 04:49:25 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:49:29 INFO : two.rclone_chunk.001_9uzf89: Moved (server-side) to: two 2025/01/18 04:49:29 DEBUG : two: md5 = 2379e4ce8c3380e996ab0509f17069ad OK 2025/01/18 04:49:29 INFO : two: Copied (new) 2025/01/18 04:49:29 DEBUG : Waiting for deletions to finish --- PASS: TestSyncCompareDest (85.90s) === RUN TestSyncBackupDir run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura'", Local "Local file system at /tmp/rclone4099020612", Modify Window "1ns" 2025/01/18 04:49:57 INFO : dst/one.rclone_chunk.001_9v06v8: Moved (server-side) to: dst/one 2025/01/18 04:50:02 INFO : dst/two.rclone_chunk.001_9v0ch4: Moved (server-side) to: dst/two 2025/01/18 04:50:07 INFO : dst/three.txt.rclone_chunk.001_9v0gfr: Moved (server-side) to: dst/three.txt 2025/01/18 04:50:07 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst" 2025/01/18 04:50:07 DEBUG : Creating backend with remote "TestYandex:rclone-test-jegekec1jura/dst" 2025/01/18 04:50:08 DEBUG : Reset feature "ListR" 2025/01/18 04:50:08 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-jegekec1jura/backup" 2025/01/18 04:50:08 DEBUG : Creating backend with remote "TestYandex:rclone-test-jegekec1jura/backup" 2025/01/18 04:50:08 DEBUG : Reset feature "ListR" 2025/01/18 04:50:09 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/01/18 04:50:09 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:50:09 DEBUG : two: Unchanged skipping 2025/01/18 04:50:09 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:50:09 DEBUG : one: move non-chunked object... 2025/01/18 04:50:11 INFO : one: Moved (server-side) 2025/01/18 04:50:11 INFO : one: Moved (server-side) 2025/01/18 04:50:11 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:50:12 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/18 04:50:16 INFO : one.rclone_chunk.001_9v0qcy: Moved (server-side) to: one 2025/01/18 04:50:16 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/01/18 04:50:16 INFO : one: Copied (new) 2025/01/18 04:50:16 DEBUG : Waiting for deletions to finish 2025/01/18 04:50:17 DEBUG : three.txt: move non-chunked object... 2025/01/18 04:50:19 INFO : three.txt: Moved (server-side) 2025/01/18 04:50:19 INFO : three.txt: Moved (server-side) 2025/01/18 04:50:19 INFO : three.txt: Moved into backup dir 2025/01/18 04:50:24 INFO : dst/three.txt.rclone_chunk.001_9v0x8s: Moved (server-side) to: dst/three.txt 2025/01/18 04:50:26 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/01/18 04:50:26 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:50:26 DEBUG : two: Unchanged skipping 2025/01/18 04:50:26 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for checks to finish 2025/01/18 04:50:30 INFO : one: Deleted 2025/01/18 04:50:30 DEBUG : one: move non-chunked object... 2025/01/18 04:50:32 INFO : one: Moved (server-side) 2025/01/18 04:50:32 INFO : one: Moved (server-side) 2025/01/18 04:50:32 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura/dst': Waiting for transfers to finish 2025/01/18 04:50:32 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/18 04:50:39 INFO : one.rclone_chunk.001_9v1a6c: Moved (server-side) to: one 2025/01/18 04:50:39 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/01/18 04:50:39 INFO : one: Copied (new) 2025/01/18 04:50:39 DEBUG : Waiting for deletions to finish 2025/01/18 04:50:43 INFO : three.txt: Deleted 2025/01/18 04:50:43 DEBUG : three.txt: move non-chunked object... 2025/01/18 04:50:44 INFO : three.txt: Moved (server-side) 2025/01/18 04:50:44 INFO : three.txt: Moved (server-side) 2025/01/18 04:50:44 INFO : three.txt: Moved into backup dir --- PASS: TestSyncBackupDir (75.47s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura'", Local "Local file system at /tmp/rclone4099020612", Modify Window "1ns" 2025/01/18 04:51:13 INFO : both0.rclone_chunk.001_9v29q1: Moved (server-side) to: both0 2025/01/18 04:51:18 INFO : only0.rclone_chunk.001_9v2fnt: Moved (server-side) to: only0 2025/01/18 04:51:24 INFO : both1.rclone_chunk.001_9v2lkk: Moved (server-side) to: both1 2025/01/18 04:51:31 INFO : only1.rclone_chunk.001_9v2raq: Moved (server-side) to: only1 2025/01/18 04:51:36 INFO : both2.rclone_chunk.001_9v2xjy: Moved (server-side) to: both2 2025/01/18 04:51:41 INFO : only2.rclone_chunk.001_9v33ng: Moved (server-side) to: only2 2025/01/18 04:51:49 INFO : both3.rclone_chunk.001_9v3752: Moved (server-side) to: both3 2025/01/18 04:51:53 INFO : only3.rclone_chunk.001_9v3fxw: Moved (server-side) to: only3 2025/01/18 04:51:58 INFO : both4.rclone_chunk.001_9v3k7s: Moved (server-side) to: both4 2025/01/18 04:52:03 INFO : only4.rclone_chunk.001_9v3ph5: Moved (server-side) to: only4 2025/01/18 04:52:12 INFO : both5.rclone_chunk.001_9v3tys: Moved (server-side) to: both5 2025/01/18 04:52:18 INFO : only5.rclone_chunk.001_9v43sw: Moved (server-side) to: only5 2025/01/18 04:52:24 INFO : both6.rclone_chunk.001_9v48vd: Moved (server-side) to: both6 2025/01/18 04:52:29 INFO : only6.rclone_chunk.001_9v4e0e: Moved (server-side) to: only6 2025/01/18 04:52:34 INFO : both7.rclone_chunk.001_9v4jlw: Moved (server-side) to: both7 2025/01/18 04:52:39 INFO : only7.rclone_chunk.001_9v4o92: Moved (server-side) to: only7 2025/01/18 04:52:44 INFO : both8.rclone_chunk.001_9v4uua: Moved (server-side) to: both8 2025/01/18 04:52:50 INFO : only8.rclone_chunk.001_9v4z2q: Moved (server-side) to: only8 2025/01/18 04:52:56 INFO : both9.rclone_chunk.001_9v54rz: Moved (server-side) to: both9 2025/01/18 04:53:03 INFO : only9.rclone_chunk.001_9v5b2q: Moved (server-side) to: only9 2025/01/18 04:53:07 INFO : both10.rclone_chunk.001_9v5hkl: Moved (server-side) to: both10 2025/01/18 04:53:12 INFO : only10.rclone_chunk.001_9v5lia: Moved (server-side) to: only10 2025/01/18 04:53:17 INFO : both11.rclone_chunk.001_9v5qjs: Moved (server-side) to: both11 2025/01/18 04:53:23 INFO : only11.rclone_chunk.001_9v5wr0: Moved (server-side) to: only11 2025/01/18 04:53:37 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/18 04:53:37 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/18 04:53:37 DEBUG : pacer: Reducing sleep to 15ms 2025/01/18 04:53:37 INFO : both12.rclone_chunk.001_9v627q: Moved (server-side) to: both12 2025/01/18 04:53:37 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/18 04:53:38 DEBUG : pacer: Reducing sleep to 10ms 2025/01/18 04:53:45 INFO : only12.rclone_chunk.001_9v6f0d: Moved (server-side) to: only12 2025/01/18 04:53:50 INFO : both13.rclone_chunk.001_9v6osx: Moved (server-side) to: both13 2025/01/18 04:53:56 INFO : only13.rclone_chunk.001_9v6ste: Moved (server-side) to: only13 2025/01/18 04:54:01 INFO : both14.rclone_chunk.001_9v6y93: Moved (server-side) to: both14 2025/01/18 04:54:06 INFO : only14.rclone_chunk.001_9v731j: Moved (server-side) to: only14 2025/01/18 04:54:12 INFO : both15.rclone_chunk.001_9v7995: Moved (server-side) to: both15 2025/01/18 04:54:18 INFO : only15.rclone_chunk.001_9v7ebf: Moved (server-side) to: only15 2025/01/18 04:54:22 INFO : both16.rclone_chunk.001_9v7lg2: Moved (server-side) to: both16 2025/01/18 04:54:27 INFO : only16.rclone_chunk.001_9v7paj: Moved (server-side) to: only16 2025/01/18 04:54:32 INFO : both17.rclone_chunk.001_9v7t9n: Moved (server-side) to: both17 2025/01/18 04:54:38 INFO : only17.rclone_chunk.001_9v7yj2: Moved (server-side) to: only17 2025/01/18 04:54:43 INFO : both18.rclone_chunk.001_9v859b: Moved (server-side) to: both18 2025/01/18 04:54:48 INFO : only18.rclone_chunk.001_9v89qw: Moved (server-side) to: only18 2025/01/18 04:54:53 INFO : both19.rclone_chunk.001_9v8ezd: Moved (server-side) to: both19 2025/01/18 04:54:58 INFO : only19.rclone_chunk.001_9v8jh1: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: only19: Modification time difference too big |-210000h49m50.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-18 04:54:57 +0000 UTC) (precision 1ns) 2025/01/18 04:54:59 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura': Waiting for checks to finish 2025/01/18 04:54:59 DEBUG : both0: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both10: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both13: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both14: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both1: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both11: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both17: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both18: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both19: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both12: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both15: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both4: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both5: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both6: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both7: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both16: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 04:54:59 DEBUG : both9: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both2: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both3: Unchanged skipping 2025/01/18 04:54:59 DEBUG : both8: Unchanged skipping 2025/01/18 04:54:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura': Waiting for transfers to finish 2025/01/18 04:54:59 DEBUG : Waiting for deletions to finish 2025/01/18 04:55:01 INFO : only15: Deleted 2025/01/18 04:55:02 INFO : only17: Deleted 2025/01/18 04:55:02 INFO : only14: Deleted 2025/01/18 04:55:02 INFO : only10: Deleted 2025/01/18 04:55:04 INFO : only6: Deleted 2025/01/18 04:55:05 INFO : only4: Deleted 2025/01/18 04:55:06 INFO : only8: Deleted 2025/01/18 04:55:06 INFO : only1: Deleted 2025/01/18 04:55:08 INFO : only16: Deleted 2025/01/18 04:55:08 INFO : only13: Deleted 2025/01/18 04:55:09 INFO : only19: Deleted 2025/01/18 04:55:09 INFO : only3: Deleted 2025/01/18 04:55:11 INFO : only5: Deleted 2025/01/18 04:55:11 INFO : only9: Deleted 2025/01/18 04:55:11 INFO : only0: Deleted 2025/01/18 04:55:12 INFO : only11: Deleted 2025/01/18 04:55:14 INFO : only2: Deleted 2025/01/18 04:55:14 INFO : only12: Deleted 2025/01/18 04:55:14 INFO : only18: Deleted 2025/01/18 04:55:15 INFO : only7: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura'", Local "Local file system at /tmp/rclone4099020612", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (319.19s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura'", Local "Local file system at /tmp/rclone4099020612", Modify Window "1ns" 2025/01/18 04:56:32 INFO : both0.rclone_chunk.001_9vb4qj: Moved (server-side) to: both0 2025/01/18 04:56:37 INFO : only0.rclone_chunk.001_9vbaa9: Moved (server-side) to: only0 2025/01/18 04:56:42 INFO : both1.rclone_chunk.001_9vbf27: Moved (server-side) to: both1 2025/01/18 04:56:46 INFO : only1.rclone_chunk.001_9vbkqy: Moved (server-side) to: only1 2025/01/18 04:56:52 INFO : both2.rclone_chunk.001_9vbp0d: Moved (server-side) to: both2 2025/01/18 04:56:57 INFO : only2.rclone_chunk.001_9vbuoz: Moved (server-side) to: only2 2025/01/18 04:57:02 INFO : both3.rclone_chunk.001_9vc03a: Moved (server-side) to: both3 2025/01/18 04:57:07 INFO : only3.rclone_chunk.001_9vc4mz: Moved (server-side) to: only3 2025/01/18 04:57:12 INFO : both4.rclone_chunk.001_9vc9bn: Moved (server-side) to: both4 2025/01/18 04:57:18 INFO : only4.rclone_chunk.001_9vce9y: Moved (server-side) to: only4 2025/01/18 04:57:23 INFO : both5.rclone_chunk.001_9vckxj: Moved (server-side) to: both5 2025/01/18 04:57:28 INFO : only5.rclone_chunk.001_9vcqqk: Moved (server-side) to: only5 2025/01/18 04:57:37 INFO : both6.rclone_chunk.001_9vczmt: Moved (server-side) to: both6 2025/01/18 04:57:42 INFO : only6.rclone_chunk.001_9vd3wl: Moved (server-side) to: only6 2025/01/18 04:57:48 INFO : both7.rclone_chunk.001_9vd9ro: Moved (server-side) to: both7 2025/01/18 04:57:53 INFO : only7.rclone_chunk.001_9vdfey: Moved (server-side) to: only7 2025/01/18 04:57:59 INFO : both8.rclone_chunk.001_9vdkmt: Moved (server-side) to: both8 2025/01/18 04:58:05 INFO : only8.rclone_chunk.001_9vdp1p: Moved (server-side) to: only8 2025/01/18 04:58:10 INFO : both9.rclone_chunk.001_9vdvwt: Moved (server-side) to: both9 2025/01/18 04:58:15 INFO : only9.rclone_chunk.001_9ve0e5: Moved (server-side) to: only9 2025/01/18 04:58:22 INFO : both10.rclone_chunk.001_9ve5am: Moved (server-side) to: both10 2025/01/18 04:58:27 INFO : only10.rclone_chunk.001_9vec4r: Moved (server-side) to: only10 2025/01/18 04:58:31 INFO : both11.rclone_chunk.001_9veh6j: Moved (server-side) to: both11 2025/01/18 04:58:37 INFO : only11.rclone_chunk.001_9vemcm: Moved (server-side) to: only11 2025/01/18 04:58:42 INFO : both12.rclone_chunk.001_9verog: Moved (server-side) to: both12 2025/01/18 04:58:48 INFO : only12.rclone_chunk.001_9vexhf: Moved (server-side) to: only12 2025/01/18 04:58:53 INFO : both13.rclone_chunk.001_9vf22f: Moved (server-side) to: both13 2025/01/18 04:58:58 INFO : only13.rclone_chunk.001_9vf8mk: Moved (server-side) to: only13 2025/01/18 04:59:07 INFO : both14.rclone_chunk.001_9vfd1i: Moved (server-side) to: both14 2025/01/18 04:59:12 INFO : only14.rclone_chunk.001_9vflcm: Moved (server-side) to: only14 2025/01/18 04:59:17 INFO : both15.rclone_chunk.001_9vfqya: Moved (server-side) to: both15 2025/01/18 04:59:23 INFO : only15.rclone_chunk.001_9vfvpx: Moved (server-side) to: only15 2025/01/18 04:59:28 INFO : both16.rclone_chunk.001_9vg1ew: Moved (server-side) to: both16 2025/01/18 04:59:32 INFO : only16.rclone_chunk.001_9vg618: Moved (server-side) to: only16 2025/01/18 04:59:37 INFO : both17.rclone_chunk.001_9vga24: Moved (server-side) to: both17 2025/01/18 04:59:42 INFO : only17.rclone_chunk.001_9vggg3: Moved (server-side) to: only17 2025/01/18 04:59:47 INFO : both18.rclone_chunk.001_9vgky6: Moved (server-side) to: both18 2025/01/18 04:59:51 INFO : only18.rclone_chunk.001_9vgpgj: Moved (server-side) to: only18 2025/01/18 04:59:56 INFO : both19.rclone_chunk.001_9vguvz: Moved (server-side) to: both19 2025/01/18 05:00:01 INFO : only19.rclone_chunk.001_9vgy2z: Moved (server-side) to: only19 2025/01/18 05:00:04 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both0: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both1: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both10: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both11: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both12: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both13: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both14: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both15: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both16: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both17: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both18: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both19: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both2: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both3: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both4: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both5: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both6: Unchanged skipping 2025/01/18 05:00:04 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : both7: Unchanged skipping 2025/01/18 05:00:04 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura': Waiting for checks to finish 2025/01/18 05:00:04 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/18 05:00:04 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : both8: Unchanged skipping 2025/01/18 05:00:04 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only10: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:04 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only11: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:04 DEBUG : only12: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:04 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only13: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:04 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/01/18 05:00:04 DEBUG : both9: Unchanged skipping 2025/01/18 05:00:04 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura': Waiting for transfers to finish 2025/01/18 05:00:11 INFO : only10: Deleted 2025/01/18 05:00:11 INFO : only12: Deleted 2025/01/18 05:00:12 INFO : only11: Deleted 2025/01/18 05:00:12 INFO : only13: Deleted 2025/01/18 05:00:12 INFO : only12.rclone_chunk.001_9vh61k: Moved (server-side) to: only12 2025/01/18 05:00:12 DEBUG : only12: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:12 INFO : only12: Copied (replaced existing) 2025/01/18 05:00:12 DEBUG : only14: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:13 INFO : only10.rclone_chunk.001_9vh6v4: Moved (server-side) to: only10 2025/01/18 05:00:13 DEBUG : only10: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:13 INFO : only10: Copied (replaced existing) 2025/01/18 05:00:13 DEBUG : only15: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:13 INFO : only11.rclone_chunk.001_9vh6tq: Moved (server-side) to: only11 2025/01/18 05:00:13 DEBUG : only11: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:13 INFO : only11: Copied (replaced existing) 2025/01/18 05:00:13 DEBUG : only16: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:14 INFO : only13.rclone_chunk.001_9vh6fv: Moved (server-side) to: only13 2025/01/18 05:00:14 DEBUG : only13: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:14 INFO : only13: Copied (replaced existing) 2025/01/18 05:00:14 DEBUG : only17: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:20 INFO : only14: Deleted 2025/01/18 05:00:20 INFO : only16: Deleted 2025/01/18 05:00:20 INFO : only15: Deleted 2025/01/18 05:00:21 INFO : only17: Deleted 2025/01/18 05:00:21 INFO : only15.rclone_chunk.001_9vhfgg: Moved (server-side) to: only15 2025/01/18 05:00:21 DEBUG : only15: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:21 INFO : only15: Copied (replaced existing) 2025/01/18 05:00:21 DEBUG : only18: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:22 INFO : only16.rclone_chunk.001_9vhfdm: Moved (server-side) to: only16 2025/01/18 05:00:22 DEBUG : only16: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:22 INFO : only16: Copied (replaced existing) 2025/01/18 05:00:22 DEBUG : only19: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:22 INFO : only14.rclone_chunk.001_9vhebb: Moved (server-side) to: only14 2025/01/18 05:00:22 DEBUG : only14: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:22 INFO : only14: Copied (replaced existing) 2025/01/18 05:00:22 DEBUG : only2: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:24 INFO : only17.rclone_chunk.001_9vhgtb: Moved (server-side) to: only17 2025/01/18 05:00:24 DEBUG : only17: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:24 INFO : only17: Copied (replaced existing) 2025/01/18 05:00:24 DEBUG : only3: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:28 INFO : only18: Deleted 2025/01/18 05:00:28 INFO : only2: Deleted 2025/01/18 05:00:29 INFO : only19: Deleted 2025/01/18 05:00:30 INFO : only18.rclone_chunk.001_9vhn6t: Moved (server-side) to: only18 2025/01/18 05:00:30 DEBUG : only18: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:30 INFO : only18: Copied (replaced existing) 2025/01/18 05:00:30 DEBUG : only4: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:31 INFO : only2.rclone_chunk.001_9vho52: Moved (server-side) to: only2 2025/01/18 05:00:31 DEBUG : only2: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:31 INFO : only2: Copied (replaced existing) 2025/01/18 05:00:31 DEBUG : only5: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:31 INFO : only3: Deleted 2025/01/18 05:00:31 INFO : only19.rclone_chunk.001_9vhokg: Moved (server-side) to: only19 2025/01/18 05:00:31 DEBUG : only19: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:31 INFO : only19: Copied (replaced existing) 2025/01/18 05:00:31 DEBUG : only6: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:33 INFO : only3.rclone_chunk.001_9vhq5c: Moved (server-side) to: only3 2025/01/18 05:00:33 DEBUG : only3: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:33 INFO : only3: Copied (replaced existing) 2025/01/18 05:00:33 DEBUG : only7: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:36 INFO : only5: Deleted 2025/01/18 05:00:37 INFO : only4: Deleted 2025/01/18 05:00:38 INFO : only4.rclone_chunk.001_9vhwqs: Moved (server-side) to: only4 2025/01/18 05:00:38 DEBUG : only4: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:38 INFO : only4: Copied (replaced existing) 2025/01/18 05:00:38 DEBUG : only8: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:39 INFO : only7: Deleted 2025/01/18 05:00:41 INFO : only7.rclone_chunk.001_9vhz58: Moved (server-side) to: only7 2025/01/18 05:00:41 DEBUG : only7: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:41 INFO : only7: Copied (replaced existing) 2025/01/18 05:00:41 DEBUG : only9: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:43 INFO : only6: Deleted 2025/01/18 05:00:45 INFO : only8: Deleted 2025/01/18 05:00:45 INFO : only6.rclone_chunk.001_9vhxsx: Moved (server-side) to: only6 2025/01/18 05:00:45 DEBUG : only6: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:45 INFO : only6: Copied (replaced existing) 2025/01/18 05:00:45 DEBUG : only1: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:45 INFO : only5.rclone_chunk.001_9vhxbj: Moved (server-side) to: only5 2025/01/18 05:00:45 DEBUG : only5: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:45 INFO : only5: Copied (replaced existing) 2025/01/18 05:00:45 DEBUG : only0: skip slow MD5 on source file, hashing in-transit 2025/01/18 05:00:46 INFO : only8.rclone_chunk.001_9vi44l: Moved (server-side) to: only8 2025/01/18 05:00:46 DEBUG : only8: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:46 INFO : only8: Copied (replaced existing) 2025/01/18 05:00:52 INFO : only1: Deleted 2025/01/18 05:00:53 INFO : only0: Deleted 2025/01/18 05:00:54 INFO : only1.rclone_chunk.001_9vibee: Moved (server-side) to: only1 2025/01/18 05:00:54 DEBUG : only1: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:54 INFO : only1: Copied (replaced existing) 2025/01/18 05:00:55 INFO : only0.rclone_chunk.001_9vibb4: Moved (server-side) to: only0 2025/01/18 05:00:55 DEBUG : only0: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:00:55 INFO : only0: Copied (replaced existing) 2025/01/18 05:00:57 INFO : only9: Deleted 2025/01/18 05:01:01 INFO : only9.rclone_chunk.001_9vi7vy: Moved (server-side) to: only9 2025/01/18 05:01:01 DEBUG : only9: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/18 05:01:01 INFO : only9: Copied (replaced existing) 2025/01/18 05:01:01 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura'", Local "Local file system at /tmp/rclone4099020612", Modify Window "1ns" --- PASS: TestSyncConcurrentTruncate (408.15s) FAIL 2025/01/18 05:03:14 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-jegekec1jura': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncBackupDir|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Finished ERROR in 14m54.565771708s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete]