"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Starting (try 2/5) 2024/11/14 19:12:43 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-xabajel8saho" 2024/11/14 19:12:43 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/14 19:12:43 DEBUG : Creating backend with remote "TestYandex:rclone-test-xabajel8saho" 2024/11/14 19:12:44 DEBUG : Reset feature "ListR" 2024/11/14 19:12:44 DEBUG : Creating backend with remote "/tmp/rclone417803115" === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho'", Local "Local file system at /tmp/rclone417803115", Modify Window "1ns" 2024/11/14 19:12:50 INFO : both0.rclone_chunk.001_ylljtb: Moved (server-side) to: both0 2024/11/14 19:12:56 INFO : only0.rclone_chunk.001_yllobi: Moved (server-side) to: only0 2024/11/14 19:13:01 INFO : both1.rclone_chunk.001_ylluj1: Moved (server-side) to: both1 2024/11/14 19:13:09 INFO : only1.rclone_chunk.001_yllzog: Moved (server-side) to: only1 2024/11/14 19:13:14 INFO : both2.rclone_chunk.001_ylm8ms: Moved (server-side) to: both2 2024/11/14 19:13:20 INFO : only2.rclone_chunk.001_ylmcq2: Moved (server-side) to: only2 2024/11/14 19:13:25 INFO : both3.rclone_chunk.001_ylmjbg: Moved (server-side) to: both3 2024/11/14 19:13:30 INFO : only3.rclone_chunk.001_ylmoqc: Moved (server-side) to: only3 2024/11/14 19:13:38 INFO : both4.rclone_chunk.001_ylmtdp: Moved (server-side) to: both4 2024/11/14 19:13:46 INFO : only4.rclone_chunk.001_yln0wy: Moved (server-side) to: only4 2024/11/14 19:13:54 INFO : both5.rclone_chunk.001_yln9o1: Moved (server-side) to: both5 2024/11/14 19:13:59 INFO : only5.rclone_chunk.001_ylngq1: Moved (server-side) to: only5 2024/11/14 19:14:04 INFO : both6.rclone_chunk.001_ylnmcg: Moved (server-side) to: both6 2024/11/14 19:14:09 INFO : only6.rclone_chunk.001_ylnqxs: Moved (server-side) to: only6 2024/11/14 19:14:16 INFO : both7.rclone_chunk.001_ylnvos: Moved (server-side) to: both7 2024/11/14 19:14:21 INFO : only7.rclone_chunk.001_ylo2ig: Moved (server-side) to: only7 2024/11/14 19:14:27 INFO : both8.rclone_chunk.001_ylo7u0: Moved (server-side) to: both8 2024/11/14 19:14:37 INFO : only8.rclone_chunk.001_ylod7z: Moved (server-side) to: only8 2024/11/14 19:14:42 INFO : both9.rclone_chunk.001_ylonm0: Moved (server-side) to: both9 2024/11/14 19:14:47 INFO : only9.rclone_chunk.001_ylosa1: Moved (server-side) to: only9 2024/11/14 19:14:54 INFO : both10.rclone_chunk.001_yloy1w: Moved (server-side) to: both10 2024/11/14 19:15:00 INFO : only10.rclone_chunk.001_ylp4lb: Moved (server-side) to: only10 2024/11/14 19:15:09 INFO : both11.rclone_chunk.001_ylpbdc: Moved (server-side) to: both11 2024/11/14 19:16:21 INFO : only11.rclone_chunk.001_ylpker: Moved (server-side) to: only11 2024/11/14 19:17:15 INFO : both12.rclone_chunk.001_yls9l5: Moved (server-side) to: both12 2024/11/14 19:17:52 INFO : only12.rclone_chunk.001_ylt107: Moved (server-side) to: only12 2024/11/14 19:18:15 DEBUG : pacer: low level retry 1/1 (error Put "https://uploader18j.disk.yandex.net:443/upload-target/20241114T221756.326.utd.6qk0mvdf5gowciuvpgq1pfv9v-k18j.6130223": dial tcp: lookup uploader18j.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:49501->127.0.0.53:53: i/o timeout) 2024/11/14 19:18:18 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "both13" to Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': 1/10 (Put "https://uploader18j.disk.yandex.net:443/upload-target/20241114T221756.326.utd.6qk0mvdf5gowciuvpgq1pfv9v-k18j.6130223": dial tcp: lookup uploader18j.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:49501->127.0.0.53:53: i/o timeout) 2024/11/14 19:18:29 DEBUG : pacer: Reducing sleep to 15ms 2024/11/14 19:18:30 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/14 19:18:31 DEBUG : pacer: Reducing sleep to 10ms 2024/11/14 19:19:44 INFO : both13.rclone_chunk.001_ylv3cy: Moved (server-side) to: both13 2024/11/14 19:20:50 INFO : only13.rclone_chunk.001_ylx7lo: Moved (server-side) to: only13 2024/11/14 19:21:22 INFO : both14.rclone_chunk.001_ylz7s1: Moved (server-side) to: both14 2024/11/14 19:22:53 INFO : only14.rclone_chunk.001_ylzxzp: Moved (server-side) to: only14 2024/11/14 19:25:27 DEBUG : pacer: low level retry 1/10 (error Patch "https://cloud-api.yandex.com/v1/disk/resources?path=disk%3A%2Frclone-test-xabajel8saho%2Fboth15.rclone_chunk.001_ym2ikm": dial tcp: lookup cloud-api.yandex.com on 127.0.0.53:53: read udp 127.0.0.1:37985->127.0.0.53:53: i/o timeout) 2024/11/14 19:25:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/14 19:25:46 DEBUG : pacer: Reducing sleep to 15ms 2024/11/14 19:25:48 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/14 19:25:49 DEBUG : pacer: Reducing sleep to 10ms 2024/11/14 19:26:17 INFO : both15.rclone_chunk.001_ym2ikm: Moved (server-side) to: both15 2024/11/14 19:27:03 DEBUG : pacer: low level retry 1/1 (error Put "https://uploader39o.disk.yandex.net:443/upload-target/20241114T222638.375.utd.14j6asje0u4z3i0rjr3adbrnk-k39o.6641735": dial tcp: lookup uploader39o.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:44868->127.0.0.53:53: i/o timeout) 2024/11/14 19:27:04 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "only15" to Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': 1/10 (Put "https://uploader39o.disk.yandex.net:443/upload-target/20241114T222638.375.utd.14j6asje0u4z3i0rjr3adbrnk-k39o.6641735": dial tcp: lookup uploader39o.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:44868->127.0.0.53:53: i/o timeout) 2024/11/14 19:27:10 DEBUG : pacer: Reducing sleep to 15ms 2024/11/14 19:27:11 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/14 19:27:13 DEBUG : pacer: Reducing sleep to 10ms 2024/11/14 19:27:36 DEBUG : pacer: low level retry 1/1 (error Put "https://uploader76j.disk.yandex.net:443/upload-target/20241114T222714.246.utd.8i5g8xnsbe14421zcz9whcuj9-k76j.5856156": dial tcp: lookup uploader76j.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:59587->127.0.0.53:53: i/o timeout) 2024/11/14 19:27:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "only15" to Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': 2/10 (Put "https://uploader76j.disk.yandex.net:443/upload-target/20241114T222714.246.utd.8i5g8xnsbe14421zcz9whcuj9-k76j.5856156": dial tcp: lookup uploader76j.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:59587->127.0.0.53:53: i/o timeout) 2024/11/14 19:29:39 DEBUG : pacer: Reducing sleep to 15ms 2024/11/14 19:31:09 DEBUG : pacer: low level retry 1/10 (error Get "https://cloud-api.yandex.com/v1/disk/resources?path=disk%3A%2Frclone-test-xabajel8saho%2Fonly15.rclone_chunk.001_ymdrgk": dial tcp: lookup cloud-api.yandex.com on 127.0.0.53:53: dial udp 127.0.0.53:53: i/o timeout) 2024/11/14 19:31:54 DEBUG : pacer: Rate limited, increasing sleep to 30ms 2024/11/14 19:32:03 DEBUG : pacer: Reducing sleep to 22.5ms 2024/11/14 19:32:05 DEBUG : pacer: Reducing sleep to 16.875ms 2024/11/14 19:32:09 DEBUG : pacer: Reducing sleep to 12.65625ms 2024/11/14 19:32:32 DEBUG : pacer: low level retry 1/1 (error Put "https://uploader50j.disk.yandex.net:443/upload-target/20241114T223207.419.utd.81kpijswgy94qyp604ss9x0qq-k50j.6103679": dial tcp: lookup uploader50j.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:43756->127.0.0.53:53: i/o timeout) 2024/11/14 19:32:35 DEBUG : pacer: Rate limited, increasing sleep to 25.3125ms run.go:281: Retry Put of "only15" to Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': 3/10 (Put "https://uploader50j.disk.yandex.net:443/upload-target/20241114T223207.419.utd.81kpijswgy94qyp604ss9x0qq-k50j.6103679": dial tcp: lookup uploader50j.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:43756->127.0.0.53:53: i/o timeout) 2024/11/14 19:33:04 DEBUG : pacer: Reducing sleep to 18.984375ms 2024/11/14 19:33:24 DEBUG : pacer: Reducing sleep to 14.238281ms 2024/11/14 19:33:27 DEBUG : pacer: Reducing sleep to 10.67871ms 2024/11/14 19:33:32 DEBUG : pacer: Reducing sleep to 10ms 2024/11/14 19:33:44 DEBUG : pacer: low level retry 1/1 (error Put "https://uploader15g.disk.yandex.net:443/upload-target/20241114T223330.728.utd.44kfzt1ofo0ykkndg3toxdx38-k15g.6116873": dial tcp: lookup uploader15g.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:56974->127.0.0.53:53: i/o timeout) 2024/11/14 19:33:44 DEBUG : pacer: Rate limited, increasing sleep to 20ms run.go:281: Retry Put of "only15" to Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': 4/10 (Put "https://uploader15g.disk.yandex.net:443/upload-target/20241114T223330.728.utd.44kfzt1ofo0ykkndg3toxdx38-k15g.6116873": dial tcp: lookup uploader15g.disk.yandex.net on 127.0.0.53:53: read udp 127.0.0.1:56974->127.0.0.53:53: i/o timeout) 2024/11/14 19:33:50 DEBUG : pacer: Reducing sleep to 15ms 2024/11/14 19:33:50 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/14 19:33:50 DEBUG : pacer: Reducing sleep to 10ms 2024/11/14 19:33:59 INFO : only15.rclone_chunk.001_ymko48: Moved (server-side) to: only15 2024/11/14 19:34:07 INFO : both16.rclone_chunk.001_ymkyos: Moved (server-side) to: both16 2024/11/14 19:34:13 INFO : only16.rclone_chunk.001_yml5un: Moved (server-side) to: only16 2024/11/14 19:34:22 INFO : both17.rclone_chunk.001_ymlbyt: Moved (server-side) to: both17 2024/11/14 19:34:28 INFO : only17.rclone_chunk.001_ymlke6: Moved (server-side) to: only17 2024/11/14 19:34:34 INFO : both18.rclone_chunk.001_ymlq03: Moved (server-side) to: both18 2024/11/14 19:34:41 INFO : only18.rclone_chunk.001_ymlw6v: Moved (server-side) to: only18 2024/11/14 19:34:48 INFO : both19.rclone_chunk.001_ymm3tx: Moved (server-side) to: both19 2024/11/14 19:34:55 INFO : only19.rclone_chunk.001_ymmajw: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2638 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2652 Error: Should be true Test: TestSyncConcurrentDelete Messages: only10: Modification time difference too big |-208455h9m52.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2024-11-14 19:14:59 +0000 UTC) (precision 1ns) 2024/11/14 19:34:56 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': Waiting for checks to finish 2024/11/14 19:34:56 DEBUG : both0: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both12: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both13: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both1: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both10: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both11: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both14: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both18: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both15: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both16: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both17: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both19: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both2: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both3: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both4: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both8: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:34:56 DEBUG : both5: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both6: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both7: Unchanged skipping 2024/11/14 19:34:56 DEBUG : both9: Unchanged skipping 2024/11/14 19:34:56 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': Waiting for transfers to finish 2024/11/14 19:34:56 DEBUG : Waiting for deletions to finish 2024/11/14 19:34:58 INFO : only14: Deleted 2024/11/14 19:34:58 INFO : only4: Deleted 2024/11/14 19:34:58 INFO : only16: Deleted 2024/11/14 19:34:58 INFO : only2: Deleted 2024/11/14 19:34:59 INFO : only11: Deleted 2024/11/14 19:34:59 INFO : only8: Deleted 2024/11/14 19:34:59 INFO : only1: Deleted 2024/11/14 19:35:00 INFO : only18: Deleted 2024/11/14 19:35:00 INFO : only10: Deleted 2024/11/14 19:35:00 INFO : only19: Deleted 2024/11/14 19:35:01 INFO : only7: Deleted 2024/11/14 19:35:02 INFO : only15: Deleted 2024/11/14 19:35:02 INFO : only13: Deleted 2024/11/14 19:35:03 INFO : only17: Deleted 2024/11/14 19:35:03 INFO : only0: Deleted 2024/11/14 19:35:04 INFO : only12: Deleted 2024/11/14 19:35:04 INFO : only3: Deleted 2024/11/14 19:35:04 INFO : only6: Deleted 2024/11/14 19:35:05 INFO : only5: Deleted 2024/11/14 19:35:07 INFO : only9: Deleted 2024/11/14 19:35:07 INFO : There was nothing to transfer run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho'", Local "Local file system at /tmp/rclone417803115", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (1396.69s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho'", Local "Local file system at /tmp/rclone417803115", Modify Window "1ns" 2024/11/14 19:36:11 INFO : both0.rclone_chunk.001_ymob4r: Moved (server-side) to: both0 2024/11/14 19:36:17 INFO : only0.rclone_chunk.001_ymomx9: Moved (server-side) to: only0 2024/11/14 19:36:21 INFO : both1.rclone_chunk.001_ymor97: Moved (server-side) to: both1 2024/11/14 19:36:26 INFO : only1.rclone_chunk.001_ymow46: Moved (server-side) to: only1 2024/11/14 19:36:31 INFO : both2.rclone_chunk.001_ymp0q8: Moved (server-side) to: both2 2024/11/14 19:36:41 INFO : only2.rclone_chunk.001_ymp53p: Moved (server-side) to: only2 2024/11/14 19:36:47 INFO : both3.rclone_chunk.001_ympf20: Moved (server-side) to: both3 2024/11/14 19:37:00 INFO : only3.rclone_chunk.001_ympla5: Moved (server-side) to: only3 2024/11/14 19:37:06 INFO : both4.rclone_chunk.001_ympzjc: Moved (server-side) to: both4 2024/11/14 19:37:10 INFO : only4.rclone_chunk.001_ymq4vo: Moved (server-side) to: only4 2024/11/14 19:37:19 INFO : both5.rclone_chunk.001_ymq85w: Moved (server-side) to: both5 2024/11/14 19:37:25 INFO : only5.rclone_chunk.001_ymqhmu: Moved (server-side) to: only5 2024/11/14 19:37:30 INFO : both6.rclone_chunk.001_ymqo0t: Moved (server-side) to: both6 2024/11/14 19:37:38 INFO : only6.rclone_chunk.001_ymqtiw: Moved (server-side) to: only6 2024/11/14 19:37:46 INFO : both7.rclone_chunk.001_ymr0p0: Moved (server-side) to: both7 2024/11/14 19:37:52 INFO : only7.rclone_chunk.001_ymr8az: Moved (server-side) to: only7 2024/11/14 19:37:57 INFO : both8.rclone_chunk.001_ymreta: Moved (server-side) to: both8 2024/11/14 19:38:08 INFO : only8.rclone_chunk.001_ymrjoz: Moved (server-side) to: only8 2024/11/14 19:38:14 INFO : both9.rclone_chunk.001_ymru83: Moved (server-side) to: both9 2024/11/14 19:38:18 INFO : only9.rclone_chunk.001_yms0tl: Moved (server-side) to: only9 2024/11/14 19:38:28 INFO : both10.rclone_chunk.001_yms6qq: Moved (server-side) to: both10 2024/11/14 19:38:35 INFO : only10.rclone_chunk.001_ymsfjz: Moved (server-side) to: only10 2024/11/14 19:38:40 INFO : both11.rclone_chunk.001_ymslme: Moved (server-side) to: both11 2024/11/14 19:38:45 INFO : only11.rclone_chunk.001_ymsq0h: Moved (server-side) to: only11 2024/11/14 19:38:52 INFO : both12.rclone_chunk.001_ymsvzk: Moved (server-side) to: both12 2024/11/14 19:38:57 INFO : only12.rclone_chunk.001_ymt2yf: Moved (server-side) to: only12 2024/11/14 19:39:02 INFO : both13.rclone_chunk.001_ymt7vg: Moved (server-side) to: both13 2024/11/14 19:39:13 INFO : only13.rclone_chunk.001_ymtcf4: Moved (server-side) to: only13 2024/11/14 19:39:20 INFO : both14.rclone_chunk.001_ymto7u: Moved (server-side) to: both14 2024/11/14 19:39:26 INFO : only14.rclone_chunk.001_ymtv9g: Moved (server-side) to: only14 2024/11/14 19:39:32 INFO : both15.rclone_chunk.001_ymu0qz: Moved (server-side) to: both15 2024/11/14 19:39:37 INFO : only15.rclone_chunk.001_ymu63o: Moved (server-side) to: only15 2024/11/14 19:39:43 INFO : both16.rclone_chunk.001_ymucjd: Moved (server-side) to: both16 2024/11/14 19:39:48 INFO : only16.rclone_chunk.001_ymui2d: Moved (server-side) to: only16 2024/11/14 19:39:54 INFO : both17.rclone_chunk.001_ymunxi: Moved (server-side) to: both17 2024/11/14 19:39:59 INFO : only17.rclone_chunk.001_ymusye: Moved (server-side) to: only17 2024/11/14 19:40:04 INFO : both18.rclone_chunk.001_ymuxka: Moved (server-side) to: both18 2024/11/14 19:40:10 INFO : only18.rclone_chunk.001_ymv3wc: Moved (server-side) to: only18 2024/11/14 19:40:16 INFO : both19.rclone_chunk.001_ymv9lp: Moved (server-side) to: both19 2024/11/14 19:40:23 INFO : only19.rclone_chunk.001_ymvf2x: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2638 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2656 Error: Should be true Test: TestSyncConcurrentTruncate Messages: both10: Modification time difference too big |-208455h33m21.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2024-11-14 19:38:28 +0000 UTC) (precision 1ns) 2024/11/14 19:40:24 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both10: Modification times differ by 208455h33m21.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2024-11-14 19:38:28 +0000 UTC 2024/11/14 19:40:24 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': Waiting for checks to finish 2024/11/14 19:40:24 DEBUG : both0: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both10: md5 = 8ee2027983915ec78acc45027d874316 OK 2024/11/14 19:40:24 DEBUG : both12: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both1: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both14: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both11: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both13: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both17: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both18: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both15: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both16: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both3: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both19: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both2: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both6: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both7: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both8: Unchanged skipping 2024/11/14 19:40:24 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2024/11/14 19:40:24 DEBUG : both9: Unchanged skipping 2024/11/14 19:40:24 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : both4: Unchanged skipping 2024/11/14 19:40:24 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : both5: Unchanged skipping 2024/11/14 19:40:24 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only0: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:24 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only10: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:24 DEBUG : only12: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:24 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only13: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:24 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:24 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2024/11/14 19:40:25 INFO : both10: Updated modification time in destination 2024/11/14 19:40:25 DEBUG : both10: Unchanged skipping 2024/11/14 19:40:25 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': Waiting for transfers to finish 2024/11/14 19:40:29 INFO : only10: Deleted 2024/11/14 19:40:29 INFO : only0: Deleted 2024/11/14 19:40:30 INFO : only12: Deleted 2024/11/14 19:40:31 INFO : only0.rclone_chunk.001_ymvm9i: Moved (server-side) to: only0 2024/11/14 19:40:31 DEBUG : only0: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:31 INFO : only0: Copied (replaced existing) 2024/11/14 19:40:31 DEBUG : only11: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:31 INFO : only10.rclone_chunk.001_ymvmzn: Moved (server-side) to: only10 2024/11/14 19:40:31 DEBUG : only10: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:31 INFO : only10: Copied (replaced existing) 2024/11/14 19:40:31 DEBUG : only1: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:33 INFO : only12.rclone_chunk.001_ymvmfi: Moved (server-side) to: only12 2024/11/14 19:40:33 DEBUG : only12: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:33 INFO : only12: Copied (replaced existing) 2024/11/14 19:40:33 DEBUG : only14: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:34 INFO : only13: Deleted 2024/11/14 19:40:35 INFO : only13.rclone_chunk.001_ymvmlp: Moved (server-side) to: only13 2024/11/14 19:40:35 DEBUG : only13: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:35 INFO : only13: Copied (replaced existing) 2024/11/14 19:40:35 DEBUG : only15: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:37 INFO : only11: Deleted 2024/11/14 19:40:40 INFO : only1: Deleted 2024/11/14 19:40:40 INFO : only11.rclone_chunk.001_ymvtkg: Moved (server-side) to: only11 2024/11/14 19:40:40 DEBUG : only11: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:40 INFO : only11: Copied (replaced existing) 2024/11/14 19:40:40 DEBUG : only18: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:40 INFO : only14: Deleted 2024/11/14 19:40:41 INFO : only15: Deleted 2024/11/14 19:40:41 INFO : only1.rclone_chunk.001_ymvtbv: Moved (server-side) to: only1 2024/11/14 19:40:41 DEBUG : only1: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:41 INFO : only1: Copied (replaced existing) 2024/11/14 19:40:41 DEBUG : only19: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:42 INFO : only14.rclone_chunk.001_ymvv4f: Moved (server-side) to: only14 2024/11/14 19:40:42 DEBUG : only14: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:42 INFO : only14: Copied (replaced existing) 2024/11/14 19:40:42 DEBUG : only2: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:42 INFO : only15.rclone_chunk.001_ymvxb9: Moved (server-side) to: only15 2024/11/14 19:40:42 DEBUG : only15: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:42 INFO : only15: Copied (replaced existing) 2024/11/14 19:40:42 DEBUG : only3: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:47 INFO : only19: Deleted 2024/11/14 19:40:48 INFO : only2: Deleted 2024/11/14 19:40:48 INFO : only3: Deleted 2024/11/14 19:40:49 INFO : only19.rclone_chunk.001_ymw3cs: Moved (server-side) to: only19 2024/11/14 19:40:49 DEBUG : only19: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:49 INFO : only19: Copied (replaced existing) 2024/11/14 19:40:49 DEBUG : only4: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:50 INFO : only2.rclone_chunk.001_ymw4qz: Moved (server-side) to: only2 2024/11/14 19:40:50 DEBUG : only2: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:50 INFO : only2: Copied (replaced existing) 2024/11/14 19:40:50 DEBUG : only5: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:50 INFO : only3.rclone_chunk.001_ymw484: Moved (server-side) to: only3 2024/11/14 19:40:50 DEBUG : only3: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:50 INFO : only3: Copied (replaced existing) 2024/11/14 19:40:50 DEBUG : only6: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:50 INFO : only18: Deleted 2024/11/14 19:40:52 INFO : only18.rclone_chunk.001_ymw26t: Moved (server-side) to: only18 2024/11/14 19:40:52 DEBUG : only18: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:52 INFO : only18: Copied (replaced existing) 2024/11/14 19:40:52 DEBUG : only7: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:55 INFO : only4: Deleted 2024/11/14 19:40:56 INFO : only5: Deleted 2024/11/14 19:40:57 INFO : only7: Deleted 2024/11/14 19:40:57 INFO : only4.rclone_chunk.001_ymwbmj: Moved (server-side) to: only4 2024/11/14 19:40:57 DEBUG : only4: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:57 INFO : only4: Copied (replaced existing) 2024/11/14 19:40:57 DEBUG : only8: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:58 INFO : only5.rclone_chunk.001_ymwcb1: Moved (server-side) to: only5 2024/11/14 19:40:58 DEBUG : only5: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:58 INFO : only5: Copied (replaced existing) 2024/11/14 19:40:58 DEBUG : only9: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:40:59 INFO : only7.rclone_chunk.001_ymwey1: Moved (server-side) to: only7 2024/11/14 19:40:59 DEBUG : only7: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:40:59 INFO : only7: Copied (replaced existing) 2024/11/14 19:40:59 DEBUG : only16: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:41:00 INFO : only6: Deleted 2024/11/14 19:41:02 INFO : only8: Deleted 2024/11/14 19:41:02 INFO : only6.rclone_chunk.001_ymwc2v: Moved (server-side) to: only6 2024/11/14 19:41:02 DEBUG : only6: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:41:02 INFO : only6: Copied (replaced existing) 2024/11/14 19:41:02 DEBUG : only17: skip slow MD5 on source file, hashing in-transit 2024/11/14 19:41:04 INFO : only8.rclone_chunk.001_ymwj1d: Moved (server-side) to: only8 2024/11/14 19:41:04 DEBUG : only8: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:41:04 INFO : only8: Copied (replaced existing) 2024/11/14 19:41:04 INFO : only9: Deleted 2024/11/14 19:41:05 INFO : only16: Deleted 2024/11/14 19:41:06 INFO : only9.rclone_chunk.001_ymwk2n: Moved (server-side) to: only9 2024/11/14 19:41:06 DEBUG : only9: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:41:06 INFO : only9: Copied (replaced existing) 2024/11/14 19:41:06 INFO : only16.rclone_chunk.001_ymwlrn: Moved (server-side) to: only16 2024/11/14 19:41:06 DEBUG : only16: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:41:06 INFO : only16: Copied (replaced existing) 2024/11/14 19:41:11 INFO : only17: Deleted 2024/11/14 19:41:13 INFO : only17.rclone_chunk.001_ymwojn: Moved (server-side) to: only17 2024/11/14 19:41:13 DEBUG : only17: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/14 19:41:13 INFO : only17: Copied (replaced existing) 2024/11/14 19:41:13 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho'", Local "Local file system at /tmp/rclone417803115", Modify Window "1ns" --- FAIL: TestSyncConcurrentTruncate (375.27s) FAIL 2024/11/14 19:42:16 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xabajel8saho': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Finished ERROR in 29m36.873604821s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete TestSyncConcurrentTruncate]