"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^TestSyncConcurrentTruncate$'" - Starting (try 4/5) 2025/01/27 02:26:04 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-wexicod9qupa" 2025/01/27 02:26:04 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/27 02:26:04 DEBUG : Creating backend with remote "TestYandex:rclone-test-wexicod9qupa" 2025/01/27 02:26:05 DEBUG : Reset feature "ListR" 2025/01/27 02:26:05 DEBUG : Creating backend with remote "/tmp/rclone4022263846" === RUN TestSyncConcurrentTruncate run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-wexicod9qupa'", Local "Local file system at /tmp/rclone4022263846", Modify Window "1ns" 2025/01/27 02:26:09 INFO : both0.rclone_chunk.001_qccjpf: Moved (server-side) to: both0 2025/01/27 02:26:13 INFO : only0.rclone_chunk.001_qccokm: Moved (server-side) to: only0 2025/01/27 02:26:18 INFO : both1.rclone_chunk.001_qccsq0: Moved (server-side) to: both1 2025/01/27 02:26:23 INFO : only1.rclone_chunk.001_qccxd7: Moved (server-side) to: only1 2025/01/27 02:26:31 INFO : both2.rclone_chunk.001_qcd2d9: Moved (server-side) to: both2 2025/01/27 02:26:35 INFO : only2.rclone_chunk.001_qcd99s: Moved (server-side) to: only2 2025/01/27 02:26:40 INFO : both3.rclone_chunk.001_qcddpv: Moved (server-side) to: both3 2025/01/27 02:26:48 INFO : only3.rclone_chunk.001_qcdj1m: Moved (server-side) to: only3 2025/01/27 02:26:52 INFO : both4.rclone_chunk.001_qcdqi2: Moved (server-side) to: both4 2025/01/27 02:26:58 INFO : only4.rclone_chunk.001_qcduod: Moved (server-side) to: only4 2025/01/27 02:27:02 INFO : both5.rclone_chunk.001_qce02m: Moved (server-side) to: both5 2025/01/27 02:27:06 INFO : only5.rclone_chunk.001_qce43f: Moved (server-side) to: only5 2025/01/27 02:27:11 INFO : both6.rclone_chunk.001_qce93l: Moved (server-side) to: both6 2025/01/27 02:27:16 INFO : only6.rclone_chunk.001_qcednt: Moved (server-side) to: only6 2025/01/27 02:27:21 INFO : both7.rclone_chunk.001_qceieo: Moved (server-side) to: both7 2025/01/27 02:27:29 INFO : only7.rclone_chunk.001_qcer33: Moved (server-side) to: only7 2025/01/27 02:27:37 INFO : both8.rclone_chunk.001_qcewzz: Moved (server-side) to: both8 2025/01/27 02:27:41 INFO : only8.rclone_chunk.001_qcf3cf: Moved (server-side) to: only8 2025/01/27 02:27:46 INFO : both9.rclone_chunk.001_qcf8xs: Moved (server-side) to: both9 2025/01/27 02:27:52 INFO : only9.rclone_chunk.001_qcfd7m: Moved (server-side) to: only9 2025/01/27 02:27:56 INFO : both10.rclone_chunk.001_qcfi22: Moved (server-side) to: both10 2025/01/27 02:28:01 INFO : only10.rclone_chunk.001_qcfnyt: Moved (server-side) to: only10 2025/01/27 02:28:06 INFO : both11.rclone_chunk.001_qcfrd2: Moved (server-side) to: both11 2025/01/27 02:28:10 INFO : only11.rclone_chunk.001_qcfw28: Moved (server-side) to: only11 2025/01/27 02:28:14 INFO : both12.rclone_chunk.001_qcg1s6: Moved (server-side) to: both12 2025/01/27 02:28:17 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/27 02:28:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/27 02:28:18 DEBUG : pacer: Reducing sleep to 15ms 2025/01/27 02:28:18 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/27 02:28:18 DEBUG : pacer: Reducing sleep to 10ms 2025/01/27 02:28:20 INFO : only12.rclone_chunk.001_qcg569: Moved (server-side) to: only12 2025/01/27 02:28:30 INFO : both13.rclone_chunk.001_qcgaqt: Moved (server-side) to: both13 2025/01/27 02:28:35 INFO : only13.rclone_chunk.001_qcgkff: Moved (server-side) to: only13 2025/01/27 02:28:40 INFO : both14.rclone_chunk.001_qcgpjz: Moved (server-side) to: both14 2025/01/27 02:28:44 INFO : only14.rclone_chunk.001_qcgu3d: Moved (server-side) to: only14 2025/01/27 02:28:49 INFO : both15.rclone_chunk.001_qcgyrm: Moved (server-side) to: both15 2025/01/27 02:28:54 INFO : only15.rclone_chunk.001_qch3gb: Moved (server-side) to: only15 2025/01/27 02:28:58 INFO : both16.rclone_chunk.001_qch8fb: Moved (server-side) to: both16 2025/01/27 02:29:03 INFO : only16.rclone_chunk.001_qchcau: Moved (server-side) to: only16 2025/01/27 02:29:10 INFO : both17.rclone_chunk.001_qchhbz: Moved (server-side) to: both17 2025/01/27 02:29:15 INFO : only17.rclone_chunk.001_qchpo7: Moved (server-side) to: only17 2025/01/27 02:29:19 INFO : both18.rclone_chunk.001_qchtjr: Moved (server-side) to: both18 2025/01/27 02:29:25 INFO : only18.rclone_chunk.001_qchxs6: Moved (server-side) to: only18 2025/01/27 02:29:30 INFO : both19.rclone_chunk.001_qci3s8: Moved (server-side) to: both19 2025/01/27 02:29:36 INFO : only19.rclone_chunk.001_qci89g: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2762 Error: Should be true Test: TestSyncConcurrentTruncate Messages: both11: Modification time difference too big |-210214h22m58.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-27 02:28:05 +0000 UTC) (precision 1ns) 2025/01/27 02:29:37 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wexicod9qupa': Waiting for checks to finish 2025/01/27 02:29:37 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both11: Modification times differ by 210214h22m58.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-01-27 02:28:05 +0000 UTC 2025/01/27 02:29:37 DEBUG : both0: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both11: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/01/27 02:29:37 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both12: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both13: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both14: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both15: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both16: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both1: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both18: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both19: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both2: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both3: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both4: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both5: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both6: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both7: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both8: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/27 02:29:37 DEBUG : both9: Unchanged skipping 2025/01/27 02:29:37 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/01/27 02:29:37 DEBUG : both10: Unchanged skipping 2025/01/27 02:29:37 DEBUG : both17: Unchanged skipping 2025/01/27 02:29:37 DEBUG : only0: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:37 DEBUG : only1: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:37 DEBUG : only10: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:37 DEBUG : only11: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:37 INFO : both11: Updated modification time in destination 2025/01/27 02:29:37 DEBUG : both11: Unchanged skipping 2025/01/27 02:29:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wexicod9qupa': Waiting for transfers to finish 2025/01/27 02:29:43 INFO : only11: Deleted 2025/01/27 02:29:43 INFO : only1: Deleted 2025/01/27 02:29:43 INFO : only0: Deleted 2025/01/27 02:29:44 INFO : only10: Deleted 2025/01/27 02:29:45 INFO : only1.rclone_chunk.001_qcifhq: Moved (server-side) to: only1 2025/01/27 02:29:45 DEBUG : only1: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:45 INFO : only1: Copied (replaced existing) 2025/01/27 02:29:45 DEBUG : only12: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:45 INFO : only0.rclone_chunk.001_qcifha: Moved (server-side) to: only0 2025/01/27 02:29:45 DEBUG : only0: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:45 INFO : only0: Copied (replaced existing) 2025/01/27 02:29:45 DEBUG : only13: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:45 INFO : only11.rclone_chunk.001_qcifq6: Moved (server-side) to: only11 2025/01/27 02:29:45 DEBUG : only11: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:45 INFO : only11: Copied (replaced existing) 2025/01/27 02:29:45 DEBUG : only14: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:46 INFO : only10.rclone_chunk.001_qcifzh: Moved (server-side) to: only10 2025/01/27 02:29:46 DEBUG : only10: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:46 INFO : only10: Copied (replaced existing) 2025/01/27 02:29:46 DEBUG : only15: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:51 INFO : only12: Deleted 2025/01/27 02:29:52 INFO : only13: Deleted 2025/01/27 02:29:52 INFO : only12.rclone_chunk.001_qcinii: Moved (server-side) to: only12 2025/01/27 02:29:52 DEBUG : only12: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:52 INFO : only12: Copied (replaced existing) 2025/01/27 02:29:52 DEBUG : only16: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:53 INFO : only15: Deleted 2025/01/27 02:29:53 INFO : only14: Deleted 2025/01/27 02:29:54 INFO : only13.rclone_chunk.001_qcinw0: Moved (server-side) to: only13 2025/01/27 02:29:54 DEBUG : only13: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:54 INFO : only13: Copied (replaced existing) 2025/01/27 02:29:54 DEBUG : only17: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:54 INFO : only15.rclone_chunk.001_qcioc2: Moved (server-side) to: only15 2025/01/27 02:29:54 DEBUG : only15: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:54 INFO : only15: Copied (replaced existing) 2025/01/27 02:29:54 DEBUG : only18: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:55 INFO : only14.rclone_chunk.001_qcinmq: Moved (server-side) to: only14 2025/01/27 02:29:55 DEBUG : only14: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:29:55 INFO : only14: Copied (replaced existing) 2025/01/27 02:29:55 DEBUG : only19: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:29:59 INFO : only16: Deleted 2025/01/27 02:30:00 INFO : only16.rclone_chunk.001_qciuad: Moved (server-side) to: only16 2025/01/27 02:30:00 DEBUG : only16: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:00 INFO : only16: Copied (replaced existing) 2025/01/27 02:30:00 DEBUG : only2: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:01 INFO : only17: Deleted 2025/01/27 02:30:01 INFO : only18: Deleted 2025/01/27 02:30:01 INFO : only19: Deleted 2025/01/27 02:30:02 INFO : only17.rclone_chunk.001_qciwrv: Moved (server-side) to: only17 2025/01/27 02:30:02 DEBUG : only17: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:02 INFO : only17: Copied (replaced existing) 2025/01/27 02:30:02 DEBUG : only3: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:02 INFO : only18.rclone_chunk.001_qciwjp: Moved (server-side) to: only18 2025/01/27 02:30:02 DEBUG : only18: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:02 INFO : only18: Copied (replaced existing) 2025/01/27 02:30:02 DEBUG : only4: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:03 INFO : only19.rclone_chunk.001_qcixa7: Moved (server-side) to: only19 2025/01/27 02:30:03 DEBUG : only19: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:03 INFO : only19: Copied (replaced existing) 2025/01/27 02:30:03 DEBUG : only5: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:07 INFO : only2: Deleted 2025/01/27 02:30:09 INFO : only2.rclone_chunk.001_qcj2in: Moved (server-side) to: only2 2025/01/27 02:30:09 DEBUG : only2: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:09 INFO : only2: Copied (replaced existing) 2025/01/27 02:30:09 DEBUG : only6: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:09 INFO : only3: Deleted 2025/01/27 02:30:09 INFO : only4: Deleted 2025/01/27 02:30:10 INFO : only5: Deleted 2025/01/27 02:30:11 INFO : only4.rclone_chunk.001_qcj4jq: Moved (server-side) to: only4 2025/01/27 02:30:11 DEBUG : only4: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:11 INFO : only4: Copied (replaced existing) 2025/01/27 02:30:11 DEBUG : only7: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:11 INFO : only3.rclone_chunk.001_qcj45g: Moved (server-side) to: only3 2025/01/27 02:30:11 DEBUG : only3: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:11 INFO : only3: Copied (replaced existing) 2025/01/27 02:30:11 DEBUG : only8: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:13 INFO : only5.rclone_chunk.001_qcj5vd: Moved (server-side) to: only5 2025/01/27 02:30:13 DEBUG : only5: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:13 INFO : only5: Copied (replaced existing) 2025/01/27 02:30:13 DEBUG : only9: skip slow MD5 on source file, hashing in-transit 2025/01/27 02:30:15 INFO : only6: Deleted 2025/01/27 02:30:17 INFO : only6.rclone_chunk.001_qcjb1j: Moved (server-side) to: only6 2025/01/27 02:30:17 DEBUG : only6: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:17 INFO : only6: Copied (replaced existing) 2025/01/27 02:30:18 INFO : only8: Deleted 2025/01/27 02:30:19 INFO : only9: Deleted 2025/01/27 02:30:20 INFO : only7: Deleted 2025/01/27 02:30:20 INFO : only8.rclone_chunk.001_qcjdsi: Moved (server-side) to: only8 2025/01/27 02:30:20 DEBUG : only8: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:20 INFO : only8: Copied (replaced existing) 2025/01/27 02:30:21 INFO : only9.rclone_chunk.001_qcjfjp: Moved (server-side) to: only9 2025/01/27 02:30:21 DEBUG : only9: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:21 INFO : only9: Copied (replaced existing) 2025/01/27 02:30:21 INFO : only7.rclone_chunk.001_qcjdq6: Moved (server-side) to: only7 2025/01/27 02:30:21 DEBUG : only7: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/27 02:30:21 INFO : only7: Copied (replaced existing) 2025/01/27 02:30:21 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-wexicod9qupa'", Local "Local file system at /tmp/rclone4022263846", Modify Window "1ns" --- FAIL: TestSyncConcurrentTruncate (383.18s) FAIL 2025/01/27 02:32:28 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wexicod9qupa': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^TestSyncConcurrentTruncate$'" - Finished ERROR in 6m31.752792818s (try 4/5): exit status 1: Failed [TestSyncConcurrentTruncate]