"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncBackupDir|TestSyncBackupDirSuffixOnly|TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Starting (try 2/5) 2025/01/25 03:46:09 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi" 2025/01/25 03:46:09 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/25 03:46:09 DEBUG : Creating backend with remote "TestYandex:rclone-test-goxesoz9yexi" 2025/01/25 03:46:09 DEBUG : Reset feature "ListR" 2025/01/25 03:46:09 DEBUG : Creating backend with remote "/tmp/rclone2300928462" === RUN TestSyncBackupDir run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi'", Local "Local file system at /tmp/rclone2300928462", Modify Window "1ns" 2025/01/25 03:46:17 INFO : dst/one.rclone_chunk.001_mqq072: Moved (server-side) to: dst/one 2025/01/25 03:46:24 INFO : dst/two.rclone_chunk.001_mqq7nk: Moved (server-side) to: dst/two 2025/01/25 03:46:30 INFO : dst/three.txt.rclone_chunk.001_mqqezt: Moved (server-side) to: dst/three.txt 2025/01/25 03:46:30 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst" 2025/01/25 03:46:30 DEBUG : Creating backend with remote "TestYandex:rclone-test-goxesoz9yexi/dst" 2025/01/25 03:46:31 DEBUG : Reset feature "ListR" 2025/01/25 03:46:31 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/backup" 2025/01/25 03:46:31 DEBUG : Creating backend with remote "TestYandex:rclone-test-goxesoz9yexi/backup" 2025/01/25 03:46:31 DEBUG : Reset feature "ListR" 2025/01/25 03:46:32 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/01/25 03:46:32 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:46:32 DEBUG : two: Unchanged skipping 2025/01/25 03:46:32 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for checks to finish 2025/01/25 03:46:32 DEBUG : one: move non-chunked object... 2025/01/25 03:46:34 INFO : one: Moved (server-side) 2025/01/25 03:46:34 INFO : one: Moved (server-side) 2025/01/25 03:46:34 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for transfers to finish 2025/01/25 03:46:34 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:46:39 INFO : one.rclone_chunk.001_mqqocj: Moved (server-side) to: one 2025/01/25 03:46:39 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/01/25 03:46:39 INFO : one: Copied (new) 2025/01/25 03:46:39 DEBUG : Waiting for deletions to finish 2025/01/25 03:46:39 DEBUG : three.txt: move non-chunked object... 2025/01/25 03:46:41 INFO : three.txt: Moved (server-side) 2025/01/25 03:46:41 INFO : three.txt: Moved (server-side) 2025/01/25 03:46:41 INFO : three.txt: Moved into backup dir 2025/01/25 03:46:46 INFO : dst/three.txt.rclone_chunk.001_mqqwjx: Moved (server-side) to: dst/three.txt 2025/01/25 03:46:47 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/01/25 03:46:47 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:46:47 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for checks to finish 2025/01/25 03:46:47 DEBUG : two: Unchanged skipping 2025/01/25 03:46:51 INFO : one: Deleted 2025/01/25 03:46:51 DEBUG : one: move non-chunked object... 2025/01/25 03:46:52 INFO : one: Moved (server-side) 2025/01/25 03:46:52 INFO : one: Moved (server-side) 2025/01/25 03:46:52 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for transfers to finish 2025/01/25 03:46:52 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:46:59 INFO : one.rclone_chunk.001_mqr6q2: Moved (server-side) to: one 2025/01/25 03:46:59 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/01/25 03:46:59 INFO : one: Copied (new) 2025/01/25 03:46:59 DEBUG : Waiting for deletions to finish 2025/01/25 03:47:03 INFO : three.txt: Deleted 2025/01/25 03:47:03 DEBUG : three.txt: move non-chunked object... 2025/01/25 03:47:05 INFO : three.txt: Moved (server-side) 2025/01/25 03:47:05 INFO : three.txt: Moved (server-side) 2025/01/25 03:47:05 INFO : three.txt: Moved into backup dir --- PASS: TestSyncBackupDir (76.25s) === RUN TestSyncBackupDirSuffixOnly run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi'", Local "Local file system at /tmp/rclone2300928462", Modify Window "1ns" 2025/01/25 03:47:30 INFO : dst/one.rclone_chunk.001_mqs4gs: Moved (server-side) to: dst/one 2025/01/25 03:47:39 INFO : dst/two.rclone_chunk.001_mqs8bs: Moved (server-side) to: dst/two 2025/01/25 03:47:48 INFO : dst/three.txt.rclone_chunk.001_mqshre: Moved (server-side) to: dst/three.txt 2025/01/25 03:47:49 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst" 2025/01/25 03:47:49 DEBUG : Creating backend with remote "TestYandex:rclone-test-goxesoz9yexi/dst" 2025/01/25 03:47:49 DEBUG : Reset feature "ListR" 2025/01/25 03:47:50 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/01/25 03:47:50 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for checks to finish 2025/01/25 03:47:50 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:47:50 DEBUG : two: Unchanged skipping 2025/01/25 03:47:50 DEBUG : one: move non-chunked object... 2025/01/25 03:47:51 INFO : one: Moved (server-side) to: one.bak 2025/01/25 03:47:51 INFO : one: Moved (server-side) to: one.bak 2025/01/25 03:47:51 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for transfers to finish 2025/01/25 03:47:52 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:47:57 INFO : one.rclone_chunk.001_mqsu3n: Moved (server-side) to: one 2025/01/25 03:47:57 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/01/25 03:47:57 INFO : one: Copied (new) 2025/01/25 03:47:57 DEBUG : Waiting for deletions to finish 2025/01/25 03:47:57 DEBUG : three.txt: move non-chunked object... 2025/01/25 03:47:59 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/25 03:47:59 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/25 03:47:59 INFO : three.txt: Moved into backup dir 2025/01/25 03:48:04 INFO : dst/three.txt.rclone_chunk.001_mqt2sv: Moved (server-side) to: dst/three.txt 2025/01/25 03:48:05 DEBUG : one.bak: Excluded (Path Filter) 2025/01/25 03:48:05 DEBUG : one.bak: Excluded 2025/01/25 03:48:05 DEBUG : three.txt.bak: Excluded (Path Filter) 2025/01/25 03:48:05 DEBUG : three.txt.bak: Excluded 2025/01/25 03:48:05 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/01/25 03:48:05 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:48:05 DEBUG : two: Unchanged skipping 2025/01/25 03:48:05 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for checks to finish 2025/01/25 03:48:13 INFO : one.bak: Deleted 2025/01/25 03:48:13 DEBUG : one: move non-chunked object... 2025/01/25 03:48:15 INFO : one: Moved (server-side) to: one.bak 2025/01/25 03:48:15 INFO : one: Moved (server-side) to: one.bak 2025/01/25 03:48:15 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi/dst': Waiting for transfers to finish 2025/01/25 03:48:15 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:48:19 INFO : one.rclone_chunk.001_mqthcm: Moved (server-side) to: one 2025/01/25 03:48:19 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/01/25 03:48:19 INFO : one: Copied (new) 2025/01/25 03:48:19 DEBUG : Waiting for deletions to finish 2025/01/25 03:48:23 INFO : three.txt.bak: Deleted 2025/01/25 03:48:23 DEBUG : three.txt: move non-chunked object... 2025/01/25 03:48:24 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/25 03:48:24 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/25 03:48:24 INFO : three.txt: Moved into backup dir --- PASS: TestSyncBackupDirSuffixOnly (79.24s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi'", Local "Local file system at /tmp/rclone2300928462", Modify Window "1ns" 2025/01/25 03:48:50 INFO : both0.rclone_chunk.001_mqubjp: Moved (server-side) to: both0 2025/01/25 03:48:55 INFO : only0.rclone_chunk.001_mqugxm: Moved (server-side) to: only0 2025/01/25 03:49:00 INFO : both1.rclone_chunk.001_mqumi8: Moved (server-side) to: both1 2025/01/25 03:49:06 INFO : only1.rclone_chunk.001_mqurnd: Moved (server-side) to: only1 2025/01/25 03:49:11 INFO : both2.rclone_chunk.001_mqux1t: Moved (server-side) to: both2 2025/01/25 03:49:16 INFO : only2.rclone_chunk.001_mqv1uy: Moved (server-side) to: only2 2025/01/25 03:49:22 INFO : both3.rclone_chunk.001_mqv7pi: Moved (server-side) to: both3 2025/01/25 03:49:27 INFO : only3.rclone_chunk.001_mqvcfr: Moved (server-side) to: only3 2025/01/25 03:49:33 INFO : both4.rclone_chunk.001_mqvhnl: Moved (server-side) to: both4 2025/01/25 03:49:38 INFO : only4.rclone_chunk.001_mqvnj5: Moved (server-side) to: only4 2025/01/25 03:49:43 INFO : both5.rclone_chunk.001_mqvsux: Moved (server-side) to: both5 2025/01/25 03:49:48 INFO : only5.rclone_chunk.001_mqvxl5: Moved (server-side) to: only5 2025/01/25 03:49:53 INFO : both6.rclone_chunk.001_mqw3f2: Moved (server-side) to: both6 2025/01/25 03:49:58 INFO : only6.rclone_chunk.001_mqw72y: Moved (server-side) to: only6 2025/01/25 03:50:03 INFO : both7.rclone_chunk.001_mqwc98: Moved (server-side) to: both7 2025/01/25 03:50:08 INFO : only7.rclone_chunk.001_mqwhu5: Moved (server-side) to: only7 2025/01/25 03:50:13 INFO : both8.rclone_chunk.001_mqwmge: Moved (server-side) to: both8 2025/01/25 03:50:18 INFO : only8.rclone_chunk.001_mqwslz: Moved (server-side) to: only8 2025/01/25 03:50:23 INFO : both9.rclone_chunk.001_mqwwhz: Moved (server-side) to: both9 2025/01/25 03:50:28 INFO : only9.rclone_chunk.001_mqx1f6: Moved (server-side) to: only9 2025/01/25 03:50:33 INFO : both10.rclone_chunk.001_mqx6p7: Moved (server-side) to: both10 2025/01/25 03:50:38 INFO : only10.rclone_chunk.001_mqxb01: Moved (server-side) to: only10 2025/01/25 03:50:43 INFO : both11.rclone_chunk.001_mqxgdb: Moved (server-side) to: both11 2025/01/25 03:50:49 INFO : only11.rclone_chunk.001_mqxlf2: Moved (server-side) to: only11 2025/01/25 03:50:58 INFO : both12.rclone_chunk.001_mqxrp9: Moved (server-side) to: both12 2025/01/25 03:51:05 INFO : only12.rclone_chunk.001_mqy08n: Moved (server-side) to: only12 2025/01/25 03:51:11 INFO : both13.rclone_chunk.001_mqy78g: Moved (server-side) to: both13 2025/01/25 03:51:17 INFO : only13.rclone_chunk.001_mqyewv: Moved (server-side) to: only13 2025/01/25 03:51:23 INFO : both14.rclone_chunk.001_mqykfl: Moved (server-side) to: both14 2025/01/25 03:51:28 INFO : only14.rclone_chunk.001_mqypsc: Moved (server-side) to: only14 2025/01/25 03:51:37 INFO : both15.rclone_chunk.001_mqyv1v: Moved (server-side) to: both15 2025/01/25 03:51:42 INFO : only15.rclone_chunk.001_mqz4pm: Moved (server-side) to: only15 2025/01/25 03:51:48 INFO : both16.rclone_chunk.001_mqz9qa: Moved (server-side) to: both16 2025/01/25 03:51:52 INFO : only16.rclone_chunk.001_mqzehw: Moved (server-side) to: only16 2025/01/25 03:51:57 INFO : both17.rclone_chunk.001_mqzjn1: Moved (server-side) to: both17 2025/01/25 03:52:02 INFO : only17.rclone_chunk.001_mqzniu: Moved (server-side) to: only17 2025/01/25 03:52:07 INFO : both18.rclone_chunk.001_mqzslc: Moved (server-side) to: both18 2025/01/25 03:52:11 INFO : only18.rclone_chunk.001_mqzxhn: Moved (server-side) to: only18 2025/01/25 03:52:16 INFO : both19.rclone_chunk.001_mr02si: Moved (server-side) to: both19 2025/01/25 03:52:21 INFO : only19.rclone_chunk.001_mr06rz: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: both3: Modification time difference too big |-210167h44m15.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-25 03:49:22 +0000 UTC) (precision 1ns) 2025/01/25 03:52:22 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi': Waiting for checks to finish 2025/01/25 03:52:22 DEBUG : both0: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both12: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both13: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both14: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both15: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both16: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both17: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both18: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both19: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both2: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both3: Modification times differ by 210167h44m15.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-01-25 03:49:22 +0000 UTC 2025/01/25 03:52:22 DEBUG : both1: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both3: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/01/25 03:52:22 DEBUG : both4: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both5: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both10: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both6: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both11: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:52:22 DEBUG : both8: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both9: Unchanged skipping 2025/01/25 03:52:22 DEBUG : both7: Unchanged skipping 2025/01/25 03:52:22 INFO : both3: Updated modification time in destination 2025/01/25 03:52:22 DEBUG : both3: Unchanged skipping 2025/01/25 03:52:22 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi': Waiting for transfers to finish 2025/01/25 03:52:22 DEBUG : Waiting for deletions to finish 2025/01/25 03:52:25 INFO : only6: Deleted 2025/01/25 03:52:25 INFO : only1: Deleted 2025/01/25 03:52:26 INFO : only19: Deleted 2025/01/25 03:52:26 INFO : only2: Deleted 2025/01/25 03:52:28 INFO : only12: Deleted 2025/01/25 03:52:28 INFO : only15: Deleted 2025/01/25 03:52:29 INFO : only4: Deleted 2025/01/25 03:52:30 INFO : only11: Deleted 2025/01/25 03:52:31 INFO : only5: Deleted 2025/01/25 03:52:32 INFO : only7: Deleted 2025/01/25 03:52:32 INFO : only0: Deleted 2025/01/25 03:52:33 INFO : only3: Deleted 2025/01/25 03:52:34 INFO : only8: Deleted 2025/01/25 03:52:34 INFO : only9: Deleted 2025/01/25 03:52:35 INFO : only10: Deleted 2025/01/25 03:52:36 INFO : only13: Deleted 2025/01/25 03:52:37 INFO : only14: Deleted 2025/01/25 03:52:37 INFO : only16: Deleted 2025/01/25 03:52:37 INFO : only17: Deleted 2025/01/25 03:52:39 INFO : only18: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi'", Local "Local file system at /tmp/rclone2300928462", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (295.84s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi'", Local "Local file system at /tmp/rclone2300928462", Modify Window "1ns" 2025/01/25 03:53:48 INFO : both0.rclone_chunk.001_mr2j9i: Moved (server-side) to: both0 2025/01/25 03:53:53 INFO : only0.rclone_chunk.001_mr2qbi: Moved (server-side) to: only0 2025/01/25 03:53:58 INFO : both1.rclone_chunk.001_mr2wv8: Moved (server-side) to: both1 2025/01/25 03:54:04 INFO : only1.rclone_chunk.001_mr31ed: Moved (server-side) to: only1 2025/01/25 03:54:08 INFO : both2.rclone_chunk.001_mr36pv: Moved (server-side) to: both2 2025/01/25 03:54:13 INFO : only2.rclone_chunk.001_mr3ab9: Moved (server-side) to: only2 2025/01/25 03:54:22 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/25 03:54:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/25 03:54:22 DEBUG : pacer: Reducing sleep to 15ms 2025/01/25 03:54:23 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/25 03:54:23 DEBUG : pacer: Reducing sleep to 10ms 2025/01/25 03:54:26 INFO : both3.rclone_chunk.001_mr3o6x: Moved (server-side) to: both3 2025/01/25 03:54:31 INFO : only3.rclone_chunk.001_mr3t4o: Moved (server-side) to: only3 2025/01/25 03:54:35 INFO : both4.rclone_chunk.001_mr3xbf: Moved (server-side) to: both4 2025/01/25 03:54:41 INFO : only4.rclone_chunk.001_mr42p4: Moved (server-side) to: only4 2025/01/25 03:54:46 INFO : both5.rclone_chunk.001_mr47o5: Moved (server-side) to: both5 2025/01/25 03:54:51 INFO : only5.rclone_chunk.001_mr4can: Moved (server-side) to: only5 2025/01/25 03:54:56 INFO : both6.rclone_chunk.001_mr4hcy: Moved (server-side) to: both6 2025/01/25 03:55:01 INFO : only6.rclone_chunk.001_mr4mih: Moved (server-side) to: only6 2025/01/25 03:55:06 INFO : both7.rclone_chunk.001_mr4r36: Moved (server-side) to: both7 2025/01/25 03:55:11 INFO : only7.rclone_chunk.001_mr4w80: Moved (server-side) to: only7 2025/01/25 03:55:17 INFO : both8.rclone_chunk.001_mr51f8: Moved (server-side) to: both8 2025/01/25 03:55:22 INFO : only8.rclone_chunk.001_mr578x: Moved (server-side) to: only8 2025/01/25 03:55:26 INFO : both9.rclone_chunk.001_mr5c4u: Moved (server-side) to: both9 2025/01/25 03:55:31 INFO : only9.rclone_chunk.001_mr5gil: Moved (server-side) to: only9 2025/01/25 03:55:36 INFO : both10.rclone_chunk.001_mr5mlx: Moved (server-side) to: both10 2025/01/25 03:55:41 INFO : only10.rclone_chunk.001_mr5qm3: Moved (server-side) to: only10 2025/01/25 03:55:46 INFO : both11.rclone_chunk.001_mr5v8v: Moved (server-side) to: both11 2025/01/25 03:55:50 INFO : only11.rclone_chunk.001_mr60jy: Moved (server-side) to: only11 2025/01/25 03:55:55 INFO : both12.rclone_chunk.001_mr65oe: Moved (server-side) to: both12 2025/01/25 03:56:00 INFO : only12.rclone_chunk.001_mr6ahd: Moved (server-side) to: only12 2025/01/25 03:56:05 INFO : both13.rclone_chunk.001_mr6eti: Moved (server-side) to: both13 2025/01/25 03:56:10 INFO : only13.rclone_chunk.001_mr6j0l: Moved (server-side) to: only13 2025/01/25 03:56:15 INFO : both14.rclone_chunk.001_mr6ob4: Moved (server-side) to: both14 2025/01/25 03:56:20 INFO : only14.rclone_chunk.001_mr6tm5: Moved (server-side) to: only14 2025/01/25 03:56:25 INFO : both15.rclone_chunk.001_mr6y9r: Moved (server-side) to: both15 2025/01/25 03:56:30 INFO : only15.rclone_chunk.001_mr73ha: Moved (server-side) to: only15 2025/01/25 03:56:37 INFO : both16.rclone_chunk.001_mr78sd: Moved (server-side) to: both16 2025/01/25 03:56:42 INFO : only16.rclone_chunk.001_mr7g05: Moved (server-side) to: only16 2025/01/25 03:56:47 INFO : both17.rclone_chunk.001_mr7ld5: Moved (server-side) to: both17 2025/01/25 03:56:51 INFO : only17.rclone_chunk.001_mr7qz5: Moved (server-side) to: only17 2025/01/25 03:56:57 INFO : both18.rclone_chunk.001_mr7ujg: Moved (server-side) to: both18 2025/01/25 03:57:02 INFO : only18.rclone_chunk.001_mr7zl7: Moved (server-side) to: only18 2025/01/25 03:57:08 INFO : both19.rclone_chunk.001_mr854y: Moved (server-side) to: both19 2025/01/25 03:57:12 INFO : only19.rclone_chunk.001_mr8bod: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2762 Error: Should be true Test: TestSyncConcurrentTruncate Messages: only2: Modification time difference too big |-210167h49m5.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-25 03:54:12 +0000 UTC) (precision 1ns) 2025/01/25 03:57:13 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi': Waiting for checks to finish 2025/01/25 03:57:13 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both0: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both1: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both13: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both10: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both15: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both12: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both17: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both11: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both19: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both2: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both3: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both4: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both14: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both6: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both16: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both8: Unchanged skipping 2025/01/25 03:57:13 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/25 03:57:13 DEBUG : both9: Unchanged skipping 2025/01/25 03:57:13 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : both18: Unchanged skipping 2025/01/25 03:57:13 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only1: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:13 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only10: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:13 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only11: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:13 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only12: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:13 DEBUG : both5: Unchanged skipping 2025/01/25 03:57:13 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : both7: Unchanged skipping 2025/01/25 03:57:13 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/01/25 03:57:13 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi': Waiting for transfers to finish 2025/01/25 03:57:20 INFO : only1: Deleted 2025/01/25 03:57:20 INFO : only10: Deleted 2025/01/25 03:57:20 INFO : only12: Deleted 2025/01/25 03:57:21 INFO : only11: Deleted 2025/01/25 03:57:21 INFO : only1.rclone_chunk.001_mr8fjk: Moved (server-side) to: only1 2025/01/25 03:57:21 DEBUG : only1: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:21 INFO : only1: Copied (replaced existing) 2025/01/25 03:57:21 DEBUG : only13: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:21 INFO : only12.rclone_chunk.001_mr8fnx: Moved (server-side) to: only12 2025/01/25 03:57:21 DEBUG : only12: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:21 INFO : only12: Copied (replaced existing) 2025/01/25 03:57:21 DEBUG : only16: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:21 INFO : only10.rclone_chunk.001_mr8fzg: Moved (server-side) to: only10 2025/01/25 03:57:21 DEBUG : only10: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:21 INFO : only10: Copied (replaced existing) 2025/01/25 03:57:21 DEBUG : only0: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:23 INFO : only11.rclone_chunk.001_mr8fcs: Moved (server-side) to: only11 2025/01/25 03:57:23 DEBUG : only11: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:23 INFO : only11: Copied (replaced existing) 2025/01/25 03:57:23 DEBUG : only18: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:27 INFO : only13: Deleted 2025/01/25 03:57:28 INFO : only16: Deleted 2025/01/25 03:57:29 INFO : only0: Deleted 2025/01/25 03:57:29 INFO : only13.rclone_chunk.001_mr8n6g: Moved (server-side) to: only13 2025/01/25 03:57:29 DEBUG : only13: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:29 INFO : only13: Copied (replaced existing) 2025/01/25 03:57:29 DEBUG : only17: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:30 INFO : only18: Deleted 2025/01/25 03:57:30 INFO : only16.rclone_chunk.001_mr8n4f: Moved (server-side) to: only16 2025/01/25 03:57:30 DEBUG : only16: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:30 INFO : only16: Copied (replaced existing) 2025/01/25 03:57:30 DEBUG : only2: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:30 INFO : only0.rclone_chunk.001_mr8nb9: Moved (server-side) to: only0 2025/01/25 03:57:30 DEBUG : only0: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:30 INFO : only0: Copied (replaced existing) 2025/01/25 03:57:30 DEBUG : only3: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:31 INFO : only18.rclone_chunk.001_mr8p4w: Moved (server-side) to: only18 2025/01/25 03:57:31 DEBUG : only18: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:31 INFO : only18: Copied (replaced existing) 2025/01/25 03:57:31 DEBUG : only4: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:35 INFO : only17: Deleted 2025/01/25 03:57:36 INFO : only2: Deleted 2025/01/25 03:57:36 INFO : only3: Deleted 2025/01/25 03:57:37 INFO : only3.rclone_chunk.001_mr8wci: Moved (server-side) to: only3 2025/01/25 03:57:37 DEBUG : only3: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:37 INFO : only3: Copied (replaced existing) 2025/01/25 03:57:37 DEBUG : only5: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:37 INFO : only2.rclone_chunk.001_mr8w1l: Moved (server-side) to: only2 2025/01/25 03:57:37 DEBUG : only2: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:37 INFO : only2: Copied (replaced existing) 2025/01/25 03:57:37 DEBUG : only6: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:38 INFO : only4: Deleted 2025/01/25 03:57:39 INFO : only17.rclone_chunk.001_mr8vj1: Moved (server-side) to: only17 2025/01/25 03:57:39 DEBUG : only17: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:39 INFO : only17: Copied (replaced existing) 2025/01/25 03:57:39 DEBUG : only7: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:39 INFO : only4.rclone_chunk.001_mr8xj7: Moved (server-side) to: only4 2025/01/25 03:57:39 DEBUG : only4: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:39 INFO : only4: Copied (replaced existing) 2025/01/25 03:57:39 DEBUG : only8: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:43 INFO : only5: Deleted 2025/01/25 03:57:43 INFO : only6: Deleted 2025/01/25 03:57:44 INFO : only5.rclone_chunk.001_mr931p: Moved (server-side) to: only5 2025/01/25 03:57:44 DEBUG : only5: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:44 INFO : only5: Copied (replaced existing) 2025/01/25 03:57:44 DEBUG : only9: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:45 INFO : only6.rclone_chunk.001_mr93yi: Moved (server-side) to: only6 2025/01/25 03:57:45 DEBUG : only6: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:45 INFO : only6: Copied (replaced existing) 2025/01/25 03:57:45 DEBUG : only14: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:46 INFO : only7: Deleted 2025/01/25 03:57:47 INFO : only7.rclone_chunk.001_mr95js: Moved (server-side) to: only7 2025/01/25 03:57:47 DEBUG : only7: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:47 INFO : only7: Copied (replaced existing) 2025/01/25 03:57:47 DEBUG : only19: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:48 INFO : only8: Deleted 2025/01/25 03:57:50 INFO : only8.rclone_chunk.001_mr95hy: Moved (server-side) to: only8 2025/01/25 03:57:50 DEBUG : only8: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:50 INFO : only8: Copied (replaced existing) 2025/01/25 03:57:50 DEBUG : only15: skip slow MD5 on source file, hashing in-transit 2025/01/25 03:57:51 INFO : only9: Deleted 2025/01/25 03:57:51 INFO : only14: Deleted 2025/01/25 03:57:53 INFO : only14.rclone_chunk.001_mr9be0: Moved (server-side) to: only14 2025/01/25 03:57:53 DEBUG : only14: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:53 INFO : only14: Copied (replaced existing) 2025/01/25 03:57:53 INFO : only9.rclone_chunk.001_mr9avp: Moved (server-side) to: only9 2025/01/25 03:57:53 DEBUG : only9: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:53 INFO : only9: Copied (replaced existing) 2025/01/25 03:57:53 INFO : only19: Deleted 2025/01/25 03:57:55 INFO : only19.rclone_chunk.001_mr9dfk: Moved (server-side) to: only19 2025/01/25 03:57:55 DEBUG : only19: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:55 INFO : only19: Copied (replaced existing) 2025/01/25 03:57:57 INFO : only15: Deleted 2025/01/25 03:57:59 INFO : only15.rclone_chunk.001_mr9gpv: Moved (server-side) to: only15 2025/01/25 03:57:59 DEBUG : only15: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/01/25 03:57:59 INFO : only15: Copied (replaced existing) 2025/01/25 03:57:59 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi'", Local "Local file system at /tmp/rclone2300928462", Modify Window "1ns" --- FAIL: TestSyncConcurrentTruncate (378.09s) FAIL 2025/01/25 03:59:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-goxesoz9yexi': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncBackupDir|TestSyncBackupDirSuffixOnly|TestSyncConcurrentDelete|TestSyncConcurrentTruncate)$'" - Finished ERROR in 13m53.180601795s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete TestSyncConcurrentTruncate]