"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncSuffix)$'" - Starting (try 2/5) 2025/02/08 03:30:26 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-natoqac3wete" 2025/02/08 03:30:26 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/08 03:30:26 DEBUG : Creating backend with remote "TestYandex:rclone-test-natoqac3wete" 2025/02/08 03:30:26 DEBUG : Reset feature "ListR" 2025/02/08 03:30:26 DEBUG : Creating backend with remote "/tmp/rclone2730610162" === RUN TestSyncSuffix run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete'", Local "Local file system at /tmp/rclone2730610162", Modify Window "1ns" 2025/02/08 03:30:32 INFO : dst/one.rclone_chunk.001_cnc0rq: Moved (server-side) to: dst/one 2025/02/08 03:30:37 INFO : dst/two.rclone_chunk.001_cnc5r6: Moved (server-side) to: dst/two 2025/02/08 03:30:44 INFO : dst/three.txt.rclone_chunk.001_cncbix: Moved (server-side) to: dst/three.txt 2025/02/08 03:30:44 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-natoqac3wete/dst" 2025/02/08 03:30:44 DEBUG : Creating backend with remote "TestYandex:rclone-test-natoqac3wete/dst" 2025/02/08 03:30:45 DEBUG : Reset feature "ListR" 2025/02/08 03:30:46 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/02/08 03:30:47 DEBUG : one: move non-chunked object... 2025/02/08 03:30:48 INFO : one: Moved (server-side) to: one.bak 2025/02/08 03:30:48 INFO : one: Moved (server-side) to: one.bak 2025/02/08 03:30:49 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:30:53 INFO : one.rclone_chunk.001_cncmoa: Moved (server-side) to: one 2025/02/08 03:30:53 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/02/08 03:30:53 INFO : one: Copied (new) 2025/02/08 03:30:54 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:30:54 DEBUG : two: Unchanged skipping 2025/02/08 03:30:54 DEBUG : three.txt: Sizes differ (src 6 vs dst 5) 2025/02/08 03:30:55 DEBUG : three.txt: move non-chunked object... 2025/02/08 03:30:57 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/02/08 03:30:57 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/02/08 03:30:57 DEBUG : three.txt: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:31:01 INFO : three.txt.rclone_chunk.001_cncumq: Moved (server-side) to: three.txt 2025/02/08 03:31:01 DEBUG : three.txt: md5 = 91341eed84691a83caea73aa785736d5 OK 2025/02/08 03:31:01 INFO : three.txt: Copied (new) 2025/02/08 03:31:04 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/02/08 03:31:08 INFO : one.bak: Deleted 2025/02/08 03:31:08 DEBUG : one: move non-chunked object... 2025/02/08 03:31:10 INFO : one: Moved (server-side) to: one.bak 2025/02/08 03:31:10 INFO : one: Moved (server-side) to: one.bak 2025/02/08 03:31:10 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:31:14 INFO : one.rclone_chunk.001_cnd721: Moved (server-side) to: one 2025/02/08 03:31:14 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/02/08 03:31:14 INFO : one: Copied (new) 2025/02/08 03:31:15 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:31:15 DEBUG : two: Unchanged skipping 2025/02/08 03:31:16 DEBUG : three.txt: Sizes differ (src 19 vs dst 6) 2025/02/08 03:31:20 INFO : three.txt.bak: Deleted 2025/02/08 03:31:20 DEBUG : three.txt: move non-chunked object... 2025/02/08 03:31:25 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/02/08 03:31:25 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/02/08 03:31:25 DEBUG : three.txt: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:31:29 INFO : three.txt.rclone_chunk.001_cndmf2: Moved (server-side) to: three.txt 2025/02/08 03:31:29 DEBUG : three.txt: md5 = 423e01c5e84a30d129b97aedb6e219a9 OK 2025/02/08 03:31:29 INFO : three.txt: Copied (new) --- PASS: TestSyncSuffix (86.24s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete'", Local "Local file system at /tmp/rclone2730610162", Modify Window "1ns" 2025/02/08 03:31:59 INFO : both0.rclone_chunk.001_cneew7: Moved (server-side) to: both0 2025/02/08 03:32:06 INFO : only0.rclone_chunk.001_cnelsr: Moved (server-side) to: only0 2025/02/08 03:32:11 INFO : both1.rclone_chunk.001_cnesi6: Moved (server-side) to: both1 2025/02/08 03:32:18 INFO : only1.rclone_chunk.001_cnewin: Moved (server-side) to: only1 2025/02/08 03:32:23 INFO : both2.rclone_chunk.001_cnf3yh: Moved (server-side) to: both2 2025/02/08 03:32:28 INFO : only2.rclone_chunk.001_cnf81n: Moved (server-side) to: only2 2025/02/08 03:32:33 INFO : both3.rclone_chunk.001_cnfd2d: Moved (server-side) to: both3 2025/02/08 03:32:39 INFO : only3.rclone_chunk.001_cnfjhl: Moved (server-side) to: only3 2025/02/08 03:32:44 INFO : both4.rclone_chunk.001_cnfobf: Moved (server-side) to: both4 2025/02/08 03:32:49 INFO : only4.rclone_chunk.001_cnfthb: Moved (server-side) to: only4 2025/02/08 03:32:55 INFO : both5.rclone_chunk.001_cnfyt8: Moved (server-side) to: both5 2025/02/08 03:33:01 INFO : only5.rclone_chunk.001_cng57o: Moved (server-side) to: only5 2025/02/08 03:33:06 INFO : both6.rclone_chunk.001_cngbzr: Moved (server-side) to: both6 2025/02/08 03:33:12 INFO : only6.rclone_chunk.001_cnggv8: Moved (server-side) to: only6 2025/02/08 03:33:17 INFO : both7.rclone_chunk.001_cnglf8: Moved (server-side) to: both7 2025/02/08 03:33:21 INFO : only7.rclone_chunk.001_cngqq6: Moved (server-side) to: only7 2025/02/08 03:33:22 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/02/08 03:33:22 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/02/08 03:33:22 DEBUG : pacer: Reducing sleep to 15ms 2025/02/08 03:33:22 DEBUG : pacer: Reducing sleep to 11.25ms 2025/02/08 03:33:23 DEBUG : pacer: Reducing sleep to 10ms 2025/02/08 03:33:28 INFO : both8.rclone_chunk.001_cngvmc: Moved (server-side) to: both8 2025/02/08 03:33:34 INFO : only8.rclone_chunk.001_cnh2qn: Moved (server-side) to: only8 2025/02/08 03:33:39 INFO : both9.rclone_chunk.001_cnh8hw: Moved (server-side) to: both9 2025/02/08 03:33:44 INFO : only9.rclone_chunk.001_cnhdsz: Moved (server-side) to: only9 2025/02/08 03:33:49 INFO : both10.rclone_chunk.001_cnhi5t: Moved (server-side) to: both10 2025/02/08 03:33:54 INFO : only10.rclone_chunk.001_cnhnb4: Moved (server-side) to: only10 2025/02/08 03:34:00 INFO : both11.rclone_chunk.001_cnhrda: Moved (server-side) to: both11 2025/02/08 03:34:06 INFO : only11.rclone_chunk.001_cnhywg: Moved (server-side) to: only11 2025/02/08 03:34:11 INFO : both12.rclone_chunk.001_cni38g: Moved (server-side) to: both12 2025/02/08 03:34:17 INFO : only12.rclone_chunk.001_cni8xk: Moved (server-side) to: only12 2025/02/08 03:34:22 INFO : both13.rclone_chunk.001_cniew9: Moved (server-side) to: both13 2025/02/08 03:34:27 INFO : only13.rclone_chunk.001_cnikhs: Moved (server-side) to: only13 2025/02/08 03:34:33 INFO : both14.rclone_chunk.001_cnipkt: Moved (server-side) to: both14 2025/02/08 03:34:37 INFO : only14.rclone_chunk.001_cniuco: Moved (server-side) to: only14 2025/02/08 03:34:42 INFO : both15.rclone_chunk.001_cnizu5: Moved (server-side) to: both15 2025/02/08 03:34:47 INFO : only15.rclone_chunk.001_cnj47q: Moved (server-side) to: only15 2025/02/08 03:34:58 INFO : both16.rclone_chunk.001_cnj949: Moved (server-side) to: both16 2025/02/08 03:35:03 INFO : only16.rclone_chunk.001_cnjjw6: Moved (server-side) to: only16 2025/02/08 03:35:09 INFO : both17.rclone_chunk.001_cnjpaz: Moved (server-side) to: both17 2025/02/08 03:35:24 INFO : only17.rclone_chunk.001_cnjuge: Moved (server-side) to: only17 2025/02/08 03:35:37 INFO : both18.rclone_chunk.001_cnk9j4: Moved (server-side) to: both18 2025/02/08 03:35:44 INFO : only18.rclone_chunk.001_cnko1t: Moved (server-side) to: only18 2025/02/08 03:35:50 INFO : both19.rclone_chunk.001_cnktbv: Moved (server-side) to: both19 2025/02/08 03:35:58 INFO : only19.rclone_chunk.001_cnl0bm: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: only8: Modification time difference too big |-210503h28m26.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-02-08 03:33:33 +0000 UTC) (precision 1ns) 2025/02/08 03:35:59 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete': Waiting for checks to finish 2025/02/08 03:35:59 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both0: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both12: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both13: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both14: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both15: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both16: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both17: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both11: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both19: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both2: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both3: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both4: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both5: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both6: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both7: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both8: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:35:59 DEBUG : both9: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both10: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both1: Unchanged skipping 2025/02/08 03:35:59 DEBUG : both18: Unchanged skipping 2025/02/08 03:35:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete': Waiting for transfers to finish 2025/02/08 03:35:59 DEBUG : Waiting for deletions to finish 2025/02/08 03:36:03 INFO : only11: Deleted 2025/02/08 03:36:03 INFO : only13: Deleted 2025/02/08 03:36:03 INFO : only4: Deleted 2025/02/08 03:36:03 INFO : only19: Deleted 2025/02/08 03:36:06 INFO : only5: Deleted 2025/02/08 03:36:06 INFO : only8: Deleted 2025/02/08 03:36:07 INFO : only10: Deleted 2025/02/08 03:36:07 INFO : only1: Deleted 2025/02/08 03:36:10 INFO : only12: Deleted 2025/02/08 03:36:10 INFO : only16: Deleted 2025/02/08 03:36:10 INFO : only9: Deleted 2025/02/08 03:36:11 INFO : only0: Deleted 2025/02/08 03:36:13 INFO : only15: Deleted 2025/02/08 03:36:14 INFO : only3: Deleted 2025/02/08 03:36:14 INFO : only6: Deleted 2025/02/08 03:36:17 INFO : only7: Deleted 2025/02/08 03:36:17 INFO : only17: Deleted 2025/02/08 03:36:18 INFO : only18: Deleted 2025/02/08 03:36:20 INFO : only2: Deleted 2025/02/08 03:36:21 ERROR : only14: Couldn't delete: [500 - InternalServerError] Internal Server Error (Ошибка сервера.) 2025/02/08 03:36:21 ERROR : Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete': not deleting directories as there were IO errors run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete'", Local "Local file system at /tmp/rclone2730610162", Modify Window "1ns" sync_test.go:2752: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2752 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Received unexpected error: failed to delete 1 files Test: TestSyncConcurrentDelete Messages: Sync must not return a error sync_test.go:2753: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2753 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be false Test: TestSyncConcurrentDelete Messages: Low level errors must not have happened fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2754 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: listing wrong, want both0 (6), both1 (6), both10 (6), both11 (6), both12 (6), both13 (6), both14 (6), both15 (6), both16 (6), both17 (6), both18 (6), both19 (6), both2 (6), both3 (6), both4 (6), both5 (6), both6 (6), both7 (6), both8 (6), both9 (6) got both0 (6), both1 (6), both10 (6), both11 (6), both12 (6), both13 (6), both14 (6), both15 (6), both16 (6), both17 (6), both18 (6), both19 (6), both2 (6), both3 (6), both4 (6), both5 (6), both6 (6), both7 (6), both8 (6), both9 (6), only14 (6) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2754 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: Unexpected file "only14" --- FAIL: TestSyncConcurrentDelete (352.41s) === RUN TestSyncConcurrentTruncate run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete'", Local "Local file system at /tmp/rclone2730610162", Modify Window "1ns" 2025/02/08 03:37:52 INFO : both0.rclone_chunk.001_cno6fm: Moved (server-side) to: both0 2025/02/08 03:37:56 INFO : only0.rclone_chunk.001_cnodqy: Moved (server-side) to: only0 2025/02/08 03:38:01 INFO : both1.rclone_chunk.001_cnoiyk: Moved (server-side) to: both1 2025/02/08 03:38:12 INFO : only1.rclone_chunk.001_cnonyb: Moved (server-side) to: only1 2025/02/08 03:38:24 INFO : both2.rclone_chunk.001_cnoxkn: Moved (server-side) to: both2 2025/02/08 03:38:30 INFO : only2.rclone_chunk.001_cnp9y3: Moved (server-side) to: only2 2025/02/08 03:38:36 INFO : both3.rclone_chunk.001_cnpgv9: Moved (server-side) to: both3 2025/02/08 03:38:42 INFO : only3.rclone_chunk.001_cnpmtm: Moved (server-side) to: only3 2025/02/08 03:38:53 INFO : both4.rclone_chunk.001_cnpslm: Moved (server-side) to: both4 2025/02/08 03:38:58 INFO : only4.rclone_chunk.001_cnq2ov: Moved (server-side) to: only4 2025/02/08 03:39:10 INFO : both5.rclone_chunk.001_cnq8k0: Moved (server-side) to: both5 2025/02/08 03:39:16 INFO : only5.rclone_chunk.001_cnqjdb: Moved (server-side) to: only5 2025/02/08 03:39:21 INFO : both6.rclone_chunk.001_cnqpjo: Moved (server-side) to: both6 2025/02/08 03:39:27 INFO : only6.rclone_chunk.001_cnqvgs: Moved (server-side) to: only6 2025/02/08 03:39:32 INFO : both7.rclone_chunk.001_cnr1c1: Moved (server-side) to: both7 2025/02/08 03:39:38 INFO : only7.rclone_chunk.001_cnr6dr: Moved (server-side) to: only7 2025/02/08 03:39:42 INFO : both8.rclone_chunk.001_cnrbbf: Moved (server-side) to: both8 2025/02/08 03:39:49 INFO : only8.rclone_chunk.001_cnrgv5: Moved (server-side) to: only8 2025/02/08 03:39:53 INFO : both9.rclone_chunk.001_cnrmzz: Moved (server-side) to: both9 2025/02/08 03:39:59 INFO : only9.rclone_chunk.001_cnrrx8: Moved (server-side) to: only9 2025/02/08 03:40:04 INFO : both10.rclone_chunk.001_cnrwmc: Moved (server-side) to: both10 2025/02/08 03:40:22 INFO : only10.rclone_chunk.001_cns19j: Moved (server-side) to: only10 2025/02/08 03:40:27 INFO : both11.rclone_chunk.001_cnsked: Moved (server-side) to: both11 2025/02/08 03:40:34 INFO : only11.rclone_chunk.001_cnspis: Moved (server-side) to: only11 2025/02/08 03:40:39 INFO : both12.rclone_chunk.001_cnsvmt: Moved (server-side) to: both12 2025/02/08 03:40:44 INFO : only12.rclone_chunk.001_cnt0jj: Moved (server-side) to: only12 2025/02/08 03:40:52 INFO : both13.rclone_chunk.001_cnt5yp: Moved (server-side) to: both13 2025/02/08 03:40:57 INFO : only13.rclone_chunk.001_cntdki: Moved (server-side) to: only13 2025/02/08 03:41:02 INFO : both14.rclone_chunk.001_cnti2b: Moved (server-side) to: both14 2025/02/08 03:41:09 INFO : only14.rclone_chunk.001_cntn74: Moved (server-side) to: only14 2025/02/08 03:41:15 INFO : both15.rclone_chunk.001_cntux8: Moved (server-side) to: both15 2025/02/08 03:41:20 INFO : only15.rclone_chunk.001_cnu0tt: Moved (server-side) to: only15 2025/02/08 03:41:25 INFO : both16.rclone_chunk.001_cnu6nw: Moved (server-side) to: both16 2025/02/08 03:41:31 INFO : only16.rclone_chunk.001_cnubx3: Moved (server-side) to: only16 2025/02/08 03:41:36 INFO : both17.rclone_chunk.001_cnugyj: Moved (server-side) to: both17 2025/02/08 03:41:42 INFO : only17.rclone_chunk.001_cnumn3: Moved (server-side) to: only17 2025/02/08 03:41:47 INFO : both18.rclone_chunk.001_cnurro: Moved (server-side) to: both18 2025/02/08 03:41:53 INFO : only18.rclone_chunk.001_cnuw8l: Moved (server-side) to: only18 2025/02/08 03:41:58 INFO : both19.rclone_chunk.001_cnv2kt: Moved (server-side) to: both19 2025/02/08 03:42:04 INFO : only19.rclone_chunk.001_cnv73h: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2762 Error: Should be true Test: TestSyncConcurrentTruncate Messages: both4: Modification time difference too big |-210503h33m45.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-02-08 03:38:52 +0000 UTC) (precision 1ns) 2025/02/08 03:42:04 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete': Waiting for checks to finish 2025/02/08 03:42:04 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both1: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both10: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both13: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both14: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both0: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both16: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both17: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both17: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both18: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both19: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both2: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both3: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both4: Modification times differ by 210503h33m45.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-02-08 03:38:52 +0000 UTC 2025/02/08 03:42:04 DEBUG : both11: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both5: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both6: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both7: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both8: Unchanged skipping 2025/02/08 03:42:04 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/02/08 03:42:04 DEBUG : both9: Unchanged skipping 2025/02/08 03:42:04 DEBUG : only0: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only1: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only10: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only11: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only12: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only13: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only14: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only15: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only16: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only17: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only18: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only19: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only2: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only3: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only4: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only5: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only6: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only7: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only8: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only9: Sizes differ (src 0 vs dst 6) 2025/02/08 03:42:04 DEBUG : only0: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:04 DEBUG : both4: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/02/08 03:42:04 DEBUG : only10: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:04 DEBUG : only11: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:04 DEBUG : both12: Unchanged skipping 2025/02/08 03:42:04 DEBUG : only1: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:04 DEBUG : both15: Unchanged skipping 2025/02/08 03:42:05 INFO : both4: Updated modification time in destination 2025/02/08 03:42:05 DEBUG : both4: Unchanged skipping 2025/02/08 03:42:05 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete': Waiting for transfers to finish 2025/02/08 03:42:11 INFO : only0: Deleted 2025/02/08 03:42:11 INFO : only10: Deleted 2025/02/08 03:42:12 INFO : only11: Deleted 2025/02/08 03:42:13 INFO : only0.rclone_chunk.001_cnvdsm: Moved (server-side) to: only0 2025/02/08 03:42:13 DEBUG : only0: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:13 INFO : only0: Copied (replaced existing) 2025/02/08 03:42:13 DEBUG : only12: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:13 INFO : only1: Deleted 2025/02/08 03:42:13 INFO : only10.rclone_chunk.001_cnvdcx: Moved (server-side) to: only10 2025/02/08 03:42:13 DEBUG : only10: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:13 INFO : only10: Copied (replaced existing) 2025/02/08 03:42:13 DEBUG : only13: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:14 INFO : only11.rclone_chunk.001_cnvd3i: Moved (server-side) to: only11 2025/02/08 03:42:14 DEBUG : only11: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:14 INFO : only11: Copied (replaced existing) 2025/02/08 03:42:14 DEBUG : only14: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:15 INFO : only1.rclone_chunk.001_cnvdtp: Moved (server-side) to: only1 2025/02/08 03:42:15 DEBUG : only1: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:15 INFO : only1: Copied (replaced existing) 2025/02/08 03:42:15 DEBUG : only15: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:21 INFO : only12: Deleted 2025/02/08 03:42:21 INFO : only14: Deleted 2025/02/08 03:42:22 INFO : only13: Deleted 2025/02/08 03:42:22 INFO : only15: Deleted 2025/02/08 03:42:23 INFO : only12.rclone_chunk.001_cnvmyd: Moved (server-side) to: only12 2025/02/08 03:42:23 DEBUG : only12: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:23 INFO : only12: Copied (replaced existing) 2025/02/08 03:42:23 DEBUG : only16: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:23 INFO : only13.rclone_chunk.001_cnvm0h: Moved (server-side) to: only13 2025/02/08 03:42:23 DEBUG : only13: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:23 INFO : only13: Copied (replaced existing) 2025/02/08 03:42:23 DEBUG : only17: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:24 INFO : only14.rclone_chunk.001_cnvn4a: Moved (server-side) to: only14 2025/02/08 03:42:24 DEBUG : only14: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:24 INFO : only14: Copied (replaced existing) 2025/02/08 03:42:24 DEBUG : only18: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:24 INFO : only15.rclone_chunk.001_cnvovb: Moved (server-side) to: only15 2025/02/08 03:42:24 DEBUG : only15: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:24 INFO : only15: Copied (replaced existing) 2025/02/08 03:42:24 DEBUG : only19: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:30 INFO : only16: Deleted 2025/02/08 03:42:30 INFO : only18: Deleted 2025/02/08 03:42:32 INFO : only17: Deleted 2025/02/08 03:42:32 INFO : only19: Deleted 2025/02/08 03:42:32 INFO : only16.rclone_chunk.001_cnvw8t: Moved (server-side) to: only16 2025/02/08 03:42:32 DEBUG : only16: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:32 INFO : only16: Copied (replaced existing) 2025/02/08 03:42:32 DEBUG : only2: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:33 INFO : only18.rclone_chunk.001_cnvxeb: Moved (server-side) to: only18 2025/02/08 03:42:33 DEBUG : only18: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:33 INFO : only18: Copied (replaced existing) 2025/02/08 03:42:33 DEBUG : only3: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:33 INFO : only17.rclone_chunk.001_cnvw0j: Moved (server-side) to: only17 2025/02/08 03:42:33 DEBUG : only17: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:33 INFO : only17: Copied (replaced existing) 2025/02/08 03:42:33 DEBUG : only4: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:34 INFO : only19.rclone_chunk.001_cnvx7b: Moved (server-side) to: only19 2025/02/08 03:42:34 DEBUG : only19: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:34 INFO : only19: Copied (replaced existing) 2025/02/08 03:42:34 DEBUG : only5: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:39 INFO : only2: Deleted 2025/02/08 03:42:41 INFO : only3: Deleted 2025/02/08 03:42:42 INFO : only2.rclone_chunk.001_cnw5py: Moved (server-side) to: only2 2025/02/08 03:42:42 DEBUG : only2: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:42 INFO : only2: Copied (replaced existing) 2025/02/08 03:42:42 DEBUG : only6: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:42 INFO : only4: Deleted 2025/02/08 03:42:42 INFO : only5: Deleted 2025/02/08 03:42:42 INFO : only3.rclone_chunk.001_cnw62n: Moved (server-side) to: only3 2025/02/08 03:42:42 DEBUG : only3: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:42 INFO : only3: Copied (replaced existing) 2025/02/08 03:42:42 DEBUG : only7: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:44 INFO : only4.rclone_chunk.001_cnw6ia: Moved (server-side) to: only4 2025/02/08 03:42:44 DEBUG : only4: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:44 INFO : only4: Copied (replaced existing) 2025/02/08 03:42:44 DEBUG : only8: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:44 INFO : only5.rclone_chunk.001_cnw7xa: Moved (server-side) to: only5 2025/02/08 03:42:44 DEBUG : only5: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:44 INFO : only5: Copied (replaced existing) 2025/02/08 03:42:44 DEBUG : only9: skip slow MD5 on source file, hashing in-transit 2025/02/08 03:42:50 INFO : only6: Deleted 2025/02/08 03:42:50 INFO : only7: Deleted 2025/02/08 03:42:51 INFO : only6.rclone_chunk.001_cnwfvw: Moved (server-side) to: only6 2025/02/08 03:42:51 DEBUG : only6: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:51 INFO : only6: Copied (replaced existing) 2025/02/08 03:42:51 INFO : only9: Deleted 2025/02/08 03:42:52 INFO : only7.rclone_chunk.001_cnwfgc: Moved (server-side) to: only7 2025/02/08 03:42:52 DEBUG : only7: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:52 INFO : only7: Copied (replaced existing) 2025/02/08 03:42:53 INFO : only8: Deleted 2025/02/08 03:42:53 INFO : only9.rclone_chunk.001_cnwhl1: Moved (server-side) to: only9 2025/02/08 03:42:53 DEBUG : only9: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:53 INFO : only9: Copied (replaced existing) 2025/02/08 03:42:54 INFO : only8.rclone_chunk.001_cnwhjc: Moved (server-side) to: only8 2025/02/08 03:42:54 DEBUG : only8: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/02/08 03:42:54 INFO : only8: Copied (replaced existing) 2025/02/08 03:42:54 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete'", Local "Local file system at /tmp/rclone2730610162", Modify Window "1ns" --- FAIL: TestSyncConcurrentTruncate (451.06s) FAIL 2025/02/08 03:45:16 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-natoqac3wete': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncSuffix)$'" - Finished ERROR in 14m53.756996861s (try 2/5): exit status 1: Failed [TestSyncConcurrentDelete TestSyncConcurrentTruncate]