"./operations.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestCopyFileBackupDir|TestDeduplicateNewestByHash|TestDelete)$'" - Starting (try 2/5) 2024/12/22 03:49:36 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe" 2024/12/22 03:49:36 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/12/22 03:49:36 DEBUG : Creating backend with remote "TestYandex:rclone-test-xutedum2kuqe" 2024/12/22 03:49:36 DEBUG : Reset feature "ListR" 2024/12/22 03:49:36 DEBUG : Creating backend with remote "/tmp/rclone2266506352" === RUN TestCopyFileBackupDir run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe'", Local "Local file system at /tmp/rclone2266506352", Modify Window "1ns" 2024/12/22 03:49:41 INFO : dst/file1.rclone_chunk.001_vs7cm4: Moved (server-side) to: dst/file1 2024/12/22 03:49:44 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe/backup" 2024/12/22 03:49:44 DEBUG : Creating backend with remote "TestYandex:rclone-test-xutedum2kuqe/backup" 2024/12/22 03:49:45 DEBUG : Reset feature "ListR" 2024/12/22 03:49:45 DEBUG : dst/file1: Sizes differ (src 14 vs dst 18) 2024/12/22 03:49:45 DEBUG : dst/file1: move non-chunked object... 2024/12/22 03:49:48 INFO : dst/file1: Moved (server-side) 2024/12/22 03:49:48 INFO : dst/file1: Moved (server-side) 2024/12/22 03:49:48 DEBUG : dst/file1: skip slow MD5 on source file, hashing in-transit 2024/12/22 03:49:53 INFO : dst/file1.rclone_chunk.001_vs7o18: Moved (server-side) to: dst/file1 2024/12/22 03:49:53 DEBUG : dst/file1: md5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2024/12/22 03:49:53 INFO : dst/file1: Copied (new) --- PASS: TestCopyFileBackupDir (28.24s) === RUN TestDeduplicateNewestByHash run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe'", Local "Local file system at /tmp/rclone2266506352", Modify Window "1ns" 2024/12/22 03:50:17 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2024/12/22 03:50:17 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/12/22 03:50:17 DEBUG : pacer: Reducing sleep to 15ms 2024/12/22 03:50:17 DEBUG : pacer: Reducing sleep to 11.25ms 2024/12/22 03:50:17 DEBUG : pacer: Reducing sleep to 10ms 2024/12/22 03:50:20 INFO : one.rclone_chunk.001_vs85sc: Moved (server-side) to: one.rclone_chunk.001 2024/12/22 03:50:21 INFO : one.rclone_chunk.002_vs85sc: Moved (server-side) to: one.rclone_chunk.002 2024/12/22 03:50:30 INFO : also/one.rclone_chunk.001_vs8ohj: Moved (server-side) to: also/one.rclone_chunk.001 2024/12/22 03:50:32 INFO : also/one.rclone_chunk.002_vs8ohj: Moved (server-side) to: also/one.rclone_chunk.002 2024/12/22 03:50:42 INFO : another.rclone_chunk.001_vs8zxm: Moved (server-side) to: another.rclone_chunk.001 2024/12/22 03:50:44 INFO : another.rclone_chunk.002_vs8zxm: Moved (server-side) to: another.rclone_chunk.002 2024/12/22 03:50:55 INFO : not-one.rclone_chunk.001_vs9fzo: Moved (server-side) to: not-one fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:159 Error: Should be true Test: TestDeduplicateNewestByHash Messages: also/one: Modification time difference too big |-113894h50m33.876543211s| > 1ns (want 2011-12-25 12:59:59.123456789 +0000 UTC vs got 2024-12-22 03:50:33 +0000 UTC) (precision 1ns) 2024/12/22 03:50:59 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe': Looking for duplicate md5 hashes using newest mode. 2024/12/22 03:51:00 NOTICE: bfe368fed9c2030544a88c64864340b3: Found 3 files with duplicate md5 hashes 2024/12/22 03:51:06 INFO : one: Deleted 2024/12/22 03:51:10 INFO : another: Deleted 2024/12/22 03:51:10 NOTICE: bfe368fed9c2030544a88c64864340b3: Deleted 2 extra copies fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:164 Error: Should be true Test: TestDeduplicateNewestByHash Messages: listing wrong, want another (100), not-one (5) got also/one (100), not-one (5) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:164 Error: Should be true Test: TestDeduplicateNewestByHash Messages: Unexpected file "also/one" fstest.go:197: Not found "another" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/dedupe_test.go:164 Error: Not equal: expected: 0 actual : 1 Test: TestDeduplicateNewestByHash Messages: 1 objects not found --- FAIL: TestDeduplicateNewestByHash (84.77s) === RUN TestDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe'", Local "Local file system at /tmp/rclone2266506352", Modify Window "1ns" 2024/12/22 03:51:35 INFO : small.rclone_chunk.001_vsahbz: Moved (server-side) to: small 2024/12/22 03:51:40 INFO : medium.rclone_chunk.001_vsanmk: Moved (server-side) to: medium.rclone_chunk.001 2024/12/22 03:51:42 INFO : medium.rclone_chunk.002_vsanmk: Moved (server-side) to: medium.rclone_chunk.002 2024/12/22 03:51:51 INFO : large.rclone_chunk.001_vsawx9: Moved (server-side) to: large.rclone_chunk.001 2024/12/22 03:51:54 INFO : large.rclone_chunk.002_vsawx9: Moved (server-side) to: large.rclone_chunk.002 2024/12/22 03:51:57 DEBUG : Waiting for deletions to finish 2024/12/22 03:51:57 DEBUG : large: Excluded (Size Filter) 2024/12/22 03:51:57 DEBUG : large: Excluded 2024/12/22 03:51:59 INFO : small: Deleted 2024/12/22 03:52:03 INFO : medium: Deleted --- PASS: TestDelete (44.17s) FAIL 2024/12/22 03:52:13 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xutedum2kuqe': Purge remote "./operations.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -fast-list -size-limit 1024 -test.run '^(TestCopyFileBackupDir|TestDeduplicateNewestByHash|TestDelete)$'" - Finished ERROR in 2m38.673433075s (try 2/5): exit status 1: Failed [TestDeduplicateNewestByHash]