"./operations.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestCat|TestCheckSum|TestCheckSumDownload|TestCopyFileCopyDest)$'" - Starting (try 2/5) 2025/01/12 02:40:36 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-yegatec7coxu" 2025/01/12 02:40:36 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/12 02:40:36 DEBUG : Creating backend with remote "TestYandex:rclone-test-yegatec7coxu" 2025/01/12 02:40:36 DEBUG : Reset feature "ListR" 2025/01/12 02:40:36 DEBUG : Creating backend with remote "/tmp/rclone1739442445" === RUN TestCheckSum run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-yegatec7coxu'", Local "Local file system at /tmp/rclone1739442445", Modify Window "1ns" 2025/01/12 02:40:36 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-yegatec7coxu/data" 2025/01/12 02:40:36 DEBUG : Creating backend with remote "TestYandex:rclone-test-yegatec7coxu/data" 2025/01/12 02:40:37 DEBUG : Reset feature "ListR" 2025/01/12 02:40:46 INFO : data/banana.rclone_chunk.001_yl0kdq: Moved (server-side) to: data/banana 2025/01/12 02:40:53 INFO : test.sum.rclone_chunk.001_yl0uzo: Moved (server-side) to: test.sum fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:440 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:541 Error: Should be true Test: TestCheckSum Messages: test.sum: Modification time difference too big |-209854h35m46.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-12 02:40:53 +0000 UTC) (precision 1ns) === RUN TestCheckSum/subtest1 2025/01/12 02:41:04 INFO : data/potato.rclone_chunk.001_yl14m6: Moved (server-side) to: data/potato 2025/01/12 02:41:14 INFO : test.sum: Deleted 2025/01/12 02:41:16 INFO : test.sum.rclone_chunk.001_yl1c28: Moved (server-side) to: test.sum === RUN TestCheckSum/subtest2 2025/01/12 02:41:30 INFO : test.sum.rclone_chunk.001_yl1sgt: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:41:33 INFO : test.sum.rclone_chunk.002_yl1sgt: Moved (server-side) to: test.sum.rclone_chunk.002 === RUN TestCheckSum/subtest3 2025/01/12 02:42:02 INFO : test.sum.rclone_chunk.001_yl2fow: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:42:04 INFO : test.sum.rclone_chunk.002_yl2fow: Moved (server-side) to: test.sum.rclone_chunk.002 === RUN TestCheckSum/subtest4 2025/01/12 02:42:39 INFO : test.sum.rclone_chunk.001_yl3ah6: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:42:41 INFO : test.sum.rclone_chunk.002_yl3ah6: Moved (server-side) to: test.sum.rclone_chunk.002 2025/01/12 02:42:43 INFO : test.sum.rclone_chunk.003_yl3ah6: Moved (server-side) to: test.sum.rclone_chunk.003 === RUN TestCheckSum/subtest5 2025/01/12 02:42:56 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/12 02:42:56 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/12 02:42:57 DEBUG : pacer: Reducing sleep to 15ms 2025/01/12 02:42:58 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/12 02:42:58 DEBUG : pacer: Reducing sleep to 10ms 2025/01/12 02:43:16 INFO : test.sum.rclone_chunk.001_yl4bax: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:43:18 INFO : test.sum.rclone_chunk.002_yl4bax: Moved (server-side) to: test.sum.rclone_chunk.002 2025/01/12 02:43:20 INFO : test.sum.rclone_chunk.003_yl4bax: Moved (server-side) to: test.sum.rclone_chunk.003 === RUN TestCheckSum/subtest6 2025/01/12 02:43:39 INFO : data/banana: Deleted 2025/01/12 02:43:42 INFO : data/banana.rclone_chunk.001_yl5dib: Moved (server-side) to: data/banana 2025/01/12 02:43:51 INFO : data/potato: Deleted 2025/01/12 02:43:53 INFO : data/potato.rclone_chunk.001_yl5p7m: Moved (server-side) to: data/potato 2025/01/12 02:44:19 INFO : test.sum.rclone_chunk.001_yl622q: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:44:20 INFO : test.sum.rclone_chunk.002_yl622q: Moved (server-side) to: test.sum.rclone_chunk.002 === RUN TestCheckSum/subtest7 --- FAIL: TestCheckSum (259.96s) --- PASS: TestCheckSum/subtest1 (2.28s) --- PASS: TestCheckSum/subtest2 (2.12s) --- PASS: TestCheckSum/subtest3 (3.22s) --- PASS: TestCheckSum/subtest4 (3.35s) --- PASS: TestCheckSum/subtest5 (3.73s) --- PASS: TestCheckSum/subtest6 (3.89s) --- PASS: TestCheckSum/subtest7 (3.90s) === RUN TestCheckSumDownload run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-yegatec7coxu'", Local "Local file system at /tmp/rclone1739442445", Modify Window "1ns" 2025/01/12 02:44:56 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-yegatec7coxu/data" 2025/01/12 02:44:56 DEBUG : Creating backend with remote "TestYandex:rclone-test-yegatec7coxu/data" 2025/01/12 02:44:57 DEBUG : Reset feature "ListR" 2025/01/12 02:45:05 INFO : data/banana.rclone_chunk.001_yl7s1u: Moved (server-side) to: data/banana 2025/01/12 02:45:13 INFO : test.sum.rclone_chunk.001_yl80rq: Moved (server-side) to: test.sum === RUN TestCheckSumDownload/subtest1 2025/01/12 02:45:28 INFO : data/potato.rclone_chunk.001_yl8d6e: Moved (server-side) to: data/potato 2025/01/12 02:45:31 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/12 02:45:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/12 02:45:31 DEBUG : pacer: Reducing sleep to 15ms 2025/01/12 02:45:32 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/12 02:45:32 DEBUG : pacer: Reducing sleep to 10ms 2025/01/12 02:45:38 INFO : test.sum: Deleted 2025/01/12 02:45:40 INFO : test.sum.rclone_chunk.001_yl8opp: Moved (server-side) to: test.sum === NAME TestCheckSumDownload fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:454 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:545 Error: Should be true Test: TestCheckSumDownload Messages: data/potato: Modification time difference too big |-209854h40m17.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-12 02:45:24 +0000 UTC) (precision 1ns) === RUN TestCheckSumDownload/subtest2 2025/01/12 02:45:53 INFO : test.sum.rclone_chunk.001_yl93g6: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:45:55 INFO : test.sum.rclone_chunk.002_yl93g6: Moved (server-side) to: test.sum.rclone_chunk.002 === NAME TestCheckSumDownload fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:468 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:545 Error: Should be true Test: TestCheckSumDownload Messages: data/potato: Modification time difference too big |-209854h40m17.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-12 02:45:24 +0000 UTC) (precision 1ns) === RUN TestCheckSumDownload/subtest3 2025/01/12 02:46:28 INFO : test.sum.rclone_chunk.001_yl9t88: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:46:31 INFO : test.sum.rclone_chunk.002_yl9t88: Moved (server-side) to: test.sum.rclone_chunk.002 === NAME TestCheckSumDownload fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:482 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:545 Error: Should be true Test: TestCheckSumDownload Messages: data/potato: Modification time difference too big |-209854h40m17.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-12 02:45:24 +0000 UTC) (precision 1ns) === RUN TestCheckSumDownload/subtest4 2025/01/12 02:47:04 INFO : test.sum.rclone_chunk.001_ylaq5d: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:47:08 INFO : test.sum.rclone_chunk.002_ylaq5d: Moved (server-side) to: test.sum.rclone_chunk.002 2025/01/12 02:47:10 INFO : test.sum.rclone_chunk.003_ylaq5d: Moved (server-side) to: test.sum.rclone_chunk.003 === NAME TestCheckSumDownload fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:497 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:545 Error: Should be true Test: TestCheckSumDownload Messages: data/potato: Modification time difference too big |-209854h40m17.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-12 02:45:24 +0000 UTC) (precision 1ns) === RUN TestCheckSumDownload/subtest5 2025/01/12 02:49:56 INFO : test.sum.rclone_chunk.001_ylbutj: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:49:58 INFO : test.sum.rclone_chunk.002_ylbutj: Moved (server-side) to: test.sum.rclone_chunk.002 2025/01/12 02:50:00 INFO : test.sum.rclone_chunk.003_ylbutj: Moved (server-side) to: test.sum.rclone_chunk.003 === NAME TestCheckSumDownload fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:512 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/check_test.go:545 Error: Should be true Test: TestCheckSumDownload Messages: data/potato: Modification time difference too big |-209854h40m17.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-12 02:45:24 +0000 UTC) (precision 1ns) === RUN TestCheckSumDownload/subtest6 2025/01/12 02:50:25 INFO : data/banana: Deleted 2025/01/12 02:50:27 INFO : data/banana.rclone_chunk.001_ylgo9k: Moved (server-side) to: data/banana 2025/01/12 02:50:37 INFO : data/potato: Deleted 2025/01/12 02:50:40 INFO : data/potato.rclone_chunk.001_ylgz1y: Moved (server-side) to: data/potato 2025/01/12 02:51:03 INFO : test.sum.rclone_chunk.001_ylhdhu: Moved (server-side) to: test.sum.rclone_chunk.001 2025/01/12 02:51:06 INFO : test.sum.rclone_chunk.002_ylhdhu: Moved (server-side) to: test.sum.rclone_chunk.002 === RUN TestCheckSumDownload/subtest7 --- FAIL: TestCheckSumDownload (404.69s) --- PASS: TestCheckSumDownload/subtest1 (3.89s) --- PASS: TestCheckSumDownload/subtest2 (2.38s) --- PASS: TestCheckSumDownload/subtest3 (4.50s) --- PASS: TestCheckSumDownload/subtest4 (4.68s) --- PASS: TestCheckSumDownload/subtest5 (4.44s) --- PASS: TestCheckSumDownload/subtest6 (5.09s) --- PASS: TestCheckSumDownload/subtest7 (4.16s) === RUN TestCopyFileCopyDest run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-yegatec7coxu'", Local "Local file system at /tmp/rclone1739442445", Modify Window "1ns" 2025/01/12 02:51:41 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-yegatec7coxu/dst" 2025/01/12 02:51:41 DEBUG : Config file has changed externally - reloading 2025/01/12 02:51:41 DEBUG : Creating backend with remote "TestYandex:rclone-test-yegatec7coxu/dst" 2025/01/12 02:51:41 DEBUG : Reset feature "ListR" 2025/01/12 02:51:42 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-yegatec7coxu/CopyDest" 2025/01/12 02:51:42 DEBUG : Creating backend with remote "TestYandex:rclone-test-yegatec7coxu/CopyDest" 2025/01/12 02:51:42 DEBUG : Reset feature "ListR" 2025/01/12 02:51:42 DEBUG : one: Need to transfer - File not found at Destination 2025/01/12 02:51:43 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/12 02:51:50 INFO : one.rclone_chunk.001_ylj22z: Moved (server-side) to: one 2025/01/12 02:51:50 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/01/12 02:51:50 INFO : one: Copied (new) 2025/01/12 02:51:53 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/12 02:51:53 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/12 02:52:05 INFO : one: Deleted 2025/01/12 02:52:08 INFO : one.rclone_chunk.001_yljcj0: Moved (server-side) to: one 2025/01/12 02:52:08 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/01/12 02:52:08 INFO : one: Copied (replaced existing) 2025/01/12 02:52:18 INFO : dst/one: Deleted 2025/01/12 02:52:21 INFO : dst/one.rclone_chunk.001_yljts7: Moved (server-side) to: dst/one 2025/01/12 02:52:28 INFO : CopyDest/one.rclone_chunk.001_ylk4gj: Moved (server-side) to: CopyDest/one 2025/01/12 02:52:30 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-yegatec7coxu/BackupDir" 2025/01/12 02:52:30 DEBUG : Creating backend with remote "TestYandex:rclone-test-yegatec7coxu/BackupDir" 2025/01/12 02:52:31 DEBUG : Reset feature "ListR" 2025/01/12 02:52:31 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/12 02:52:32 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/12 02:52:32 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/12 02:52:32 DEBUG : one: move non-chunked object... 2025/01/12 02:52:35 INFO : one: Moved (server-side) 2025/01/12 02:52:35 INFO : one: Moved (server-side) 2025/01/12 02:52:35 DEBUG : one: copy non-chunked object... 2025/01/12 02:52:37 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/01/12 02:52:37 INFO : one: Copied (server-side copy) 2025/01/12 02:52:37 DEBUG : one: Destination found in --copy-dest, using server-side copy 2025/01/12 02:52:45 INFO : CopyDest/two.rclone_chunk.001_ylkmtr: Moved (server-side) to: CopyDest/two 2025/01/12 02:52:47 DEBUG : two: Need to transfer - File not found at Destination 2025/01/12 02:52:48 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/12 02:52:48 DEBUG : two: copy non-chunked object... 2025/01/12 02:52:52 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/12 02:52:52 INFO : two: Copied (server-side copy) 2025/01/12 02:52:52 DEBUG : two: Destination found in --copy-dest, using server-side copy 2025/01/12 02:52:54 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/12 02:52:54 DEBUG : two: Unchanged skipping 2025/01/12 02:53:01 INFO : CopyDest/three.rclone_chunk.001_yll2bz: Moved (server-side) to: CopyDest/three 2025/01/12 02:53:04 DEBUG : three: Need to transfer - File not found at Destination 2025/01/12 02:53:05 DEBUG : three: Sizes differ (src 7 vs dst 5) 2025/01/12 02:53:05 DEBUG : three: Destination not found in --copy-dest 2025/01/12 02:53:05 DEBUG : three: skip slow MD5 on source file, hashing in-transit 2025/01/12 02:53:11 INFO : three.rclone_chunk.001_yllcnt: Moved (server-side) to: three 2025/01/12 02:53:11 DEBUG : three: md5 = 1bccb9dccb3e9f6a3f9d2a8bdb54b7f5 OK 2025/01/12 02:53:11 INFO : three: Copied (new) --- PASS: TestCopyFileCopyDest (131.27s) === RUN TestCat run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-yegatec7coxu'", Local "Local file system at /tmp/rclone1739442445", Modify Window "1ns" 2025/01/12 02:53:59 INFO : file1.rclone_chunk.001_ylmo6h: Moved (server-side) to: file1 2025/01/12 02:54:06 INFO : file2.rclone_chunk.001_ylmuu1: Moved (server-side) to: file2 --- PASS: TestCat (30.58s) FAIL 2025/01/12 02:54:23 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-yegatec7coxu': Purge remote "./operations.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestCat|TestCheckSum|TestCheckSumDownload|TestCopyFileCopyDest)$'" - Finished ERROR in 13m51.493018715s (try 2/5): exit status 1: Failed [TestCheckSum TestCheckSumDownload]