"./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestSyncBackupDirSuffixOnly|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncIgnoreSize|TestSyncNoEmptyDirectories|TestSyncSuffix|TestSyncWithUpdateOlder)$'" - Starting (try 2/5) 2025/01/14 02:21:10 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-hofanum0viki" 2025/01/14 02:21:10 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/01/14 02:21:10 DEBUG : Creating backend with remote "TestYandex:rclone-test-hofanum0viki" 2025/01/14 02:21:11 DEBUG : Reset feature "ListR" 2025/01/14 02:21:11 DEBUG : Creating backend with remote "/tmp/rclone4001019536" === RUN TestSyncNoEmptyDirectories run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:21:11 INFO : sub dir2: Making directory 2025/01/14 02:21:12 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2025/01/14 02:21:12 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for checks to finish 2025/01/14 02:21:12 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for transfers to finish 2025/01/14 02:21:12 DEBUG : sub dir/hello world: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:21:19 INFO : sub dir/hello world.rclone_chunk.001_29gewp: Moved (server-side) to: sub dir/hello world 2025/01/14 02:21:19 DEBUG : sub dir/hello world: md5 = 5eb63bbbe01eeed093cb22bb8f5acdc3 OK 2025/01/14 02:21:19 INFO : sub dir/hello world: Copied (new) 2025/01/14 02:21:19 DEBUG : Waiting for deletions to finish --- PASS: TestSyncNoEmptyDirectories (17.73s) === RUN TestSyncIgnoreSize run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:21:29 DEBUG : ignore-size: Need to transfer - File not found at Destination 2025/01/14 02:21:29 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for checks to finish 2025/01/14 02:21:29 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for transfers to finish 2025/01/14 02:21:29 DEBUG : ignore-size: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:21:35 INFO : ignore-size.rclone_chunk.001_29gvyn: Moved (server-side) to: ignore-size 2025/01/14 02:21:35 DEBUG : ignore-size: md5 = 98bf7d8c15784f0a3d63204441e1e2aa OK 2025/01/14 02:21:35 INFO : ignore-size: Copied (new) 2025/01/14 02:21:35 DEBUG : Waiting for deletions to finish run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:21:37 DEBUG : ignore-size: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:21:37 DEBUG : ignore-size: Unchanged skipping 2025/01/14 02:21:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for checks to finish 2025/01/14 02:21:37 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for transfers to finish 2025/01/14 02:21:37 DEBUG : Waiting for deletions to finish 2025/01/14 02:21:37 INFO : There was nothing to transfer run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" --- PASS: TestSyncIgnoreSize (14.87s) === RUN TestSyncWithUpdateOlder run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:21:50 INFO : one.rclone_chunk.001_29halx: Moved (server-side) to: one 2025/01/14 02:21:56 INFO : two.rclone_chunk.001_29hg88: Moved (server-side) to: two 2025/01/14 02:22:02 INFO : three.rclone_chunk.001_29hmq2: Moved (server-side) to: three 2025/01/14 02:22:08 INFO : four.rclone_chunk.001_29hsrs: Moved (server-side) to: four 2025/01/14 02:22:09 DEBUG : five: Need to transfer - File not found at Destination 2025/01/14 02:22:09 DEBUG : one: Destination is newer than source, skipping 2025/01/14 02:22:09 DEBUG : three: Sizes identical 2025/01/14 02:22:09 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for checks to finish 2025/01/14 02:22:09 DEBUG : three: Destination mod time is within 1s of source and files identical, skipping 2025/01/14 02:22:09 DEBUG : four: Sizes differ (src 4 vs dst 8) 2025/01/14 02:22:09 DEBUG : four: Destination mod time is within 1s of source but files differ, transferring 2025/01/14 02:22:09 DEBUG : four: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:22:09 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 (Local file system at /tmp/rclone4001019536) 2025/01/14 02:22:09 DEBUG : two: md5 = 0f82d86afa0f5dc965c5c15aca58dcfb (Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki') 2025/01/14 02:22:09 DEBUG : two: md5 differ 2025/01/14 02:22:09 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for transfers to finish 2025/01/14 02:22:09 DEBUG : two: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:22:09 DEBUG : five: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:22:15 INFO : five.rclone_chunk.001_29hza0: Moved (server-side) to: five 2025/01/14 02:22:15 DEBUG : five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/01/14 02:22:15 INFO : five: Copied (new) 2025/01/14 02:22:17 INFO : two: Deleted 2025/01/14 02:22:18 INFO : four: Deleted 2025/01/14 02:22:19 INFO : two.rclone_chunk.001_29hzo4: Moved (server-side) to: two 2025/01/14 02:22:19 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/14 02:22:19 INFO : two: Copied (replaced existing) 2025/01/14 02:22:20 INFO : four.rclone_chunk.001_29hz4h: Moved (server-side) to: four 2025/01/14 02:22:20 DEBUG : four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/01/14 02:22:20 INFO : four: Copied (replaced existing) 2025/01/14 02:22:20 DEBUG : Waiting for deletions to finish 2025/01/14 02:22:21 DEBUG : one: Destination is newer than source, skipping 2025/01/14 02:22:21 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for checks to finish 2025/01/14 02:22:21 DEBUG : three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 (Local file system at /tmp/rclone4001019536) 2025/01/14 02:22:21 DEBUG : three: md5 = 413af0de1f97a2155acf2b8b26ab36e2 (Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki') 2025/01/14 02:22:21 DEBUG : three: md5 differ 2025/01/14 02:22:21 DEBUG : three: Destination mod time is within 1s of source but files differ, transferring 2025/01/14 02:22:21 DEBUG : five: md5 = 30056e1cab7a61d256fc8edd970d14f5 OK 2025/01/14 02:22:21 DEBUG : five: Size and md5 of src and dst objects identical 2025/01/14 02:22:21 DEBUG : five: Destination mod time is within 1s of source and files identical, skipping 2025/01/14 02:22:21 DEBUG : three: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:22:21 DEBUG : four: md5 = 8cbad96aced40b3838dd9f07f6ef5772 OK 2025/01/14 02:22:21 DEBUG : four: Size and md5 of src and dst objects identical 2025/01/14 02:22:21 DEBUG : four: Destination mod time is within 1s of source and files identical, skipping 2025/01/14 02:22:21 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/14 02:22:21 DEBUG : two: Size and md5 of src and dst objects identical 2025/01/14 02:22:21 DEBUG : two: Destination mod time is within 1s of source and files identical, skipping 2025/01/14 02:22:21 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for transfers to finish 2025/01/14 02:22:29 INFO : three: Deleted 2025/01/14 02:22:31 INFO : three.rclone_chunk.001_29ibyw: Moved (server-side) to: three 2025/01/14 02:22:31 DEBUG : three: md5 = 35d6d33467aae9a2e3dccb4b6b027878 OK 2025/01/14 02:22:31 INFO : three: Copied (replaced existing) 2025/01/14 02:22:31 DEBUG : Waiting for deletions to finish --- PASS: TestSyncWithUpdateOlder (67.44s) === RUN TestServerSideMove run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:22:51 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-wilelay2baju" 2025/01/14 02:22:51 DEBUG : Config file has changed externally - reloading 2025/01/14 02:22:51 DEBUG : Creating backend with remote "TestYandex:rclone-test-wilelay2baju" 2025/01/14 02:22:52 DEBUG : Reset feature "ListR" 2025/01/14 02:23:00 INFO : potato2.rclone_chunk.001_29j6ea: Moved (server-side) to: potato2.rclone_chunk.001 2025/01/14 02:23:03 INFO : potato2.rclone_chunk.002_29j6ea: Moved (server-side) to: potato2.rclone_chunk.002 2025/01/14 02:23:15 INFO : empty space.rclone_chunk.001_29jnch: Moved (server-side) to: empty space 2025/01/14 02:23:24 INFO : potato3.rclone_chunk.001_29jutu: Moved (server-side) to: potato3.rclone_chunk.001 2025/01/14 02:23:27 INFO : potato3.rclone_chunk.002_29jutu: Moved (server-side) to: potato3.rclone_chunk.002 2025/01/14 02:23:30 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/14 02:23:30 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/14 02:23:30 DEBUG : pacer: Reducing sleep to 15ms 2025/01/14 02:23:31 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/14 02:23:32 DEBUG : pacer: Reducing sleep to 10ms sync_test.go:1705: Server side move (if possible) Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki' -> Chunked 'TestChunkerChunk50bYandex:rclone-test-wilelay2baju' 2025/01/14 02:23:40 INFO : empty space.rclone_chunk.001_29kcmx: Moved (server-side) to: empty space 2025/01/14 02:23:49 INFO : potato3.rclone_chunk.001_29kism: Moved (server-side) to: potato3.rclone_chunk.001 2025/01/14 02:23:51 INFO : potato3.rclone_chunk.002_29kism: Moved (server-side) to: potato3.rclone_chunk.002 2025/01/14 02:23:54 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wilelay2baju': Using server-side directory move 2025/01/14 02:23:54 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-wilelay2baju': Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2025/01/14 02:23:55 DEBUG : potato2: Need to transfer - File not found at Destination 2025/01/14 02:23:55 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:23:55 DEBUG : empty space: Unchanged skipping 2025/01/14 02:23:55 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/01/14 02:23:55 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wilelay2baju': Waiting for checks to finish 2025/01/14 02:23:55 DEBUG : potato2: move 2 data chunks... 2025/01/14 02:23:58 INFO : potato2.rclone_chunk.001: Moved (server-side) 2025/01/14 02:23:59 INFO : empty space: Deleted 2025/01/14 02:23:59 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wilelay2baju': Waiting for transfers to finish 2025/01/14 02:24:00 INFO : potato2.rclone_chunk.002: Moved (server-side) 2025/01/14 02:24:04 INFO : potato2: Moved (server-side) 2025/01/14 02:24:06 INFO : potato3: Deleted 2025/01/14 02:24:07 INFO : potato2: Moved (server-side) 2025/01/14 02:24:07 DEBUG : potato3: move 2 data chunks... 2025/01/14 02:24:10 INFO : potato3.rclone_chunk.001: Moved (server-side) 2025/01/14 02:24:14 INFO : potato3.rclone_chunk.002: Moved (server-side) 2025/01/14 02:24:16 INFO : potato3: Moved (server-side) 2025/01/14 02:24:18 INFO : potato3: Moved (server-side) 2025/01/14 02:24:20 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-xijojuk6qefe" 2025/01/14 02:24:20 DEBUG : Creating backend with remote "TestYandex:rclone-test-xijojuk6qefe" 2025/01/14 02:24:20 DEBUG : Reset feature "ListR" 2025/01/14 02:24:20 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xijojuk6qefe': Using server-side directory move 2025/01/14 02:24:24 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-xijojuk6qefe': Server side directory move succeeded 2025/01/14 02:24:26 ERROR : : error listing: directory not found 2025/01/14 02:24:26 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-xijojuk6qefe': Purge remote 2025/01/14 02:24:38 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-wilelay2baju': Purge remote 2025/01/14 02:24:38 NOTICE: purge failed: [404 - DiskNotFoundError] Resource not found. (Не удалось найти запрошенный ресурс.) --- PASS: TestServerSideMove (108.13s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:24:39 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-daliqoz2niro" 2025/01/14 02:24:39 DEBUG : Config file has changed externally - reloading 2025/01/14 02:24:39 DEBUG : Creating backend with remote "TestYandex:rclone-test-daliqoz2niro" 2025/01/14 02:24:40 DEBUG : Reset feature "ListR" 2025/01/14 02:24:53 INFO : potato2.rclone_chunk.001_29m6hu: Moved (server-side) to: potato2.rclone_chunk.001 2025/01/14 02:24:55 INFO : potato2.rclone_chunk.002_29m6hu: Moved (server-side) to: potato2.rclone_chunk.002 2025/01/14 02:25:04 INFO : empty space.rclone_chunk.001_29mosx: Moved (server-side) to: empty space 2025/01/14 02:25:13 INFO : potato3.rclone_chunk.001_29mv80: Moved (server-side) to: potato3.rclone_chunk.001 2025/01/14 02:25:15 INFO : potato3.rclone_chunk.002_29mv80: Moved (server-side) to: potato3.rclone_chunk.002 2025/01/14 02:25:18 INFO : tomatoDir: Making directory sync_test.go:1705: Server side move (if possible) Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki' -> Chunked 'TestChunkerChunk50bYandex:rclone-test-daliqoz2niro' 2025/01/14 02:25:28 INFO : empty space.rclone_chunk.001_29nbpd: Moved (server-side) to: empty space 2025/01/14 02:25:37 INFO : potato3.rclone_chunk.001_29nir6: Moved (server-side) to: potato3.rclone_chunk.001 2025/01/14 02:25:38 INFO : potato3.rclone_chunk.002_29nir6: Moved (server-side) to: potato3.rclone_chunk.002 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1710 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901 Error: Should be true Test: TestServerSideMoveDeleteEmptySourceDirs Messages: potato3: Modification time difference too big |-209902h20m32.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-14 02:25:39 +0000 UTC) (precision 1ns) 2025/01/14 02:25:43 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-daliqoz2niro': Using server-side directory move 2025/01/14 02:25:43 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-daliqoz2niro': Server side directory move failed - fallback to file moves: can't copy directory - destination already exists 2025/01/14 02:25:44 DEBUG : potato2: Need to transfer - File not found at Destination 2025/01/14 02:25:44 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:25:44 DEBUG : empty space: Unchanged skipping 2025/01/14 02:25:44 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2025/01/14 02:25:44 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-daliqoz2niro': Waiting for checks to finish 2025/01/14 02:25:44 DEBUG : potato2: move 2 data chunks... 2025/01/14 02:25:46 INFO : potato2.rclone_chunk.001: Moved (server-side) 2025/01/14 02:25:48 INFO : potato2.rclone_chunk.002: Moved (server-side) 2025/01/14 02:25:51 INFO : empty space: Deleted 2025/01/14 02:25:51 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-daliqoz2niro': Waiting for transfers to finish 2025/01/14 02:25:53 INFO : potato2: Moved (server-side) 2025/01/14 02:25:55 INFO : potato3: Deleted 2025/01/14 02:25:55 DEBUG : potato3: move 2 data chunks... 2025/01/14 02:25:57 INFO : potato2: Moved (server-side) 2025/01/14 02:25:58 INFO : potato3.rclone_chunk.001: Moved (server-side) 2025/01/14 02:26:00 INFO : potato3.rclone_chunk.002: Moved (server-side) 2025/01/14 02:26:02 INFO : potato3: Moved (server-side) 2025/01/14 02:26:05 INFO : potato3: Moved (server-side) 2025/01/14 02:26:05 INFO : tomatoDir: Removing directory 2025/01/14 02:26:09 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': deleted 1 directories fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1729 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901 Error: Should be true Test: TestServerSideMoveDeleteEmptySourceDirs Messages: potato3: Modification time difference too big |-114445h26m4.876543211s| > 1ns (want 2011-12-25 12:59:59.123456789 +0000 UTC vs got 2025-01-14 02:26:04 +0000 UTC) (precision 1ns) 2025/01/14 02:26:12 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-palamaq7qoci" 2025/01/14 02:26:12 DEBUG : Creating backend with remote "TestYandex:rclone-test-palamaq7qoci" 2025/01/14 02:26:13 DEBUG : Reset feature "ListR" 2025/01/14 02:26:13 INFO : tomatoDir: Making directory 2025/01/14 02:26:13 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-palamaq7qoci': Using server-side directory move 2025/01/14 02:26:19 INFO : Chunked 'TestChunkerChunk50bYandex:rclone-test-palamaq7qoci': Server side directory move succeeded fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1752 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:1901 Error: Should be true Test: TestServerSideMoveDeleteEmptySourceDirs Messages: potato3: Modification time difference too big |-114445h26m4.876543211s| > 1ns (want 2011-12-25 12:59:59.123456789 +0000 UTC vs got 2025-01-14 02:26:04 +0000 UTC) (precision 1ns) 2025/01/14 02:26:22 ERROR : : error listing: directory not found 2025/01/14 02:26:22 ERROR : : error listing: directory not found 2025/01/14 02:26:22 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-palamaq7qoci': Purge remote 2025/01/14 02:26:33 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-daliqoz2niro': Purge remote 2025/01/14 02:26:33 NOTICE: purge failed: [404 - DiskNotFoundError] Resource not found. (Не удалось найти запрошенный ресурс.) --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (114.66s) === RUN TestSyncCompareDest run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:26:34 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst" 2025/01/14 02:26:34 DEBUG : Creating backend with remote "TestYandex:rclone-test-hofanum0viki/dst" 2025/01/14 02:26:34 DEBUG : Reset feature "ListR" 2025/01/14 02:26:34 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-hofanum0viki/CompareDest" 2025/01/14 02:26:34 DEBUG : Creating backend with remote "TestYandex:rclone-test-hofanum0viki/CompareDest" 2025/01/14 02:26:34 DEBUG : Reset feature "ListR" 2025/01/14 02:26:35 DEBUG : one: Need to transfer - File not found at Destination 2025/01/14 02:26:35 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:26:35 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:26:36 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:26:42 INFO : one.rclone_chunk.001_29pexl: Moved (server-side) to: one 2025/01/14 02:26:42 DEBUG : one: md5 = f97c5d29941bfb1b2fdab0874906ab82 OK 2025/01/14 02:26:42 INFO : one: Copied (new) 2025/01/14 02:26:42 DEBUG : Waiting for deletions to finish 2025/01/14 02:26:45 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/14 02:26:45 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:26:45 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:26:45 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:26:53 INFO : one: Deleted 2025/01/14 02:26:55 INFO : one.rclone_chunk.001_29pns4: Moved (server-side) to: one 2025/01/14 02:26:55 DEBUG : one: md5 = 07912d142f5d63ee918b34796b5a2432 OK 2025/01/14 02:26:55 INFO : one: Copied (replaced existing) 2025/01/14 02:26:55 DEBUG : Waiting for deletions to finish 2025/01/14 02:27:05 INFO : dst/one: Deleted 2025/01/14 02:27:07 INFO : dst/one.rclone_chunk.001_29pzix: Moved (server-side) to: dst/one 2025/01/14 02:27:14 INFO : CompareDest/one.rclone_chunk.001_29qaej: Moved (server-side) to: CompareDest/one 2025/01/14 02:27:16 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/14 02:27:16 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:27:16 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:16 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/14 02:27:16 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:27:16 DEBUG : Waiting for deletions to finish 2025/01/14 02:27:16 INFO : There was nothing to transfer 2025/01/14 02:27:24 INFO : CompareDest/two.rclone_chunk.001_29qkup: Moved (server-side) to: CompareDest/two 2025/01/14 02:27:27 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:27 DEBUG : two: Destination found in --compare-dest, skipping 2025/01/14 02:27:27 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/14 02:27:27 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:27:28 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:28 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/14 02:27:28 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:27:28 DEBUG : Waiting for deletions to finish 2025/01/14 02:27:28 INFO : There was nothing to transfer 2025/01/14 02:27:31 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:31 DEBUG : two: Destination found in --compare-dest, skipping 2025/01/14 02:27:31 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/14 02:27:31 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:27:32 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:32 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/14 02:27:32 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:27:32 DEBUG : Waiting for deletions to finish 2025/01/14 02:27:32 INFO : There was nothing to transfer 2025/01/14 02:27:35 DEBUG : two: Modification times differ by -119h59m59.876543211s: 2011-12-30 12:59:59 +0000 UTC, 2011-12-25 12:59:59.123456789 +0000 UTC 2025/01/14 02:27:35 DEBUG : two: md5 = b8a9f715dbb64fd5c56e7783c6820a61 OK 2025/01/14 02:27:35 DEBUG : two: Destination found in --compare-dest, skipping 2025/01/14 02:27:35 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/14 02:27:35 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:27:36 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:36 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/14 02:27:36 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:27:36 DEBUG : Waiting for deletions to finish 2025/01/14 02:27:36 INFO : There was nothing to transfer 2025/01/14 02:27:40 DEBUG : two: Sizes differ (src 5 vs dst 3) 2025/01/14 02:27:40 DEBUG : two: Need to transfer - File not found at Destination 2025/01/14 02:27:40 DEBUG : one: Sizes differ (src 5 vs dst 3) 2025/01/14 02:27:40 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:27:41 DEBUG : two: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:27:41 DEBUG : one: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:27:41 DEBUG : one: Destination found in --compare-dest, skipping 2025/01/14 02:27:41 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:27:43 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/14 02:27:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/14 02:27:44 DEBUG : pacer: Reducing sleep to 15ms 2025/01/14 02:27:44 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/14 02:27:45 DEBUG : pacer: Reducing sleep to 10ms 2025/01/14 02:28:05 INFO : two.rclone_chunk.001_29r7ok: Moved (server-side) to: two 2025/01/14 02:28:05 DEBUG : two: md5 = 2379e4ce8c3380e996ab0509f17069ad OK 2025/01/14 02:28:05 INFO : two: Copied (new) 2025/01/14 02:28:05 DEBUG : Waiting for deletions to finish --- PASS: TestSyncCompareDest (117.91s) === RUN TestSyncBackupDirSuffixOnly run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:28:37 INFO : dst/one.rclone_chunk.001_29sm59: Moved (server-side) to: dst/one 2025/01/14 02:28:46 INFO : dst/two.rclone_chunk.001_29ssf3: Moved (server-side) to: dst/two 2025/01/14 02:28:53 INFO : dst/three.txt.rclone_chunk.001_29t08p: Moved (server-side) to: dst/three.txt 2025/01/14 02:28:53 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst" 2025/01/14 02:28:53 DEBUG : Config file has changed externally - reloading 2025/01/14 02:28:53 DEBUG : Creating backend with remote "TestYandex:rclone-test-hofanum0viki/dst" 2025/01/14 02:28:54 DEBUG : Reset feature "ListR" 2025/01/14 02:28:54 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/01/14 02:28:54 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:28:54 DEBUG : two: Unchanged skipping 2025/01/14 02:28:54 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:28:55 DEBUG : one: move non-chunked object... 2025/01/14 02:28:57 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:28:57 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:28:57 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:28:58 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:29:05 INFO : one.rclone_chunk.001_29tckx: Moved (server-side) to: one 2025/01/14 02:29:05 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/01/14 02:29:05 INFO : one: Copied (new) 2025/01/14 02:29:05 DEBUG : Waiting for deletions to finish 2025/01/14 02:29:05 DEBUG : three.txt: move non-chunked object... 2025/01/14 02:29:08 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:29:08 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:29:08 INFO : three.txt: Moved into backup dir 2025/01/14 02:29:16 INFO : dst/three.txt.rclone_chunk.001_29tn8z: Moved (server-side) to: dst/three.txt 2025/01/14 02:29:17 DEBUG : one.bak: Excluded (Path Filter) 2025/01/14 02:29:17 DEBUG : one.bak: Excluded 2025/01/14 02:29:17 DEBUG : three.txt.bak: Excluded (Path Filter) 2025/01/14 02:29:17 DEBUG : three.txt.bak: Excluded 2025/01/14 02:29:17 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/01/14 02:29:17 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:29:17 DEBUG : two: Unchanged skipping 2025/01/14 02:29:17 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for checks to finish 2025/01/14 02:29:22 INFO : one.bak: Deleted 2025/01/14 02:29:22 DEBUG : one: move non-chunked object... 2025/01/14 02:29:25 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:29:25 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:29:25 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst': Waiting for transfers to finish 2025/01/14 02:29:25 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:29:31 INFO : one.rclone_chunk.001_29u338: Moved (server-side) to: one 2025/01/14 02:29:31 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/01/14 02:29:31 INFO : one: Copied (new) 2025/01/14 02:29:31 DEBUG : Waiting for deletions to finish 2025/01/14 02:29:35 INFO : three.txt.bak: Deleted 2025/01/14 02:29:35 DEBUG : three.txt: move non-chunked object... 2025/01/14 02:29:37 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:29:37 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:29:37 INFO : three.txt: Moved into backup dir --- PASS: TestSyncBackupDirSuffixOnly (87.62s) === RUN TestSyncSuffix run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:30:06 INFO : dst/one.rclone_chunk.001_29v2sn: Moved (server-side) to: dst/one 2025/01/14 02:30:14 INFO : dst/two.rclone_chunk.001_29v814: Moved (server-side) to: dst/two 2025/01/14 02:30:21 INFO : dst/three.txt.rclone_chunk.001_29vhly: Moved (server-side) to: dst/three.txt 2025/01/14 02:30:22 DEBUG : Creating backend with remote "TestChunkerChunk50bYandex:rclone-test-hofanum0viki/dst" 2025/01/14 02:30:22 DEBUG : Config file has changed externally - reloading 2025/01/14 02:30:22 DEBUG : Creating backend with remote "TestYandex:rclone-test-hofanum0viki/dst" 2025/01/14 02:30:22 DEBUG : Reset feature "ListR" 2025/01/14 02:30:23 DEBUG : one: Sizes differ (src 4 vs dst 3) 2025/01/14 02:30:24 DEBUG : one: move non-chunked object... 2025/01/14 02:30:25 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:30:25 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:30:26 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:30:32 INFO : one.rclone_chunk.001_29vsof: Moved (server-side) to: one 2025/01/14 02:30:32 DEBUG : one: md5 = c7957179c41f69d44f217a108c7915d8 OK 2025/01/14 02:30:32 INFO : one: Copied (new) 2025/01/14 02:30:33 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:30:33 DEBUG : two: Unchanged skipping 2025/01/14 02:30:34 DEBUG : three.txt: Sizes differ (src 6 vs dst 5) 2025/01/14 02:30:35 DEBUG : three.txt: move non-chunked object... 2025/01/14 02:30:37 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:30:37 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:30:38 DEBUG : three.txt: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:30:44 INFO : three.txt.rclone_chunk.001_29w4by: Moved (server-side) to: three.txt 2025/01/14 02:30:44 DEBUG : three.txt: md5 = 91341eed84691a83caea73aa785736d5 OK 2025/01/14 02:30:44 INFO : three.txt: Copied (new) 2025/01/14 02:30:47 DEBUG : one: Sizes differ (src 5 vs dst 4) 2025/01/14 02:30:52 INFO : one.bak: Deleted 2025/01/14 02:30:52 DEBUG : one: move non-chunked object... 2025/01/14 02:30:54 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:30:54 INFO : one: Moved (server-side) to: one.bak 2025/01/14 02:30:55 DEBUG : one: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:31:01 INFO : one.rclone_chunk.001_29wlj5: Moved (server-side) to: one 2025/01/14 02:31:01 DEBUG : one: md5 = 0f93e81041f0cab37c37a05ae998b219 OK 2025/01/14 02:31:01 INFO : one: Copied (new) 2025/01/14 02:31:02 DEBUG : two: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:31:02 DEBUG : two: Unchanged skipping 2025/01/14 02:31:03 DEBUG : three.txt: Sizes differ (src 19 vs dst 6) 2025/01/14 02:31:08 INFO : three.txt.bak: Deleted 2025/01/14 02:31:08 DEBUG : three.txt: move non-chunked object... 2025/01/14 02:31:10 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:31:10 INFO : three.txt: Moved (server-side) to: three.txt.bak 2025/01/14 02:31:10 DEBUG : three.txt: skip slow MD5 on source file, hashing in-transit 2025/01/14 02:31:16 INFO : three.txt.rclone_chunk.001_29x0d2: Moved (server-side) to: three.txt 2025/01/14 02:31:16 DEBUG : three.txt: md5 = 423e01c5e84a30d129b97aedb6e219a9 OK 2025/01/14 02:31:16 INFO : three.txt: Copied (new) --- PASS: TestSyncSuffix (102.64s) === RUN TestSyncConcurrentDelete run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" 2025/01/14 02:31:49 INFO : both0.rclone_chunk.001_29xw00: Moved (server-side) to: both0 2025/01/14 02:31:55 INFO : only0.rclone_chunk.001_29y32y: Moved (server-side) to: only0 2025/01/14 02:32:02 INFO : both1.rclone_chunk.001_29y9fb: Moved (server-side) to: both1 2025/01/14 02:32:08 INFO : only1.rclone_chunk.001_29yg22: Moved (server-side) to: only1 2025/01/14 02:32:11 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/14 02:32:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/14 02:32:11 DEBUG : pacer: Reducing sleep to 15ms 2025/01/14 02:32:12 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/14 02:32:12 DEBUG : pacer: Reducing sleep to 10ms 2025/01/14 02:32:15 INFO : both2.rclone_chunk.001_29ym2v: Moved (server-side) to: both2 2025/01/14 02:32:21 INFO : only2.rclone_chunk.001_29ytcm: Moved (server-side) to: only2 2025/01/14 02:32:27 INFO : both3.rclone_chunk.001_29z06v: Moved (server-side) to: both3 2025/01/14 02:32:34 INFO : only3.rclone_chunk.001_29z6ar: Moved (server-side) to: only3 2025/01/14 02:32:41 INFO : both4.rclone_chunk.001_29zddy: Moved (server-side) to: both4 2025/01/14 02:32:47 INFO : only4.rclone_chunk.001_29zksj: Moved (server-side) to: only4 2025/01/14 02:32:54 INFO : both5.rclone_chunk.001_29zqjr: Moved (server-side) to: both5 2025/01/14 02:33:01 INFO : only5.rclone_chunk.001_29zwh1: Moved (server-side) to: only5 2025/01/14 02:33:07 INFO : both6.rclone_chunk.001_2a03e1: Moved (server-side) to: both6 2025/01/14 02:33:13 INFO : only6.rclone_chunk.001_2a09ur: Moved (server-side) to: only6 2025/01/14 02:33:20 INFO : both7.rclone_chunk.001_2a0gd6: Moved (server-side) to: both7 2025/01/14 02:33:27 INFO : only7.rclone_chunk.001_2a0nh9: Moved (server-side) to: only7 2025/01/14 02:33:35 INFO : both8.rclone_chunk.001_2a0tj5: Moved (server-side) to: both8 2025/01/14 02:33:41 INFO : only8.rclone_chunk.001_2a11de: Moved (server-side) to: only8 2025/01/14 02:33:48 INFO : both9.rclone_chunk.001_2a187p: Moved (server-side) to: both9 2025/01/14 02:33:54 INFO : only9.rclone_chunk.001_2a1es6: Moved (server-side) to: only9 2025/01/14 02:34:00 INFO : both10.rclone_chunk.001_2a1knb: Moved (server-side) to: both10 2025/01/14 02:34:07 INFO : only10.rclone_chunk.001_2a1qmh: Moved (server-side) to: only10 2025/01/14 02:34:13 INFO : both11.rclone_chunk.001_2a1y6s: Moved (server-side) to: both11 2025/01/14 02:34:20 INFO : only11.rclone_chunk.001_2a241y: Moved (server-side) to: only11 2025/01/14 02:34:27 INFO : both12.rclone_chunk.001_2a2afz: Moved (server-side) to: both12 2025/01/14 02:34:33 INFO : only12.rclone_chunk.001_2a2h61: Moved (server-side) to: only12 2025/01/14 02:34:39 INFO : both13.rclone_chunk.001_2a2nou: Moved (server-side) to: both13 2025/01/14 02:34:46 INFO : only13.rclone_chunk.001_2a2uja: Moved (server-side) to: only13 2025/01/14 02:34:52 INFO : both14.rclone_chunk.001_2a30iv: Moved (server-side) to: both14 2025/01/14 02:34:59 INFO : only14.rclone_chunk.001_2a37dw: Moved (server-side) to: only14 2025/01/14 02:35:06 INFO : both15.rclone_chunk.001_2a3ecn: Moved (server-side) to: both15 2025/01/14 02:35:13 INFO : only15.rclone_chunk.001_2a3l4v: Moved (server-side) to: only15 2025/01/14 02:35:24 INFO : both16.rclone_chunk.001_2a3rhk: Moved (server-side) to: both16 2025/01/14 02:35:31 INFO : only16.rclone_chunk.001_2a43oz: Moved (server-side) to: only16 2025/01/14 02:35:37 INFO : both17.rclone_chunk.001_2a49cg: Moved (server-side) to: both17 2025/01/14 02:35:44 INFO : only17.rclone_chunk.001_2a4ged: Moved (server-side) to: only17 2025/01/14 02:35:53 INFO : both18.rclone_chunk.001_2a4n79: Moved (server-side) to: both18 2025/01/14 02:36:00 INFO : only18.rclone_chunk.001_2a4v1o: Moved (server-side) to: only18 2025/01/14 02:36:08 INFO : both19.rclone_chunk.001_2a53i6: Moved (server-side) to: both19 2025/01/14 02:36:12 DEBUG : pacer: low level retry 1/10 (error [500 - InternalServerError] Internal Server Error (Ошибка сервера.)) 2025/01/14 02:36:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/01/14 02:36:12 DEBUG : pacer: Reducing sleep to 15ms 2025/01/14 02:36:13 DEBUG : pacer: Reducing sleep to 11.25ms 2025/01/14 02:36:13 DEBUG : pacer: Reducing sleep to 10ms 2025/01/14 02:36:16 INFO : only19.rclone_chunk.001_2a5a79: Moved (server-side) to: only19 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: both17: Modification time difference too big |-209902h30m29.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-14 02:35:36 +0000 UTC) (precision 1ns) fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:344 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:340 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2744 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2758 Error: Should be true Test: TestSyncConcurrentDelete Messages: only11: Modification time difference too big |-209902h29m12.500000001s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2025-01-14 02:34:19 +0000 UTC) (precision 1ns) 2025/01/14 02:36:17 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for checks to finish 2025/01/14 02:36:17 DEBUG : both1: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both0: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both10: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both11: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both1: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both12: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both12: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both13: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both13: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both14: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both14: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both15: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both15: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both16: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both16: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both17: Modification times differ by 209902h30m29.500000001s: 2001-02-03 04:05:06.499999999 +0000 UTC, 2025-01-14 02:35:36 +0000 UTC 2025/01/14 02:36:17 DEBUG : both0: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both18: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both18: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both19: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both17: md5 = 8ee2027983915ec78acc45027d874316 OK 2025/01/14 02:36:17 DEBUG : both19: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both2: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both2: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both3: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both3: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both4: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both4: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both5: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both5: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both6: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both6: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both7: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both7: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both8: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both8: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both9: Size and modification time the same (differ by 0s, within tolerance 1ns) 2025/01/14 02:36:17 DEBUG : both9: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both10: Unchanged skipping 2025/01/14 02:36:17 DEBUG : both11: Unchanged skipping 2025/01/14 02:36:18 INFO : both17: Updated modification time in destination 2025/01/14 02:36:18 DEBUG : both17: Unchanged skipping 2025/01/14 02:36:18 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Waiting for transfers to finish 2025/01/14 02:36:18 DEBUG : Waiting for deletions to finish 2025/01/14 02:36:21 INFO : only7: Deleted 2025/01/14 02:36:21 INFO : only1: Deleted 2025/01/14 02:36:21 INFO : only8: Deleted 2025/01/14 02:36:22 INFO : only9: Deleted 2025/01/14 02:36:25 INFO : only4: Deleted 2025/01/14 02:36:25 INFO : only17: Deleted 2025/01/14 02:36:25 INFO : only12: Deleted 2025/01/14 02:36:25 INFO : only18: Deleted 2025/01/14 02:36:28 INFO : only16: Deleted 2025/01/14 02:36:29 INFO : only0: Deleted 2025/01/14 02:36:29 INFO : only10: Deleted 2025/01/14 02:36:32 INFO : only19: Deleted 2025/01/14 02:36:32 INFO : only2: Deleted 2025/01/14 02:36:32 INFO : only5: Deleted 2025/01/14 02:36:33 INFO : only3: Deleted 2025/01/14 02:36:36 INFO : only6: Deleted 2025/01/14 02:36:36 INFO : only11: Deleted 2025/01/14 02:36:36 INFO : only13: Deleted 2025/01/14 02:36:36 INFO : only14: Deleted 2025/01/14 02:36:40 INFO : only15: Deleted run.go:180: Remote "Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki'", Local "Local file system at /tmp/rclone4001019536", Modify Window "1ns" --- FAIL: TestSyncConcurrentDelete (378.87s) FAIL 2025/01/14 02:38:01 DEBUG : Chunked 'TestChunkerChunk50bYandex:rclone-test-hofanum0viki': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bYandex: -verbose -size-limit 1024 -test.run '^(TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestSyncBackupDirSuffixOnly|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncIgnoreSize|TestSyncNoEmptyDirectories|TestSyncSuffix|TestSyncWithUpdateOlder)$'" - Finished ERROR in 16m56.36347965s (try 2/5): exit status 1: Failed [TestServerSideMoveDeleteEmptySourceDirs TestSyncConcurrentDelete]