"./sync.test -test.v -test.timeout 1h0m0s -remote TestGoFile: -verbose -fast-list -test.run '^TestServerSideCopyOverSelf$'" - Starting (try 4/5) 2024/09/30 02:01:13 DEBUG : Creating backend with remote "TestGoFile:rclone-test-zutikuy0mevo" 2024/09/30 02:01:13 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/09/30 02:01:13 DEBUG : Creating backend with remote "/tmp/rclone1021678198" === RUN TestServerSideCopyOverSelf run.go:180: Remote "gofile root 'rclone-test-zutikuy0mevo'", Local "Local file system at /tmp/rclone1021678198", Modify Window "1s" 2024/09/30 02:01:14 DEBUG : Upload server store7 (eu) responded in 133.578854ms 2024/09/30 02:01:14 DEBUG : Upload server store2 (eu) responded in 135.890483ms 2024/09/30 02:01:14 DEBUG : sub dir/hello world: Using upload server store7 (eu) 2024/09/30 02:01:15 DEBUG : Creating backend with remote "TestGoFile:rclone-test-mipebir7vodu" sync_test.go:626: Server side copy (if possible) gofile root 'rclone-test-zutikuy0mevo' -> gofile root 'rclone-test-mipebir7vodu' 2024/09/30 02:01:15 DEBUG : Added delayed dir = "sub dir", newDst= 2024/09/30 02:01:15 DEBUG : sub dir/hello world: Need to transfer - File not found at Destination 2024/09/30 02:01:15 DEBUG : gofile root 'rclone-test-mipebir7vodu': Waiting for checks to finish 2024/09/30 02:01:15 DEBUG : gofile root 'rclone-test-mipebir7vodu': Waiting for transfers to finish 2024/09/30 02:01:16 DEBUG : sub dir/hello world: md5 = 5eb63bbbe01eeed093cb22bb8f5acdc3 OK 2024/09/30 02:01:16 INFO : sub dir/hello world: Copied (server-side copy) 2024/09/30 02:01:16 INFO : sub dir: Set directory modification time (using DirSetModTime) run.go:180: Remote "gofile root 'rclone-test-zutikuy0mevo'", Local "Local file system at /tmp/rclone1021678198", Modify Window "1s" 2024/09/30 02:01:17 DEBUG : sub dir/hello world: Using upload server store7 (eu) 2024/09/30 02:01:17 DEBUG : sub dir/hello world: Removing old object on successful upload 2024/09/30 02:01:18 DEBUG : Added delayed dir = "sub dir", newDst=sub dir 2024/09/30 02:01:18 DEBUG : sub dir/hello world: Sizes differ (src 17 vs dst 11) 2024/09/30 02:01:18 DEBUG : gofile root 'rclone-test-mipebir7vodu': Waiting for checks to finish 2024/09/30 02:01:18 DEBUG : gofile root 'rclone-test-mipebir7vodu': Waiting for transfers to finish 2024/09/30 02:01:18 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:23 DEBUG : pacer: low level retry 1/10 (error Error "error-rateLimit") 2024/09/30 02:01:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/09/30 02:01:23 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:28 DEBUG : pacer: low level retry 2/10 (error Error "error-rateLimit") 2024/09/30 02:01:28 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/09/30 02:01:28 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:33 DEBUG : pacer: low level retry 3/10 (error Error "error-rateLimit") 2024/09/30 02:01:33 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/09/30 02:01:33 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:38 DEBUG : pacer: low level retry 4/10 (error Error "error-rateLimit") 2024/09/30 02:01:38 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/09/30 02:01:38 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:43 DEBUG : pacer: low level retry 5/10 (error Error "error-rateLimit") 2024/09/30 02:01:43 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/09/30 02:01:43 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:48 DEBUG : pacer: low level retry 6/10 (error Error "error-rateLimit") 2024/09/30 02:01:48 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/09/30 02:01:48 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:53 DEBUG : pacer: low level retry 7/10 (error Error "error-rateLimit") 2024/09/30 02:01:53 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/09/30 02:01:53 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:01:58 DEBUG : pacer: low level retry 8/10 (error Error "error-rateLimit") 2024/09/30 02:01:58 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2024/09/30 02:01:58 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:02:03 DEBUG : pacer: low level retry 9/10 (error Error "error-rateLimit") 2024/09/30 02:02:03 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2024/09/30 02:02:03 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:02:08 DEBUG : pacer: low level retry 10/10 (error Error "error-rateLimit") 2024/09/30 02:02:08 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2024/09/30 02:02:08 DEBUG : sub dir/hello world: Received error: failed to copy item: Error "error-rateLimit" - low level retry 0/10 2024/09/30 02:02:08 DEBUG : Rate limited, sleep for 5s 2024/09/30 02:02:13 DEBUG : pacer: low level retry 1/10 (error Error "error-rateLimit") 2024/09/30 02:02:13 DEBUG : pacer: Rate limited, increasing sleep to 20s 2024/09/30 02:02:19 DEBUG : pacer: Reducing sleep to 10s 2024/09/30 02:02:38 DEBUG : pacer: Reducing sleep to 5s 2024/09/30 02:02:38 DEBUG : sub dir/hello world: md5 = 00321a507bdb420dbbd4f53c733b1505 OK 2024/09/30 02:02:38 INFO : sub dir/hello world: Copied (server-side copy) 2024/09/30 02:02:48 DEBUG : pacer: Reducing sleep to 2.5s 2024/09/30 02:02:48 INFO : sub dir: Set directory modification time (using SetModTime) run.go:180: Remote "gofile root 'rclone-test-zutikuy0mevo'", Local "Local file system at /tmp/rclone1021678198", Modify Window "1s" 2024/09/30 02:02:54 DEBUG : pacer: Reducing sleep to 1.25s fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Flushing the directory cache 2024/09/30 02:02:56 DEBUG : pacer: Reducing sleep to 625ms 2024/09/30 02:02:57 DEBUG : pacer: Reducing sleep to 312.5ms fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Flushing the directory cache 2024/09/30 02:03:00 DEBUG : pacer: Reducing sleep to 156.25ms 2024/09/30 02:03:00 DEBUG : pacer: Reducing sleep to 78.125ms fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:295: Flushing the directory cache fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:641 Error: Should be true Test: TestServerSideCopyOverSelf Messages: listing wrong, want sub dir/hello world (17) got sub dir/hello world (11), sub dir/hello world (17) fstest.go:137: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:137 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:143 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:641 Error: Should be true Test: TestServerSideCopyOverSelf Messages: gofile root 'rclone-test-mipebir7vodu'/sub dir/hello world: md5 hash incorrect - expecting "00321a507bdb420dbbd4f53c733b1505" got "5eb63bbbe01eeed093cb22bb8f5acdc3" fstest.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:144 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:641 Error: Not equal: expected: 17 actual : 11 Test: TestServerSideCopyOverSelf Messages: sub dir/hello world: size incorrect file=17 vs obj=11 fstest.go:121: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:121 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:126 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:145 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:189 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:641 Error: Should be true Test: TestServerSideCopyOverSelf Messages: sub dir/hello world: Modification time difference too big |95456h54m53.123456789s| > 1s (want 2011-12-25 12:59:59.123456789 +0000 UTC vs got 2001-02-03 04:05:06 +0000 UTC) (precision 1s) fstest.go:185: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:350 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:641 Error: Should be true Test: TestServerSideCopyOverSelf Messages: Unexpected file "sub dir/hello world" 2024/09/30 02:03:04 DEBUG : gofile root 'rclone-test-mipebir7vodu': Purge remote 2024/09/30 02:03:04 DEBUG : pacer: Reducing sleep to 39.0625ms 2024/09/30 02:03:05 DEBUG : pacer: Reducing sleep to 19.53125ms --- FAIL: TestServerSideCopyOverSelf (112.72s) FAIL 2024/09/30 02:03:06 DEBUG : gofile root 'rclone-test-zutikuy0mevo': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestGoFile: -verbose -fast-list -test.run '^TestServerSideCopyOverSelf$'" - Finished ERROR in 1m53.443624584s (try 4/5): exit status 1: Failed [TestServerSideCopyOverSelf]