"./vfs.test -test.v -test.timeout 1h0m0s -remote TestGoFile: -verbose -test.run '^TestFileRename$/^(minimal,forceCache=false|off,forceCache=false)$'" - Starting (try 3/5) 2024/11/03 04:49:17 DEBUG : Creating backend with remote "TestGoFile:rclone-test-gogosec7juvi" 2024/11/03 04:49:17 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/03 04:49:17 DEBUG : Creating backend with remote "/tmp/rclone1845053647" === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "gofile root 'rclone-test-gogosec7juvi'", Local "Local file system at /tmp/rclone1845053647", Modify Window "1s" 2024/11/03 04:49:17 INFO : gofile root 'rclone-test-gogosec7juvi': poll-interval is not supported by this remote 2024/11/03 04:49:18 DEBUG : Upload server store4 (eu) responded in 126.282636ms 2024/11/03 04:49:18 DEBUG : Upload server store1 (eu) responded in 133.593844ms 2024/11/03 04:49:18 DEBUG : dir/file1: Using upload server store1 (eu) 2024/11/03 04:49:19 DEBUG : WaitForWriters: timeout=30s 2024/11/03 04:49:19 DEBUG : dir: Looking for writers 2024/11/03 04:49:19 DEBUG : file1: reading active writers 2024/11/03 04:49:19 DEBUG : : Looking for writers 2024/11/03 04:49:19 DEBUG : dir: reading active writers 2024/11/03 04:49:19 DEBUG : >WaitForWriters: 2024/11/03 04:49:19 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:24 DEBUG : pacer: low level retry 1/10 (error Error "error-rateLimit") 2024/11/03 04:49:24 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/03 04:49:24 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:29 DEBUG : pacer: low level retry 2/10 (error Error "error-rateLimit") 2024/11/03 04:49:29 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/03 04:49:29 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:34 DEBUG : pacer: low level retry 3/10 (error Error "error-rateLimit") 2024/11/03 04:49:34 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/03 04:49:34 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:39 DEBUG : pacer: low level retry 4/10 (error Error "error-rateLimit") 2024/11/03 04:49:39 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/11/03 04:49:39 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:44 DEBUG : pacer: low level retry 5/10 (error Error "error-rateLimit") 2024/11/03 04:49:44 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/11/03 04:49:45 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:50 DEBUG : pacer: low level retry 6/10 (error Error "error-rateLimit") 2024/11/03 04:49:50 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/11/03 04:49:50 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:49:55 DEBUG : pacer: low level retry 7/10 (error Error "error-rateLimit") 2024/11/03 04:49:55 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/11/03 04:49:55 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:00 DEBUG : pacer: low level retry 8/10 (error Error "error-rateLimit") 2024/11/03 04:50:00 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2024/11/03 04:50:00 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:05 DEBUG : pacer: low level retry 9/10 (error Error "error-rateLimit") 2024/11/03 04:50:05 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2024/11/03 04:50:05 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:10 DEBUG : pacer: low level retry 10/10 (error Error "error-rateLimit") 2024/11/03 04:50:10 DEBUG : pacer: Rate limited, increasing sleep to 10.24s 2024/11/03 04:50:10 ERROR : dir/file1: Couldn't move: failed to move item: Error "error-rateLimit" 2024/11/03 04:50:10 ERROR : newLeaf: File.Rename error: failed to move item: Error "error-rateLimit" 2024/11/03 04:50:10 ERROR : dir/file1: Dir.Rename error: failed to move item: Error "error-rateLimit" file_test.go:342: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/file_test.go:342 /home/rclone/go/src/github.com/rclone/rclone/vfs/file_test.go:413 Error: Received unexpected error: failed to move item: Error "error-rateLimit" Test: TestFileRename/off,forceCache=false 2024/11/03 04:50:10 DEBUG : WaitForWriters: timeout=30s 2024/11/03 04:50:10 DEBUG : dir: Looking for writers 2024/11/03 04:50:10 DEBUG : file1: reading active writers 2024/11/03 04:50:10 DEBUG : : Looking for writers 2024/11/03 04:50:10 DEBUG : dir: reading active writers 2024/11/03 04:50:10 DEBUG : >WaitForWriters: 2024/11/03 04:50:10 DEBUG : pacer: Reducing sleep to 5.12s 2024/11/03 04:50:20 DEBUG : pacer: Reducing sleep to 2.56s 2024/11/03 04:50:25 DEBUG : pacer: Reducing sleep to 1.28s 2024/11/03 04:50:28 DEBUG : pacer: Reducing sleep to 640ms 2024/11/03 04:50:29 DEBUG : pacer: Reducing sleep to 320ms === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "gofile root 'rclone-test-gogosec7juvi'", Local "Local file system at /tmp/rclone1845053647", Modify Window "1s" 2024/11/03 04:50:29 INFO : gofile root 'rclone-test-gogosec7juvi': poll-interval is not supported by this remote 2024/11/03 04:50:29 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/11/03 04:50:29 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestGoFile/rclone-test-gogosec7juvi" 2024/11/03 04:50:29 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestGoFile/rclone-test-gogosec7juvi" 2024/11/03 04:50:29 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot':/home/rclone/.cache/rclone/vfs/TestGoFile/rclone-test-gogosec7juvi" 2024/11/03 04:50:29 DEBUG : :local: detected overridden config - adding "{bxYPm}" suffix to name 2024/11/03 04:50:29 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot':/home/rclone/.cache/rclone/vfs/TestGoFile/rclone-test-gogosec7juvi" to be canonical ":local{bxYPm}:/home/rclone/.cache/rclone/vfs/TestGoFile/rclone-test-gogosec7juvi" 2024/11/03 04:50:29 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot':/home/rclone/.cache/rclone/vfsMeta/TestGoFile/rclone-test-gogosec7juvi" 2024/11/03 04:50:29 DEBUG : :local: detected overridden config - adding "{bxYPm}" suffix to name 2024/11/03 04:50:29 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot':/home/rclone/.cache/rclone/vfsMeta/TestGoFile/rclone-test-gogosec7juvi" to be canonical ":local{bxYPm}:/home/rclone/.cache/rclone/vfsMeta/TestGoFile/rclone-test-gogosec7juvi" 2024/11/03 04:50:29 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/11/03 04:50:30 DEBUG : pacer: Reducing sleep to 160ms 2024/11/03 04:50:30 DEBUG : pacer: Reducing sleep to 80ms 2024/11/03 04:50:30 DEBUG : pacer: Reducing sleep to 40ms 2024/11/03 04:50:30 DEBUG : pacer: Reducing sleep to 20ms 2024/11/03 04:50:30 DEBUG : Upload server store6 (eu) responded in 129.71508ms 2024/11/03 04:50:30 DEBUG : Upload server store10 (eu) responded in 132.813512ms 2024/11/03 04:50:30 DEBUG : dir/file1: Using upload server store6 (eu) 2024/11/03 04:50:31 DEBUG : pacer: Reducing sleep to 10ms 2024/11/03 04:50:31 DEBUG : WaitForWriters: timeout=30s 2024/11/03 04:50:31 DEBUG : dir: Looking for writers 2024/11/03 04:50:31 DEBUG : file1: reading active writers 2024/11/03 04:50:31 DEBUG : : Looking for writers 2024/11/03 04:50:31 DEBUG : dir: reading active writers 2024/11/03 04:50:31 DEBUG : >WaitForWriters: 2024/11/03 04:50:31 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:36 DEBUG : pacer: low level retry 1/10 (error Error "error-rateLimit") 2024/11/03 04:50:36 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/03 04:50:36 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:41 DEBUG : pacer: low level retry 2/10 (error Error "error-rateLimit") 2024/11/03 04:50:41 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/03 04:50:42 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:47 DEBUG : pacer: low level retry 3/10 (error Error "error-rateLimit") 2024/11/03 04:50:47 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/03 04:50:47 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:52 DEBUG : pacer: low level retry 4/10 (error Error "error-rateLimit") 2024/11/03 04:50:52 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/11/03 04:50:52 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:50:57 DEBUG : pacer: low level retry 5/10 (error Error "error-rateLimit") 2024/11/03 04:50:57 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/11/03 04:50:57 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:51:02 DEBUG : pacer: low level retry 6/10 (error Error "error-rateLimit") 2024/11/03 04:51:02 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/11/03 04:51:02 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:51:07 DEBUG : pacer: low level retry 7/10 (error Error "error-rateLimit") 2024/11/03 04:51:07 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/11/03 04:51:07 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:51:12 DEBUG : pacer: low level retry 8/10 (error Error "error-rateLimit") 2024/11/03 04:51:12 DEBUG : pacer: Rate limited, increasing sleep to 2.56s 2024/11/03 04:51:12 DEBUG : Rate limited, sleep for 5s 2024/11/03 04:51:17 DEBUG : pacer: low level retry 9/10 (error Error "error-rateLimit") 2024/11/03 04:51:17 DEBUG : pacer: Rate limited, increasing sleep to 5.12s 2024/11/03 04:51:18 DEBUG : pacer: Reducing sleep to 2.56s 2024/11/03 04:51:18 INFO : dir/file1: Moved (server-side) to: newLeaf 2024/11/03 04:51:18 DEBUG : newLeaf: Updating file with newLeaf 0xc0002c0a80 2024/11/03 04:51:18 DEBUG : dir: Added virtual directory entry vDel: "file1" 2024/11/03 04:51:18 DEBUG : : Added virtual directory entry vAddFile: "newLeaf" 2024/11/03 04:51:23 DEBUG : pacer: Reducing sleep to 1.28s 2024/11/03 04:51:26 DEBUG : pacer: Reducing sleep to 640ms 2024/11/03 04:51:26 DEBUG : pacer: Reducing sleep to 320ms 2024/11/03 04:51:27 DEBUG : pacer: Reducing sleep to 160ms 2024/11/03 04:51:27 INFO : newLeaf: Moved (server-side) to: dir/file1 2024/11/03 04:51:27 DEBUG : dir/file1: Updating file with dir/file1 0xc0002c0a80 2024/11/03 04:51:27 DEBUG : : Added virtual directory entry vDel: "newLeaf" 2024/11/03 04:51:27 DEBUG : dir: Added virtual directory entry vAddFile: "file1" 2024/11/03 04:51:27 DEBUG : pacer: Reducing sleep to 80ms 2024/11/03 04:51:27 DEBUG : dir/file1: Open: flags=O_WRONLY|O_TRUNC 2024/11/03 04:51:27 DEBUG : dir/file1: >Open: fd=dir/file1 (w), err= 2024/11/03 04:51:27 DEBUG : dir: Added virtual directory entry vAddFile: "file1" 2024/11/03 04:51:27 DEBUG : dir/file1: File is currently open, delaying rename 0xc0002c0a80 2024/11/03 04:51:27 DEBUG : dir: Added virtual directory entry vDel: "file1" 2024/11/03 04:51:27 DEBUG : : Added virtual directory entry vAddFile: "newLeaf" 2024/11/03 04:51:27 DEBUG : gofile root 'rclone-test-gogosec7juvi': File to upload is small (25 bytes), uploading instead of streaming 2024/11/03 04:51:28 DEBUG : pacer: Reducing sleep to 40ms 2024/11/03 04:51:28 DEBUG : dir/file1: Using upload server store6 (eu) 2024/11/03 04:51:28 DEBUG : pacer: Reducing sleep to 20ms 2024/11/03 04:51:28 DEBUG : dir/file1: Removing old object on successful upload 2024/11/03 04:51:28 DEBUG : pacer: Reducing sleep to 10ms 2024/11/03 04:51:28 DEBUG : dir/file1: md5 = c7247bead226dfd7bd970c17229f4044 OK 2024/11/03 04:51:28 DEBUG : dir/file1: Size and md5 of src and dst objects identical 2024/11/03 04:51:28 DEBUG : : Added virtual directory entry vAddFile: "newLeaf" 2024/11/03 04:51:28 DEBUG : newLeaf: Running delayed rename now 2024/11/03 04:51:28 INFO : dir/file1: Moved (server-side) to: newLeaf 2024/11/03 04:51:28 DEBUG : newLeaf: Updating file with newLeaf 0xc0002c0a80 2024/11/03 04:51:28 DEBUG : WaitForWriters: timeout=30s 2024/11/03 04:51:28 DEBUG : dir: Looking for writers 2024/11/03 04:51:28 DEBUG : : Looking for writers 2024/11/03 04:51:28 DEBUG : dir: reading active writers 2024/11/03 04:51:28 DEBUG : newLeaf: reading active writers 2024/11/03 04:51:28 DEBUG : >WaitForWriters: 2024/11/03 04:51:28 DEBUG : WaitForWriters: timeout=30s 2024/11/03 04:51:28 DEBUG : dir: Looking for writers 2024/11/03 04:51:28 DEBUG : : Looking for writers 2024/11/03 04:51:28 DEBUG : newLeaf: reading active writers 2024/11/03 04:51:28 DEBUG : dir: reading active writers 2024/11/03 04:51:28 DEBUG : >WaitForWriters: 2024/11/03 04:51:28 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (132.13s) --- FAIL: TestFileRename/off,forceCache=false (72.11s) --- PASS: TestFileRename/minimal,forceCache=false (60.02s) FAIL 2024/11/03 04:51:29 DEBUG : gofile root 'rclone-test-gogosec7juvi': Purge remote "./vfs.test -test.v -test.timeout 1h0m0s -remote TestGoFile: -verbose -test.run '^TestFileRename$/^(minimal,forceCache=false|off,forceCache=false)$'" - Finished ERROR in 2m12.83711669s (try 3/5): exit status 1: Failed [TestFileRename/off,forceCache=false]