"./vfs.test -test.v -test.timeout 1h0m0s -remote TestS3DigitalOcean: -verbose -test.run '^(TestDirRename|TestFileRename)$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$'" - Starting (try 4/5) === RUN TestDirRename 2020/07/24 10:50:45 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 10:50:53 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: Bucket "rclone-test-joroleg9yazerut7punefal5" created with ACL "private" 2020/07/24 10:50:53 ERROR : dir/not found: Dir.Rename error: file does not exist 2020/07/24 10:50:53 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/07/24 10:50:53 INFO : dir/file1: Copied (server side copy) 2020/07/24 10:50:53 INFO : dir/file1: Deleted 2020/07/24 10:50:53 DEBUG : dir/file3: MD5 = ea32138586c9d4e9533ef6cf95e9ec4b OK 2020/07/24 10:50:53 INFO : dir/file3: Copied (server side copy) 2020/07/24 10:50:53 INFO : dir/file3: Deleted 2020/07/24 10:50:53 DEBUG : dir: Updating dir with dir2 0xc000228600 2020/07/24 10:50:53 DEBUG : dir: forgetting directory cache 2020/07/24 10:50:53 DEBUG : : Added virtual directory entry vDel: "dir" 2020/07/24 10:50:53 DEBUG : : Added virtual directory entry vAdd: "dir2" 2020/07/24 10:50:54 DEBUG : dir2/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/07/24 10:50:54 INFO : dir2/file1: Copied (server side copy) 2020/07/24 10:50:54 INFO : dir2/file1: Deleted 2020/07/24 10:50:54 DEBUG : file2: Updating file with file2 0xc00057e0c0 2020/07/24 10:50:54 DEBUG : dir2: Added virtual directory entry vDel: "file1" 2020/07/24 10:50:54 DEBUG : : Added virtual directory entry vAdd: "file2" 2020/07/24 10:50:54 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2020/07/24 10:50:54 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:54 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2020/07/24 10:50:55 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:55 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 10:50:56 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:50:56 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 10:50:58 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:00 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:02 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:04 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:06 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:08 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:10 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:12 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:14 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:16 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:16 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 10:51:18 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:20 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:22 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:24 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:26 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:28 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:30 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:32 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:34 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:36 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:36 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 10:51:38 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:40 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:42 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:44 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:46 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:48 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:50 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:52 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:54 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:56 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:51:56 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 10:51:58 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:00 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:02 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:04 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:06 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:08 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:10 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:12 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:14 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:16 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:16 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 10:52:18 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:20 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:22 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:24 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:26 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:28 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:30 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:32 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:34 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:36 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:36 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 10:52:38 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:40 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:42 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:44 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:46 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:48 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:50 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:52 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:54 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:56 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:52:56 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 10:52:58 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:00 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:02 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:04 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:06 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:08 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:10 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:12 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:14 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:16 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:16 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 10:53:18 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:20 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:22 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:24 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:26 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:28 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:30 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:32 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:34 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:36 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:36 DEBUG : file2: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 10:53:38 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:40 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:42 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:44 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:46 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:48 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:50 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:52 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:54 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:56 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:53:56 ERROR : file2: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:53:56 ERROR : file2: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:53:56 ERROR : dir2/file3: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:53:56 ERROR : file2: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:53:58 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 10:54:00 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 10:54:02 DEBUG : pacer: Reducing sleep to 843.75ms 2020/07/24 10:54:06 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 10:54:06 DEBUG : : Added virtual directory entry vAdd: "empty directory" 2020/07/24 10:54:07 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 10:54:07 DEBUG : empty directory: Updating dir with renamed empty directory 0xc0002286c0 2020/07/24 10:54:07 DEBUG : empty directory: forgetting directory cache 2020/07/24 10:54:07 DEBUG : : Added virtual directory entry vDel: "empty directory" 2020/07/24 10:54:07 DEBUG : : Added virtual directory entry vAdd: "renamed empty directory" 2020/07/24 10:54:07 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:54:07 DEBUG : dir2: Looking for writers 2020/07/24 10:54:07 DEBUG : file3: reading active writers 2020/07/24 10:54:07 DEBUG : renamed empty directory: Looking for writers 2020/07/24 10:54:07 DEBUG : : Looking for writers 2020/07/24 10:54:07 DEBUG : dir2: reading active writers 2020/07/24 10:54:07 DEBUG : file2: reading active writers 2020/07/24 10:54:07 DEBUG : renamed empty directory: reading active writers 2020/07/24 10:54:07 DEBUG : >WaitForWriters: 2020/07/24 10:54:08 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/07/24 10:54:08 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 150.169371ms --- FAIL: TestDirRename (204.25s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" dir_test.go:546: Error Trace: dir_test.go:546 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestDirRename dir_test.go:252: Error Trace: dir_test.go:252 dir_test.go:547 Error: Not equal: expected: []string{"dir2,0,true"} actual : []string{"dir2,0,true", "file3,14,false"} Diff: --- Expected +++ Actual @@ -1,3 +1,4 @@ -([]string) (len=1) { - (string) (len=11) "dir2,0,true" +([]string) (len=2) { + (string) (len=11) "dir2,0,true", + (string) (len=14) "file3,14,false" } Test: TestDirRename dir_test.go:252: Error Trace: dir_test.go:252 dir_test.go:548 Error: Not equal: expected: []string{"file3,14,false"} actual : []string{"file3,15,false"} Diff: --- Expected +++ Actual @@ -1,3 +1,3 @@ ([]string) (len=1) { - (string) (len=14) "file3,14,false" + (string) (len=14) "file3,15,false" } Test: TestDirRename fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 dir_test.go:552 Error: Should be true Test: TestDirRename Messages: listing wrong, want dir2/file3 (14) got dir2/file3 (15), file2 (14) fstest.go:140: Error Trace: fstest.go:140 fstest.go:146 fstest.go:192 fstest.go:305 fstest.go:335 dir_test.go:552 Error: Should be true Test: TestDirRename Messages: S3 bucket rclone-test-joroleg9yazerut7punefal5/dir2/file3: MD5 hash incorrect - expecting "0ef726ce9b1a7692357ff70dd321d595" got "ea32138586c9d4e9533ef6cf95e9ec4b" fstest.go:147: Error Trace: fstest.go:147 fstest.go:192 fstest.go:305 fstest.go:335 dir_test.go:552 Error: Not equal: expected: 14 actual : 15 Test: TestDirRename Messages: dir2/file3: size incorrect file=14 vs obj=15 fstest.go:188: Error Trace: fstest.go:188 fstest.go:305 fstest.go:335 dir_test.go:552 Error: Should be true Test: TestDirRename Messages: Unexpected file "file2" dir_test.go:252: Error Trace: dir_test.go:252 dir_test.go:557 Error: Not equal: expected: []string{"dir2,0,true", "empty directory,0,true"} actual : []string{"dir2,0,true", "file3,14,false", "empty directory,0,true"} Diff: --- Expected +++ Actual @@ -1,3 +1,4 @@ -([]string) (len=2) { +([]string) (len=3) { (string) (len=11) "dir2,0,true", + (string) (len=14) "file3,14,false", (string) (len=22) "empty directory,0,true" Test: TestDirRename dir_test.go:252: Error Trace: dir_test.go:252 dir_test.go:563 Error: Not equal: expected: []string{"dir2,0,true", "renamed empty directory,0,true"} actual : []string{"dir2,0,true", "file3,14,false", "renamed empty directory,0,true"} Diff: --- Expected +++ Actual @@ -1,3 +1,4 @@ -([]string) (len=2) { +([]string) (len=3) { (string) (len=11) "dir2,0,true", + (string) (len=14) "file3,14,false", (string) (len=30) "renamed empty directory,0,true" Test: TestDirRename === RUN TestFileRename === RUN TestFileRename/off,forceCache=false 2020/07/24 10:54:09 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/07/24 10:54:09 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/07/24 10:54:10 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/07/24 10:54:10 DEBUG : pacer: Reducing sleep to 20.04519ms 2020/07/24 10:54:10 DEBUG : pacer: Reducing sleep to 15.033892ms 2020/07/24 10:54:10 DEBUG : pacer: Reducing sleep to 11.275419ms 2020/07/24 10:54:10 DEBUG : pacer: Reducing sleep to 0s 2020/07/24 10:54:10 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/07/24 10:54:10 INFO : dir/file1: Copied (server side copy) 2020/07/24 10:54:10 INFO : dir/file1: Deleted 2020/07/24 10:54:10 DEBUG : newLeaf: Updating file with newLeaf 0xc000690000 2020/07/24 10:54:10 DEBUG : dir: Added virtual directory entry vDel: "file1" 2020/07/24 10:54:10 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/07/24 10:54:10 DEBUG : newLeaf: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/07/24 10:54:10 INFO : newLeaf: Copied (server side copy) 2020/07/24 10:54:10 INFO : newLeaf: Deleted 2020/07/24 10:54:10 DEBUG : dir/file1: Updating file with dir/file1 0xc000690000 2020/07/24 10:54:10 DEBUG : : Added virtual directory entry vDel: "newLeaf" 2020/07/24 10:54:10 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 10:54:10 DEBUG : dir/file1: Open: flags=O_WRONLY|O_TRUNC 2020/07/24 10:54:10 DEBUG : dir/file1: >Open: fd=dir/file1 (w), err= 2020/07/24 10:54:10 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 10:54:10 DEBUG : dir/file1: File is currently open, delaying rename 0xc000690000 2020/07/24 10:54:10 DEBUG : dir: Added virtual directory entry vDel: "file1" 2020/07/24 10:54:10 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/07/24 10:54:10 DEBUG : S3 bucket rclone-test-joroleg9yazerut7punefal5: File to upload is small (25 bytes), uploading instead of streaming 2020/07/24 10:54:10 DEBUG : dir/file1: MD5 = c7247bead226dfd7bd970c17229f4044 OK 2020/07/24 10:54:10 INFO : dir/file1: Copied (new) 2020/07/24 10:54:10 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/07/24 10:54:10 DEBUG : newLeaf: Running delayed rename now 2020/07/24 10:54:10 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2020/07/24 10:54:10 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2020/07/24 10:54:10 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2020/07/24 10:54:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2020/07/24 10:54:10 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2020/07/24 10:54:10 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2020/07/24 10:54:10 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:10 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2020/07/24 10:54:11 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:11 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2020/07/24 10:54:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:11 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 10:54:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:13 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 10:54:15 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:17 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:19 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:23 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:25 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:27 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:33 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 10:54:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:37 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:39 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:41 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:43 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:45 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:47 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:49 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:51 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:53 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:53 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 10:54:55 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:57 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:54:59 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:03 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:05 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:07 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:09 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:13 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 10:55:15 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:17 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:19 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:23 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:25 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:27 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:33 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 10:55:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:37 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:39 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:41 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:43 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:45 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:47 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:49 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:51 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:53 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:53 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 10:55:55 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:57 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:55:59 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:03 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:05 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:07 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:09 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:13 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 10:56:15 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:17 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:19 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:23 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:25 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:27 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:33 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 10:56:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:37 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:39 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:41 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:43 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:45 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:47 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:49 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:51 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:53 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:53 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 10:56:55 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:57 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:56:59 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:03 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:05 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:07 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:09 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:13 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:57:13 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:57:13 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:57:13 ERROR : newLeaf: delayed File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 10:57:13 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:57:13 DEBUG : dir: Looking for writers 2020/07/24 10:57:13 DEBUG : : Looking for writers 2020/07/24 10:57:13 DEBUG : dir: reading active writers 2020/07/24 10:57:13 DEBUG : newLeaf: reading active writers 2020/07/24 10:57:13 DEBUG : >WaitForWriters: 2020/07/24 10:57:15 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 10:57:17 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 10:57:19 DEBUG : pacer: Reducing sleep to 843.75ms 2020/07/24 10:57:23 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:57:23 DEBUG : dir: Looking for writers 2020/07/24 10:57:23 DEBUG : : Looking for writers 2020/07/24 10:57:23 DEBUG : dir: reading active writers 2020/07/24 10:57:23 DEBUG : newLeaf: reading active writers 2020/07/24 10:57:23 DEBUG : >WaitForWriters: 2020/07/24 10:57:23 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 10:57:24 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 10:57:24 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestFileRename/minimal,forceCache=false 2020/07/24 10:57:24 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 10:57:24 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 10:57:24 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 10:57:24 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 10:57:25 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/07/24 10:57:25 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/07/24 10:57:25 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/07/24 10:57:26 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/07/24 10:57:26 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/07/24 10:57:26 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/07/24 10:57:26 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/07/24 10:57:26 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/07/24 10:57:26 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/07/24 10:57:26 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:26 DEBUG : pacer: Rate limited, increasing sleep to 53.453842ms 2020/07/24 10:57:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:26 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2020/07/24 10:57:26 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:26 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2020/07/24 10:57:26 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:26 DEBUG : pacer: Rate limited, increasing sleep to 427.630736ms 2020/07/24 10:57:26 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:26 DEBUG : pacer: Rate limited, increasing sleep to 855.261472ms 2020/07/24 10:57:27 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:27 DEBUG : pacer: Rate limited, increasing sleep to 1.710522944s 2020/07/24 10:57:28 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:28 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 10:57:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:33 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 10:57:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:37 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:39 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:41 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:43 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:45 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:47 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:49 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:51 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:53 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:53 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 10:57:55 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:57 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:57:59 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:03 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:05 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:07 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:09 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:13 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 10:58:15 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:17 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:19 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:23 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:24 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 10:58:25 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:27 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:33 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 10:58:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:37 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:39 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:41 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:43 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:45 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:47 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:49 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:51 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:53 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:53 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 10:58:55 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:57 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:58:59 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:03 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:05 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:07 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:09 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:13 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 10:59:15 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:17 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:19 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:23 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:24 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 10:59:25 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:27 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:33 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 10:59:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:37 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:39 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:41 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:43 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:45 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:47 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:49 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:51 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:53 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:53 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 10:59:55 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:57 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 10:59:59 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:03 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:05 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:07 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:09 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:11 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:13 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:13 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 11:00:15 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:17 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:19 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:23 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:24 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:00:25 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:27 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:29 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:31 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:33 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:33 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:00:33 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:00:33 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:00:33 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:00:33 DEBUG : WaitForWriters: timeout=10s 2020/07/24 11:00:33 DEBUG : dir: Looking for writers 2020/07/24 11:00:33 DEBUG : file1: reading active writers 2020/07/24 11:00:33 DEBUG : : Looking for writers 2020/07/24 11:00:33 DEBUG : dir: reading active writers 2020/07/24 11:00:33 DEBUG : >WaitForWriters: 2020/07/24 11:00:33 DEBUG : vfs cache: cleaner exiting 2020/07/24 11:00:35 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 11:00:37 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 11:00:39 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/minimal,forceCache=true 2020/07/24 11:00:39 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 11:00:39 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:00:39 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:00:39 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:00:40 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 11:00:41 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 11:00:42 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/07/24 11:00:42 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/07/24 11:00:42 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/07/24 11:00:43 DEBUG : dir/file1: Open: flags=O_RDWR|O_CREATE|O_TRUNC 2020/07/24 11:00:43 DEBUG : dir/file1: newRWFileHandle: 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006ad540): openPending: 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "" 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/07/24 11:00:43 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006ad540): >openPending: err= 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: truncate to size=0 2020/07/24 11:00:43 DEBUG : dir/file1: >newRWFileHandle: err= 2020/07/24 11:00:43 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:00:43 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006ad540): _writeAt: size=14, off=0 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006ad540): >_writeAt: n=14, err= 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006ad540): close: 2020/07/24 11:00:43 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: setting modification time to 2020-07-24 11:00:43.343271427 +0000 UTC m=+598.237843869 2020/07/24 11:00:43 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006ad540): >close: err= 2020/07/24 11:00:43 DEBUG : dir/file1: Open: flags=O_RDONLY 2020/07/24 11:00:43 DEBUG : dir/file1: newRWFileHandle: 2020/07/24 11:00:43 DEBUG : dir/file1: >newRWFileHandle: err= 2020/07/24 11:00:43 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006c7180): _readAt: size=512, off=0 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006c7180): openPending: 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/07/24 11:00:43 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006c7180): >openPending: err= 2020/07/24 11:00:43 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006c7180): >_readAt: n=14, err=EOF 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006c7180): close: 2020/07/24 11:00:43 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: setting modification time to 2020-07-24 11:00:43.343271427 +0000 UTC m=+598.237843869 2020/07/24 11:00:43 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/07/24 11:00:43 DEBUG : dir/file1(0xc0006c7180): >close: err= 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: starting upload 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/07/24 11:00:43 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/07/24 11:00:43 INFO : dir/file1: Copied (replaced existing) 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: fingerprint now "14,2020-07-24 11:00:43.343271427 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/07/24 11:00:43 DEBUG : dir/file1: vfs cache: writeback object to VFS layer 2020/07/24 11:00:43 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/07/24 11:00:43 INFO : dir/file1: vfs cache: upload succeeded try #1 2020/07/24 11:00:43 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/07/24 11:00:43 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:43 DEBUG : pacer: Rate limited, increasing sleep to 53.453842ms 2020/07/24 11:00:43 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:43 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2020/07/24 11:00:43 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:43 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2020/07/24 11:00:44 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:44 DEBUG : pacer: Rate limited, increasing sleep to 427.630736ms 2020/07/24 11:00:44 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:44 DEBUG : pacer: Rate limited, increasing sleep to 855.261472ms 2020/07/24 11:00:44 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:44 DEBUG : pacer: Rate limited, increasing sleep to 1.710522944s 2020/07/24 11:00:45 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:45 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 11:00:47 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:49 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:51 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:51 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 11:00:53 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:55 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:57 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:00:59 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:01 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:03 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:05 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:07 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:09 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:11 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:11 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 11:01:13 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:15 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:17 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:19 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:21 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:23 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:25 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:27 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:29 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:31 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:31 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 11:01:33 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:35 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:37 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:39 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:39 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 0) 2020/07/24 11:01:41 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:43 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:45 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:47 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:49 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:51 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:51 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 11:01:53 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:55 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:57 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:01:59 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:01 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:03 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:05 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:07 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:09 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:11 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:11 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 11:02:13 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:15 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:17 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:19 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:21 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:23 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:25 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:27 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:29 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:31 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:31 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 11:02:33 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:35 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:37 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:39 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:39 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/07/24 11:02:41 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:43 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:45 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:47 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:49 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:51 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:51 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 11:02:53 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:55 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:57 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:02:59 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:01 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:03 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:05 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:07 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:09 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:11 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:11 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 11:03:13 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:15 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:17 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:19 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:21 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:23 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:25 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:27 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:29 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:31 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:31 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 11:03:33 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:35 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:37 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:39 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:39 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/07/24 11:03:41 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:43 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:45 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:47 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:49 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:51 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:03:51 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:03:51 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:03:51 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:03:51 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:03:51 DEBUG : WaitForWriters: timeout=10s 2020/07/24 11:03:51 DEBUG : dir: Looking for writers 2020/07/24 11:03:51 DEBUG : file1: reading active writers 2020/07/24 11:03:51 DEBUG : : Looking for writers 2020/07/24 11:03:51 DEBUG : dir: reading active writers 2020/07/24 11:03:51 DEBUG : newLeaf: reading active writers 2020/07/24 11:03:51 DEBUG : >WaitForWriters: 2020/07/24 11:03:51 DEBUG : vfs cache: cleaner exiting 2020/07/24 11:03:53 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 11:03:55 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 11:03:56 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/writes,forceCache=false 2020/07/24 11:03:56 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 11:03:56 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:03:56 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:03:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:03:57 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 11:03:58 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 11:03:59 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/07/24 11:03:59 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/07/24 11:04:00 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/07/24 11:04:00 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/07/24 11:04:00 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/07/24 11:04:00 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/07/24 11:04:00 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/07/24 11:04:01 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:01 DEBUG : pacer: Rate limited, increasing sleep to 126.705406ms 2020/07/24 11:04:01 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:01 DEBUG : pacer: Rate limited, increasing sleep to 253.410812ms 2020/07/24 11:04:01 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:01 DEBUG : pacer: Rate limited, increasing sleep to 506.821624ms 2020/07/24 11:04:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:01 DEBUG : pacer: Rate limited, increasing sleep to 1.013643248s 2020/07/24 11:04:01 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:01 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 11:04:02 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:04 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:06 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:08 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:10 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:10 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 11:04:12 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:14 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:16 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:18 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:20 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:22 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:24 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:26 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:28 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:30 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:30 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 11:04:32 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:34 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:36 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:38 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:40 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:42 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:44 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:46 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:48 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:50 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:50 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 11:04:52 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:54 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:04:56 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:04:58 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:00 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:02 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:04 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:06 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:08 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:10 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:10 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 11:05:12 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:14 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:16 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:18 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:20 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:22 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:24 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:26 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:28 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:30 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:30 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 11:05:32 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:34 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:36 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:38 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:40 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:42 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:44 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:46 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:48 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:50 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:50 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 11:05:53 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:54 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:05:56 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:05:58 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:00 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:02 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:05 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:06 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:09 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:11 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:11 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 11:06:13 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:15 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:17 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:19 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:21 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:23 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:25 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:27 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:29 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:31 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:31 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 11:06:33 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:35 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:37 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:39 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:41 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:43 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:45 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:47 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:49 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:51 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:51 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 11:06:53 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:55 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:06:57 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:06:59 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:01 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:03 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:05 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:07 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:09 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:11 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:11 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:07:11 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:07:11 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:07:11 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:07:11 DEBUG : WaitForWriters: timeout=10s 2020/07/24 11:07:11 DEBUG : dir: Looking for writers 2020/07/24 11:07:11 DEBUG : file1: reading active writers 2020/07/24 11:07:11 DEBUG : : Looking for writers 2020/07/24 11:07:11 DEBUG : dir: reading active writers 2020/07/24 11:07:11 DEBUG : >WaitForWriters: 2020/07/24 11:07:11 DEBUG : vfs cache: cleaner exiting 2020/07/24 11:07:13 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 11:07:15 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 11:07:16 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/writes,forceCache=true 2020/07/24 11:07:16 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 11:07:16 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:07:16 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:07:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:07:17 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 11:07:18 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 11:07:19 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/07/24 11:07:19 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/07/24 11:07:19 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/07/24 11:07:20 DEBUG : dir/file1: Open: flags=O_RDWR|O_CREATE|O_TRUNC 2020/07/24 11:07:20 DEBUG : dir/file1: newRWFileHandle: 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006f3280): openPending: 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "" 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/07/24 11:07:20 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006f3280): >openPending: err= 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: truncate to size=0 2020/07/24 11:07:20 DEBUG : dir/file1: >newRWFileHandle: err= 2020/07/24 11:07:20 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:07:20 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006f3280): _writeAt: size=14, off=0 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006f3280): >_writeAt: n=14, err= 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006f3280): close: 2020/07/24 11:07:20 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: setting modification time to 2020-07-24 11:07:20.416646083 +0000 UTC m=+995.311218537 2020/07/24 11:07:20 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006f3280): >close: err= 2020/07/24 11:07:20 DEBUG : dir/file1: Open: flags=O_RDONLY 2020/07/24 11:07:20 DEBUG : dir/file1: newRWFileHandle: 2020/07/24 11:07:20 DEBUG : dir/file1: >newRWFileHandle: err= 2020/07/24 11:07:20 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006ac8c0): _readAt: size=512, off=0 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006ac8c0): openPending: 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/07/24 11:07:20 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006ac8c0): >openPending: err= 2020/07/24 11:07:20 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006ac8c0): >_readAt: n=14, err=EOF 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006ac8c0): close: 2020/07/24 11:07:20 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: setting modification time to 2020-07-24 11:07:20.416646083 +0000 UTC m=+995.311218537 2020/07/24 11:07:20 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/07/24 11:07:20 DEBUG : dir/file1(0xc0006ac8c0): >close: err= 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: starting upload 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/07/24 11:07:20 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/07/24 11:07:20 INFO : dir/file1: Copied (replaced existing) 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: fingerprint now "14,2020-07-24 11:07:20.416646083 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/07/24 11:07:20 DEBUG : dir/file1: vfs cache: writeback object to VFS layer 2020/07/24 11:07:20 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/07/24 11:07:20 INFO : dir/file1: vfs cache: upload succeeded try #1 2020/07/24 11:07:20 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/07/24 11:07:20 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:20 DEBUG : pacer: Rate limited, increasing sleep to 53.453842ms 2020/07/24 11:07:20 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:20 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2020/07/24 11:07:20 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:20 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2020/07/24 11:07:21 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:21 DEBUG : pacer: Rate limited, increasing sleep to 427.630736ms 2020/07/24 11:07:21 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:21 DEBUG : pacer: Rate limited, increasing sleep to 855.261472ms 2020/07/24 11:07:21 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:21 DEBUG : pacer: Rate limited, increasing sleep to 1.710522944s 2020/07/24 11:07:22 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:22 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 11:07:24 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:26 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:28 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:28 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 11:07:30 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:32 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:34 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:36 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:38 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:40 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:42 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:44 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:46 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:48 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:48 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 11:07:50 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:52 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:54 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:56 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:07:58 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:00 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:02 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:04 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:06 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:08 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:08 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 11:08:10 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:12 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:14 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:16 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:16 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 0) 2020/07/24 11:08:18 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:20 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:22 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:24 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:26 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:28 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:28 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 11:08:30 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:32 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:34 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:36 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:38 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:40 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:42 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:44 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:46 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:48 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:48 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 11:08:50 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:52 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:54 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:56 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:08:58 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:00 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:02 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:04 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:06 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:08 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:08 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 11:09:10 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:12 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:14 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:16 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:16 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/07/24 11:09:18 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:20 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:22 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:24 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:26 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:28 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:28 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 11:09:30 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:32 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:34 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:36 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:38 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:40 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:42 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:44 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:46 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:48 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:48 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 11:09:50 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:52 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:54 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:56 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:09:58 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:00 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:02 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:04 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:06 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:08 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:08 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 11:10:10 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:12 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:14 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:16 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:16 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/07/24 11:10:18 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:20 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:22 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:24 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:26 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:28 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:28 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:10:28 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:10:28 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:10:28 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:10:28 DEBUG : WaitForWriters: timeout=10s 2020/07/24 11:10:28 DEBUG : dir: Looking for writers 2020/07/24 11:10:28 DEBUG : file1: reading active writers 2020/07/24 11:10:28 DEBUG : : Looking for writers 2020/07/24 11:10:28 DEBUG : dir: reading active writers 2020/07/24 11:10:28 DEBUG : newLeaf: reading active writers 2020/07/24 11:10:28 DEBUG : >WaitForWriters: 2020/07/24 11:10:28 DEBUG : vfs cache: cleaner exiting 2020/07/24 11:10:30 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 11:10:32 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 11:10:33 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/full,forceCache=false 2020/07/24 11:10:33 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: poll-interval is not supported by this remote 2020/07/24 11:10:33 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:10:33 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-joroleg9yazerut7punefal5" 2020/07/24 11:10:33 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 11:10:34 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 11:10:35 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 11:10:36 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/07/24 11:10:36 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/07/24 11:10:37 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/07/24 11:10:37 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/07/24 11:10:37 DEBUG : dir/file1: Open: flags=O_RDONLY 2020/07/24 11:10:37 DEBUG : dir/file1: newRWFileHandle: 2020/07/24 11:10:37 DEBUG : dir/file1: >newRWFileHandle: err= 2020/07/24 11:10:37 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/07/24 11:10:37 DEBUG : dir/file1(0xc0007d20c0): _readAt: size=512, off=0 2020/07/24 11:10:37 DEBUG : dir/file1(0xc0007d20c0): openPending: 2020/07/24 11:10:37 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/07/24 11:10:37 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "" 2020/07/24 11:10:37 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/07/24 11:10:37 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/07/24 11:10:37 DEBUG : dir/file1(0xc0007d20c0): >openPending: err= 2020/07/24 11:10:37 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [] - present false 2020/07/24 11:10:37 DEBUG : dir/file1: ChunkedReader.RangeSeek from -1 to 0 length -1 2020/07/24 11:10:37 DEBUG : dir/file1: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2020/07/24 11:10:37 DEBUG : dir/file1: ChunkedReader.openRange at 0 length 134217728 2020/07/24 11:10:37 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/07/24 11:10:37 DEBUG : dir/file1(0xc0007d20c0): >_readAt: n=14, err=EOF 2020/07/24 11:10:37 DEBUG : dir/file1(0xc0007d20c0): close: 2020/07/24 11:10:37 DEBUG : dir/file1: vfs cache: setting modification time to 2001-02-03 04:05:06.499999999 +0000 UTC 2020/07/24 11:10:37 DEBUG : dir/file1(0xc0007d20c0): >close: err= 2020/07/24 11:10:38 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/07/24 11:10:38 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/07/24 11:10:38 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/07/24 11:10:38 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:38 DEBUG : pacer: Rate limited, increasing sleep to 71.27179ms 2020/07/24 11:10:38 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:38 DEBUG : pacer: Rate limited, increasing sleep to 142.54358ms 2020/07/24 11:10:38 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:38 DEBUG : pacer: Rate limited, increasing sleep to 285.08716ms 2020/07/24 11:10:38 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:38 DEBUG : pacer: Rate limited, increasing sleep to 570.17432ms 2020/07/24 11:10:38 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:38 DEBUG : pacer: Rate limited, increasing sleep to 1.14034864s 2020/07/24 11:10:39 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:39 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/07/24 11:10:40 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:42 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:44 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:46 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:46 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/07/24 11:10:48 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:50 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:52 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:54 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:56 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:10:58 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:00 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:02 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:04 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:06 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:06 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/07/24 11:11:08 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:10 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:12 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:14 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:16 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:18 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:20 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:22 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:24 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:26 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:26 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/07/24 11:11:28 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:30 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:32 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:33 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 0) 2020/07/24 11:11:34 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:36 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:38 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:40 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:42 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:44 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:46 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:46 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/07/24 11:11:48 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:50 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:52 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:54 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:56 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:11:58 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:00 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:02 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:04 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:06 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:06 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/07/24 11:12:08 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:10 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:12 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:14 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:16 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:18 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:20 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:22 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:24 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:26 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:26 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/07/24 11:12:28 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:30 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:32 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:33 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/07/24 11:12:34 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:36 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:38 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:40 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:42 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:44 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:46 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:46 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/07/24 11:12:48 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:50 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:52 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:54 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:56 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:12:58 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:00 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:02 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:04 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:06 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:06 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/07/24 11:13:08 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:10 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:12 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:14 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:16 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:18 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:20 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:22 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:24 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:26 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:26 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/07/24 11:13:28 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:30 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:32 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:33 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/07/24 11:13:34 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:36 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:38 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:40 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:42 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:44 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:46 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/07/24 11:13:46 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:13:46 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:13:46 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:13:46 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/07/24 11:13:46 DEBUG : WaitForWriters: timeout=10s 2020/07/24 11:13:46 DEBUG : dir: Looking for writers 2020/07/24 11:13:46 DEBUG : file1: reading active writers 2020/07/24 11:13:46 DEBUG : : Looking for writers 2020/07/24 11:13:46 DEBUG : dir: reading active writers 2020/07/24 11:13:46 DEBUG : >WaitForWriters: 2020/07/24 11:13:46 DEBUG : vfs cache: cleaner exiting 2020/07/24 11:13:48 DEBUG : pacer: Reducing sleep to 1.5s 2020/07/24 11:13:50 DEBUG : pacer: Reducing sleep to 1.125s 2020/07/24 11:13:51 DEBUG : pacer: Reducing sleep to 843.75ms --- FAIL: TestFileRename (1182.61s) --- FAIL: TestFileRename/off,forceCache=false (195.33s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 file_test.go:340 file_test.go:357 Error: Should be true Test: TestFileRename/off,forceCache=false Messages: listing wrong, want newLeaf (25) got dir/file1 (25) fstest.go:188: Error Trace: fstest.go:188 fstest.go:305 fstest.go:335 file_test.go:340 file_test.go:357 Error: Should be true Test: TestFileRename/off,forceCache=false Messages: Unexpected file "dir/file1" fstest.go:200: Not found "newLeaf" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 file_test.go:340 file_test.go:357 Error: Not equal: expected: 0 actual : 1 Test: TestFileRename/off,forceCache=false Messages: 1 objects not found --- FAIL: TestFileRename/minimal,forceCache=false (194.74s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/minimal,forceCache=false --- FAIL: TestFileRename/minimal,forceCache=true (197.32s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" fstest.go:124: Error Trace: fstest.go:124 fstest.go:129 fstest.go:148 fstest.go:192 fstest.go:305 fstest.go:335 fstest.go:347 file_test.go:282 file_test.go:357 Error: Should be true Test: TestFileRename/minimal,forceCache=true Messages: dir/file1: Modification time difference too big |-170670h55m36.843271428s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2020-07-24 11:00:43.343271427 +0000 UTC) (precision 1ns) file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/minimal,forceCache=true --- FAIL: TestFileRename/writes,forceCache=false (199.75s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/writes,forceCache=false --- FAIL: TestFileRename/writes,forceCache=true (197.33s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" fstest.go:124: Error Trace: fstest.go:124 fstest.go:129 fstest.go:148 fstest.go:192 fstest.go:305 fstest.go:335 fstest.go:347 file_test.go:282 file_test.go:357 Error: Should be true Test: TestFileRename/writes,forceCache=true Messages: dir/file1: Modification time difference too big |-170671h2m13.916646084s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2020-07-24 11:07:20.416646083 +0000 UTC) (precision 1ns) file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/writes,forceCache=true --- FAIL: TestFileRename/full,forceCache=false (198.14s) run.go:176: Remote "S3 bucket rclone-test-joroleg9yazerut7punefal5", Local "Local file system at /tmp/rclone975043246", Modify Window "1ns" file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/full,forceCache=false FAIL 2020/07/24 11:13:53 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/07/24 11:13:53 DEBUG : S3 bucket rclone-test-joroleg9yazerut7punefal5: Purge dir "" 2020/07/24 11:13:55 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/07/24 11:13:55 INFO : S3 bucket rclone-test-joroleg9yazerut7punefal5: Bucket "rclone-test-joroleg9yazerut7punefal5" deleted "./vfs.test -test.v -test.timeout 1h0m0s -remote TestS3DigitalOcean: -verbose -test.run '^(TestDirRename|TestFileRename)$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$'" - Finished ERROR in 23m10.040020893s (try 4/5): exit status 1: Failed [TestDirRename TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false]