"./vfs.test -test.v -test.timeout 1h0m0s -remote TestS3DigitalOcean: -verbose -test.run '^(TestDirRename|TestFileRename)$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$'" - Starting (try 5/5) === RUN TestDirRename run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 06:55:47 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 06:55:55 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: Bucket "rclone-test-zahezut3gemuyid1ravoyaq7" created with ACL "private" 2020/08/16 06:55:56 ERROR : dir/not found: Dir.Rename error: file does not exist 2020/08/16 06:55:57 DEBUG : dir/file3: MD5 = ea32138586c9d4e9533ef6cf95e9ec4b OK 2020/08/16 06:55:57 INFO : dir/file3: Copied (server side copy) 2020/08/16 06:55:57 INFO : dir/file3: Deleted 2020/08/16 06:55:57 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 06:55:57 INFO : dir/file1: Copied (server side copy) 2020/08/16 06:55:57 INFO : dir/file1: Deleted 2020/08/16 06:55:57 DEBUG : dir: Updating dir with dir2 0xc00033a480 2020/08/16 06:55:57 DEBUG : dir: forgetting directory cache 2020/08/16 06:55:57 DEBUG : : Added virtual directory entry vDel: "dir" 2020/08/16 06:55:57 DEBUG : : Added virtual directory entry vAdd: "dir2" 2020/08/16 06:55:58 DEBUG : dir2/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 06:55:58 INFO : dir2/file1: Copied (server side copy) 2020/08/16 06:55:58 INFO : dir2/file1: Deleted 2020/08/16 06:55:58 DEBUG : file2: Updating file with file2 0xc0005ac000 2020/08/16 06:55:58 DEBUG : dir2: Added virtual directory entry vDel: "file1" 2020/08/16 06:55:58 DEBUG : : Added virtual directory entry vAdd: "file2" 2020/08/16 06:55:58 DEBUG : file2: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 06:55:58 INFO : file2: Copied (server side copy) 2020/08/16 06:55:58 INFO : file2: Deleted 2020/08/16 06:55:58 DEBUG : dir2/file3: Updating file with dir2/file3 0xc0005ac000 2020/08/16 06:55:58 DEBUG : : Added virtual directory entry vDel: "file2" 2020/08/16 06:55:58 DEBUG : dir2: Added virtual directory entry vAdd: "file3" 2020/08/16 06:55:59 DEBUG : : Added virtual directory entry vAdd: "empty directory" 2020/08/16 06:55:59 DEBUG : empty directory: Updating dir with renamed empty directory 0xc00033a540 2020/08/16 06:55:59 DEBUG : empty directory: forgetting directory cache 2020/08/16 06:55:59 DEBUG : : Added virtual directory entry vDel: "empty directory" 2020/08/16 06:55:59 DEBUG : : Added virtual directory entry vAdd: "renamed empty directory" 2020/08/16 06:55:59 DEBUG : WaitForWriters: timeout=10s 2020/08/16 06:55:59 DEBUG : renamed empty directory: Looking for writers 2020/08/16 06:55:59 DEBUG : dir2: Looking for writers 2020/08/16 06:55:59 DEBUG : file3: reading active writers 2020/08/16 06:55:59 DEBUG : : Looking for writers 2020/08/16 06:55:59 DEBUG : dir2: reading active writers 2020/08/16 06:55:59 DEBUG : renamed empty directory: reading active writers 2020/08/16 06:55:59 DEBUG : >WaitForWriters: --- PASS: TestDirRename (12.21s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 06:55:59 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 06:56:00 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 06:56:00 INFO : dir/file1: Copied (server side copy) 2020/08/16 06:56:00 INFO : dir/file1: Deleted 2020/08/16 06:56:00 DEBUG : newLeaf: Updating file with newLeaf 0xc0005ac180 2020/08/16 06:56:00 DEBUG : dir: Added virtual directory entry vDel: "file1" 2020/08/16 06:56:00 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/08/16 06:56:00 DEBUG : newLeaf: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 06:56:00 INFO : newLeaf: Copied (server side copy) 2020/08/16 06:56:00 INFO : newLeaf: Deleted 2020/08/16 06:56:00 DEBUG : dir/file1: Updating file with dir/file1 0xc0005ac180 2020/08/16 06:56:00 DEBUG : : Added virtual directory entry vDel: "newLeaf" 2020/08/16 06:56:00 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 06:56:01 DEBUG : dir/file1: Open: flags=O_WRONLY|O_TRUNC 2020/08/16 06:56:01 DEBUG : dir/file1: >Open: fd=dir/file1 (w), err= 2020/08/16 06:56:01 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 06:56:01 DEBUG : dir/file1: File is currently open, delaying rename 0xc0005ac180 2020/08/16 06:56:01 DEBUG : dir: Added virtual directory entry vDel: "file1" 2020/08/16 06:56:01 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/08/16 06:56:01 DEBUG : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: File to upload is small (25 bytes), uploading instead of streaming 2020/08/16 06:56:01 DEBUG : dir/file1: MD5 = c7247bead226dfd7bd970c17229f4044 OK 2020/08/16 06:56:01 INFO : dir/file1: Copied (new) 2020/08/16 06:56:01 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/08/16 06:56:01 DEBUG : newLeaf: Running delayed rename now 2020/08/16 06:56:01 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:01 DEBUG : pacer: Rate limited, increasing sleep to 10ms 2020/08/16 06:56:01 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:01 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2020/08/16 06:56:01 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:01 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2020/08/16 06:56:01 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:01 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2020/08/16 06:56:01 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:01 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2020/08/16 06:56:01 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:01 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2020/08/16 06:56:02 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:02 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2020/08/16 06:56:02 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:02 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2020/08/16 06:56:03 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:03 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/08/16 06:56:04 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:04 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/08/16 06:56:06 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:08 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:10 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:12 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:14 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:16 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:18 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:20 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:22 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:24 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:24 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/08/16 06:56:26 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:28 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:30 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:32 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:34 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:36 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:38 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:40 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:42 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:44 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:44 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/08/16 06:56:46 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:48 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:50 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:52 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:54 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:56 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:56:58 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:00 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:02 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:04 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:04 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/08/16 06:57:06 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:08 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:10 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:12 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:14 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:16 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:18 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:20 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:22 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:24 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:24 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/08/16 06:57:26 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:28 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:30 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:32 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:34 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:36 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:38 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:40 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:42 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:44 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:44 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/08/16 06:57:46 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:48 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:50 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:52 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:54 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:56 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:57:58 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:00 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:02 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:04 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:04 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/08/16 06:58:06 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:08 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:10 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:12 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:14 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:16 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:18 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:20 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:22 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:24 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:24 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/08/16 06:58:26 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:28 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:30 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:32 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:34 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:36 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:38 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:40 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:42 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:44 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:44 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/08/16 06:58:46 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:48 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:50 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:52 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:54 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:56 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:58:58 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:00 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:02 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:04 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:04 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 06:59:04 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 06:59:04 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 06:59:04 ERROR : newLeaf: delayed File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 06:59:04 DEBUG : WaitForWriters: timeout=10s 2020/08/16 06:59:04 DEBUG : dir: Looking for writers 2020/08/16 06:59:04 DEBUG : : Looking for writers 2020/08/16 06:59:04 DEBUG : dir: reading active writers 2020/08/16 06:59:04 DEBUG : newLeaf: reading active writers 2020/08/16 06:59:04 DEBUG : >WaitForWriters: 2020/08/16 06:59:06 DEBUG : pacer: Reducing sleep to 1.5s fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 2020/08/16 06:59:08 DEBUG : pacer: Reducing sleep to 1.125s fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 2020/08/16 06:59:10 DEBUG : pacer: Reducing sleep to 843.75ms fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 file_test.go:340 file_test.go:357 Error: Should be true Test: TestFileRename/off,forceCache=false Messages: listing wrong, want newLeaf (25) got dir/file1 (25) fstest.go:188: Error Trace: fstest.go:188 fstest.go:305 fstest.go:335 file_test.go:340 file_test.go:357 Error: Should be true Test: TestFileRename/off,forceCache=false Messages: Unexpected file "dir/file1" fstest.go:200: Not found "newLeaf" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 file_test.go:340 file_test.go:357 Error: Not equal: expected: 0 actual : 1 Test: TestFileRename/off,forceCache=false Messages: 1 objects not found 2020/08/16 06:59:14 DEBUG : WaitForWriters: timeout=10s 2020/08/16 06:59:14 DEBUG : dir: Looking for writers 2020/08/16 06:59:14 DEBUG : : Looking for writers 2020/08/16 06:59:14 DEBUG : dir: reading active writers 2020/08/16 06:59:14 DEBUG : newLeaf: reading active writers 2020/08/16 06:59:14 DEBUG : >WaitForWriters: 2020/08/16 06:59:14 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/08/16 06:59:15 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/08/16 06:59:16 DEBUG : pacer: Reducing sleep to 355.957031ms === RUN TestFileRename/minimal,forceCache=false run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 06:59:16 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 06:59:16 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 06:59:16 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 06:59:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 06:59:16 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/08/16 06:59:16 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/08/16 06:59:17 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/08/16 06:59:17 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:17 DEBUG : pacer: Rate limited, increasing sleep to 53.453842ms 2020/08/16 06:59:18 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:18 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2020/08/16 06:59:18 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:18 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2020/08/16 06:59:18 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:18 DEBUG : pacer: Rate limited, increasing sleep to 427.630736ms 2020/08/16 06:59:18 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:18 DEBUG : pacer: Rate limited, increasing sleep to 855.261472ms 2020/08/16 06:59:18 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:18 DEBUG : pacer: Rate limited, increasing sleep to 1.710522944s 2020/08/16 06:59:19 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:19 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/08/16 06:59:21 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:23 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:25 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:25 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/08/16 06:59:27 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:29 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:31 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:33 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:35 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:37 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:39 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:41 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:43 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:45 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:45 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/08/16 06:59:47 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:49 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:51 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:53 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:55 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:57 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 06:59:59 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:01 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:03 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:05 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:05 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/08/16 07:00:07 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:09 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:11 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:13 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:15 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:00:17 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:19 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:21 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:23 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:25 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:25 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/08/16 07:00:27 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:29 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:31 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:33 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:35 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:37 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:39 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:41 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:43 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:45 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:45 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/08/16 07:00:47 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:49 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:51 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:53 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:55 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:57 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:00:59 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:01 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:03 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:05 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:05 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/08/16 07:01:07 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:09 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:11 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:13 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:15 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:01:17 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:19 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:21 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:23 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:25 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:25 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/08/16 07:01:27 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:29 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:31 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:33 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:35 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:37 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:39 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:41 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:43 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:45 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:45 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/08/16 07:01:47 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:49 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:51 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:53 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:55 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:57 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:01:59 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:01 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:03 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:05 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:05 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/08/16 07:02:07 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:09 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:11 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:13 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:15 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:02:17 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:19 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:21 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:23 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:25 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:25 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:02:25 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:02:25 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:02:25 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/minimal,forceCache=false 2020/08/16 07:02:25 DEBUG : WaitForWriters: timeout=10s 2020/08/16 07:02:25 DEBUG : dir: Looking for writers 2020/08/16 07:02:25 DEBUG : file1: reading active writers 2020/08/16 07:02:25 DEBUG : : Looking for writers 2020/08/16 07:02:25 DEBUG : dir: reading active writers 2020/08/16 07:02:25 DEBUG : >WaitForWriters: 2020/08/16 07:02:25 DEBUG : vfs cache: cleaner exiting 2020/08/16 07:02:27 DEBUG : pacer: Reducing sleep to 1.5s 2020/08/16 07:02:29 DEBUG : pacer: Reducing sleep to 1.125s 2020/08/16 07:02:30 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/minimal,forceCache=true run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 07:02:30 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 07:02:30 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:02:30 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:02:30 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:02:32 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/08/16 07:02:33 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/08/16 07:02:33 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/08/16 07:02:34 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/08/16 07:02:34 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/08/16 07:02:34 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/08/16 07:02:34 DEBUG : dir/file1: Open: flags=O_RDWR|O_CREATE|O_TRUNC 2020/08/16 07:02:34 DEBUG : dir/file1: newRWFileHandle: 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3c40): openPending: 2020/08/16 07:02:34 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "" 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/08/16 07:02:34 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3c40): >openPending: err= 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: truncate to size=0 2020/08/16 07:02:34 DEBUG : dir/file1: >newRWFileHandle: err= 2020/08/16 07:02:34 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:02:34 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3c40): _writeAt: size=14, off=0 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3c40): >_writeAt: n=14, err= 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3c40): close: 2020/08/16 07:02:34 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: setting modification time to 2020-08-16 07:02:34.874014675 +0000 UTC m=+407.709847670 2020/08/16 07:02:34 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3c40): >close: err= 2020/08/16 07:02:34 DEBUG : dir/file1: Open: flags=O_RDONLY 2020/08/16 07:02:34 DEBUG : dir/file1: newRWFileHandle: 2020/08/16 07:02:34 DEBUG : dir/file1: >newRWFileHandle: err= 2020/08/16 07:02:34 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3d00): _readAt: size=512, off=0 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3d00): openPending: 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/08/16 07:02:34 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3d00): >openPending: err= 2020/08/16 07:02:34 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3d00): >_readAt: n=14, err=EOF 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3d00): close: 2020/08/16 07:02:34 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: setting modification time to 2020-08-16 07:02:34.874014675 +0000 UTC m=+407.709847670 2020/08/16 07:02:34 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/08/16 07:02:34 DEBUG : dir/file1(0xc0000b3d00): >close: err= 2020/08/16 07:02:34 DEBUG : dir/file1: vfs cache: starting upload 2020/08/16 07:02:35 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/08/16 07:02:35 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/08/16 07:02:35 DEBUG : pacer: Reducing sleep to 47.514527ms fstest.go:124: Error Trace: fstest.go:124 fstest.go:129 fstest.go:148 fstest.go:192 fstest.go:305 fstest.go:335 fstest.go:347 file_test.go:282 file_test.go:357 Error: Should be true Test: TestFileRename/minimal,forceCache=true Messages: dir/file1: Modification time difference too big |-171218h57m28.374014676s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2020-08-16 07:02:34.874014675 +0000 UTC) (precision 1ns) 2020/08/16 07:02:35 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/08/16 07:02:35 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 07:02:35 INFO : dir/file1: Copied (replaced existing) 2020/08/16 07:02:35 DEBUG : dir/file1: vfs cache: fingerprint now "14,2020-08-16 07:02:34.874014675 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/08/16 07:02:35 DEBUG : dir/file1: vfs cache: writeback object to VFS layer 2020/08/16 07:02:35 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/08/16 07:02:35 INFO : dir/file1: vfs cache: upload succeeded try #1 2020/08/16 07:02:35 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/08/16 07:02:35 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:35 DEBUG : pacer: Rate limited, increasing sleep to 53.453842ms 2020/08/16 07:02:35 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:35 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2020/08/16 07:02:35 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:35 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2020/08/16 07:02:35 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:35 DEBUG : pacer: Rate limited, increasing sleep to 427.630736ms 2020/08/16 07:02:35 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:35 DEBUG : pacer: Rate limited, increasing sleep to 855.261472ms 2020/08/16 07:02:36 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:36 DEBUG : pacer: Rate limited, increasing sleep to 1.710522944s 2020/08/16 07:02:37 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:37 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/08/16 07:02:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:42 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:42 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/08/16 07:02:44 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:46 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:48 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:50 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:52 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:02:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:02 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:02 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/08/16 07:03:04 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:06 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:08 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:12 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:14 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:16 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:18 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:20 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:22 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:22 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/08/16 07:03:24 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:28 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:30 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 0) 2020/08/16 07:03:32 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:34 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:36 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:42 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:42 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/08/16 07:03:44 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:46 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:48 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:50 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:52 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:03:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:02 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:02 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/08/16 07:04:04 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:06 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:08 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:12 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:14 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:16 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:18 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:20 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:22 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:22 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/08/16 07:04:24 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:28 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:30 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/08/16 07:04:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:32 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:34 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:36 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:42 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:42 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/08/16 07:04:44 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:46 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:48 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:50 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:52 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:04:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:02 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:02 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/08/16 07:05:04 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:06 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:08 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:13 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:14 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:16 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:18 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:20 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:22 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:22 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/08/16 07:05:24 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:28 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:30 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/08/16 07:05:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:32 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:35 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:37 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:43 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:43 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:05:43 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:05:43 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:05:43 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/minimal,forceCache=true 2020/08/16 07:05:43 DEBUG : WaitForWriters: timeout=10s 2020/08/16 07:05:43 DEBUG : dir: Looking for writers 2020/08/16 07:05:43 DEBUG : file1: reading active writers 2020/08/16 07:05:43 DEBUG : : Looking for writers 2020/08/16 07:05:43 DEBUG : dir: reading active writers 2020/08/16 07:05:43 DEBUG : newLeaf: reading active writers 2020/08/16 07:05:43 DEBUG : >WaitForWriters: 2020/08/16 07:05:43 DEBUG : vfs cache: cleaner exiting 2020/08/16 07:05:45 DEBUG : pacer: Reducing sleep to 1.5s 2020/08/16 07:05:47 DEBUG : pacer: Reducing sleep to 1.125s 2020/08/16 07:05:48 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/writes,forceCache=false run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 07:05:48 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 07:05:48 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:05:48 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:05:48 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:05:49 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/08/16 07:05:50 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/08/16 07:05:51 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/08/16 07:05:51 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/08/16 07:05:51 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/08/16 07:05:52 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/08/16 07:05:52 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/08/16 07:05:52 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/08/16 07:05:52 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/08/16 07:05:52 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:52 DEBUG : pacer: Rate limited, increasing sleep to 126.705406ms 2020/08/16 07:05:52 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:52 DEBUG : pacer: Rate limited, increasing sleep to 253.410812ms 2020/08/16 07:05:52 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:52 DEBUG : pacer: Rate limited, increasing sleep to 506.821624ms 2020/08/16 07:05:53 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:53 DEBUG : pacer: Rate limited, increasing sleep to 1.013643248s 2020/08/16 07:05:53 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:53 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/08/16 07:05:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:05:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:02 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:02 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/08/16 07:06:04 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:06 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:08 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:12 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:14 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:16 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:18 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:20 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:22 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:22 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/08/16 07:06:24 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:28 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:32 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:34 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:36 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:42 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:42 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/08/16 07:06:44 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:46 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:48 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:06:48 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:50 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:52 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:06:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:02 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:02 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/08/16 07:07:04 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:06 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:08 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:12 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:14 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:16 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:18 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:20 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:22 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:22 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/08/16 07:07:24 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:28 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:32 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:34 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:36 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:42 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:42 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/08/16 07:07:44 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:46 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:48 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:07:48 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:50 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:52 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:07:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:03 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:03 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/08/16 07:08:04 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:06 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:08 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:10 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:12 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:14 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:16 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:18 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:20 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:22 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:22 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/08/16 07:08:24 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:26 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:28 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:32 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:34 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:36 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:38 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:40 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:42 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:42 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/08/16 07:08:44 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:46 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:48 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:08:48 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:50 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:52 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:54 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:56 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:08:58 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:00 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:02 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:02 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:09:02 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:09:02 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:09:02 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/writes,forceCache=false 2020/08/16 07:09:02 DEBUG : WaitForWriters: timeout=10s 2020/08/16 07:09:02 DEBUG : dir: Looking for writers 2020/08/16 07:09:02 DEBUG : file1: reading active writers 2020/08/16 07:09:02 DEBUG : : Looking for writers 2020/08/16 07:09:02 DEBUG : dir: reading active writers 2020/08/16 07:09:02 DEBUG : >WaitForWriters: 2020/08/16 07:09:02 DEBUG : vfs cache: cleaner exiting 2020/08/16 07:09:04 DEBUG : pacer: Reducing sleep to 1.5s 2020/08/16 07:09:06 DEBUG : pacer: Reducing sleep to 1.125s 2020/08/16 07:09:08 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/writes,forceCache=true run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 07:09:08 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 07:09:08 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:09:08 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:09:08 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:09:09 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/08/16 07:09:10 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/08/16 07:09:10 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/08/16 07:09:11 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/08/16 07:09:11 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/08/16 07:09:11 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/08/16 07:09:11 DEBUG : dir/file1: Open: flags=O_RDWR|O_CREATE|O_TRUNC 2020/08/16 07:09:11 DEBUG : dir/file1: newRWFileHandle: 2020/08/16 07:09:11 DEBUG : dir/file1(0xc0004aaa00): openPending: 2020/08/16 07:09:12 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "" 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/08/16 07:09:12 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0004aaa00): >openPending: err= 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: truncate to size=0 2020/08/16 07:09:12 DEBUG : dir/file1: >newRWFileHandle: err= 2020/08/16 07:09:12 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:09:12 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0004aaa00): _writeAt: size=14, off=0 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0004aaa00): >_writeAt: n=14, err= 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0004aaa00): close: 2020/08/16 07:09:12 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: setting modification time to 2020-08-16 07:09:12.143081807 +0000 UTC m=+804.978914797 2020/08/16 07:09:12 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0004aaa00): >close: err= 2020/08/16 07:09:12 DEBUG : dir/file1: Open: flags=O_RDONLY 2020/08/16 07:09:12 DEBUG : dir/file1: newRWFileHandle: 2020/08/16 07:09:12 DEBUG : dir/file1: >newRWFileHandle: err= 2020/08/16 07:09:12 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0007d6380): _readAt: size=512, off=0 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0007d6380): openPending: 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/08/16 07:09:12 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0007d6380): >openPending: err= 2020/08/16 07:09:12 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0007d6380): >_readAt: n=14, err=EOF 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0007d6380): close: 2020/08/16 07:09:12 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: setting modification time to 2020-08-16 07:09:12.143081807 +0000 UTC m=+804.978914797 2020/08/16 07:09:12 INFO : dir/file1: vfs cache: queuing for upload in 100ms 2020/08/16 07:09:12 DEBUG : dir/file1(0xc0007d6380): >close: err= 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: starting upload 2020/08/16 07:09:12 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/08/16 07:09:12 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/08/16 07:09:12 DEBUG : pacer: Reducing sleep to 47.514527ms fstest.go:124: Error Trace: fstest.go:124 fstest.go:129 fstest.go:148 fstest.go:192 fstest.go:305 fstest.go:335 fstest.go:347 file_test.go:282 file_test.go:357 Error: Should be true Test: TestFileRename/writes,forceCache=true Messages: dir/file1: Modification time difference too big |-171219h4m5.643081808s| > 1ns (want 2001-02-03 04:05:06.499999999 +0000 UTC vs got 2020-08-16 07:09:12.143081807 +0000 UTC) (precision 1ns) 2020/08/16 07:09:12 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/08/16 07:09:12 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK 2020/08/16 07:09:12 INFO : dir/file1: Copied (replaced existing) 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: fingerprint now "14,2020-08-16 07:09:12.143081807 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" 2020/08/16 07:09:12 DEBUG : dir/file1: vfs cache: writeback object to VFS layer 2020/08/16 07:09:12 DEBUG : : Added virtual directory entry vAdd: "newLeaf" 2020/08/16 07:09:12 INFO : dir/file1: vfs cache: upload succeeded try #1 2020/08/16 07:09:12 DEBUG : pacer: Reducing sleep to 26.726921ms 2020/08/16 07:09:12 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:12 DEBUG : pacer: Rate limited, increasing sleep to 53.453842ms 2020/08/16 07:09:12 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:12 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2020/08/16 07:09:12 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:12 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2020/08/16 07:09:13 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:13 DEBUG : pacer: Rate limited, increasing sleep to 427.630736ms 2020/08/16 07:09:13 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:13 DEBUG : pacer: Rate limited, increasing sleep to 855.261472ms 2020/08/16 07:09:13 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:13 DEBUG : pacer: Rate limited, increasing sleep to 1.710522944s 2020/08/16 07:09:14 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:14 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/08/16 07:09:16 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:18 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:20 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:20 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/08/16 07:09:22 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:24 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:26 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:28 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:30 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:32 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:34 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:36 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:38 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:40 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:40 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/08/16 07:09:42 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:44 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:46 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:48 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:50 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:52 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:54 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:56 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:09:58 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:00 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:00 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/08/16 07:10:02 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:04 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:06 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:08 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 0) 2020/08/16 07:10:08 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:10 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:12 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:14 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:16 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:18 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:20 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:20 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/08/16 07:10:22 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:24 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:26 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:28 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:30 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:32 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:34 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:36 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:38 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:40 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:40 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/08/16 07:10:42 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:44 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:46 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:48 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:50 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:52 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:54 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:56 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:10:58 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:00 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:00 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/08/16 07:11:02 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:04 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:06 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:08 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/08/16 07:11:08 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:10 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:12 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:14 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:16 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:18 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:20 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:20 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/08/16 07:11:22 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:24 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:26 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:28 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:30 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:32 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:34 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:36 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:38 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:40 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:40 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/08/16 07:11:42 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:44 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:46 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:48 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:50 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:52 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:54 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:56 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:11:58 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:00 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:00 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/08/16 07:12:02 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:04 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:06 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:08 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/08/16 07:12:08 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:10 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:12 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:14 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:16 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:18 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:20 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:20 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:12:20 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:12:20 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:12:20 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/writes,forceCache=true 2020/08/16 07:12:20 DEBUG : WaitForWriters: timeout=10s 2020/08/16 07:12:20 DEBUG : dir: Looking for writers 2020/08/16 07:12:20 DEBUG : file1: reading active writers 2020/08/16 07:12:20 DEBUG : : Looking for writers 2020/08/16 07:12:20 DEBUG : dir: reading active writers 2020/08/16 07:12:20 DEBUG : newLeaf: reading active writers 2020/08/16 07:12:20 DEBUG : >WaitForWriters: 2020/08/16 07:12:20 DEBUG : vfs cache: cleaner exiting 2020/08/16 07:12:22 DEBUG : pacer: Reducing sleep to 1.5s 2020/08/16 07:12:24 DEBUG : pacer: Reducing sleep to 1.125s 2020/08/16 07:12:25 DEBUG : pacer: Reducing sleep to 843.75ms === RUN TestFileRename/full,forceCache=false run.go:176: Remote "S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7", Local "Local file system at /tmp/rclone926475512", Modify Window "1ns" 2020/08/16 07:12:25 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: poll-interval is not supported by this remote 2020/08/16 07:12:25 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:12:25 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3DigitalOcean/rclone-test-zahezut3gemuyid1ravoyaq7" 2020/08/16 07:12:25 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/08/16 07:12:26 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/08/16 07:12:27 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/08/16 07:12:28 DEBUG : pacer: Reducing sleep to 355.957031ms 2020/08/16 07:12:28 DEBUG : pacer: Reducing sleep to 266.967773ms 2020/08/16 07:12:29 DEBUG : pacer: Reducing sleep to 200.225829ms 2020/08/16 07:12:29 DEBUG : pacer: Reducing sleep to 150.169371ms 2020/08/16 07:12:29 DEBUG : dir/file1: Open: flags=O_RDONLY 2020/08/16 07:12:29 DEBUG : dir/file1: newRWFileHandle: 2020/08/16 07:12:29 DEBUG : dir/file1: >newRWFileHandle: err= 2020/08/16 07:12:29 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err= 2020/08/16 07:12:29 DEBUG : dir/file1(0xc0007cce00): _readAt: size=512, off=0 2020/08/16 07:12:29 DEBUG : dir/file1(0xc0007cce00): openPending: 2020/08/16 07:12:29 DEBUG : pacer: Reducing sleep to 112.627028ms 2020/08/16 07:12:29 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "" 2020/08/16 07:12:29 DEBUG : dir/file1: vfs cache: truncate to size=14 2020/08/16 07:12:29 DEBUG : dir: Added virtual directory entry vAdd: "file1" 2020/08/16 07:12:29 DEBUG : dir/file1(0xc0007cce00): >openPending: err= 2020/08/16 07:12:29 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [] - present false 2020/08/16 07:12:29 DEBUG : dir/file1: ChunkedReader.RangeSeek from -1 to 0 length -1 2020/08/16 07:12:29 DEBUG : dir/file1: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2020/08/16 07:12:29 DEBUG : dir/file1: ChunkedReader.openRange at 0 length 134217728 2020/08/16 07:12:29 DEBUG : pacer: Reducing sleep to 84.470271ms 2020/08/16 07:12:29 DEBUG : dir/file1(0xc0007cce00): >_readAt: n=14, err=EOF 2020/08/16 07:12:29 DEBUG : dir/file1(0xc0007cce00): close: 2020/08/16 07:12:29 DEBUG : dir/file1: vfs cache: setting modification time to 2001-02-03 04:05:06.499999999 +0000 UTC 2020/08/16 07:12:29 DEBUG : dir/file1(0xc0007cce00): >close: err= 2020/08/16 07:12:30 DEBUG : pacer: Reducing sleep to 63.352703ms 2020/08/16 07:12:30 DEBUG : pacer: Reducing sleep to 47.514527ms 2020/08/16 07:12:30 DEBUG : pacer: Reducing sleep to 35.635895ms 2020/08/16 07:12:30 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:30 DEBUG : pacer: Rate limited, increasing sleep to 71.27179ms 2020/08/16 07:12:30 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:30 DEBUG : pacer: Rate limited, increasing sleep to 142.54358ms 2020/08/16 07:12:30 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:30 DEBUG : pacer: Rate limited, increasing sleep to 285.08716ms 2020/08/16 07:12:30 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:30 DEBUG : pacer: Rate limited, increasing sleep to 570.17432ms 2020/08/16 07:12:30 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:30 DEBUG : pacer: Rate limited, increasing sleep to 1.14034864s 2020/08/16 07:12:31 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:31 DEBUG : pacer: Rate limited, increasing sleep to 2s 2020/08/16 07:12:32 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:34 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:36 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:38 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:38 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 1/10 2020/08/16 07:12:40 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:42 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:44 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:46 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:48 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:50 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:52 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:54 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:56 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:58 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:12:58 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 2/10 2020/08/16 07:13:00 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:02 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:04 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:06 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:08 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:10 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:12 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:14 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:16 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:18 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:18 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 3/10 2020/08/16 07:13:20 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:22 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:24 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:25 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 0) 2020/08/16 07:13:26 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:28 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:30 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:32 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:34 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:36 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:38 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:38 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 4/10 2020/08/16 07:13:40 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:42 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:44 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:46 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:48 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:50 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:52 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:54 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:56 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:58 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:13:58 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 5/10 2020/08/16 07:14:00 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:02 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:04 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:06 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:08 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:10 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:12 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:14 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:16 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:18 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:18 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 6/10 2020/08/16 07:14:20 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:22 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:24 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:25 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/08/16 07:14:26 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:28 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:30 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:32 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:34 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:36 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:38 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:38 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 7/10 2020/08/16 07:14:40 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:42 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:44 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:46 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:48 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:50 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:52 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:54 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:56 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:58 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:14:58 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 8/10 2020/08/16 07:15:00 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:02 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:04 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:06 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:08 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:10 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:12 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:14 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:16 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:18 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:18 DEBUG : dir/file1: Received error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: - low level retry 9/10 2020/08/16 07:15:20 DEBUG : pacer: low level retry 1/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:22 DEBUG : pacer: low level retry 2/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:24 DEBUG : pacer: low level retry 3/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:25 INFO : vfs cache: cleaned: objects 1 (was 1) in use 0, to upload 0, uploading 0, total size 14 (was 14) 2020/08/16 07:15:26 DEBUG : pacer: low level retry 4/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:28 DEBUG : pacer: low level retry 5/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:30 DEBUG : pacer: low level retry 6/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:32 DEBUG : pacer: low level retry 7/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:34 DEBUG : pacer: low level retry 8/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:36 DEBUG : pacer: low level retry 9/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:38 DEBUG : pacer: low level retry 10/10 (error SlowDown: Reduce your request rate. status code: 503, request id: , host id: ) 2020/08/16 07:15:38 ERROR : dir/file1: Failed to copy: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:15:38 ERROR : dir/file1: Not deleting source as copy failed: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:15:38 ERROR : newLeaf: File.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: 2020/08/16 07:15:38 ERROR : dir/file1: Dir.Rename error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: file_test.go:286: Error Trace: file_test.go:286 file_test.go:357 Error: Received unexpected error: SlowDown: Reduce your request rate. status code: 503, request id: , host id: Test: TestFileRename/full,forceCache=false 2020/08/16 07:15:38 DEBUG : WaitForWriters: timeout=10s 2020/08/16 07:15:38 DEBUG : dir: Looking for writers 2020/08/16 07:15:38 DEBUG : file1: reading active writers 2020/08/16 07:15:38 DEBUG : : Looking for writers 2020/08/16 07:15:38 DEBUG : dir: reading active writers 2020/08/16 07:15:38 DEBUG : >WaitForWriters: 2020/08/16 07:15:38 DEBUG : vfs cache: cleaner exiting 2020/08/16 07:15:40 DEBUG : pacer: Reducing sleep to 1.5s 2020/08/16 07:15:42 DEBUG : pacer: Reducing sleep to 1.125s 2020/08/16 07:15:44 DEBUG : pacer: Reducing sleep to 843.75ms --- FAIL: TestFileRename (1184.66s) --- FAIL: TestFileRename/off,forceCache=false (196.63s) --- FAIL: TestFileRename/minimal,forceCache=false (194.95s) --- FAIL: TestFileRename/minimal,forceCache=true (197.57s) --- FAIL: TestFileRename/writes,forceCache=false (199.70s) --- FAIL: TestFileRename/writes,forceCache=true (197.56s) --- FAIL: TestFileRename/full,forceCache=false (198.24s) FAIL 2020/08/16 07:15:45 DEBUG : pacer: Reducing sleep to 632.8125ms 2020/08/16 07:15:45 DEBUG : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: Purge dir "" 2020/08/16 07:15:47 DEBUG : pacer: Reducing sleep to 474.609375ms 2020/08/16 07:15:47 INFO : S3 bucket rclone-test-zahezut3gemuyid1ravoyaq7: Bucket "rclone-test-zahezut3gemuyid1ravoyaq7" deleted "./vfs.test -test.v -test.timeout 1h0m0s -remote TestS3DigitalOcean: -verbose -test.run '^(TestDirRename|TestFileRename)$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$'" - Finished ERROR in 20m0.3610762s (try 5/5): exit status 1: Failed [TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false]