"./vfs.test -test.v -test.timeout 1h0m0s -remote TestS3Ceph: -verbose -test.run '^TestFileRename$/^minimal,forceCache=true$'" - Starting (try 3/5)
=== RUN   TestFileRename
=== RUN   TestFileRename/minimal,forceCache=true
2020/07/24 09:57:22 INFO  : S3 bucket rclone-test-joxolak2nivegaf3jefetox7: poll-interval is not supported by this remote
2020/07/24 09:57:22 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestS3Ceph/rclone-test-joxolak2nivegaf3jefetox7"
2020/07/24 09:57:22 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestS3Ceph/rclone-test-joxolak2nivegaf3jefetox7"
2020/07/24 09:57:22 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2020/07/24 09:57:22 INFO  : S3 bucket rclone-test-joxolak2nivegaf3jefetox7: Bucket "rclone-test-joxolak2nivegaf3jefetox7" created with ACL "private"
2020/07/24 09:57:22 DEBUG : dir/file1: Open: flags=O_RDWR|O_CREATE|O_TRUNC
2020/07/24 09:57:22 DEBUG : dir/file1: newRWFileHandle: 
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000092c80): openPending: 
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint ""
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: truncate to size=14
2020/07/24 09:57:22 DEBUG : dir: Added virtual directory entry vAdd: "file1"
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000092c80): >openPending: err=<nil>
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: truncate to size=0
2020/07/24 09:57:22 DEBUG : dir/file1: >newRWFileHandle: err=<nil>
2020/07/24 09:57:22 DEBUG : dir: Added virtual directory entry vAdd: "file1"
2020/07/24 09:57:22 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err=<nil>
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000092c80): _writeAt: size=14, off=0
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000092c80): >_writeAt: n=14, err=<nil>
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000092c80): close: 
2020/07/24 09:57:22 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: setting modification time to 2020-07-24 09:57:22.996304629 +0000 UTC m=+0.389245153
2020/07/24 09:57:22 INFO  : dir/file1: vfs cache: queuing for upload in 100ms
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000092c80): >close: err=<nil>
2020/07/24 09:57:22 DEBUG : dir/file1: Open: flags=O_RDONLY
2020/07/24 09:57:22 DEBUG : dir/file1: newRWFileHandle: 
2020/07/24 09:57:22 DEBUG : dir/file1: >newRWFileHandle: err=<nil>
2020/07/24 09:57:22 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err=<nil>
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000352200): _readAt: size=512, off=0
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000352200): openPending: 
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595"
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: truncate to size=14
2020/07/24 09:57:22 DEBUG : dir: Added virtual directory entry vAdd: "file1"
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000352200): >openPending: err=<nil>
2020/07/24 09:57:22 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000352200): >_readAt: n=14, err=EOF
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000352200): close: 
2020/07/24 09:57:22 DEBUG : vfs cache: looking for range={Pos:0 Size:14} in [{Pos:0 Size:14}] - present true
2020/07/24 09:57:22 DEBUG : dir/file1: vfs cache: setting modification time to 2020-07-24 09:57:22.996304629 +0000 UTC m=+0.389245153
2020/07/24 09:57:22 INFO  : dir/file1: vfs cache: queuing for upload in 100ms
2020/07/24 09:57:22 DEBUG : dir/file1(0xc000352200): >close: err=<nil>
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: starting upload
2020/07/24 09:57:23 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK
2020/07/24 09:57:23 INFO  : dir/file1: Copied (server side copy)
2020/07/24 09:57:23 INFO  : dir/file1: Deleted
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: cancelling upload
2020/07/24 09:57:23 ERROR : dir/file1: Failed to copy: RequestCanceled: request context canceled
caused by: context canceled
2020/07/24 09:57:23 ERROR : dir/file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: RequestCanceled: request context canceled
caused by: context canceled
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: cancelled upload
2020/07/24 09:57:23 INFO  : dir/file1: vfs cache: renamed in cache to "newLeaf"
2020/07/24 09:57:23 DEBUG : newLeaf: Updating file with newLeaf 0xc000350000
2020/07/24 09:57:23 DEBUG : dir: Added virtual directory entry vDel: "file1"
2020/07/24 09:57:23 DEBUG : : Added virtual directory entry vAdd: "newLeaf"
2020/07/24 09:57:23 DEBUG : newLeaf: vfs cache: starting upload
2020/07/24 09:57:23 DEBUG : newLeaf: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK
2020/07/24 09:57:23 INFO  : newLeaf: Copied (replaced existing)
2020/07/24 09:57:23 DEBUG : newLeaf: vfs cache: fingerprint now "14,2020-07-24 09:57:22.996304629 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595"
2020/07/24 09:57:23 DEBUG : newLeaf: vfs cache: writeback object to VFS layer
2020/07/24 09:57:23 DEBUG : dir: Added virtual directory entry vAdd: "file1"
2020/07/24 09:57:23 INFO  : newLeaf: vfs cache: upload succeeded try #2
2020/07/24 09:57:23 DEBUG : newLeaf: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK
2020/07/24 09:57:23 INFO  : newLeaf: Copied (server side copy)
2020/07/24 09:57:23 INFO  : newLeaf: Deleted
2020/07/24 09:57:23 INFO  : newLeaf: vfs cache: renamed in cache to "dir/file1"
2020/07/24 09:57:23 DEBUG : dir/file1: Updating file with dir/file1 0xc000350000
2020/07/24 09:57:23 DEBUG : : Added virtual directory entry vDel: "newLeaf"
2020/07/24 09:57:23 DEBUG : dir: Added virtual directory entry vAdd: "file1"
2020/07/24 09:57:23 DEBUG : dir/file1: Open: flags=O_WRONLY|O_TRUNC
2020/07/24 09:57:23 DEBUG : dir/file1: newRWFileHandle: 
2020/07/24 09:57:23 DEBUG : dir/file1(0xc0003528c0): openPending: 
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: checking remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" against cached fingerprint "14,2020-07-24 09:57:22.996304629 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595"
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: removing cached entry as stale (remote fingerprint "14,2001-02-03 04:05:06.499999999 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595" != cached fingerprint "14,2020-07-24 09:57:22.996304629 +0000 UTC,0ef726ce9b1a7692357ff70dd321d595")
2020/07/24 09:57:23 INFO  : dir/file1: vfs cache: removed cache file as stale (remote is different)
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: removed metadata from cache as stale (remote is different)
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: truncate to size=14
2020/07/24 09:57:23 DEBUG : dir: Added virtual directory entry vAdd: "file1"
2020/07/24 09:57:23 DEBUG : dir/file1(0xc0003528c0): >openPending: err=<nil>
2020/07/24 09:57:23 DEBUG : dir/file1: vfs cache: truncate to size=0
2020/07/24 09:57:23 DEBUG : dir/file1: >newRWFileHandle: err=<nil>
2020/07/24 09:57:23 DEBUG : dir/file1: >Open: fd=dir/file1 (rw), err=<nil>
2020/07/24 09:57:23 DEBUG : dir/file1(0xc0003528c0): _writeAt: size=25, off=0
2020/07/24 09:57:23 DEBUG : dir/file1(0xc0003528c0): >_writeAt: n=25, err=<nil>
2020/07/24 09:57:23 DEBUG : dir/file1: MD5 = 0ef726ce9b1a7692357ff70dd321d595 OK
2020/07/24 09:57:23 INFO  : dir/file1: Copied (server side copy)
2020/07/24 09:57:23 INFO  : dir/file1: Deleted
2020/07/24 09:57:23 INFO  : dir/file1: vfs cache: renamed in cache to "newLeaf"
2020/07/24 09:57:23 DEBUG : newLeaf: Updating file with newLeaf 0xc000350000
2020/07/24 09:57:23 DEBUG : dir: Added virtual directory entry vDel: "file1"
2020/07/24 09:57:23 DEBUG : : Added virtual directory entry vAdd: "newLeaf"
2020/07/24 09:57:23 DEBUG : newLeaf(0xc0003528c0): close: 
2020/07/24 09:57:23 DEBUG : vfs cache: looking for range={Pos:0 Size:25} in [{Pos:0 Size:25}] - present true
2020/07/24 09:57:23 DEBUG : newLeaf: vfs cache: setting modification time to 2020-07-24 09:57:23.626784267 +0000 UTC m=+1.019724795
2020/07/24 09:57:23 INFO  : newLeaf: vfs cache: queuing for upload in 100ms
2020/07/24 09:57:23 DEBUG : newLeaf(0xc0003528c0): >close: err=<nil>
2020/07/24 09:57:23 DEBUG : WaitForWriters: timeout=10s
2020/07/24 09:57:23 DEBUG : dir: Looking for writers
2020/07/24 09:57:23 DEBUG : : Looking for writers
2020/07/24 09:57:23 DEBUG : dir: reading active writers
2020/07/24 09:57:23 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms
2020/07/24 09:57:23 DEBUG : dir: Looking for writers
2020/07/24 09:57:23 DEBUG : : Looking for writers
2020/07/24 09:57:23 DEBUG : dir: reading active writers
2020/07/24 09:57:23 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms
2020/07/24 09:57:23 DEBUG : dir: Looking for writers
2020/07/24 09:57:23 DEBUG : : Looking for writers
2020/07/24 09:57:23 DEBUG : dir: reading active writers
2020/07/24 09:57:23 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms
2020/07/24 09:57:23 DEBUG : dir: Looking for writers
2020/07/24 09:57:23 DEBUG : : Looking for writers
2020/07/24 09:57:23 DEBUG : dir: reading active writers
2020/07/24 09:57:23 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms
2020/07/24 09:57:23 DEBUG : newLeaf: vfs cache: starting upload
2020/07/24 09:57:23 DEBUG : dir: Looking for writers
2020/07/24 09:57:23 DEBUG : : Looking for writers
2020/07/24 09:57:23 DEBUG : dir: reading active writers
2020/07/24 09:57:23 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms
2020/07/24 09:57:24 DEBUG : newLeaf: MD5 = c7247bead226dfd7bd970c17229f4044 OK
2020/07/24 09:57:24 INFO  : newLeaf: Copied (replaced existing)
2020/07/24 09:57:24 DEBUG : newLeaf: vfs cache: fingerprint now "25,2020-07-24 09:57:23.626784267 +0000 UTC,c7247bead226dfd7bd970c17229f4044"
2020/07/24 09:57:24 DEBUG : newLeaf: vfs cache: writeback object to VFS layer
2020/07/24 09:57:24 DEBUG : : Added virtual directory entry vAdd: "newLeaf"
2020/07/24 09:57:24 INFO  : newLeaf: vfs cache: upload succeeded try #1
2020/07/24 09:57:24 DEBUG : dir: Looking for writers
2020/07/24 09:57:24 DEBUG : : Looking for writers
2020/07/24 09:57:24 DEBUG : dir: reading active writers
2020/07/24 09:57:24 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:24 DEBUG : >WaitForWriters: 
2020/07/24 09:57:24 DEBUG : WaitForWriters: timeout=10s
2020/07/24 09:57:24 DEBUG : dir: Looking for writers
2020/07/24 09:57:24 DEBUG : : Looking for writers
2020/07/24 09:57:24 DEBUG : dir: reading active writers
2020/07/24 09:57:24 DEBUG : newLeaf: reading active writers
2020/07/24 09:57:24 DEBUG : >WaitForWriters: 
2020/07/24 09:57:24 DEBUG : vfs cache: cleaner exiting
--- PASS: TestFileRename (1.68s)
    --- PASS: TestFileRename/minimal,forceCache=true (1.68s)
        run.go:176: Remote "S3 bucket rclone-test-joxolak2nivegaf3jefetox7", Local "Local file system at /tmp/rclone754518584", Modify Window "1ns"
PASS
2020/07/24 09:57:24 DEBUG : S3 bucket rclone-test-joxolak2nivegaf3jefetox7: Purge dir ""
2020/07/24 09:57:24 INFO  : S3 bucket rclone-test-joxolak2nivegaf3jefetox7: Bucket "rclone-test-joxolak2nivegaf3jefetox7" deleted
"./vfs.test -test.v -test.timeout 1h0m0s -remote TestS3Ceph: -verbose -test.run '^TestFileRename$/^minimal,forceCache=true$'" - Finished OK in 1.797279683s (try 3/5)