"./vfs.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bMD5HashS3: -verbose -size-limit 1024 -test.run '^(TestRWFileHandleMethodsWrite|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleWriteAt)$'" - Starting (try 2/5) === RUN TestRWFileHandleMethodsWrite 2020/07/24 10:36:16 INFO : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': poll-interval is not supported by this remote 2020/07/24 10:36:16 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestChunkerChunk50bMD5HashS3/rclone-test-sehikeb1xodicob6dufedad2" 2020/07/24 10:36:16 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestChunkerChunk50bMD5HashS3/rclone-test-sehikeb1xodicob6dufedad2" 2020/07/24 10:36:16 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:36:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 10:36:17 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:36:17 DEBUG : file1: newRWFileHandle: 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): openPending: 2020/07/24 10:36:17 DEBUG : file1: vfs cache: truncate to size=0 2020/07/24 10:36:17 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): >openPending: err= 2020/07/24 10:36:17 DEBUG : file1: >newRWFileHandle: err= 2020/07/24 10:36:17 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:36:17 DEBUG : file1: >Open: fd=file1 (rw), err= 2020/07/24 10:36:17 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): _writeAt: size=5, off=0 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): >_writeAt: n=5, err= 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): _writeAt: size=7, off=5 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): >_writeAt: n=7, err= 2020/07/24 10:36:17 DEBUG : file1: vfs cache: truncate to size=11 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): close: 2020/07/24 10:36:17 DEBUG : file1: vfs cache: setting modification time to 2020-07-24 10:36:17.086606553 +0000 UTC m=+0.134041594 2020/07/24 10:36:17 INFO : file1: vfs cache: queuing for upload in 100ms 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): >close: err= 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): close: 2020/07/24 10:36:17 DEBUG : file1(0xc00086c380): >close: err=file already closed 2020/07/24 10:36:17 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2020/07/24 10:36:17 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:17 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad257FA7E781367EF1ECQTl2Ym4lulp6/2S6kKFEuFAfhIjONSQ6GtCmsrIp0oZoUHvR9pVy4y1ufx04vxPgKd/EsBU1gk= 2020/07/24 10:36:17 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad257FA7E781367EF1ECQTl2Ym4lulp6/2S6kKFEuFAfhIjONSQ6GtCmsrIp0oZoUHvR9pVy4y1ufx04vxPgKd/EsBU1gk= 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2020/07/24 10:36:17 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:17 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad26D1135BE629137B9KMPt3AiBBGuij7EIIcRIXCqtAF5VzOBh4zx9PH7HygA4PwMN31r3Jz24XMRwfhiNZP0AgIoVJPo= 2020/07/24 10:36:17 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad26D1135BE629137B9KMPt3AiBBGuij7EIIcRIXCqtAF5VzOBh4zx9PH7HygA4PwMN31r3Jz24XMRwfhiNZP0AgIoVJPo= 2020/07/24 10:36:17 DEBUG : : Looking for writers 2020/07/24 10:36:17 DEBUG : file1: reading active writers 2020/07/24 10:36:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2020/07/24 10:36:17 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:17 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad219570CB528485841/WPcIEO8KGWaDcuRHJSx55KTVqWMHUXwIQrwnjMsBUzOjLRidkNO1Ub9cDsEZ8JimdDOpBSD/rY= 2020/07/24 10:36:17 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad219570CB528485841/WPcIEO8KGWaDcuRHJSx55KTVqWMHUXwIQrwnjMsBUzOjLRidkNO1Ub9cDsEZ8JimdDOpBSD/rY= 2020/07/24 10:36:18 DEBUG : : Looking for writers 2020/07/24 10:36:18 DEBUG : file1: reading active writers 2020/07/24 10:36:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:18 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:18 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad29911C057594348F3T+HHWahmIrX1WzftCLWyda4XYcY9sxSSfoRhxwDpFUspMvwL+6N4caFkT0cDtPNcUdKgtd21Wrs= 2020/07/24 10:36:18 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad29911C057594348F3T+HHWahmIrX1WzftCLWyda4XYcY9sxSSfoRhxwDpFUspMvwL+6N4caFkT0cDtPNcUdKgtd21Wrs= 2020/07/24 10:36:19 DEBUG : : Looking for writers 2020/07/24 10:36:19 DEBUG : file1: reading active writers 2020/07/24 10:36:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:20 DEBUG : : Looking for writers 2020/07/24 10:36:20 DEBUG : file1: reading active writers 2020/07/24 10:36:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:20 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:20 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad29754E5CDE3B56250G0aJoGfcf7Ih8z3mAamLLycpDjILxH6BC/Gqh2UNvBaUzG0Om19DhAywOAuCkI6FrKYgHuo8ZrE= 2020/07/24 10:36:20 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad29754E5CDE3B56250G0aJoGfcf7Ih8z3mAamLLycpDjILxH6BC/Gqh2UNvBaUzG0Om19DhAywOAuCkI6FrKYgHuo8ZrE= 2020/07/24 10:36:21 DEBUG : : Looking for writers 2020/07/24 10:36:21 DEBUG : file1: reading active writers 2020/07/24 10:36:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:22 DEBUG : : Looking for writers 2020/07/24 10:36:22 DEBUG : file1: reading active writers 2020/07/24 10:36:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:23 DEBUG : : Looking for writers 2020/07/24 10:36:23 DEBUG : file1: reading active writers 2020/07/24 10:36:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:23 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:23 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2EP2R7T0T5NDT8R7R5iJpwgtQseZqoAJ7Xp9biitp3m/K7yv7ckt5IvKVXxfYWyeD2tyZoUZ9nsYTKVVlIZLtImklqW4= 2020/07/24 10:36:23 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2EP2R7T0T5NDT8R7R5iJpwgtQseZqoAJ7Xp9biitp3m/K7yv7ckt5IvKVXxfYWyeD2tyZoUZ9nsYTKVVlIZLtImklqW4= 2020/07/24 10:36:24 DEBUG : : Looking for writers 2020/07/24 10:36:24 DEBUG : file1: reading active writers 2020/07/24 10:36:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:25 DEBUG : : Looking for writers 2020/07/24 10:36:25 DEBUG : file1: reading active writers 2020/07/24 10:36:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:26 DEBUG : : Looking for writers 2020/07/24 10:36:26 DEBUG : file1: reading active writers 2020/07/24 10:36:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:27 ERROR : Exiting even though 0 writers active and 1 cache items in use after 10s Cache{ "file1": &{c:0xc00056b830 mu:{state:0 sema:0} name:file1 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705317589320409 ext:134041594 loc:0x28e63c0} ATime:{wall:13816705317589337183 ext:134058328 loc:0x28e63c0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1}, } 2020/07/24 10:36:27 DEBUG : >WaitForWriters: 2020/07/24 10:36:30 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:30 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2F2CB6D24F6857A5CVr7it1XvVVgMaz5Z1832GBioxC2cN4/ywBY3ulLh8F220ekT+dv7XRwPXTg3K4aegkZbkp/Iu2c= 2020/07/24 10:36:30 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2F2CB6D24F6857A5CVr7it1XvVVgMaz5Z1832GBioxC2cN4/ywBY3ulLh8F220ekT+dv7XRwPXTg3K4aegkZbkp/Iu2c= 2020/07/24 10:36:34 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2020/07/24 10:36:34 DEBUG : : Looking for writers 2020/07/24 10:36:34 DEBUG : file1: reading active writers 2020/07/24 10:36:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2020/07/24 10:36:35 DEBUG : : Looking for writers 2020/07/24 10:36:35 DEBUG : file1: reading active writers 2020/07/24 10:36:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:36 DEBUG : : Looking for writers 2020/07/24 10:36:36 DEBUG : file1: reading active writers 2020/07/24 10:36:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:37 DEBUG : : Looking for writers 2020/07/24 10:36:37 DEBUG : file1: reading active writers 2020/07/24 10:36:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:38 DEBUG : : Looking for writers 2020/07/24 10:36:38 DEBUG : file1: reading active writers 2020/07/24 10:36:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:39 DEBUG : : Looking for writers 2020/07/24 10:36:39 DEBUG : file1: reading active writers 2020/07/24 10:36:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:40 DEBUG : : Looking for writers 2020/07/24 10:36:40 DEBUG : file1: reading active writers 2020/07/24 10:36:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:41 DEBUG : : Looking for writers 2020/07/24 10:36:41 DEBUG : file1: reading active writers 2020/07/24 10:36:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:42 DEBUG : : Looking for writers 2020/07/24 10:36:42 DEBUG : file1: reading active writers 2020/07/24 10:36:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:42 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:43 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2DABB22DDBCAD1FDBgppLrTUSa3YahRj43YnBWxzHquJrRh5xaN27iYDtx8uGEduYnhL6RHqjcar8+jP3BAl6O6mQf3E= 2020/07/24 10:36:43 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2DABB22DDBCAD1FDBgppLrTUSa3YahRj43YnBWxzHquJrRh5xaN27iYDtx8uGEduYnhL6RHqjcar8+jP3BAl6O6mQf3E= 2020/07/24 10:36:43 DEBUG : : Looking for writers 2020/07/24 10:36:43 DEBUG : file1: reading active writers 2020/07/24 10:36:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:44 ERROR : Exiting even though 0 writers active and 1 cache items in use after 10s Cache{ "file1": &{c:0xc00056b830 mu:{state:0 sema:0} name:file1 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705317589320409 ext:134041594 loc:0x28e63c0} ATime:{wall:13816705317589337183 ext:134058328 loc:0x28e63c0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1}, } 2020/07/24 10:36:44 DEBUG : >WaitForWriters: 2020/07/24 10:36:44 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (27.30s) run.go:176: Remote "Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2'", Local "Local file system at /tmp/rclone823664040", Modify Window "1ns" fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 read_write_test.go:344 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:200: Not found "file1" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 read_write_test.go:344 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found === RUN TestRWFileHandleWriteAt 2020/07/24 10:36:44 INFO : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': poll-interval is not supported by this remote 2020/07/24 10:36:44 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestChunkerChunk50bMD5HashS3/rclone-test-sehikeb1xodicob6dufedad2" 2020/07/24 10:36:44 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestChunkerChunk50bMD5HashS3/rclone-test-sehikeb1xodicob6dufedad2" 2020/07/24 10:36:44 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:36:44 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 10:36:44 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:36:44 DEBUG : file1: newRWFileHandle: 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): openPending: 2020/07/24 10:36:44 DEBUG : file1: vfs cache: truncate to size=0 2020/07/24 10:36:44 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): >openPending: err= 2020/07/24 10:36:44 DEBUG : file1: >newRWFileHandle: err= 2020/07/24 10:36:44 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:36:44 DEBUG : file1: >Open: fd=file1 (rw), err= 2020/07/24 10:36:44 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): _writeAt: size=7, off=0 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): >_writeAt: n=7, err= 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): _writeAt: size=6, off=5 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): >_writeAt: n=6, err= 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): close: 2020/07/24 10:36:44 DEBUG : file1: vfs cache: setting modification time to 2020-07-24 10:36:44.274904344 +0000 UTC m=+27.322339344 2020/07/24 10:36:44 INFO : file1: vfs cache: queuing for upload in 100ms 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): >close: err= 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): _writeAt: size=5, off=0 2020/07/24 10:36:44 DEBUG : file1(0xc000093300): >_writeAt: n=0, err=file already closed 2020/07/24 10:36:44 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2020/07/24 10:36:44 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:44 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2D113446AD0391AFEYdGklQosFbWmt0XacPCrIEDgi/Gs5hj/Y87A0AfQ6yMGK3DXmb1F7XNYrDwAyz0znmXOAAyIPaI= 2020/07/24 10:36:44 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2D113446AD0391AFEYdGklQosFbWmt0XacPCrIEDgi/Gs5hj/Y87A0AfQ6yMGK3DXmb1F7XNYrDwAyz0znmXOAAyIPaI= 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2020/07/24 10:36:44 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:44 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A2CEB525C94AE0B1NRFCKysnldAPYU5WYrgJnLMbcvU+F+0YMXfl3wQxiz+T2lwYcjuITQyGllVuZdo0n2u4H4He05A= 2020/07/24 10:36:44 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A2CEB525C94AE0B1NRFCKysnldAPYU5WYrgJnLMbcvU+F+0YMXfl3wQxiz+T2lwYcjuITQyGllVuZdo0n2u4H4He05A= 2020/07/24 10:36:44 DEBUG : : Looking for writers 2020/07/24 10:36:44 DEBUG : file1: reading active writers 2020/07/24 10:36:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2020/07/24 10:36:45 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:45 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2FC409C1C6CE20760n56jk6yEg/uGWe6y6cSZZc9l6N6ZIWKAmMJn1O0qlYBwgnTdd71A3KUmDDeIYBlZiIqTGeEkxhM= 2020/07/24 10:36:45 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2FC409C1C6CE20760n56jk6yEg/uGWe6y6cSZZc9l6N6ZIWKAmMJn1O0qlYBwgnTdd71A3KUmDDeIYBlZiIqTGeEkxhM= 2020/07/24 10:36:45 DEBUG : : Looking for writers 2020/07/24 10:36:45 DEBUG : file1: reading active writers 2020/07/24 10:36:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:45 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:45 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2D935527980E5E1F4BnOs1UL1MH6Jqfo8CcC4kbV7wJ65Vh7F0wJwNRDl3gj2ada+Okop155PQydIf+wg7ftPu6hXAEk= 2020/07/24 10:36:45 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2D935527980E5E1F4BnOs1UL1MH6Jqfo8CcC4kbV7wJ65Vh7F0wJwNRDl3gj2ada+Okop155PQydIf+wg7ftPu6hXAEk= 2020/07/24 10:36:46 DEBUG : : Looking for writers 2020/07/24 10:36:46 DEBUG : file1: reading active writers 2020/07/24 10:36:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:47 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:47 DEBUG : : Looking for writers 2020/07/24 10:36:47 DEBUG : file1: reading active writers 2020/07/24 10:36:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:47 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad23AEB11DE2D776C8Ewe7cGh0LfIzLJXaP11AJu3YG1j6W+FowciH2GI9161DcSG+QgSAeKJMCtCg1XVwFcbaYTw5dpXA= 2020/07/24 10:36:47 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad23AEB11DE2D776C8Ewe7cGh0LfIzLJXaP11AJu3YG1j6W+FowciH2GI9161DcSG+QgSAeKJMCtCg1XVwFcbaYTw5dpXA= 2020/07/24 10:36:48 DEBUG : : Looking for writers 2020/07/24 10:36:48 DEBUG : file1: reading active writers 2020/07/24 10:36:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:49 DEBUG : : Looking for writers 2020/07/24 10:36:49 DEBUG : file1: reading active writers 2020/07/24 10:36:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:50 DEBUG : : Looking for writers 2020/07/24 10:36:50 DEBUG : file1: reading active writers 2020/07/24 10:36:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:50 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:50 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad23YFR1K6Q7S4G4G0YY+NQV1R+wJidSONqmyFNqIHSt5yKKuvUuByMnKdJNS+ZiM74YA4EVJpqLKHk0Eahf9jqxWKNDmc= 2020/07/24 10:36:50 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad23YFR1K6Q7S4G4G0YY+NQV1R+wJidSONqmyFNqIHSt5yKKuvUuByMnKdJNS+ZiM74YA4EVJpqLKHk0Eahf9jqxWKNDmc= 2020/07/24 10:36:51 DEBUG : : Looking for writers 2020/07/24 10:36:51 DEBUG : file1: reading active writers 2020/07/24 10:36:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:52 DEBUG : : Looking for writers 2020/07/24 10:36:52 DEBUG : file1: reading active writers 2020/07/24 10:36:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:53 DEBUG : : Looking for writers 2020/07/24 10:36:53 DEBUG : file1: reading active writers 2020/07/24 10:36:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:36:54 ERROR : Exiting even though 0 writers active and 1 cache items in use after 10s Cache{ "file1": &{c:0xc0001e8360 mu:{state:0 sema:0} name:file1 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705346768647448 ext:27322339344 loc:0x28e63c0} ATime:{wall:13816705346768662360 ext:27322354265 loc:0x28e63c0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1}, } 2020/07/24 10:36:54 DEBUG : >WaitForWriters: 2020/07/24 10:36:57 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:36:57 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2B9C69DD6153E986126FB1fduxmLNhSo9xvsRUQURO/dnimTVFM4iMpD0t8oRfdf5oGV0/Ga7zFulvdBGeQNEH5F0U7s= 2020/07/24 10:36:57 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2B9C69DD6153E986126FB1fduxmLNhSo9xvsRUQURO/dnimTVFM4iMpD0t8oRfdf5oGV0/Ga7zFulvdBGeQNEH5F0U7s= 2020/07/24 10:37:01 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2020/07/24 10:37:01 DEBUG : : Looking for writers 2020/07/24 10:37:01 DEBUG : file1: reading active writers 2020/07/24 10:37:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2020/07/24 10:37:02 DEBUG : : Looking for writers 2020/07/24 10:37:02 DEBUG : file1: reading active writers 2020/07/24 10:37:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:03 DEBUG : : Looking for writers 2020/07/24 10:37:03 DEBUG : file1: reading active writers 2020/07/24 10:37:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:04 DEBUG : : Looking for writers 2020/07/24 10:37:04 DEBUG : file1: reading active writers 2020/07/24 10:37:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:05 DEBUG : : Looking for writers 2020/07/24 10:37:05 DEBUG : file1: reading active writers 2020/07/24 10:37:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:06 DEBUG : : Looking for writers 2020/07/24 10:37:06 DEBUG : file1: reading active writers 2020/07/24 10:37:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:07 DEBUG : : Looking for writers 2020/07/24 10:37:07 DEBUG : file1: reading active writers 2020/07/24 10:37:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:08 DEBUG : : Looking for writers 2020/07/24 10:37:08 DEBUG : file1: reading active writers 2020/07/24 10:37:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:09 DEBUG : : Looking for writers 2020/07/24 10:37:09 DEBUG : file1: reading active writers 2020/07/24 10:37:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:10 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:10 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27BBA954DB579A5FC6Kki9mG6Z0K+eqmmdybF2EAkyC31BupaUUWR/rdv5NaKzw9Gn/cpcRrUtirCqFWdZBTbVgc/mTM= 2020/07/24 10:37:10 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27BBA954DB579A5FC6Kki9mG6Z0K+eqmmdybF2EAkyC31BupaUUWR/rdv5NaKzw9Gn/cpcRrUtirCqFWdZBTbVgc/mTM= 2020/07/24 10:37:10 DEBUG : : Looking for writers 2020/07/24 10:37:10 DEBUG : file1: reading active writers 2020/07/24 10:37:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2020/07/24 10:37:11 ERROR : Exiting even though 0 writers active and 1 cache items in use after 10s Cache{ "file1": &{c:0xc0001e8360 mu:{state:0 sema:0} name:file1 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705346768647448 ext:27322339344 loc:0x28e63c0} ATime:{wall:13816705346768662360 ext:27322354265 loc:0x28e63c0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1}, } 2020/07/24 10:37:11 DEBUG : >WaitForWriters: 2020/07/24 10:37:11 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (27.12s) run.go:176: Remote "Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2'", Local "Local file system at /tmp/rclone823664040", Modify Window "1ns" fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 read_write_test.go:392 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:200: Not found "file1" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 read_write_test.go:392 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found === RUN TestRWFileHandleWriteNoWrite 2020/07/24 10:37:11 INFO : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': poll-interval is not supported by this remote 2020/07/24 10:37:11 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone/vfs/TestChunkerChunk50bMD5HashS3/rclone-test-sehikeb1xodicob6dufedad2" 2020/07/24 10:37:11 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfs/TestChunkerChunk50bMD5HashS3/rclone-test-sehikeb1xodicob6dufedad2" 2020/07/24 10:37:11 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:37:11 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2020/07/24 10:37:11 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:37:11 DEBUG : file1: newRWFileHandle: 2020/07/24 10:37:11 DEBUG : file1(0xc000093800): openPending: 2020/07/24 10:37:11 DEBUG : file1: vfs cache: truncate to size=0 2020/07/24 10:37:11 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:11 DEBUG : file1(0xc000093800): >openPending: err= 2020/07/24 10:37:11 DEBUG : file1: >newRWFileHandle: err= 2020/07/24 10:37:11 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:11 DEBUG : file1: >Open: fd=file1 (rw), err= 2020/07/24 10:37:11 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2020/07/24 10:37:11 DEBUG : file1(0xc000093800): close: 2020/07/24 10:37:11 DEBUG : file1: vfs cache: setting modification time to 2020-07-24 10:37:11.394667568 +0000 UTC m=+54.442102569 2020/07/24 10:37:11 INFO : file1: vfs cache: queuing for upload in 100ms 2020/07/24 10:37:11 DEBUG : file1(0xc000093800): >close: err= 2020/07/24 10:37:11 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2020/07/24 10:37:11 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2020/07/24 10:37:11 DEBUG : file2: newRWFileHandle: 2020/07/24 10:37:11 DEBUG : file2(0xc000093b00): openPending: 2020/07/24 10:37:11 DEBUG : file2: vfs cache: truncate to size=0 2020/07/24 10:37:11 DEBUG : : Added virtual directory entry vAdd: "file2" 2020/07/24 10:37:11 DEBUG : file2(0xc000093b00): >openPending: err= 2020/07/24 10:37:11 DEBUG : file2: >newRWFileHandle: err= 2020/07/24 10:37:11 DEBUG : : Added virtual directory entry vAdd: "file2" 2020/07/24 10:37:11 DEBUG : file2: >Open: fd=file2 (rw), err= 2020/07/24 10:37:11 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2020/07/24 10:37:11 DEBUG : file2(0xc000093b00): RWFileHandle.Flush 2020/07/24 10:37:11 DEBUG : file2(0xc000093b00): RWFileHandle.Release 2020/07/24 10:37:11 DEBUG : file2(0xc000093b00): close: 2020/07/24 10:37:11 DEBUG : file2: vfs cache: setting modification time to 2020-07-24 10:37:11.395327155 +0000 UTC m=+54.442762165 2020/07/24 10:37:11 INFO : file2: vfs cache: queuing for upload in 100ms 2020/07/24 10:37:11 DEBUG : file2(0xc000093b00): >close: err= 2020/07/24 10:37:11 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:37:11 DEBUG : : Looking for writers 2020/07/24 10:37:11 DEBUG : file2: reading active writers 2020/07/24 10:37:11 DEBUG : file1: reading active writers 2020/07/24 10:37:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2020/07/24 10:37:11 DEBUG : : Looking for writers 2020/07/24 10:37:11 DEBUG : file1: reading active writers 2020/07/24 10:37:11 DEBUG : file2: reading active writers 2020/07/24 10:37:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2020/07/24 10:37:11 DEBUG : : Looking for writers 2020/07/24 10:37:11 DEBUG : file2: reading active writers 2020/07/24 10:37:11 DEBUG : file1: reading active writers 2020/07/24 10:37:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2020/07/24 10:37:11 DEBUG : : Looking for writers 2020/07/24 10:37:11 DEBUG : file1: reading active writers 2020/07/24 10:37:11 DEBUG : file2: reading active writers 2020/07/24 10:37:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2020/07/24 10:37:11 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:11 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:11 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2096E055C50B146ECWInVEyerFzvb1fflaW7zAR2H91RpVqdoIjh17cpV8OghBz+akj8/s4hTPiLYb7M19DNcvvBK4t0= 2020/07/24 10:37:11 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2096E055C50B146ECWInVEyerFzvb1fflaW7zAR2H91RpVqdoIjh17cpV8OghBz+akj8/s4hTPiLYb7M19DNcvvBK4t0= 2020/07/24 10:37:11 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2206CFE4E1F929E5Fox784JuBrCw21XhF/uBFbY5p6Azff9PqQV4CL/HOOCl1ZzvYyOGZwXghwPIcwxL8zfJ0W56AfQQ= 2020/07/24 10:37:11 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2206CFE4E1F929E5Fox784JuBrCw21XhF/uBFbY5p6Azff9PqQV4CL/HOOCl1ZzvYyOGZwXghwPIcwxL8zfJ0W56AfQQ= 2020/07/24 10:37:11 DEBUG : : Looking for writers 2020/07/24 10:37:11 DEBUG : file1: reading active writers 2020/07/24 10:37:11 DEBUG : file2: reading active writers 2020/07/24 10:37:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2020/07/24 10:37:11 DEBUG : : Looking for writers 2020/07/24 10:37:11 DEBUG : file1: reading active writers 2020/07/24 10:37:11 DEBUG : file2: reading active writers 2020/07/24 10:37:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2020/07/24 10:37:11 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:11 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:11 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad281714FB0036BE88AnqoXXodhHSwsHstewJ5qVvyGtGgfmzoPJzgbC5TsIxGCbIRW7HfNJriSkcGO/Mhcxh1Hutv29Nw= 2020/07/24 10:37:11 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad281714FB0036BE88AnqoXXodhHSwsHstewJ5qVvyGtGgfmzoPJzgbC5TsIxGCbIRW7HfNJriSkcGO/Mhcxh1Hutv29Nw= 2020/07/24 10:37:11 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad20E4AAF741A699190xPzAN89SbV6tS6+I9aYIWmmVzrUvnhhPUuPrpnN2BmNCMWCJD8z50E210EdBokepI+Sa8YWhaOg= 2020/07/24 10:37:11 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad20E4AAF741A699190xPzAN89SbV6tS6+I9aYIWmmVzrUvnhhPUuPrpnN2BmNCMWCJD8z50E210EdBokepI+Sa8YWhaOg= 2020/07/24 10:37:12 DEBUG : : Looking for writers 2020/07/24 10:37:12 DEBUG : file2: reading active writers 2020/07/24 10:37:12 DEBUG : file1: reading active writers 2020/07/24 10:37:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2020/07/24 10:37:12 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:12 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:12 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad202015C9DB839EC265aU+4KOzaEwnbqD7+RXK3HY7RwnfzqgGsyDzGCsOkNLr6SojI0oxX5G6pd9NbxYhm911lgMy2F8= 2020/07/24 10:37:12 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad202015C9DB839EC265aU+4KOzaEwnbqD7+RXK3HY7RwnfzqgGsyDzGCsOkNLr6SojI0oxX5G6pd9NbxYhm911lgMy2F8= 2020/07/24 10:37:12 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2EE37BB257ED60CA1muEfrEYjC5zbblrIpzy0joH35QDsX4Qq2R0ECKxMU+zYvHfepJu2gLsF4iLNwSWWnn+wLmiGCgc= 2020/07/24 10:37:12 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2EE37BB257ED60CA1muEfrEYjC5zbblrIpzy0joH35QDsX4Qq2R0ECKxMU+zYvHfepJu2gLsF4iLNwSWWnn+wLmiGCgc= 2020/07/24 10:37:12 DEBUG : : Looking for writers 2020/07/24 10:37:12 DEBUG : file1: reading active writers 2020/07/24 10:37:12 DEBUG : file2: reading active writers 2020/07/24 10:37:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:12 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:12 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:12 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad29AE0B2B8CE769579/85QwpCD8VtehQKc7BhNCQWERcpH3m7iAFarlgQwjmvMh3BL8L76auM07q78yWdIfa3h290mlQc= 2020/07/24 10:37:12 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad29AE0B2B8CE769579/85QwpCD8VtehQKc7BhNCQWERcpH3m7iAFarlgQwjmvMh3BL8L76auM07q78yWdIfa3h290mlQc= 2020/07/24 10:37:12 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27B32AC87E0E146DDvKsuQVlMj3G3q8+AJysbtf+UyVTrVWTeJbI3UAJy28W3qd3t1oEjS4qu5rdxdoAigGH7CltLdxo= 2020/07/24 10:37:12 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27B32AC87E0E146DDvKsuQVlMj3G3q8+AJysbtf+UyVTrVWTeJbI3UAJy28W3qd3t1oEjS4qu5rdxdoAigGH7CltLdxo= 2020/07/24 10:37:13 DEBUG : : Looking for writers 2020/07/24 10:37:13 DEBUG : file1: reading active writers 2020/07/24 10:37:13 DEBUG : file2: reading active writers 2020/07/24 10:37:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:14 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:14 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:14 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A2D8840C3E11FD6BUMi9aC/lHxIr4UkgzywM7GqCm9HiWM9gCefgnWKZQZI85cRfsWL8x1/KjJdCp7TZnDODzcmSROo= 2020/07/24 10:37:14 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A2D8840C3E11FD6BUMi9aC/lHxIr4UkgzywM7GqCm9HiWM9gCefgnWKZQZI85cRfsWL8x1/KjJdCp7TZnDODzcmSROo= 2020/07/24 10:37:14 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2E8F88C3C7121DB4DBjRM4dO8qPThxmMcf5+vGNmaQnHAnm65CvrM72kSZfD9CHSAT9iMzFhljM+fMwJFl8g26AyDas0= 2020/07/24 10:37:14 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2E8F88C3C7121DB4DBjRM4dO8qPThxmMcf5+vGNmaQnHAnm65CvrM72kSZfD9CHSAT9iMzFhljM+fMwJFl8g26AyDas0= 2020/07/24 10:37:14 DEBUG : : Looking for writers 2020/07/24 10:37:14 DEBUG : file1: reading active writers 2020/07/24 10:37:14 DEBUG : file2: reading active writers 2020/07/24 10:37:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:15 DEBUG : : Looking for writers 2020/07/24 10:37:15 DEBUG : file1: reading active writers 2020/07/24 10:37:15 DEBUG : file2: reading active writers 2020/07/24 10:37:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:16 DEBUG : : Looking for writers 2020/07/24 10:37:16 DEBUG : file1: reading active writers 2020/07/24 10:37:16 DEBUG : file2: reading active writers 2020/07/24 10:37:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:17 DEBUG : : Looking for writers 2020/07/24 10:37:17 DEBUG : file2: reading active writers 2020/07/24 10:37:17 DEBUG : file1: reading active writers 2020/07/24 10:37:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:17 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:17 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:17 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2574DED6A84CFA81B674O+ijXgNUkpqk2HHjZdhpTG/oTS/LJtZNNpMLPhN2vYuZxyki5gPGQ5MJBVfwBo1ogZIDIx1s= 2020/07/24 10:37:17 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2574DED6A84CFA81B674O+ijXgNUkpqk2HHjZdhpTG/oTS/LJtZNNpMLPhN2vYuZxyki5gPGQ5MJBVfwBo1ogZIDIx1s= 2020/07/24 10:37:17 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad293C4B619E7179AC4KuW/+fEGb4weWGsE5diqkcCA2Cu7ox7PHLJjRMQVORsQP898HblDmoMnz5aZnxBgJ/IOvmHl87E= 2020/07/24 10:37:17 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad293C4B619E7179AC4KuW/+fEGb4weWGsE5diqkcCA2Cu7ox7PHLJjRMQVORsQP898HblDmoMnz5aZnxBgJ/IOvmHl87E= 2020/07/24 10:37:18 DEBUG : : Looking for writers 2020/07/24 10:37:18 DEBUG : file1: reading active writers 2020/07/24 10:37:18 DEBUG : file2: reading active writers 2020/07/24 10:37:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:19 DEBUG : : Looking for writers 2020/07/24 10:37:19 DEBUG : file1: reading active writers 2020/07/24 10:37:19 DEBUG : file2: reading active writers 2020/07/24 10:37:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:20 DEBUG : : Looking for writers 2020/07/24 10:37:20 DEBUG : file1: reading active writers 2020/07/24 10:37:20 DEBUG : file2: reading active writers 2020/07/24 10:37:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:21 ERROR : Exiting even though 0 writers active and 2 cache items in use after 10s Cache{ "file1": &{c:0xc00078c3f0 mu:{state:0 sema:0} name:file1 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705375879439920 ext:54442102569 loc:0x28e63c0} ATime:{wall:13816705375879557065 ext:54442219727 loc:0x28e63c0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1}, "file2": &{c:0xc00078c3f0 mu:{state:0 sema:0} name:file2 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705375880099507 ext:54442762165 loc:0x28e63c0} ATime:{wall:13816705375880241922 ext:54442904583 loc:0x28e63c0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2}, } 2020/07/24 10:37:21 DEBUG : >WaitForWriters: 2020/07/24 10:37:24 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:24 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:24 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2FEA25C46002CD6A1LX+HCn7Iosgex63mgTivQc6/L+LCklSOF5rZszxhDrbpn58bM7W4RFop36M7o7VJNt7BVnwr2LU= 2020/07/24 10:37:24 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2FEA25C46002CD6A1LX+HCn7Iosgex63mgTivQc6/L+LCklSOF5rZszxhDrbpn58bM7W4RFop36M7o7VJNt7BVnwr2LU= 2020/07/24 10:37:24 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2405BE6871E0544671EJuZSC9VftQNhcDf9/PJa8wgQ4XZNaU4OXXexgNVcoMPNmmMOm+E/8qL6juu7G/RyJKaykTxUA= 2020/07/24 10:37:24 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2405BE6871E0544671EJuZSC9VftQNhcDf9/PJa8wgQ4XZNaU4OXXexgNVcoMPNmmMOm+E/8qL6juu7G/RyJKaykTxUA= 2020/07/24 10:37:28 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:37:28 DEBUG : : Looking for writers 2020/07/24 10:37:28 DEBUG : file1: reading active writers 2020/07/24 10:37:28 DEBUG : file2: reading active writers 2020/07/24 10:37:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2020/07/24 10:37:28 DEBUG : : Looking for writers 2020/07/24 10:37:28 DEBUG : file1: reading active writers 2020/07/24 10:37:28 DEBUG : file2: reading active writers 2020/07/24 10:37:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2020/07/24 10:37:28 DEBUG : : Looking for writers 2020/07/24 10:37:28 DEBUG : file1: reading active writers 2020/07/24 10:37:28 DEBUG : file2: reading active writers 2020/07/24 10:37:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2020/07/24 10:37:28 DEBUG : : Looking for writers 2020/07/24 10:37:28 DEBUG : file1: reading active writers 2020/07/24 10:37:28 DEBUG : file2: reading active writers 2020/07/24 10:37:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2020/07/24 10:37:28 DEBUG : : Looking for writers 2020/07/24 10:37:28 DEBUG : file1: reading active writers 2020/07/24 10:37:28 DEBUG : file2: reading active writers 2020/07/24 10:37:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2020/07/24 10:37:28 DEBUG : : Looking for writers 2020/07/24 10:37:28 DEBUG : file1: reading active writers 2020/07/24 10:37:28 DEBUG : file2: reading active writers 2020/07/24 10:37:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2020/07/24 10:37:29 DEBUG : : Looking for writers 2020/07/24 10:37:29 DEBUG : file1: reading active writers 2020/07/24 10:37:29 DEBUG : file2: reading active writers 2020/07/24 10:37:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2020/07/24 10:37:29 DEBUG : : Looking for writers 2020/07/24 10:37:29 DEBUG : file1: reading active writers 2020/07/24 10:37:29 DEBUG : file2: reading active writers 2020/07/24 10:37:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:30 DEBUG : : Looking for writers 2020/07/24 10:37:30 DEBUG : file1: reading active writers 2020/07/24 10:37:30 DEBUG : file2: reading active writers 2020/07/24 10:37:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:31 DEBUG : : Looking for writers 2020/07/24 10:37:31 DEBUG : file1: reading active writers 2020/07/24 10:37:31 DEBUG : file2: reading active writers 2020/07/24 10:37:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:32 DEBUG : : Looking for writers 2020/07/24 10:37:32 DEBUG : file1: reading active writers 2020/07/24 10:37:32 DEBUG : file2: reading active writers 2020/07/24 10:37:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:33 DEBUG : : Looking for writers 2020/07/24 10:37:33 DEBUG : file1: reading active writers 2020/07/24 10:37:33 DEBUG : file2: reading active writers 2020/07/24 10:37:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:34 DEBUG : : Looking for writers 2020/07/24 10:37:34 DEBUG : file1: reading active writers 2020/07/24 10:37:34 DEBUG : file2: reading active writers 2020/07/24 10:37:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:35 DEBUG : : Looking for writers 2020/07/24 10:37:35 DEBUG : file1: reading active writers 2020/07/24 10:37:35 DEBUG : file2: reading active writers 2020/07/24 10:37:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:36 DEBUG : : Looking for writers 2020/07/24 10:37:36 DEBUG : file1: reading active writers 2020/07/24 10:37:36 DEBUG : file2: reading active writers 2020/07/24 10:37:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:37 DEBUG : file1: vfs cache: starting upload 2020/07/24 10:37:37 DEBUG : file2: vfs cache: starting upload 2020/07/24 10:37:37 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2629387D7DF650FEEXJSuPSRGkadethJP55KbEMfakce1/DHqdJ9wNN9A30xMgDPRo7JwBg8Q6lUHbXXnO+olOB7B45s= 2020/07/24 10:37:37 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2629387D7DF650FEEXJSuPSRGkadethJP55KbEMfakce1/DHqdJ9wNN9A30xMgDPRo7JwBg8Q6lUHbXXnO+olOB7B45s= 2020/07/24 10:37:37 ERROR : file2: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad267CC3B99359890B33b0Tvupw6hLuKN7zEBzXmATOMI7Uj4oJ6Z0kkrYAcJe8fnEntIB3XVu2/aPrTWTSjhMXEzZgw8k= 2020/07/24 10:37:37 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad267CC3B99359890B33b0Tvupw6hLuKN7zEBzXmATOMI7Uj4oJ6Z0kkrYAcJe8fnEntIB3XVu2/aPrTWTSjhMXEzZgw8k= 2020/07/24 10:37:37 DEBUG : : Looking for writers 2020/07/24 10:37:37 DEBUG : file1: reading active writers 2020/07/24 10:37:37 DEBUG : file2: reading active writers 2020/07/24 10:37:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2020/07/24 10:37:38 ERROR : Exiting even though 0 writers active and 2 cache items in use after 10s Cache{ "file1": &{c:0xc00078c3f0 mu:{state:0 sema:0} name:file1 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705375879439920 ext:54442102569 loc:0x28e63c0} ATime:{wall:13816705375879557065 ext:54442219727 loc:0x28e63c0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1}, "file2": &{c:0xc00078c3f0 mu:{state:0 sema:0} name:file2 opens:0 downloaders: o: fd: metaDirty:false modified:false info:{ModTime:{wall:13816705375880099507 ext:54442762165 loc:0x28e63c0} ATime:{wall:13816705375880241922 ext:54442904583 loc:0x28e63c0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2}, } 2020/07/24 10:37:38 DEBUG : >WaitForWriters: 2020/07/24 10:37:38 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (27.03s) run.go:176: Remote "Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2'", Local "Local file system at /tmp/rclone823664040", Modify Window "1ns" fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 read_write_test.go:426 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:200: Not found "file1" fstest.go:200: Not found "file2" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 read_write_test.go:426 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found === RUN TestWriteFileHandleMethods 2020/07/24 10:37:38 INFO : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': poll-interval is not supported by this remote 2020/07/24 10:37:38 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:37:38 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:37:38 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:38 DEBUG : file1: >Open: fd=file1 (w), err= 2020/07/24 10:37:38 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2020/07/24 10:37:38 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:38 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2020/07/24 10:37:38 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2020/07/24 10:37:38 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2020/07/24 10:37:38 DEBUG : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': File to upload is small (5 bytes), uploading instead of streaming 2020/07/24 10:37:38 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27602A93C6CB99A14aWtrLPwp5I/aM2VmKWtXbVndhRmhwh7cJJU6M8+yRczP92+FVn2J1otJNlTllhEE/a/27MvFBUE= 2020/07/24 10:37:38 ERROR : file1: WriteFileHandle.New Rcat failed: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27602A93C6CB99A14aWtrLPwp5I/aM2VmKWtXbVndhRmhwh7cJJU6M8+yRczP92+FVn2J1otJNlTllhEE/a/27MvFBUE= 2020/07/24 10:37:45 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:37:45 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:37:45 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:45 DEBUG : file1: >Open: fd=file1 (w), err= 2020/07/24 10:37:45 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2020/07/24 10:37:45 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:45 DEBUG : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': File to upload is small (0 bytes), uploading instead of streaming 2020/07/24 10:37:45 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2ABAC3C324A6AAF87XDrKAoccfkH6kFAJ9JU9+xEmAlpm+Dt+tYwzqs2/UyUz0e7nlPGUER6zyeV9hZllgm9pd/Tp1uY= 2020/07/24 10:37:45 ERROR : file1: WriteFileHandle.New Rcat failed: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2ABAC3C324A6AAF87XDrKAoccfkH6kFAJ9JU9+xEmAlpm+Dt+tYwzqs2/UyUz0e7nlPGUER6zyeV9hZllgm9pd/Tp1uY= 2020/07/24 10:37:45 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:37:45 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:37:45 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:45 DEBUG : file1: >Open: fd=file1 (w), err= 2020/07/24 10:37:45 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2020/07/24 10:37:45 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:45 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:37:45 DEBUG : : Looking for writers 2020/07/24 10:37:45 DEBUG : file1: reading active writers 2020/07/24 10:37:45 DEBUG : file1: active writers 1 2020/07/24 10:37:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2020/07/24 10:37:45 DEBUG : : Looking for writers 2020/07/24 10:37:45 DEBUG : file1: reading active writers 2020/07/24 10:37:45 DEBUG : file1: active writers 1 2020/07/24 10:37:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2020/07/24 10:37:45 DEBUG : : Looking for writers 2020/07/24 10:37:45 DEBUG : file1: reading active writers 2020/07/24 10:37:45 DEBUG : file1: active writers 1 2020/07/24 10:37:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2020/07/24 10:37:45 DEBUG : : Looking for writers 2020/07/24 10:37:45 DEBUG : file1: reading active writers 2020/07/24 10:37:45 DEBUG : file1: active writers 1 2020/07/24 10:37:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2020/07/24 10:37:45 DEBUG : : Looking for writers 2020/07/24 10:37:45 DEBUG : file1: reading active writers 2020/07/24 10:37:45 DEBUG : file1: active writers 1 2020/07/24 10:37:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2020/07/24 10:37:45 DEBUG : : Looking for writers 2020/07/24 10:37:45 DEBUG : file1: reading active writers 2020/07/24 10:37:45 DEBUG : file1: active writers 1 2020/07/24 10:37:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2020/07/24 10:37:46 DEBUG : : Looking for writers 2020/07/24 10:37:46 DEBUG : file1: reading active writers 2020/07/24 10:37:46 DEBUG : file1: active writers 1 2020/07/24 10:37:46 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2020/07/24 10:37:46 DEBUG : : Looking for writers 2020/07/24 10:37:46 DEBUG : file1: reading active writers 2020/07/24 10:37:46 DEBUG : file1: active writers 1 2020/07/24 10:37:46 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:47 DEBUG : : Looking for writers 2020/07/24 10:37:47 DEBUG : file1: reading active writers 2020/07/24 10:37:47 DEBUG : file1: active writers 1 2020/07/24 10:37:47 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:48 DEBUG : : Looking for writers 2020/07/24 10:37:48 DEBUG : file1: reading active writers 2020/07/24 10:37:48 DEBUG : file1: active writers 1 2020/07/24 10:37:48 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:49 DEBUG : : Looking for writers 2020/07/24 10:37:49 DEBUG : file1: reading active writers 2020/07/24 10:37:49 DEBUG : file1: active writers 1 2020/07/24 10:37:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:50 DEBUG : : Looking for writers 2020/07/24 10:37:50 DEBUG : file1: reading active writers 2020/07/24 10:37:50 DEBUG : file1: active writers 1 2020/07/24 10:37:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:51 DEBUG : : Looking for writers 2020/07/24 10:37:51 DEBUG : file1: reading active writers 2020/07/24 10:37:51 DEBUG : file1: active writers 1 2020/07/24 10:37:51 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:52 DEBUG : : Looking for writers 2020/07/24 10:37:52 DEBUG : file1: reading active writers 2020/07/24 10:37:52 DEBUG : file1: active writers 1 2020/07/24 10:37:52 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:53 DEBUG : : Looking for writers 2020/07/24 10:37:53 DEBUG : file1: reading active writers 2020/07/24 10:37:53 DEBUG : file1: active writers 1 2020/07/24 10:37:53 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:54 DEBUG : : Looking for writers 2020/07/24 10:37:54 DEBUG : file1: reading active writers 2020/07/24 10:37:54 DEBUG : file1: active writers 1 2020/07/24 10:37:54 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2020/07/24 10:37:55 ERROR : Exiting even though 1 writers active and 0 cache items in use after 10s Cache: 2020/07/24 10:37:55 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (17.08s) run.go:176: Remote "Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2'", Local "Local file system at /tmp/rclone823664040", Modify Window "1ns" write_test.go:84: Error Trace: write_test.go:84 Error: Received unexpected error: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad27602A93C6CB99A14aWtrLPwp5I/aM2VmKWtXbVndhRmhwh7cJJU6M8+yRczP92+FVn2J1otJNlTllhEE/a/27MvFBUE= Test: TestWriteFileHandleMethods fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 write_test.go:97 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:200: Not found "file1" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 write_test.go:97 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found write_test.go:103: Error Trace: write_test.go:103 Error: Received unexpected error: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2ABAC3C324A6AAF87XDrKAoccfkH6kFAJ9JU9+xEmAlpm+Dt+tYwzqs2/UyUz0e7nlPGUER6zyeV9hZllgm9pd/Tp1uY= Test: TestWriteFileHandleMethods dir_test.go:252: Error Trace: dir_test.go:252 write_test.go:104 Error: Not equal: expected: []string{"file1,5,false"} actual : []string{"file1,0,false"} Diff: --- Expected +++ Actual @@ -1,3 +1,3 @@ ([]string) (len=1) { - (string) (len=13) "file1,5,false" + (string) (len=13) "file1,0,false" } Test: TestWriteFileHandleMethods write_test.go:111: Error Trace: write_test.go:111 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods === RUN TestWriteFileHandleWriteAt 2020/07/24 10:37:55 INFO : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': poll-interval is not supported by this remote 2020/07/24 10:37:55 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:37:55 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:37:55 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:55 DEBUG : file1: >Open: fd=file1 (w), err= 2020/07/24 10:37:55 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2020/07/24 10:37:55 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:37:55 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2020/07/24 10:37:56 DEBUG : file1: aborting in-sequence write wait, off=100 2020/07/24 10:37:56 DEBUG : file1: failed to wait for in-sequence write to 100 2020/07/24 10:37:56 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2020/07/24 10:37:56 DEBUG : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': File to upload is small (11 bytes), uploading instead of streaming 2020/07/24 10:37:56 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2ACC6CBF5EFC5BF20kYmTo/a9FYz66KEgx1qVXqDu05Y909ajQm6P9J84taKqnmlE5uW367TpI9NKbqQtW8BFCaMP59M= 2020/07/24 10:37:56 ERROR : file1: WriteFileHandle.New Rcat failed: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2ACC6CBF5EFC5BF20kYmTo/a9FYz66KEgx1qVXqDu05Y909ajQm6P9J84taKqnmlE5uW367TpI9NKbqQtW8BFCaMP59M= 2020/07/24 10:37:56 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor 2020/07/24 10:38:03 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:38:03 DEBUG : : Looking for writers 2020/07/24 10:38:03 DEBUG : file1: reading active writers 2020/07/24 10:38:03 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (8.06s) run.go:176: Remote "Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2'", Local "Local file system at /tmp/rclone823664040", Modify Window "1ns" write_test.go:162: Error Trace: write_test.go:162 Error: Received unexpected error: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2ACC6CBF5EFC5BF20kYmTo/a9FYz66KEgx1qVXqDu05Y909ajQm6P9J84taKqnmlE5uW367TpI9NKbqQtW8BFCaMP59M= Test: TestWriteFileHandleWriteAt fstest.go:295: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:295: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:295: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:302: Error Trace: fstest.go:302 fstest.go:335 write_test.go:176 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:200: Not found "file1" fstest.go:203: Error Trace: fstest.go:203 fstest.go:307 fstest.go:335 write_test.go:176 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found === RUN TestWriteFileHandleFlush 2020/07/24 10:38:03 INFO : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': poll-interval is not supported by this remote 2020/07/24 10:38:03 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2020/07/24 10:38:03 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2020/07/24 10:38:03 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:38:03 DEBUG : file1: >Open: fd=file1 (w), err= 2020/07/24 10:38:03 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2020/07/24 10:38:03 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2020/07/24 10:38:03 DEBUG : : Added virtual directory entry vAdd: "file1" 2020/07/24 10:38:03 DEBUG : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': File to upload is small (5 bytes), uploading instead of streaming 2020/07/24 10:38:03 ERROR : file1: Failed to copy: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A07E5D8255F85936ZhCdnSfxNsnrwSzCrGxG8qwogvdJnPY2B8vDabxZ0JVCeY7mSom8VuFOw4zHZwOw1bkuDfoXVg4= 2020/07/24 10:38:03 ERROR : file1: WriteFileHandle.New Rcat failed: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A07E5D8255F85936ZhCdnSfxNsnrwSzCrGxG8qwogvdJnPY2B8vDabxZ0JVCeY7mSom8VuFOw4zHZwOw1bkuDfoXVg4= 2020/07/24 10:38:03 ERROR : file1: WriteFileHandle.Flush error: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A07E5D8255F85936ZhCdnSfxNsnrwSzCrGxG8qwogvdJnPY2B8vDabxZ0JVCeY7mSom8VuFOw4zHZwOw1bkuDfoXVg4= 2020/07/24 10:38:03 DEBUG : file1: WriteFileHandle.Flush nothing to do 2020/07/24 10:38:03 DEBUG : WaitForWriters: timeout=10s 2020/07/24 10:38:03 DEBUG : : Looking for writers 2020/07/24 10:38:03 DEBUG : file1: reading active writers 2020/07/24 10:38:03 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (0.07s) run.go:176: Remote "Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2'", Local "Local file system at /tmp/rclone823664040", Modify Window "1ns" write_test.go:198: Error Trace: write_test.go:198 Error: Received unexpected error: s3 upload: 404 Not Found: NoSuchBucketThe specified bucket does not existrclone-test-sehikeb1xodicob6dufedad2A07E5D8255F85936ZhCdnSfxNsnrwSzCrGxG8qwogvdJnPY2B8vDabxZ0JVCeY7mSom8VuFOw4zHZwOw1bkuDfoXVg4= Test: TestWriteFileHandleFlush FAIL 2020/07/24 10:38:03 DEBUG : Chunked 'TestChunkerChunk50bMD5HashS3:rclone-test-sehikeb1xodicob6dufedad2': Purge dir "" 2020/07/24 10:38:03 purge failed to rmdir "": NoSuchBucket: The specified bucket does not exist status code: 404, request id: FDD36643182FF70F, host id: y6ZYUAzIUx0y+F4ZGzkG2UbFoZC8skeIzJxFh8C3lZvZXFW4CbwfzmXaJiND9a0i2g6RF6Wp+Lw= 2020/07/24 10:38:03 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestChunkerChunk50bMD5HashS3: -verbose -size-limit 1024 -test.run '^(TestRWFileHandleMethodsWrite|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleWriteAt)$'" - Finished ERROR in 1m46.701118515s (try 2/5): exit status 1: Failed [TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush]