"./vfs.test -test.v -test.timeout 1h0m0s -remote TestGoogleCloudStorage: -verbose -test.run '^TestRWCacheUpdate$'" - Starting (try 4/5) 2026/04/07 03:49:37 DEBUG : Creating backend with remote "TestGoogleCloudStorage:rclone-test-kebujuc8bori" 2026/04/07 03:49:37 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/07 03:49:37 DEBUG : Creating backend with remote "/tmp/rclone313583279" === RUN TestRWCacheUpdate run.go:185: Remote "GCS bucket rclone-test-kebujuc8bori", Local "Local file system at /tmp/rclone313583279", Modify Window "1ns" 2026/04/07 03:49:37 INFO : GCS bucket rclone-test-kebujuc8bori: poll-interval is not supported by this remote 2026/04/07 03:49:37 DEBUG : GCS bucket rclone-test-kebujuc8bori: vfs cache: root is "/home/rclone/.cache/rclone" 2026/04/07 03:49:37 DEBUG : GCS bucket rclone-test-kebujuc8bori: vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage/rclone-test-kebujuc8bori" 2026/04/07 03:49:37 DEBUG : GCS bucket rclone-test-kebujuc8bori: vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage/rclone-test-kebujuc8bori" 2026/04/07 03:49:37 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage/rclone-test-kebujuc8bori" 2026/04/07 03:49:37 DEBUG : :local: detected overridden config - adding "{8un-i}" suffix to name 2026/04/07 03:49:37 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage/rclone-test-kebujuc8bori" to be canonical ":local{8un-i}:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage/rclone-test-kebujuc8bori" 2026/04/07 03:49:37 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage/rclone-test-kebujuc8bori" 2026/04/07 03:49:37 DEBUG : :local: detected overridden config - adding "{8un-i}" suffix to name 2026/04/07 03:49:37 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage/rclone-test-kebujuc8bori" to be canonical ":local{8un-i}:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage/rclone-test-kebujuc8bori" 2026/04/07 03:49:37 INFO : GCS bucket rclone-test-kebujuc8bori: vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2026/04/07 03:49:37 DEBUG : forgetting directory cache 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: OpenFile: flags=O_RDONLY, perm=---------- 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: Open: flags=O_RDONLY 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: newRWFileHandle: 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: >newRWFileHandle: err= 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: >Open: fd=TestRWCacheUpdate (rw), err= 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: >OpenFile: fd=TestRWCacheUpdate (rw), err= 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate(0x2ce161918180): _readAt: size=512, off=0 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate(0x2ce161918180): openPending: 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: vfs cache: checking remote fingerprint "20,2026-04-07 02:50:37.129595017 +0000 UTC,8558f20bbf1a5777c862752b37ad49be" against cached fingerprint "" 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: vfs cache: truncate to size=20 2026/04/07 03:49:39 DEBUG : Added virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate(0x2ce161918180): >openPending: err= 2026/04/07 03:49:39 DEBUG : vfs cache: looking for range={Pos:0 Size:20} in [] - present false 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:39 DEBUG : forgetting directory cache 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate(0x2ce161918180): >_readAt: n=20, err=EOF 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate(0x2ce161918180): close: 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate(0x2ce161918180): >close: err= 2026/04/07 03:49:39 DEBUG : Re-reading directory (272.246981ms old) 2026/04/07 03:49:39 DEBUG : Removed virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/07 03:49:39 DEBUG : TestRWCacheUpdate: Reset virtual modtime 2026/04/07 03:49:40 DEBUG : forgetting directory cache 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: OpenFile: flags=O_RDONLY, perm=---------- 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: Open: flags=O_RDONLY 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: newRWFileHandle: 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: >newRWFileHandle: err= 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: >Open: fd=TestRWCacheUpdate (rw), err= 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: >OpenFile: fd=TestRWCacheUpdate (rw), err= 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate(0x2ce161918940): _readAt: size=512, off=0 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate(0x2ce161918940): openPending: 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: vfs cache: checking remote fingerprint "20,2026-04-07 02:51:37.129595017 +0000 UTC,944a242d910e2bbacae0d0db8c64490a" against cached fingerprint "20,2026-04-07 02:50:37.129595017 +0000 UTC,8558f20bbf1a5777c862752b37ad49be" 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: vfs cache: removing cached entry as stale (remote fingerprint "20,2026-04-07 02:51:37.129595017 +0000 UTC,944a242d910e2bbacae0d0db8c64490a" != cached fingerprint "20,2026-04-07 02:50:37.129595017 +0000 UTC,8558f20bbf1a5777c862752b37ad49be") 2026/04/07 03:49:40 INFO : TestRWCacheUpdate: vfs cache: removed cache file as stale (remote is different) 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: vfs cache: removed metadata from cache as stale (remote is different) 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: vfs cache: truncate to size=20 (not needed as size correct) 2026/04/07 03:49:40 DEBUG : Added virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate(0x2ce161918940): >openPending: err= 2026/04/07 03:49:40 DEBUG : vfs cache: looking for range={Pos:0 Size:20} in [] - present false 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:40 DEBUG : forgetting directory cache 2026/04/07 03:49:40 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 1: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:40 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:40 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:41 DEBUG : forgetting directory cache 2026/04/07 03:49:41 DEBUG : forgetting directory cache 2026/04/07 03:49:41 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 2: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:41 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:41 DEBUG : forgetting directory cache 2026/04/07 03:49:41 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 3: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:41 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:41 DEBUG : forgetting directory cache 2026/04/07 03:49:41 DEBUG : forgetting directory cache 2026/04/07 03:49:41 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 4: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:41 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:41 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:42 DEBUG : forgetting directory cache 2026/04/07 03:49:42 DEBUG : forgetting directory cache 2026/04/07 03:49:42 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 5: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:42 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:42 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:42 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:42 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:42 DEBUG : forgetting directory cache 2026/04/07 03:49:42 DEBUG : forgetting directory cache 2026/04/07 03:49:42 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 6: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:42 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:42 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:42 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:42 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:42 DEBUG : forgetting directory cache 2026/04/07 03:49:43 DEBUG : forgetting directory cache 2026/04/07 03:49:43 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 7: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:43 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:43 DEBUG : forgetting directory cache 2026/04/07 03:49:43 DEBUG : forgetting directory cache 2026/04/07 03:49:43 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 8: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:43 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:43 DEBUG : forgetting directory cache 2026/04/07 03:49:43 DEBUG : forgetting directory cache 2026/04/07 03:49:43 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 9: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:43 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:43 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:44 DEBUG : forgetting directory cache 2026/04/07 03:49:44 DEBUG : forgetting directory cache 2026/04/07 03:49:44 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 10: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/07 03:49:44 DEBUG : forgetting directory cache 2026/04/07 03:49:44 DEBUG : forgetting directory cache 2026/04/07 03:49:44 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 11: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/07 03:49:44 ERROR : TestRWCacheUpdate: vfs cache: too many errors 11/10: last error: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 ERROR : TestRWCacheUpdate: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 ERROR : TestRWCacheUpdate: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate is not out of space 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate(0x2ce161918940): >_readAt: n=0, err=vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate(0x2ce161918940): close: 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate(0x2ce161918940): >close: err= 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 read_write_test.go:751: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:751 Error: Received unexpected error: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate Test: TestRWCacheUpdate 2026/04/07 03:49:44 DEBUG : WaitForWriters: timeout=30s 2026/04/07 03:49:44 DEBUG : Looking for writers 2026/04/07 03:49:44 DEBUG : TestRWCacheUpdate: reading active writers 2026/04/07 03:49:44 DEBUG : >WaitForWriters: 2026/04/07 03:49:44 DEBUG : GCS bucket rclone-test-kebujuc8bori: vfs cache: cleaner exiting 2026/04/07 03:49:44 DEBUG : forgetting directory cache 2026/04/07 03:49:44 DEBUG : Removed virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/07 03:49:45 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 12: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate 2026/04/07 03:49:45 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-kebujuc8bori/TestRWCacheUpdate --- FAIL: TestRWCacheUpdate (8.03s) FAIL 2026/04/07 03:49:45 DEBUG : GCS bucket rclone-test-kebujuc8bori: Purge dir "" "./vfs.test -test.v -test.timeout 1h0m0s -remote TestGoogleCloudStorage: -verbose -test.run '^TestRWCacheUpdate$'" - Finished ERROR in 8.866435648s (try 4/5): exit status 1: Failed [TestRWCacheUpdate]