"./vfs.test -test.v -test.timeout 1h0m0s -remote 'TestGoogleCloudStorage,directory_markers:' -verbose -test.run '^TestRWCacheUpdate$'" - Starting (try 5/5) 2026/04/04 03:30:46 DEBUG : Creating backend with remote "TestGoogleCloudStorage,directory_markers:rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/04 03:30:46 DEBUG : TestGoogleCloudStorage: detected overridden config - adding "{juk_h}" suffix to name 2026/04/04 03:30:46 DEBUG : Creating backend with remote "/tmp/rclone3205893423" === RUN TestRWCacheUpdate run.go:185: Remote "GCS bucket rclone-test-fiqezih0fafi", Local "Local file system at /tmp/rclone3205893423", Modify Window "1ns" 2026/04/04 03:30:46 INFO : GCS bucket rclone-test-fiqezih0fafi: poll-interval is not supported by this remote 2026/04/04 03:30:46 DEBUG : GCS bucket rclone-test-fiqezih0fafi: vfs cache: root is "/home/rclone/.cache/rclone" 2026/04/04 03:30:46 DEBUG : GCS bucket rclone-test-fiqezih0fafi: vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 DEBUG : GCS bucket rclone-test-fiqezih0fafi: vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 DEBUG : :local: detected overridden config - adding "{8un-i}" suffix to name 2026/04/04 03:30:46 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" to be canonical ":local{8un-i}:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 DEBUG : :local: detected overridden config - adding "{8un-i}" suffix to name 2026/04/04 03:30:46 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" to be canonical ":local{8un-i}:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-fiqezih0fafi" 2026/04/04 03:30:46 INFO : GCS bucket rclone-test-fiqezih0fafi: vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2026/04/04 03:30:46 DEBUG : forgetting directory cache 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: OpenFile: flags=O_RDONLY, perm=---------- 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: Open: flags=O_RDONLY 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: newRWFileHandle: 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: >newRWFileHandle: err= 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: >Open: fd=TestRWCacheUpdate (rw), err= 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: >OpenFile: fd=TestRWCacheUpdate (rw), err= 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate(0x164a4b668380): _readAt: size=512, off=0 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate(0x164a4b668380): openPending: 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: vfs cache: checking remote fingerprint "20,2026-04-04 02:31:46.60668096 +0000 UTC,8558f20bbf1a5777c862752b37ad49be" against cached fingerprint "" 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: vfs cache: truncate to size=20 2026/04/04 03:30:49 DEBUG : Added virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate(0x164a4b668380): >openPending: err= 2026/04/04 03:30:49 DEBUG : vfs cache: looking for range={Pos:0 Size:20} in [] - present false 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:49 DEBUG : forgetting directory cache 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate(0x164a4b668380): >_readAt: n=20, err=EOF 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate(0x164a4b668380): close: 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate(0x164a4b668380): >close: err= 2026/04/04 03:30:49 DEBUG : Re-reading directory (286.684016ms old) 2026/04/04 03:30:49 DEBUG : Removed virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/04 03:30:49 DEBUG : TestRWCacheUpdate: Reset virtual modtime 2026/04/04 03:30:49 DEBUG : forgetting directory cache 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: OpenFile: flags=O_RDONLY, perm=---------- 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: Open: flags=O_RDONLY 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: newRWFileHandle: 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: >newRWFileHandle: err= 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: >Open: fd=TestRWCacheUpdate (rw), err= 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: >OpenFile: fd=TestRWCacheUpdate (rw), err= 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate(0x164a4b668bc0): _readAt: size=512, off=0 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate(0x164a4b668bc0): openPending: 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: vfs cache: checking remote fingerprint "20,2026-04-04 02:32:46.60668096 +0000 UTC,944a242d910e2bbacae0d0db8c64490a" against cached fingerprint "20,2026-04-04 02:31:46.60668096 +0000 UTC,8558f20bbf1a5777c862752b37ad49be" 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: vfs cache: removing cached entry as stale (remote fingerprint "20,2026-04-04 02:32:46.60668096 +0000 UTC,944a242d910e2bbacae0d0db8c64490a" != cached fingerprint "20,2026-04-04 02:31:46.60668096 +0000 UTC,8558f20bbf1a5777c862752b37ad49be") 2026/04/04 03:30:50 INFO : TestRWCacheUpdate: vfs cache: removed cache file as stale (remote is different) 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: vfs cache: removed metadata from cache as stale (remote is different) 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: vfs cache: truncate to size=20 (not needed as size correct) 2026/04/04 03:30:50 DEBUG : Added virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate(0x164a4b668bc0): >openPending: err= 2026/04/04 03:30:50 DEBUG : vfs cache: looking for range={Pos:0 Size:20} in [] - present false 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:50 DEBUG : forgetting directory cache 2026/04/04 03:30:50 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 1: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:50 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:50 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:50 DEBUG : forgetting directory cache 2026/04/04 03:30:50 DEBUG : forgetting directory cache 2026/04/04 03:30:51 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 2: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:51 DEBUG : forgetting directory cache 2026/04/04 03:30:51 DEBUG : forgetting directory cache 2026/04/04 03:30:51 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 3: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:51 DEBUG : forgetting directory cache 2026/04/04 03:30:51 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 4: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:51 DEBUG : forgetting directory cache 2026/04/04 03:30:51 DEBUG : forgetting directory cache 2026/04/04 03:30:51 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 5: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:51 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:52 DEBUG : forgetting directory cache 2026/04/04 03:30:52 DEBUG : forgetting directory cache 2026/04/04 03:30:52 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 6: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:52 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:52 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:52 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:52 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:52 DEBUG : forgetting directory cache 2026/04/04 03:30:52 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 7: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:52 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:52 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:52 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:52 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:52 DEBUG : forgetting directory cache 2026/04/04 03:30:52 DEBUG : forgetting directory cache 2026/04/04 03:30:53 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 8: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:53 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:53 DEBUG : forgetting directory cache 2026/04/04 03:30:53 DEBUG : forgetting directory cache 2026/04/04 03:30:53 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 9: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:53 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:53 DEBUG : forgetting directory cache 2026/04/04 03:30:53 DEBUG : forgetting directory cache 2026/04/04 03:30:53 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 10: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:53 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:53 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:53 DEBUG : forgetting directory cache 2026/04/04 03:30:54 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 11: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/04 03:30:54 ERROR : TestRWCacheUpdate: vfs cache: too many errors 11/10: last error: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 ERROR : TestRWCacheUpdate: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 ERROR : TestRWCacheUpdate: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate is not out of space 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate(0x164a4b668bc0): >_readAt: n=0, err=vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate(0x164a4b668bc0): close: 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate(0x164a4b668bc0): >close: err= read_write_test.go:751: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:751 Error: Received unexpected error: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate Test: TestRWCacheUpdate 2026/04/04 03:30:54 DEBUG : WaitForWriters: timeout=30s 2026/04/04 03:30:54 DEBUG : Looking for writers 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate: reading active writers 2026/04/04 03:30:54 DEBUG : >WaitForWriters: 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/04 03:30:54 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/04 03:30:54 DEBUG : GCS bucket rclone-test-fiqezih0fafi: vfs cache: cleaner exiting 2026/04/04 03:30:54 DEBUG : forgetting directory cache 2026/04/04 03:30:54 DEBUG : Removed virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/04 03:30:54 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 12: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate 2026/04/04 03:30:54 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-fiqezih0fafi/TestRWCacheUpdate --- FAIL: TestRWCacheUpdate (7.94s) FAIL 2026/04/04 03:30:54 DEBUG : GCS bucket rclone-test-fiqezih0fafi: Purge dir "" "./vfs.test -test.v -test.timeout 1h0m0s -remote 'TestGoogleCloudStorage,directory_markers:' -verbose -test.run '^TestRWCacheUpdate$'" - Finished ERROR in 8.635995647s (try 5/5): exit status 1: Failed [TestRWCacheUpdate]