"./vfs.test -test.v -test.timeout 1h0m0s -remote 'TestGoogleCloudStorage,directory_markers:' -verbose -test.run '^TestRWCacheUpdate$'" - Starting (try 2/5) 2026/04/05 03:39:54 DEBUG : Creating backend with remote "TestGoogleCloudStorage,directory_markers:rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2026/04/05 03:39:54 DEBUG : TestGoogleCloudStorage: detected overridden config - adding "{juk_h}" suffix to name 2026/04/05 03:39:54 DEBUG : Creating backend with remote "/tmp/rclone3607958015" === RUN TestRWCacheUpdate run.go:185: Remote "GCS bucket rclone-test-siqoyab7ximo", Local "Local file system at /tmp/rclone3607958015", Modify Window "1ns" 2026/04/05 03:39:54 INFO : GCS bucket rclone-test-siqoyab7ximo: poll-interval is not supported by this remote 2026/04/05 03:39:54 DEBUG : GCS bucket rclone-test-siqoyab7ximo: vfs cache: root is "/home/rclone/.cache/rclone" 2026/04/05 03:39:54 DEBUG : GCS bucket rclone-test-siqoyab7ximo: vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 DEBUG : GCS bucket rclone-test-siqoyab7ximo: vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 DEBUG : :local: detected overridden config - adding "{8un-i}" suffix to name 2026/04/05 03:39:54 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" to be canonical ":local{8un-i}:/home/rclone/.cache/rclone/vfs/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 DEBUG : Creating backend with remote ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 DEBUG : :local: detected overridden config - adding "{8un-i}" suffix to name 2026/04/05 03:39:54 DEBUG : fs cache: renaming cache item ":local,encoding='Slash,Dot',links=false:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" to be canonical ":local{8un-i}:/home/rclone/.cache/rclone/vfsMeta/TestGoogleCloudStorage{juk_h}/rclone-test-siqoyab7ximo" 2026/04/05 03:39:54 INFO : GCS bucket rclone-test-siqoyab7ximo: vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2026/04/05 03:39:54 DEBUG : forgetting directory cache 2026/04/05 03:39:56 DEBUG : TestRWCacheUpdate: OpenFile: flags=O_RDONLY, perm=---------- 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: Open: flags=O_RDONLY 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: newRWFileHandle: 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: >newRWFileHandle: err= 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: >Open: fd=TestRWCacheUpdate (rw), err= 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: >OpenFile: fd=TestRWCacheUpdate (rw), err= 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate(0x14ad1fb10140): _readAt: size=512, off=0 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate(0x14ad1fb10140): openPending: 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: vfs cache: checking remote fingerprint "20,2026-04-05 02:40:54.690995402 +0000 UTC,8558f20bbf1a5777c862752b37ad49be" against cached fingerprint "" 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: vfs cache: truncate to size=20 2026/04/05 03:39:57 DEBUG : Added virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate(0x14ad1fb10140): >openPending: err= 2026/04/05 03:39:57 DEBUG : vfs cache: looking for range={Pos:0 Size:20} in [] - present false 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:57 DEBUG : forgetting directory cache 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate(0x14ad1fb10140): >_readAt: n=20, err=EOF 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate(0x14ad1fb10140): close: 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate(0x14ad1fb10140): >close: err= 2026/04/05 03:39:57 DEBUG : Re-reading directory (276.533684ms old) 2026/04/05 03:39:57 DEBUG : Removed virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: Reset virtual modtime 2026/04/05 03:39:57 DEBUG : forgetting directory cache 2026/04/05 03:39:57 DEBUG : TestRWCacheUpdate: OpenFile: flags=O_RDONLY, perm=---------- 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: Open: flags=O_RDONLY 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: newRWFileHandle: 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: >newRWFileHandle: err= 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: >Open: fd=TestRWCacheUpdate (rw), err= 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: >OpenFile: fd=TestRWCacheUpdate (rw), err= 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate(0x14ad1f986800): _readAt: size=512, off=0 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate(0x14ad1f986800): openPending: 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: vfs cache: checking remote fingerprint "20,2026-04-05 02:41:54.690995402 +0000 UTC,944a242d910e2bbacae0d0db8c64490a" against cached fingerprint "20,2026-04-05 02:40:54.690995402 +0000 UTC,8558f20bbf1a5777c862752b37ad49be" 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: vfs cache: removing cached entry as stale (remote fingerprint "20,2026-04-05 02:41:54.690995402 +0000 UTC,944a242d910e2bbacae0d0db8c64490a" != cached fingerprint "20,2026-04-05 02:40:54.690995402 +0000 UTC,8558f20bbf1a5777c862752b37ad49be") 2026/04/05 03:39:58 INFO : TestRWCacheUpdate: vfs cache: removed cache file as stale (remote is different) 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: vfs cache: removed metadata from cache as stale (remote is different) 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: vfs cache: truncate to size=20 (not needed as size correct) 2026/04/05 03:39:58 DEBUG : Added virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate(0x14ad1f986800): >openPending: err= 2026/04/05 03:39:58 DEBUG : vfs cache: looking for range={Pos:0 Size:20} in [] - present false 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:58 DEBUG : forgetting directory cache 2026/04/05 03:39:58 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 1: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:58 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:58 DEBUG : forgetting directory cache 2026/04/05 03:39:58 DEBUG : forgetting directory cache 2026/04/05 03:39:58 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 2: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:58 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:58 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:58 DEBUG : forgetting directory cache 2026/04/05 03:39:59 DEBUG : forgetting directory cache 2026/04/05 03:39:59 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 3: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:59 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:59 DEBUG : forgetting directory cache 2026/04/05 03:39:59 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 4: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:59 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:59 DEBUG : forgetting directory cache 2026/04/05 03:39:59 DEBUG : forgetting directory cache 2026/04/05 03:39:59 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 5: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:59 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:39:59 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:39:59 DEBUG : forgetting directory cache 2026/04/05 03:40:00 DEBUG : forgetting directory cache 2026/04/05 03:40:00 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 6: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:00 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:00 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:40:00 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:40:00 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:40:00 DEBUG : forgetting directory cache 2026/04/05 03:40:00 DEBUG : forgetting directory cache 2026/04/05 03:40:00 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 7: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:00 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:00 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:40:00 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:40:00 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:40:00 DEBUG : forgetting directory cache 2026/04/05 03:40:00 DEBUG : forgetting directory cache 2026/04/05 03:40:01 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 8: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:01 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:40:01 DEBUG : forgetting directory cache 2026/04/05 03:40:01 DEBUG : forgetting directory cache 2026/04/05 03:40:01 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 9: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:01 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:40:01 DEBUG : forgetting directory cache 2026/04/05 03:40:01 DEBUG : forgetting directory cache 2026/04/05 03:40:01 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 10: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:01 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:40:01 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:40:01 DEBUG : forgetting directory cache 2026/04/05 03:40:02 DEBUG : forgetting directory cache 2026/04/05 03:40:02 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 11: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate: ChunkedReader.RangeSeek from -1 to 0 length -1 2026/04/05 03:40:02 ERROR : TestRWCacheUpdate: vfs cache: too many errors 11/10: last error: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 ERROR : TestRWCacheUpdate: vfs cache: failed to kick waiters: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate: ChunkedReader.openRange at 0 length 134217728 2026/04/05 03:40:02 ERROR : TestRWCacheUpdate: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate: vfs cache: failed to _ensure cache vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate is not out of space 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate(0x14ad1f986800): >_readAt: n=0, err=vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate(0x14ad1f986800): close: 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate(0x14ad1f986800): >close: err= read_write_test.go:751: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:751 Error: Received unexpected error: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate Test: TestRWCacheUpdate 2026/04/05 03:40:02 DEBUG : WaitForWriters: timeout=30s 2026/04/05 03:40:02 DEBUG : Looking for writers 2026/04/05 03:40:02 DEBUG : TestRWCacheUpdate: reading active writers 2026/04/05 03:40:02 DEBUG : >WaitForWriters: 2026/04/05 03:40:02 DEBUG : GCS bucket rclone-test-siqoyab7ximo: vfs cache: cleaner exiting 2026/04/05 03:40:02 DEBUG : forgetting directory cache 2026/04/05 03:40:02 DEBUG : Removed virtual directory entry vAddFile: "TestRWCacheUpdate" 2026/04/05 03:40:02 INFO : TestRWCacheUpdate: vfs cache: downloader: error count now 12: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate 2026/04/05 03:40:02 ERROR : TestRWCacheUpdate: vfs cache: failed to download: vfs reader: failed to write to cache file: googleapi: got HTTP response code 404 with body: No such object: rclone-test-siqoyab7ximo/TestRWCacheUpdate --- FAIL: TestRWCacheUpdate (8.06s) FAIL 2026/04/05 03:40:02 DEBUG : GCS bucket rclone-test-siqoyab7ximo: Purge dir "" "./vfs.test -test.v -test.timeout 1h0m0s -remote 'TestGoogleCloudStorage,directory_markers:' -verbose -test.run '^TestRWCacheUpdate$'" - Finished ERROR in 8.907820491s (try 2/5): exit status 1: Failed [TestRWCacheUpdate]