"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 2/5) 2024/04/26 06:03:31 DEBUG : Creating backend with remote "TestQingStor:rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:03:31 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 06:03:31 DEBUG : Creating backend with remote "/tmp/rclone213528184" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:31 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:31 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "812261848c559b8a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:34 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:34 DEBUG : : Looking for writers 2024/04/26 06:03:34 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (3.53s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:34 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:34 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72b110adbd4e7105", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:35 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:35 DEBUG : : Looking for writers 2024/04/26 06:03:35 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (1.02s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:35 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:35 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cdd8dedb5f5b47ca", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:36 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:36 DEBUG : : Looking for writers 2024/04/26 06:03:36 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (1.58s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:37 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:37 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "44c5b440c55b35b5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:38 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:38 DEBUG : : Looking for writers 2024/04/26 06:03:38 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (1.02s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:38 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:38 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "979a83fc64339042", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:39 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:39 DEBUG : : Looking for writers 2024/04/26 06:03:39 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (2.11s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:40 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:40 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a2c91b1326b74c83", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:41 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:41 DEBUG : : Looking for writers 2024/04/26 06:03:41 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (1.12s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:41 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:41 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4ea833c2cae2264e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:43 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:43 DEBUG : : Looking for writers 2024/04/26 06:03:43 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (2.03s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:43 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:43 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3a8f6f77ea916d0f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:44 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:44 DEBUG : : Looking for writers 2024/04/26 06:03:44 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (1.01s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:44 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:44 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f8e6fa730832652", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:48 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:48 DEBUG : : Looking for writers 2024/04/26 06:03:48 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (3.71s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:48 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:48 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1bb22528a4d48002", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:53 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:53 DEBUG : : Looking for writers 2024/04/26 06:03:53 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (5.23s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:53 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:53 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "48b6585462a589b2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:54 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:54 DEBUG : : Looking for writers 2024/04/26 06:03:54 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (1.01s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:54 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:54 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3afda91cdd7539b3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:55 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:55 DEBUG : : Looking for writers 2024/04/26 06:03:55 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (1.01s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:55 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:55 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "677b816578a0ef3d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:56 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:56 DEBUG : : Looking for writers 2024/04/26 06:03:56 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (1.61s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:57 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:57 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "da2c367bc7b0b9be", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:03:58 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:03:58 DEBUG : : Looking for writers 2024/04/26 06:03:58 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (1.02s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:03:58 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:03:58 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "48ba79bdf376ff1d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:01 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:01 DEBUG : : Looking for writers 2024/04/26 06:04:01 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (3.21s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:01 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:01 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "08f5610a99a11b43", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:02 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:02 DEBUG : : Looking for writers 2024/04/26 06:04:02 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (2.11s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:03 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:03 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "68d5407e1aab5cca", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:05 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:05 DEBUG : : Looking for writers 2024/04/26 06:04:05 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (2.08s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:05 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:05 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6da77f059c770476", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:06 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:06 DEBUG : : Looking for writers 2024/04/26 06:04:06 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (1.02s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:06 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:06 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dae45f6628e4a28a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:07 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:07 DEBUG : : Looking for writers 2024/04/26 06:04:07 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (1.01s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:07 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:07 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "08aa229346e6ad77", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:09 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:09 DEBUG : : Looking for writers 2024/04/26 06:04:09 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:09 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:09 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "677314bce8332c63", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:11 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:11 DEBUG : : Looking for writers 2024/04/26 06:04:11 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:11 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:11 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d392f27b729242a8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:12 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:12 DEBUG : : Looking for writers 2024/04/26 06:04:12 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:12 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:12 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:12 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:12 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:12 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c4aa3373ef5e77cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:13 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:13 DEBUG : : Looking for writers 2024/04/26 06:04:13 DEBUG : >WaitForWriters: 2024/04/26 06:04:13 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:13 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:13 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:13 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:13 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:13 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:13 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:13 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8341bda2bf95e581", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:14 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:14 DEBUG : : Looking for writers 2024/04/26 06:04:14 DEBUG : >WaitForWriters: 2024/04/26 06:04:14 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:14 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:14 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:14 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:14 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:14 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:14 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:14 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "207167062b0c293e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:16 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:16 DEBUG : : Looking for writers 2024/04/26 06:04:16 DEBUG : >WaitForWriters: 2024/04/26 06:04:16 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (8.98s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (2.10s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (1.54s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (1.01s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (1.20s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (1.02s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (2.10s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:16 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:16 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ea82cc929180f0b0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:18 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:18 DEBUG : : Looking for writers 2024/04/26 06:04:18 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (1.55s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:18 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:18 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "af8d66e2ab991319", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:19 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:19 DEBUG : : Looking for writers 2024/04/26 06:04:19 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (1.02s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:19 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:19 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "52abf6d49a04d238", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:20 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:20 DEBUG : : Looking for writers 2024/04/26 06:04:20 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (1.03s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:20 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:20 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8fbba759975f4b63", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:21 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:21 DEBUG : : Looking for writers 2024/04/26 06:04:21 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (1.02s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:21 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:21 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ce839144843ef13a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:22 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:22 DEBUG : : Looking for writers 2024/04/26 06:04:22 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (1.02s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:22 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:22 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1a0f6b0c06bfb2aa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:23 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:23 DEBUG : : Looking for writers 2024/04/26 06:04:23 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:23 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:23 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:04:23 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:23 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:23 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:23 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:23 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:23 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2cb84e8f81c5f8e4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:24 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:24 DEBUG : : Looking for writers 2024/04/26 06:04:24 DEBUG : >WaitForWriters: 2024/04/26 06:04:24 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:25 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:25 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:04:25 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:25 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:25 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:25 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:25 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:25 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5283018de970144f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:25 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:25 DEBUG : : Looking for writers 2024/04/26 06:04:25 DEBUG : >WaitForWriters: 2024/04/26 06:04:25 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:26 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:26 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:26 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:26 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:26 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:26 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:26 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "20ec2402b8092860", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:27 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:27 DEBUG : : Looking for writers 2024/04/26 06:04:27 DEBUG : >WaitForWriters: 2024/04/26 06:04:27 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:29 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:29 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:29 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:29 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:29 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:29 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:29 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6c75d0e0ca151a79", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:29 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:29 DEBUG : : Looking for writers 2024/04/26 06:04:29 DEBUG : >WaitForWriters: 2024/04/26 06:04:29 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:30 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:30 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:30 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:30 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:30 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d6eacc445e017935", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:31 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:31 DEBUG : : Looking for writers 2024/04/26 06:04:31 DEBUG : >WaitForWriters: 2024/04/26 06:04:31 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (9.66s) --- FAIL: TestFileRename/off,forceCache=false (1.01s) --- FAIL: TestFileRename/minimal,forceCache=false (1.53s) --- FAIL: TestFileRename/minimal,forceCache=true (1.02s) --- FAIL: TestFileRename/writes,forceCache=false (3.06s) --- FAIL: TestFileRename/writes,forceCache=true (1.01s) --- FAIL: TestFileRename/full,forceCache=false (2.02s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:32 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:32 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f1e78bcccf1344f5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:32 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:32 DEBUG : : Looking for writers 2024/04/26 06:04:32 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (1.57s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:33 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:33 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f01d3101a9daa5b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:34 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:34 DEBUG : : Looking for writers 2024/04/26 06:04:34 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (1.55s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:35 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:35 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "84823119e82281bf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:37 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:37 DEBUG : : Looking for writers 2024/04/26 06:04:37 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (2.09s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:37 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:37 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0d1d7942298dd555", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:38 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:38 DEBUG : : Looking for writers 2024/04/26 06:04:38 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (1.55s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:38 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:38 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "43f81b4bd5f92be7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:39 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:39 DEBUG : : Looking for writers 2024/04/26 06:04:39 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (1.53s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:40 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:40 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:40 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:40 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:40 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "619958a10dd7cc62", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:41 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:41 DEBUG : : Looking for writers 2024/04/26 06:04:41 DEBUG : >WaitForWriters: 2024/04/26 06:04:41 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (1.54s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:41 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:41 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:41 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:41 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:41 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "16b2d52d73d75483", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:42 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:42 DEBUG : : Looking for writers 2024/04/26 06:04:42 DEBUG : >WaitForWriters: 2024/04/26 06:04:42 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (1.26s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:43 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:43 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:43 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:43 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:43 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8d7b6c37230385e8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:43 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:43 DEBUG : : Looking for writers 2024/04/26 06:04:43 DEBUG : >WaitForWriters: 2024/04/26 06:04:43 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (1.01s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:44 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:44 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:44 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:44 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:44 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:44 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:44 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b17be54d592f64c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:45 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:45 DEBUG : : Looking for writers 2024/04/26 06:04:45 DEBUG : >WaitForWriters: 2024/04/26 06:04:45 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (1.53s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:45 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:45 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:45 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:45 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:45 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:45 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:45 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e0c1d45fd234697b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:46 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:46 DEBUG : : Looking for writers 2024/04/26 06:04:46 DEBUG : >WaitForWriters: 2024/04/26 06:04:46 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (1.01s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:04:46 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:04:46 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:04:46 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:46 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:46 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:46 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:04:46 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:04:46 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:04:47 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:04:47 DEBUG : file1: newRWFileHandle: 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): openPending: 2024/04/26 06:04:47 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:04:47 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): >openPending: err= 2024/04/26 06:04:47 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:04:47 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:04:47 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:04:47 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): _writeAt: size=5, off=0 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): >_writeAt: n=5, err= 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): _writeAt: size=7, off=5 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): >_writeAt: n=7, err= 2024/04/26 06:04:47 DEBUG : file1: vfs cache: truncate to size=11 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): close: 2024/04/26 06:04:47 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:04:47.095405702 +0000 UTC m=+75.689471974 2024/04/26 06:04:47 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): >close: err= 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): close: 2024/04/26 06:04:47 DEBUG : file1(0xc00064cbc0): >close: err=file already closed 2024/04/26 06:04:47 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:04:47 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:04:47 DEBUG : : Looking for writers 2024/04/26 06:04:47 DEBUG : file1: reading active writers 2024/04/26 06:04:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:04:47 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "168799a26a5f27e5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:47 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "168799a26a5f27e5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:48 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:04:48 DEBUG : : Looking for writers 2024/04/26 06:04:48 DEBUG : file1: reading active writers 2024/04/26 06:04:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:48 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f1cab336ab70c563", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:48 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f1cab336ab70c563", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:49 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:04:49 DEBUG : : Looking for writers 2024/04/26 06:04:49 DEBUG : file1: reading active writers 2024/04/26 06:04:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:50 DEBUG : : Looking for writers 2024/04/26 06:04:50 DEBUG : file1: reading active writers 2024/04/26 06:04:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:50 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d24c8e603f6cb347", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:50 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d24c8e603f6cb347", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:51 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:04:51 DEBUG : : Looking for writers 2024/04/26 06:04:51 DEBUG : file1: reading active writers 2024/04/26 06:04:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:51 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7d36fc93de57b635", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:51 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7d36fc93de57b635", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:52 DEBUG : : Looking for writers 2024/04/26 06:04:52 DEBUG : file1: reading active writers 2024/04/26 06:04:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:53 DEBUG : : Looking for writers 2024/04/26 06:04:53 DEBUG : file1: reading active writers 2024/04/26 06:04:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:53 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:04:54 DEBUG : : Looking for writers 2024/04/26 06:04:54 DEBUG : file1: reading active writers 2024/04/26 06:04:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:54 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a6212eb193381737", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:54 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a6212eb193381737", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:04:55 DEBUG : : Looking for writers 2024/04/26 06:04:55 DEBUG : file1: reading active writers 2024/04/26 06:04:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:56 DEBUG : : Looking for writers 2024/04/26 06:04:56 DEBUG : file1: reading active writers 2024/04/26 06:04:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:57 DEBUG : : Looking for writers 2024/04/26 06:04:57 DEBUG : file1: reading active writers 2024/04/26 06:04:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:58 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:04:58 DEBUG : : Looking for writers 2024/04/26 06:04:58 DEBUG : file1: reading active writers 2024/04/26 06:04:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:04:59 DEBUG : : Looking for writers 2024/04/26 06:04:59 DEBUG : file1: reading active writers 2024/04/26 06:04:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:00 DEBUG : : Looking for writers 2024/04/26 06:05:00 DEBUG : file1: reading active writers 2024/04/26 06:05:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:00 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8f99962d5be19a9e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:00 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8f99962d5be19a9e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:01 DEBUG : : Looking for writers 2024/04/26 06:05:01 DEBUG : file1: reading active writers 2024/04/26 06:05:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:02 DEBUG : : Looking for writers 2024/04/26 06:05:02 DEBUG : file1: reading active writers 2024/04/26 06:05:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:03 DEBUG : : Looking for writers 2024/04/26 06:05:03 DEBUG : file1: reading active writers 2024/04/26 06:05:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:04 DEBUG : : Looking for writers 2024/04/26 06:05:04 DEBUG : file1: reading active writers 2024/04/26 06:05:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:05 DEBUG : : Looking for writers 2024/04/26 06:05:05 DEBUG : file1: reading active writers 2024/04/26 06:05:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:06 DEBUG : : Looking for writers 2024/04/26 06:05:06 DEBUG : file1: reading active writers 2024/04/26 06:05:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:07 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:05:07 DEBUG : : Looking for writers 2024/04/26 06:05:07 DEBUG : file1: reading active writers 2024/04/26 06:05:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:07 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4a18c17e34fe36ac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:07 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4a18c17e34fe36ac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:08 DEBUG : : Looking for writers 2024/04/26 06:05:08 DEBUG : file1: reading active writers 2024/04/26 06:05:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:09 DEBUG : : Looking for writers 2024/04/26 06:05:09 DEBUG : file1: reading active writers 2024/04/26 06:05:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:10 DEBUG : : Looking for writers 2024/04/26 06:05:10 DEBUG : file1: reading active writers 2024/04/26 06:05:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:11 DEBUG : : Looking for writers 2024/04/26 06:05:11 DEBUG : file1: reading active writers 2024/04/26 06:05:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:12 DEBUG : : Looking for writers 2024/04/26 06:05:12 DEBUG : file1: reading active writers 2024/04/26 06:05:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:13 DEBUG : : Looking for writers 2024/04/26 06:05:13 DEBUG : file1: reading active writers 2024/04/26 06:05:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:14 DEBUG : : Looking for writers 2024/04/26 06:05:14 DEBUG : file1: reading active writers 2024/04/26 06:05:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:15 DEBUG : : Looking for writers 2024/04/26 06:05:15 DEBUG : file1: reading active writers 2024/04/26 06:05:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:16 DEBUG : : Looking for writers 2024/04/26 06:05:16 DEBUG : file1: reading active writers 2024/04/26 06:05:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:17 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0008b83c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00085b108 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642482496} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970041154225798 ext:75689471974 loc:0x3a12660} ATime:{wall:13943970041154245906 ext:75689492082 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:05:17 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/26 06:05:20 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:05:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "910fc49c0175f46d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:22 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "910fc49c0175f46d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/04/26 06:05:27 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:05:27 DEBUG : : Looking for writers 2024/04/26 06:05:27 DEBUG : file1: reading active writers 2024/04/26 06:05:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:05:28 DEBUG : : Looking for writers 2024/04/26 06:05:28 DEBUG : file1: reading active writers 2024/04/26 06:05:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:29 DEBUG : : Looking for writers 2024/04/26 06:05:29 DEBUG : file1: reading active writers 2024/04/26 06:05:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:30 DEBUG : : Looking for writers 2024/04/26 06:05:30 DEBUG : file1: reading active writers 2024/04/26 06:05:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:31 DEBUG : : Looking for writers 2024/04/26 06:05:31 DEBUG : file1: reading active writers 2024/04/26 06:05:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:32 DEBUG : : Looking for writers 2024/04/26 06:05:32 DEBUG : file1: reading active writers 2024/04/26 06:05:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:33 DEBUG : : Looking for writers 2024/04/26 06:05:33 DEBUG : file1: reading active writers 2024/04/26 06:05:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:34 DEBUG : : Looking for writers 2024/04/26 06:05:34 DEBUG : file1: reading active writers 2024/04/26 06:05:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:35 DEBUG : : Looking for writers 2024/04/26 06:05:35 DEBUG : file1: reading active writers 2024/04/26 06:05:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:36 DEBUG : : Looking for writers 2024/04/26 06:05:36 DEBUG : file1: reading active writers 2024/04/26 06:05:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:37 DEBUG : : Looking for writers 2024/04/26 06:05:37 DEBUG : file1: reading active writers 2024/04/26 06:05:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:38 DEBUG : : Looking for writers 2024/04/26 06:05:38 DEBUG : file1: reading active writers 2024/04/26 06:05:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:39 DEBUG : : Looking for writers 2024/04/26 06:05:39 DEBUG : file1: reading active writers 2024/04/26 06:05:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:40 DEBUG : : Looking for writers 2024/04/26 06:05:40 DEBUG : file1: reading active writers 2024/04/26 06:05:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:41 DEBUG : : Looking for writers 2024/04/26 06:05:41 DEBUG : file1: reading active writers 2024/04/26 06:05:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:42 DEBUG : : Looking for writers 2024/04/26 06:05:42 DEBUG : file1: reading active writers 2024/04/26 06:05:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:43 DEBUG : : Looking for writers 2024/04/26 06:05:43 DEBUG : file1: reading active writers 2024/04/26 06:05:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:44 DEBUG : : Looking for writers 2024/04/26 06:05:44 DEBUG : file1: reading active writers 2024/04/26 06:05:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:45 DEBUG : : Looking for writers 2024/04/26 06:05:45 DEBUG : file1: reading active writers 2024/04/26 06:05:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:46 DEBUG : : Looking for writers 2024/04/26 06:05:46 DEBUG : file1: reading active writers 2024/04/26 06:05:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:46 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:05:46 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/26 06:05:47 DEBUG : : Looking for writers 2024/04/26 06:05:47 DEBUG : file1: reading active writers 2024/04/26 06:05:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:48 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:05:48 DEBUG : : Looking for writers 2024/04/26 06:05:48 DEBUG : file1: reading active writers 2024/04/26 06:05:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:49 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3404ffd80e396935", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:49 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3404ffd80e396935", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:05:49 DEBUG : : Looking for writers 2024/04/26 06:05:49 DEBUG : file1: reading active writers 2024/04/26 06:05:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:50 DEBUG : : Looking for writers 2024/04/26 06:05:50 DEBUG : file1: reading active writers 2024/04/26 06:05:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:51 DEBUG : : Looking for writers 2024/04/26 06:05:51 DEBUG : file1: reading active writers 2024/04/26 06:05:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:52 DEBUG : : Looking for writers 2024/04/26 06:05:52 DEBUG : file1: reading active writers 2024/04/26 06:05:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:53 DEBUG : : Looking for writers 2024/04/26 06:05:53 DEBUG : file1: reading active writers 2024/04/26 06:05:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:54 DEBUG : : Looking for writers 2024/04/26 06:05:54 DEBUG : file1: reading active writers 2024/04/26 06:05:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:55 DEBUG : : Looking for writers 2024/04/26 06:05:55 DEBUG : file1: reading active writers 2024/04/26 06:05:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:56 DEBUG : : Looking for writers 2024/04/26 06:05:56 DEBUG : file1: reading active writers 2024/04/26 06:05:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:05:57 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0008b83c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00085b108 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642482496} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970041154225798 ext:75689471974 loc:0x3a12660} ATime:{wall:13943970041154245906 ext:75689492082 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:05:57 DEBUG : >WaitForWriters: 2024/04/26 06:05:57 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (71.46s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:05:58 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:05:58 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:05:58 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:05:58 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:05:58 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:05:58 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:05:58 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:05:58 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:05:59 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:05:59 DEBUG : file1: newRWFileHandle: 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): openPending: 2024/04/26 06:05:59 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:05:59 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): >openPending: err= 2024/04/26 06:05:59 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:05:59 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:05:59 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:05:59 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): _writeAt: size=7, off=0 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): >_writeAt: n=7, err= 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): _writeAt: size=6, off=5 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): >_writeAt: n=6, err= 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): close: 2024/04/26 06:05:59 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:05:59.269617122 +0000 UTC m=+147.863683394 2024/04/26 06:05:59 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): >close: err= 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): _writeAt: size=5, off=0 2024/04/26 06:05:59 DEBUG : file1(0xc0005ba080): >_writeAt: n=0, err=file already closed 2024/04/26 06:05:59 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:05:59 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:05:59 DEBUG : : Looking for writers 2024/04/26 06:05:59 DEBUG : file1: reading active writers 2024/04/26 06:05:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:06:00 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ea67570662238422", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:00 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ea67570662238422", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:00 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:06:00 DEBUG : : Looking for writers 2024/04/26 06:06:00 DEBUG : file1: reading active writers 2024/04/26 06:06:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:01 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "eeaa71baa9a46f65", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:01 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "eeaa71baa9a46f65", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:01 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:06:01 DEBUG : : Looking for writers 2024/04/26 06:06:01 DEBUG : file1: reading active writers 2024/04/26 06:06:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:02 DEBUG : : Looking for writers 2024/04/26 06:06:02 DEBUG : file1: reading active writers 2024/04/26 06:06:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:03 DEBUG : : Looking for writers 2024/04/26 06:06:03 DEBUG : file1: reading active writers 2024/04/26 06:06:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:04 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "674f45fb94be184a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:04 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "674f45fb94be184a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:04 DEBUG : : Looking for writers 2024/04/26 06:06:04 DEBUG : file1: reading active writers 2024/04/26 06:06:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:05 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:06:05 DEBUG : : Looking for writers 2024/04/26 06:06:05 DEBUG : file1: reading active writers 2024/04/26 06:06:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "407bd9d41557a006", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:06 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "407bd9d41557a006", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:06 DEBUG : : Looking for writers 2024/04/26 06:06:06 DEBUG : file1: reading active writers 2024/04/26 06:06:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:07 DEBUG : : Looking for writers 2024/04/26 06:06:07 DEBUG : file1: reading active writers 2024/04/26 06:06:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:07 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:06:08 DEBUG : : Looking for writers 2024/04/26 06:06:08 DEBUG : file1: reading active writers 2024/04/26 06:06:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:08 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "150fa9ad69527164", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:08 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "150fa9ad69527164", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:09 DEBUG : : Looking for writers 2024/04/26 06:06:09 DEBUG : file1: reading active writers 2024/04/26 06:06:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:10 DEBUG : : Looking for writers 2024/04/26 06:06:10 DEBUG : file1: reading active writers 2024/04/26 06:06:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:11 DEBUG : : Looking for writers 2024/04/26 06:06:11 DEBUG : file1: reading active writers 2024/04/26 06:06:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:12 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:06:12 DEBUG : : Looking for writers 2024/04/26 06:06:12 DEBUG : file1: reading active writers 2024/04/26 06:06:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:13 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7b44e5b7fa86c034", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:13 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7b44e5b7fa86c034", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:13 DEBUG : : Looking for writers 2024/04/26 06:06:13 DEBUG : file1: reading active writers 2024/04/26 06:06:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:14 DEBUG : : Looking for writers 2024/04/26 06:06:14 DEBUG : file1: reading active writers 2024/04/26 06:06:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:15 DEBUG : : Looking for writers 2024/04/26 06:06:15 DEBUG : file1: reading active writers 2024/04/26 06:06:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:16 DEBUG : : Looking for writers 2024/04/26 06:06:16 DEBUG : file1: reading active writers 2024/04/26 06:06:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:17 DEBUG : : Looking for writers 2024/04/26 06:06:17 DEBUG : file1: reading active writers 2024/04/26 06:06:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:18 DEBUG : : Looking for writers 2024/04/26 06:06:18 DEBUG : file1: reading active writers 2024/04/26 06:06:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:19 DEBUG : : Looking for writers 2024/04/26 06:06:19 DEBUG : file1: reading active writers 2024/04/26 06:06:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:19 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:06:20 DEBUG : : Looking for writers 2024/04/26 06:06:20 DEBUG : file1: reading active writers 2024/04/26 06:06:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:20 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4965ab9fcae69758", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:20 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4965ab9fcae69758", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:21 DEBUG : : Looking for writers 2024/04/26 06:06:21 DEBUG : file1: reading active writers 2024/04/26 06:06:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:22 DEBUG : : Looking for writers 2024/04/26 06:06:22 DEBUG : file1: reading active writers 2024/04/26 06:06:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:23 DEBUG : : Looking for writers 2024/04/26 06:06:23 DEBUG : file1: reading active writers 2024/04/26 06:06:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:24 DEBUG : : Looking for writers 2024/04/26 06:06:24 DEBUG : file1: reading active writers 2024/04/26 06:06:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:25 DEBUG : : Looking for writers 2024/04/26 06:06:25 DEBUG : file1: reading active writers 2024/04/26 06:06:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:26 DEBUG : : Looking for writers 2024/04/26 06:06:26 DEBUG : file1: reading active writers 2024/04/26 06:06:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:27 DEBUG : : Looking for writers 2024/04/26 06:06:27 DEBUG : file1: reading active writers 2024/04/26 06:06:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:28 DEBUG : : Looking for writers 2024/04/26 06:06:28 DEBUG : file1: reading active writers 2024/04/26 06:06:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:29 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b4a2d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00085b908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642484544} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970118637848546 ext:147863683394 loc:0x3a12660} ATime:{wall:13943970118637876188 ext:147863711026 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:06:29 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:06:33 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 2024/04/26 06:06:35 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "98e8784a777fd056", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:06:35 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "98e8784a777fd056", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/04/26 06:06:38 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:06:38 DEBUG : : Looking for writers 2024/04/26 06:06:38 DEBUG : file1: reading active writers 2024/04/26 06:06:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:06:38 DEBUG : : Looking for writers 2024/04/26 06:06:38 DEBUG : file1: reading active writers 2024/04/26 06:06:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:06:38 DEBUG : : Looking for writers 2024/04/26 06:06:38 DEBUG : file1: reading active writers 2024/04/26 06:06:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:06:38 DEBUG : : Looking for writers 2024/04/26 06:06:38 DEBUG : file1: reading active writers 2024/04/26 06:06:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:06:38 DEBUG : : Looking for writers 2024/04/26 06:06:38 DEBUG : file1: reading active writers 2024/04/26 06:06:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:06:38 DEBUG : : Looking for writers 2024/04/26 06:06:38 DEBUG : file1: reading active writers 2024/04/26 06:06:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:06:39 DEBUG : : Looking for writers 2024/04/26 06:06:39 DEBUG : file1: reading active writers 2024/04/26 06:06:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:06:39 DEBUG : : Looking for writers 2024/04/26 06:06:39 DEBUG : file1: reading active writers 2024/04/26 06:06:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:40 DEBUG : : Looking for writers 2024/04/26 06:06:40 DEBUG : file1: reading active writers 2024/04/26 06:06:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:41 DEBUG : : Looking for writers 2024/04/26 06:06:41 DEBUG : file1: reading active writers 2024/04/26 06:06:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:42 DEBUG : : Looking for writers 2024/04/26 06:06:42 DEBUG : file1: reading active writers 2024/04/26 06:06:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:43 DEBUG : : Looking for writers 2024/04/26 06:06:43 DEBUG : file1: reading active writers 2024/04/26 06:06:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:44 DEBUG : : Looking for writers 2024/04/26 06:06:44 DEBUG : file1: reading active writers 2024/04/26 06:06:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:45 DEBUG : : Looking for writers 2024/04/26 06:06:45 DEBUG : file1: reading active writers 2024/04/26 06:06:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:46 DEBUG : : Looking for writers 2024/04/26 06:06:46 DEBUG : file1: reading active writers 2024/04/26 06:06:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:47 DEBUG : : Looking for writers 2024/04/26 06:06:47 DEBUG : file1: reading active writers 2024/04/26 06:06:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:48 DEBUG : : Looking for writers 2024/04/26 06:06:48 DEBUG : file1: reading active writers 2024/04/26 06:06:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:49 DEBUG : : Looking for writers 2024/04/26 06:06:49 DEBUG : file1: reading active writers 2024/04/26 06:06:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:50 DEBUG : : Looking for writers 2024/04/26 06:06:50 DEBUG : file1: reading active writers 2024/04/26 06:06:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:51 DEBUG : : Looking for writers 2024/04/26 06:06:51 DEBUG : file1: reading active writers 2024/04/26 06:06:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:52 DEBUG : : Looking for writers 2024/04/26 06:06:52 DEBUG : file1: reading active writers 2024/04/26 06:06:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:53 DEBUG : : Looking for writers 2024/04/26 06:06:53 DEBUG : file1: reading active writers 2024/04/26 06:06:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:54 DEBUG : : Looking for writers 2024/04/26 06:06:54 DEBUG : file1: reading active writers 2024/04/26 06:06:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:55 DEBUG : : Looking for writers 2024/04/26 06:06:55 DEBUG : file1: reading active writers 2024/04/26 06:06:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:56 DEBUG : : Looking for writers 2024/04/26 06:06:56 DEBUG : file1: reading active writers 2024/04/26 06:06:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:57 DEBUG : : Looking for writers 2024/04/26 06:06:57 DEBUG : file1: reading active writers 2024/04/26 06:06:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:06:58 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/26 06:06:58 DEBUG : : Looking for writers 2024/04/26 06:06:58 DEBUG : file1: reading active writers 2024/04/26 06:06:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:06:59 DEBUG : : Looking for writers 2024/04/26 06:06:59 DEBUG : file1: reading active writers 2024/04/26 06:06:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:00 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:00 DEBUG : : Looking for writers 2024/04/26 06:07:00 DEBUG : file1: reading active writers 2024/04/26 06:07:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:01 DEBUG : : Looking for writers 2024/04/26 06:07:01 DEBUG : file1: reading active writers 2024/04/26 06:07:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:02 DEBUG : : Looking for writers 2024/04/26 06:07:02 DEBUG : file1: reading active writers 2024/04/26 06:07:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:03 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3f96bc96d0bb8c8d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:03 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3f96bc96d0bb8c8d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:03 DEBUG : : Looking for writers 2024/04/26 06:07:03 DEBUG : file1: reading active writers 2024/04/26 06:07:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:04 DEBUG : : Looking for writers 2024/04/26 06:07:04 DEBUG : file1: reading active writers 2024/04/26 06:07:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:05 DEBUG : : Looking for writers 2024/04/26 06:07:05 DEBUG : file1: reading active writers 2024/04/26 06:07:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:06 DEBUG : : Looking for writers 2024/04/26 06:07:06 DEBUG : file1: reading active writers 2024/04/26 06:07:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:07 DEBUG : : Looking for writers 2024/04/26 06:07:07 DEBUG : file1: reading active writers 2024/04/26 06:07:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:07:08 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b4a2d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00085b908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642484544} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970118637848546 ext:147863683394 loc:0x3a12660} ATime:{wall:13943970118637876188 ext:147863711026 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:07:08 DEBUG : >WaitForWriters: 2024/04/26 06:07:08 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (70.64s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:07:08 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:07:08 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:07:08 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:07:08 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:07:08 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:07:08 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:07:08 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:07:08 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:07:09 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:07:09 DEBUG : file1: newRWFileHandle: 2024/04/26 06:07:09 DEBUG : file1(0xc0002b9a00): openPending: 2024/04/26 06:07:09 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:07:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:07:09 DEBUG : file1(0xc0002b9a00): >openPending: err= 2024/04/26 06:07:09 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:07:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:07:09 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:07:09 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:07:09 DEBUG : file1(0xc0002b9a00): close: 2024/04/26 06:07:09 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:07:09.176691128 +0000 UTC m=+217.770757390 2024/04/26 06:07:09 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:07:09 DEBUG : file1(0xc0002b9a00): >close: err= 2024/04/26 06:07:09 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/04/26 06:07:09 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/04/26 06:07:09 DEBUG : file2: newRWFileHandle: 2024/04/26 06:07:09 DEBUG : file2(0xc0002b9bc0): openPending: 2024/04/26 06:07:09 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:07:09 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/26 06:07:09 DEBUG : file2(0xc0002b9bc0): >openPending: err= 2024/04/26 06:07:09 DEBUG : file2: >newRWFileHandle: err= 2024/04/26 06:07:09 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/26 06:07:09 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/04/26 06:07:09 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/04/26 06:07:09 DEBUG : file2(0xc0002b9bc0): RWFileHandle.Flush 2024/04/26 06:07:09 DEBUG : file2(0xc0002b9bc0): RWFileHandle.Release 2024/04/26 06:07:09 DEBUG : file2(0xc0002b9bc0): close: 2024/04/26 06:07:09 DEBUG : file2: vfs cache: setting modification time to 2024-04-26 06:07:09.177611656 +0000 UTC m=+217.771677907 2024/04/26 06:07:09 INFO : file2: vfs cache: queuing for upload in 100ms 2024/04/26 06:07:09 DEBUG : file2(0xc0002b9bc0): >close: err= 2024/04/26 06:07:09 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/26 06:07:09 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:09 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/26 06:07:09 DEBUG : : Looking for writers 2024/04/26 06:07:09 DEBUG : file2: reading active writers 2024/04/26 06:07:09 DEBUG : file1: reading active writers 2024/04/26 06:07:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/26 06:07:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2ea8bc8ae4bd8edb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:09 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2ea8bc8ae4bd8edb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:10 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:10 DEBUG : : Looking for writers 2024/04/26 06:07:10 DEBUG : file1: reading active writers 2024/04/26 06:07:10 DEBUG : file2: reading active writers 2024/04/26 06:07:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:10 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "021d0f26804ebfb1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:10 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "021d0f26804ebfb1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:10 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "956194c7173bc4c4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:11 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "956194c7173bc4c4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:11 DEBUG : : Looking for writers 2024/04/26 06:07:11 DEBUG : file1: reading active writers 2024/04/26 06:07:11 DEBUG : file2: reading active writers 2024/04/26 06:07:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:11 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:12 DEBUG : : Looking for writers 2024/04/26 06:07:12 DEBUG : file2: reading active writers 2024/04/26 06:07:12 DEBUG : file1: reading active writers 2024/04/26 06:07:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:13 DEBUG : : Looking for writers 2024/04/26 06:07:13 DEBUG : file1: reading active writers 2024/04/26 06:07:13 DEBUG : file2: reading active writers 2024/04/26 06:07:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:14 DEBUG : : Looking for writers 2024/04/26 06:07:14 DEBUG : file1: reading active writers 2024/04/26 06:07:14 DEBUG : file2: reading active writers 2024/04/26 06:07:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:15 DEBUG : : Looking for writers 2024/04/26 06:07:15 DEBUG : file1: reading active writers 2024/04/26 06:07:15 DEBUG : file2: reading active writers 2024/04/26 06:07:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:16 DEBUG : : Looking for writers 2024/04/26 06:07:16 DEBUG : file1: reading active writers 2024/04/26 06:07:16 DEBUG : file2: reading active writers 2024/04/26 06:07:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:17 DEBUG : : Looking for writers 2024/04/26 06:07:17 DEBUG : file1: reading active writers 2024/04/26 06:07:17 DEBUG : file2: reading active writers 2024/04/26 06:07:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:18 DEBUG : : Looking for writers 2024/04/26 06:07:18 DEBUG : file1: reading active writers 2024/04/26 06:07:18 DEBUG : file2: reading active writers 2024/04/26 06:07:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:18 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72aadd7386c52e93", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:18 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72aadd7386c52e93", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:19 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:19 DEBUG : : Looking for writers 2024/04/26 06:07:19 DEBUG : file1: reading active writers 2024/04/26 06:07:19 DEBUG : file2: reading active writers 2024/04/26 06:07:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:19 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a92b700432296a44", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:19 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a92b700432296a44", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:20 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:20 DEBUG : : Looking for writers 2024/04/26 06:07:20 DEBUG : file1: reading active writers 2024/04/26 06:07:20 DEBUG : file2: reading active writers 2024/04/26 06:07:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:21 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3ba6202a5c266294", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:21 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3ba6202a5c266294", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:21 DEBUG : : Looking for writers 2024/04/26 06:07:21 DEBUG : file1: reading active writers 2024/04/26 06:07:21 DEBUG : file2: reading active writers 2024/04/26 06:07:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:22 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:22 DEBUG : : Looking for writers 2024/04/26 06:07:22 DEBUG : file1: reading active writers 2024/04/26 06:07:22 DEBUG : file2: reading active writers 2024/04/26 06:07:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d18a0785c5d43c90", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:22 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d18a0785c5d43c90", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:23 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8e9d6a41b29324c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:23 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8e9d6a41b29324c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:23 DEBUG : : Looking for writers 2024/04/26 06:07:23 DEBUG : file1: reading active writers 2024/04/26 06:07:23 DEBUG : file2: reading active writers 2024/04/26 06:07:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:24 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:24 DEBUG : : Looking for writers 2024/04/26 06:07:24 DEBUG : file1: reading active writers 2024/04/26 06:07:24 DEBUG : file2: reading active writers 2024/04/26 06:07:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:24 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:25 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cd52a2cfdfbd7d8e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:25 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cd52a2cfdfbd7d8e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:25 DEBUG : : Looking for writers 2024/04/26 06:07:25 DEBUG : file2: reading active writers 2024/04/26 06:07:25 DEBUG : file1: reading active writers 2024/04/26 06:07:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:26 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "88258fb555bda805", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:26 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "88258fb555bda805", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:26 DEBUG : : Looking for writers 2024/04/26 06:07:26 DEBUG : file2: reading active writers 2024/04/26 06:07:26 DEBUG : file1: reading active writers 2024/04/26 06:07:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:27 DEBUG : : Looking for writers 2024/04/26 06:07:27 DEBUG : file1: reading active writers 2024/04/26 06:07:27 DEBUG : file2: reading active writers 2024/04/26 06:07:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:28 DEBUG : : Looking for writers 2024/04/26 06:07:28 DEBUG : file1: reading active writers 2024/04/26 06:07:28 DEBUG : file2: reading active writers 2024/04/26 06:07:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:28 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:29 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1c42f6e5614b5e9c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:29 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1c42f6e5614b5e9c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:29 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:29 DEBUG : : Looking for writers 2024/04/26 06:07:29 DEBUG : file2: reading active writers 2024/04/26 06:07:29 DEBUG : file1: reading active writers 2024/04/26 06:07:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:30 DEBUG : : Looking for writers 2024/04/26 06:07:30 DEBUG : file1: reading active writers 2024/04/26 06:07:30 DEBUG : file2: reading active writers 2024/04/26 06:07:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:30 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "49171fd3e05b8a73", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:30 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "49171fd3e05b8a73", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:31 DEBUG : : Looking for writers 2024/04/26 06:07:31 DEBUG : file1: reading active writers 2024/04/26 06:07:31 DEBUG : file2: reading active writers 2024/04/26 06:07:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:32 DEBUG : : Looking for writers 2024/04/26 06:07:32 DEBUG : file1: reading active writers 2024/04/26 06:07:32 DEBUG : file2: reading active writers 2024/04/26 06:07:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:33 DEBUG : : Looking for writers 2024/04/26 06:07:33 DEBUG : file1: reading active writers 2024/04/26 06:07:33 DEBUG : file2: reading active writers 2024/04/26 06:07:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:34 DEBUG : : Looking for writers 2024/04/26 06:07:34 DEBUG : file1: reading active writers 2024/04/26 06:07:34 DEBUG : file2: reading active writers 2024/04/26 06:07:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:35 DEBUG : : Looking for writers 2024/04/26 06:07:35 DEBUG : file1: reading active writers 2024/04/26 06:07:35 DEBUG : file2: reading active writers 2024/04/26 06:07:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:35 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:36 DEBUG : : Looking for writers 2024/04/26 06:07:36 DEBUG : file2: reading active writers 2024/04/26 06:07:36 DEBUG : file1: reading active writers 2024/04/26 06:07:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:36 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f547c1e548821975", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:36 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f547c1e548821975", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:36 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:37 DEBUG : : Looking for writers 2024/04/26 06:07:37 DEBUG : file1: reading active writers 2024/04/26 06:07:37 DEBUG : file2: reading active writers 2024/04/26 06:07:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:37 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f6ae2f75953167f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:37 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f6ae2f75953167f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:38 DEBUG : : Looking for writers 2024/04/26 06:07:38 DEBUG : file1: reading active writers 2024/04/26 06:07:38 DEBUG : file2: reading active writers 2024/04/26 06:07:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:39 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc000b4a3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0005ec108 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639930688} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970193706850232 ext:217770757390 loc:0x3a12660} ATime:{wall:13943970193707045699 ext:217770952857 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc000b4a3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0005ec208 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639930944} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970193707770760 ext:217771677907 loc:0x3a12660} ATime:{wall:13943970193707903618 ext:217771810767 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:07:39 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:197: Not found "file1" fstest.go:197: Not found "file2" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/04/26 06:07:48 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/26 06:07:48 DEBUG : : Looking for writers 2024/04/26 06:07:48 DEBUG : file1: reading active writers 2024/04/26 06:07:48 DEBUG : file2: reading active writers 2024/04/26 06:07:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/26 06:07:49 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:07:49 DEBUG : : Looking for writers 2024/04/26 06:07:49 DEBUG : file1: reading active writers 2024/04/26 06:07:49 DEBUG : file2: reading active writers 2024/04/26 06:07:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:50 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:07:50 DEBUG : : Looking for writers 2024/04/26 06:07:50 DEBUG : file1: reading active writers 2024/04/26 06:07:50 DEBUG : file2: reading active writers 2024/04/26 06:07:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:50 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "97699cb96471e026", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:50 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "97699cb96471e026", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:51 DEBUG : : Looking for writers 2024/04/26 06:07:51 DEBUG : file1: reading active writers 2024/04/26 06:07:51 DEBUG : file2: reading active writers 2024/04/26 06:07:51 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:51 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f73fba6d51a5f674", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:51 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f73fba6d51a5f674", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:07:52 DEBUG : : Looking for writers 2024/04/26 06:07:52 DEBUG : file1: reading active writers 2024/04/26 06:07:52 DEBUG : file2: reading active writers 2024/04/26 06:07:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:53 DEBUG : : Looking for writers 2024/04/26 06:07:53 DEBUG : file2: reading active writers 2024/04/26 06:07:53 DEBUG : file1: reading active writers 2024/04/26 06:07:53 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:54 DEBUG : : Looking for writers 2024/04/26 06:07:54 DEBUG : file2: reading active writers 2024/04/26 06:07:54 DEBUG : file1: reading active writers 2024/04/26 06:07:54 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:55 DEBUG : : Looking for writers 2024/04/26 06:07:55 DEBUG : file1: reading active writers 2024/04/26 06:07:55 DEBUG : file2: reading active writers 2024/04/26 06:07:55 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:56 DEBUG : : Looking for writers 2024/04/26 06:07:56 DEBUG : file1: reading active writers 2024/04/26 06:07:56 DEBUG : file2: reading active writers 2024/04/26 06:07:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:57 DEBUG : : Looking for writers 2024/04/26 06:07:57 DEBUG : file2: reading active writers 2024/04/26 06:07:57 DEBUG : file1: reading active writers 2024/04/26 06:07:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:58 DEBUG : : Looking for writers 2024/04/26 06:07:58 DEBUG : file1: reading active writers 2024/04/26 06:07:58 DEBUG : file2: reading active writers 2024/04/26 06:07:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:07:59 DEBUG : : Looking for writers 2024/04/26 06:07:59 DEBUG : file2: reading active writers 2024/04/26 06:07:59 DEBUG : file1: reading active writers 2024/04/26 06:07:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:00 DEBUG : : Looking for writers 2024/04/26 06:08:00 DEBUG : file1: reading active writers 2024/04/26 06:08:00 DEBUG : file2: reading active writers 2024/04/26 06:08:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:01 DEBUG : : Looking for writers 2024/04/26 06:08:01 DEBUG : file1: reading active writers 2024/04/26 06:08:01 DEBUG : file2: reading active writers 2024/04/26 06:08:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:02 DEBUG : : Looking for writers 2024/04/26 06:08:02 DEBUG : file1: reading active writers 2024/04/26 06:08:02 DEBUG : file2: reading active writers 2024/04/26 06:08:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:03 DEBUG : : Looking for writers 2024/04/26 06:08:03 DEBUG : file2: reading active writers 2024/04/26 06:08:03 DEBUG : file1: reading active writers 2024/04/26 06:08:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:04 DEBUG : : Looking for writers 2024/04/26 06:08:04 DEBUG : file1: reading active writers 2024/04/26 06:08:04 DEBUG : file2: reading active writers 2024/04/26 06:08:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:05 DEBUG : : Looking for writers 2024/04/26 06:08:05 DEBUG : file1: reading active writers 2024/04/26 06:08:05 DEBUG : file2: reading active writers 2024/04/26 06:08:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:06 DEBUG : : Looking for writers 2024/04/26 06:08:06 DEBUG : file2: reading active writers 2024/04/26 06:08:06 DEBUG : file1: reading active writers 2024/04/26 06:08:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:07 DEBUG : : Looking for writers 2024/04/26 06:08:07 DEBUG : file1: reading active writers 2024/04/26 06:08:07 DEBUG : file2: reading active writers 2024/04/26 06:08:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:08 DEBUG : : Looking for writers 2024/04/26 06:08:08 DEBUG : file1: reading active writers 2024/04/26 06:08:08 DEBUG : file2: reading active writers 2024/04/26 06:08:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:08 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:08:08 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/04/26 06:08:08 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/04/26 06:08:09 DEBUG : : Looking for writers 2024/04/26 06:08:09 DEBUG : file1: reading active writers 2024/04/26 06:08:09 DEBUG : file2: reading active writers 2024/04/26 06:08:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:10 DEBUG : : Looking for writers 2024/04/26 06:08:10 DEBUG : file1: reading active writers 2024/04/26 06:08:10 DEBUG : file2: reading active writers 2024/04/26 06:08:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:11 DEBUG : : Looking for writers 2024/04/26 06:08:11 DEBUG : file1: reading active writers 2024/04/26 06:08:11 DEBUG : file2: reading active writers 2024/04/26 06:08:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:12 DEBUG : : Looking for writers 2024/04/26 06:08:12 DEBUG : file1: reading active writers 2024/04/26 06:08:12 DEBUG : file2: reading active writers 2024/04/26 06:08:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:13 DEBUG : : Looking for writers 2024/04/26 06:08:13 DEBUG : file1: reading active writers 2024/04/26 06:08:13 DEBUG : file2: reading active writers 2024/04/26 06:08:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:14 DEBUG : : Looking for writers 2024/04/26 06:08:14 DEBUG : file1: reading active writers 2024/04/26 06:08:14 DEBUG : file2: reading active writers 2024/04/26 06:08:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:15 DEBUG : : Looking for writers 2024/04/26 06:08:15 DEBUG : file1: reading active writers 2024/04/26 06:08:15 DEBUG : file2: reading active writers 2024/04/26 06:08:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:16 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:08:16 DEBUG : : Looking for writers 2024/04/26 06:08:16 DEBUG : file1: reading active writers 2024/04/26 06:08:16 DEBUG : file2: reading active writers 2024/04/26 06:08:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:16 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0966aa005ca5ae79", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:16 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0966aa005ca5ae79", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:17 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:08:17 DEBUG : : Looking for writers 2024/04/26 06:08:17 DEBUG : file1: reading active writers 2024/04/26 06:08:17 DEBUG : file2: reading active writers 2024/04/26 06:08:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:08:18 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "946e4070e2e2a2d1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:18 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "946e4070e2e2a2d1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:18 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc000b4a3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0005ec108 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639930688} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970193706850232 ext:217770757390 loc:0x3a12660} ATime:{wall:13943970193707045699 ext:217770952857 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc000b4a3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0005ec208 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639930944} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970193707770760 ext:217771677907 loc:0x3a12660} ATime:{wall:13943970193707903618 ext:217771810767 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:08:18 DEBUG : >WaitForWriters: 2024/04/26 06:08:18 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (69.63s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:18 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:18 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:08:18 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:18 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:18 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:18 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:18 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "71b8b5bbb5d497f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:19 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:08:19 DEBUG : : Looking for writers 2024/04/26 06:08:19 DEBUG : >WaitForWriters: 2024/04/26 06:08:19 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (1.53s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:20 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:20 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:08:20 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:20 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:20 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:20 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:20 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0a84c494b6400e03", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:20 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:08:20 DEBUG : : Looking for writers 2024/04/26 06:08:20 DEBUG : >WaitForWriters: 2024/04/26 06:08:20 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (1.00s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:21 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:21 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:08:21 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:21 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-sakacer2pejasad7kewenom9" 2024/04/26 06:08:21 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:08:21 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:08:21 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:08:21 DEBUG : file1: newRWFileHandle: 2024/04/26 06:08:21 DEBUG : file1(0xc000859e40): openPending: 2024/04/26 06:08:21 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:08:21 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:08:21 DEBUG : file1(0xc000859e40): >openPending: err= 2024/04/26 06:08:21 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:08:21 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:08:21 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:08:21 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6628838b65ba07b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:22 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:08:22 DEBUG : : Looking for writers 2024/04/26 06:08:22 DEBUG : file1: reading active writers 2024/04/26 06:08:22 DEBUG : file1: active writers 1 2024/04/26 06:08:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:08:23 DEBUG : : Looking for writers 2024/04/26 06:08:23 DEBUG : file1: reading active writers 2024/04/26 06:08:23 DEBUG : file1: active writers 1 2024/04/26 06:08:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:24 DEBUG : : Looking for writers 2024/04/26 06:08:24 DEBUG : file1: reading active writers 2024/04/26 06:08:24 DEBUG : file1: active writers 1 2024/04/26 06:08:24 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:25 DEBUG : : Looking for writers 2024/04/26 06:08:25 DEBUG : file1: reading active writers 2024/04/26 06:08:25 DEBUG : file1: active writers 1 2024/04/26 06:08:25 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:26 DEBUG : : Looking for writers 2024/04/26 06:08:26 DEBUG : file1: reading active writers 2024/04/26 06:08:26 DEBUG : file1: active writers 1 2024/04/26 06:08:26 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:27 DEBUG : : Looking for writers 2024/04/26 06:08:27 DEBUG : file1: reading active writers 2024/04/26 06:08:27 DEBUG : file1: active writers 1 2024/04/26 06:08:27 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:28 DEBUG : : Looking for writers 2024/04/26 06:08:28 DEBUG : file1: reading active writers 2024/04/26 06:08:28 DEBUG : file1: active writers 1 2024/04/26 06:08:28 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:29 DEBUG : : Looking for writers 2024/04/26 06:08:29 DEBUG : file1: reading active writers 2024/04/26 06:08:29 DEBUG : file1: active writers 1 2024/04/26 06:08:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:30 DEBUG : : Looking for writers 2024/04/26 06:08:30 DEBUG : file1: reading active writers 2024/04/26 06:08:30 DEBUG : file1: active writers 1 2024/04/26 06:08:30 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:31 DEBUG : : Looking for writers 2024/04/26 06:08:31 DEBUG : file1: reading active writers 2024/04/26 06:08:31 DEBUG : file1: active writers 1 2024/04/26 06:08:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:32 DEBUG : : Looking for writers 2024/04/26 06:08:32 DEBUG : file1: reading active writers 2024/04/26 06:08:32 DEBUG : file1: active writers 1 2024/04/26 06:08:32 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:33 DEBUG : : Looking for writers 2024/04/26 06:08:33 DEBUG : file1: reading active writers 2024/04/26 06:08:33 DEBUG : file1: active writers 1 2024/04/26 06:08:33 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:34 DEBUG : : Looking for writers 2024/04/26 06:08:34 DEBUG : file1: reading active writers 2024/04/26 06:08:34 DEBUG : file1: active writers 1 2024/04/26 06:08:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:35 DEBUG : : Looking for writers 2024/04/26 06:08:35 DEBUG : file1: reading active writers 2024/04/26 06:08:35 DEBUG : file1: active writers 1 2024/04/26 06:08:35 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:36 DEBUG : : Looking for writers 2024/04/26 06:08:36 DEBUG : file1: reading active writers 2024/04/26 06:08:36 DEBUG : file1: active writers 1 2024/04/26 06:08:36 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:37 DEBUG : : Looking for writers 2024/04/26 06:08:37 DEBUG : file1: reading active writers 2024/04/26 06:08:37 DEBUG : file1: active writers 1 2024/04/26 06:08:37 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:38 DEBUG : : Looking for writers 2024/04/26 06:08:38 DEBUG : file1: reading active writers 2024/04/26 06:08:38 DEBUG : file1: active writers 1 2024/04/26 06:08:38 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:39 DEBUG : : Looking for writers 2024/04/26 06:08:39 DEBUG : file1: reading active writers 2024/04/26 06:08:39 DEBUG : file1: active writers 1 2024/04/26 06:08:39 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:40 DEBUG : : Looking for writers 2024/04/26 06:08:40 DEBUG : file1: reading active writers 2024/04/26 06:08:40 DEBUG : file1: active writers 1 2024/04/26 06:08:40 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:41 DEBUG : : Looking for writers 2024/04/26 06:08:41 DEBUG : file1: reading active writers 2024/04/26 06:08:41 DEBUG : file1: active writers 1 2024/04/26 06:08:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:42 DEBUG : : Looking for writers 2024/04/26 06:08:42 DEBUG : file1: reading active writers 2024/04/26 06:08:42 DEBUG : file1: active writers 1 2024/04/26 06:08:42 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:43 DEBUG : : Looking for writers 2024/04/26 06:08:43 DEBUG : file1: reading active writers 2024/04/26 06:08:43 DEBUG : file1: active writers 1 2024/04/26 06:08:43 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:44 DEBUG : : Looking for writers 2024/04/26 06:08:44 DEBUG : file1: reading active writers 2024/04/26 06:08:44 DEBUG : file1: active writers 1 2024/04/26 06:08:44 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:45 DEBUG : : Looking for writers 2024/04/26 06:08:45 DEBUG : file1: reading active writers 2024/04/26 06:08:45 DEBUG : file1: active writers 1 2024/04/26 06:08:45 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:46 DEBUG : : Looking for writers 2024/04/26 06:08:46 DEBUG : file1: reading active writers 2024/04/26 06:08:46 DEBUG : file1: active writers 1 2024/04/26 06:08:46 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:47 DEBUG : : Looking for writers 2024/04/26 06:08:47 DEBUG : file1: reading active writers 2024/04/26 06:08:47 DEBUG : file1: active writers 1 2024/04/26 06:08:47 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:48 DEBUG : : Looking for writers 2024/04/26 06:08:48 DEBUG : file1: reading active writers 2024/04/26 06:08:48 DEBUG : file1: active writers 1 2024/04/26 06:08:48 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:49 DEBUG : : Looking for writers 2024/04/26 06:08:49 DEBUG : file1: reading active writers 2024/04/26 06:08:49 DEBUG : file1: active writers 1 2024/04/26 06:08:49 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:50 DEBUG : : Looking for writers 2024/04/26 06:08:50 DEBUG : file1: reading active writers 2024/04/26 06:08:50 DEBUG : file1: active writers 1 2024/04/26 06:08:50 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:51 DEBUG : : Looking for writers 2024/04/26 06:08:51 DEBUG : file1: reading active writers 2024/04/26 06:08:51 DEBUG : file1: active writers 1 2024/04/26 06:08:51 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:08:52 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b045a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0009ba408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643920960} name:file1 opens:1 downloaders: o: fd:0xc0004f2288 info:{ModTime:{wall:13943970271189559831 ext:289944055631 loc:0x3a12660} ATime:{wall:13943970271189559831 ext:289944055631 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/04/26 06:08:52 DEBUG : >WaitForWriters: 2024/04/26 06:08:52 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.31s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b05cf69861550ada", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (1.67s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c718bea32c1e3409", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (2.10s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:56 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:56 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a2a0781b51857661", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:56 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:08:56 DEBUG : : Looking for writers 2024/04/26 06:08:56 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (1.00s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:57 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:57 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "106b8112a08f4a53", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:57 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:08:57 DEBUG : : Looking for writers 2024/04/26 06:08:57 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (1.01s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:58 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:58 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8d25ccd2c357d64e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:08:59 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:08:59 DEBUG : : Looking for writers 2024/04/26 06:08:59 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (1.53s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:08:59 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:08:59 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-sakacer2pejasad7kewenom9": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fafc7bc2dc7c9859", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:00 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:09:00 DEBUG : : Looking for writers 2024/04/26 06:09:00 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (1.52s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:09:01 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:09:01 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:09:01 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:09:02 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:09:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:02 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:09:02 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:09:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:02 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/26 06:09:02 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/26 06:09:02 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/04/26 06:09:02 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (5 bytes), uploading instead of streaming 2024/04/26 06:09:03 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "32dd037da760e287", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:03 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "32dd037da760e287", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:03 DEBUG : file1: Remove: 2024/04/26 06:09:03 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:09:03 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "32dd037da760e287", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/04/26 06:09:11 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:09:11 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:09:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:11 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:09:11 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:09:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:11 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:09:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9780227ea2deeaeb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:11 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9780227ea2deeaeb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:11 DEBUG : file1: Remove: 2024/04/26 06:09:11 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:09:11 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9780227ea2deeaeb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/04/26 06:09:11 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:09:11 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:09:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:11 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:09:11 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:09:11 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/04/26 06:09:11 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:09:11 DEBUG : : Looking for writers 2024/04/26 06:09:11 DEBUG : file1: reading active writers 2024/04/26 06:09:11 DEBUG : file1: active writers 1 2024/04/26 06:09:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/04/26 06:09:11 DEBUG : : Looking for writers 2024/04/26 06:09:11 DEBUG : file1: reading active writers 2024/04/26 06:09:11 DEBUG : file1: active writers 1 2024/04/26 06:09:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/04/26 06:09:11 DEBUG : : Looking for writers 2024/04/26 06:09:11 DEBUG : file1: reading active writers 2024/04/26 06:09:11 DEBUG : file1: active writers 1 2024/04/26 06:09:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/04/26 06:09:11 DEBUG : : Looking for writers 2024/04/26 06:09:11 DEBUG : file1: reading active writers 2024/04/26 06:09:11 DEBUG : file1: active writers 1 2024/04/26 06:09:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/04/26 06:09:12 DEBUG : : Looking for writers 2024/04/26 06:09:12 DEBUG : file1: reading active writers 2024/04/26 06:09:12 DEBUG : file1: active writers 1 2024/04/26 06:09:12 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/04/26 06:09:12 DEBUG : : Looking for writers 2024/04/26 06:09:12 DEBUG : file1: reading active writers 2024/04/26 06:09:12 DEBUG : file1: active writers 1 2024/04/26 06:09:12 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/04/26 06:09:12 DEBUG : : Looking for writers 2024/04/26 06:09:12 DEBUG : file1: reading active writers 2024/04/26 06:09:12 DEBUG : file1: active writers 1 2024/04/26 06:09:12 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/04/26 06:09:13 DEBUG : : Looking for writers 2024/04/26 06:09:13 DEBUG : file1: reading active writers 2024/04/26 06:09:13 DEBUG : file1: active writers 1 2024/04/26 06:09:13 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:14 DEBUG : : Looking for writers 2024/04/26 06:09:14 DEBUG : file1: reading active writers 2024/04/26 06:09:14 DEBUG : file1: active writers 1 2024/04/26 06:09:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:15 DEBUG : : Looking for writers 2024/04/26 06:09:15 DEBUG : file1: reading active writers 2024/04/26 06:09:15 DEBUG : file1: active writers 1 2024/04/26 06:09:15 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:16 DEBUG : : Looking for writers 2024/04/26 06:09:16 DEBUG : file1: reading active writers 2024/04/26 06:09:16 DEBUG : file1: active writers 1 2024/04/26 06:09:16 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:17 DEBUG : : Looking for writers 2024/04/26 06:09:17 DEBUG : file1: reading active writers 2024/04/26 06:09:17 DEBUG : file1: active writers 1 2024/04/26 06:09:17 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:18 DEBUG : : Looking for writers 2024/04/26 06:09:18 DEBUG : file1: reading active writers 2024/04/26 06:09:18 DEBUG : file1: active writers 1 2024/04/26 06:09:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:19 DEBUG : : Looking for writers 2024/04/26 06:09:19 DEBUG : file1: reading active writers 2024/04/26 06:09:19 DEBUG : file1: active writers 1 2024/04/26 06:09:19 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:20 DEBUG : : Looking for writers 2024/04/26 06:09:20 DEBUG : file1: reading active writers 2024/04/26 06:09:20 DEBUG : file1: active writers 1 2024/04/26 06:09:20 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:21 DEBUG : : Looking for writers 2024/04/26 06:09:21 DEBUG : file1: reading active writers 2024/04/26 06:09:21 DEBUG : file1: active writers 1 2024/04/26 06:09:21 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:22 DEBUG : : Looking for writers 2024/04/26 06:09:22 DEBUG : file1: reading active writers 2024/04/26 06:09:22 DEBUG : file1: active writers 1 2024/04/26 06:09:22 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:23 DEBUG : : Looking for writers 2024/04/26 06:09:23 DEBUG : file1: reading active writers 2024/04/26 06:09:23 DEBUG : file1: active writers 1 2024/04/26 06:09:23 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:24 DEBUG : : Looking for writers 2024/04/26 06:09:24 DEBUG : file1: reading active writers 2024/04/26 06:09:24 DEBUG : file1: active writers 1 2024/04/26 06:09:24 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:25 DEBUG : : Looking for writers 2024/04/26 06:09:25 DEBUG : file1: reading active writers 2024/04/26 06:09:25 DEBUG : file1: active writers 1 2024/04/26 06:09:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:26 DEBUG : : Looking for writers 2024/04/26 06:09:26 DEBUG : file1: reading active writers 2024/04/26 06:09:26 DEBUG : file1: active writers 1 2024/04/26 06:09:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:27 DEBUG : : Looking for writers 2024/04/26 06:09:27 DEBUG : file1: reading active writers 2024/04/26 06:09:27 DEBUG : file1: active writers 1 2024/04/26 06:09:27 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:28 DEBUG : : Looking for writers 2024/04/26 06:09:28 DEBUG : file1: reading active writers 2024/04/26 06:09:28 DEBUG : file1: active writers 1 2024/04/26 06:09:28 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:29 DEBUG : : Looking for writers 2024/04/26 06:09:29 DEBUG : file1: reading active writers 2024/04/26 06:09:29 DEBUG : file1: active writers 1 2024/04/26 06:09:29 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:30 DEBUG : : Looking for writers 2024/04/26 06:09:30 DEBUG : file1: reading active writers 2024/04/26 06:09:30 DEBUG : file1: active writers 1 2024/04/26 06:09:30 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:31 DEBUG : : Looking for writers 2024/04/26 06:09:31 DEBUG : file1: reading active writers 2024/04/26 06:09:31 DEBUG : file1: active writers 1 2024/04/26 06:09:31 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:32 DEBUG : : Looking for writers 2024/04/26 06:09:32 DEBUG : file1: reading active writers 2024/04/26 06:09:32 DEBUG : file1: active writers 1 2024/04/26 06:09:32 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:33 DEBUG : : Looking for writers 2024/04/26 06:09:33 DEBUG : file1: reading active writers 2024/04/26 06:09:33 DEBUG : file1: active writers 1 2024/04/26 06:09:33 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:34 DEBUG : : Looking for writers 2024/04/26 06:09:34 DEBUG : file1: reading active writers 2024/04/26 06:09:34 DEBUG : file1: active writers 1 2024/04/26 06:09:34 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:35 DEBUG : : Looking for writers 2024/04/26 06:09:35 DEBUG : file1: reading active writers 2024/04/26 06:09:35 DEBUG : file1: active writers 1 2024/04/26 06:09:35 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:36 DEBUG : : Looking for writers 2024/04/26 06:09:36 DEBUG : file1: reading active writers 2024/04/26 06:09:36 DEBUG : file1: active writers 1 2024/04/26 06:09:36 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:37 DEBUG : : Looking for writers 2024/04/26 06:09:37 DEBUG : file1: reading active writers 2024/04/26 06:09:37 DEBUG : file1: active writers 1 2024/04/26 06:09:37 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:38 DEBUG : : Looking for writers 2024/04/26 06:09:38 DEBUG : file1: reading active writers 2024/04/26 06:09:38 DEBUG : file1: active writers 1 2024/04/26 06:09:38 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:39 DEBUG : : Looking for writers 2024/04/26 06:09:39 DEBUG : file1: reading active writers 2024/04/26 06:09:39 DEBUG : file1: active writers 1 2024/04/26 06:09:39 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:40 DEBUG : : Looking for writers 2024/04/26 06:09:40 DEBUG : file1: reading active writers 2024/04/26 06:09:40 DEBUG : file1: active writers 1 2024/04/26 06:09:40 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:41 DEBUG : : Looking for writers 2024/04/26 06:09:41 DEBUG : file1: reading active writers 2024/04/26 06:09:41 DEBUG : file1: active writers 1 2024/04/26 06:09:41 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:09:41 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/04/26 06:09:41 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (41.52s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:09:42 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:09:42 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:09:42 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:09:43 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:09:43 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:43 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:09:43 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:09:43 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:43 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/04/26 06:09:44 DEBUG : file1: aborting in-sequence write wait, off=100 2024/04/26 06:09:44 DEBUG : file1: failed to wait for in-sequence write to 100 2024/04/26 06:09:44 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/04/26 06:09:44 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (11 bytes), uploading instead of streaming 2024/04/26 06:09:45 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6d56c0d47251e139", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:45 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6d56c0d47251e139", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:45 DEBUG : file1: Remove: 2024/04/26 06:09:45 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:09:45 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6d56c0d47251e139", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/04/26 06:09:45 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/04/26 06:09:54 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:09:54 DEBUG : : Looking for writers 2024/04/26 06:09:54 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (12.36s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:09:55 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:09:55 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:09:55 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:09:55 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:09:55 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:55 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:09:55 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:09:55 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/04/26 06:09:55 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:55 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (5 bytes), uploading instead of streaming 2024/04/26 06:09:56 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7552785ad8e47f3c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:56 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7552785ad8e47f3c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:09:56 DEBUG : file1: Remove: 2024/04/26 06:09:56 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:09:56 DEBUG : file1: >Remove: err= 2024/04/26 06:09:56 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7552785ad8e47f3c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7552785ad8e47f3c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/04/26 06:09:56 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/04/26 06:09:56 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:09:56 DEBUG : : Looking for writers 2024/04/26 06:09:56 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (3.00s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:09:58 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:09:58 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:09:58 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:09:59 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:09:59 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:59 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:09:59 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:09:59 DEBUG : file1: WriteFileHandle.Release closing 2024/04/26 06:09:59 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:09:59 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:10:00 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "55aba2515173873c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:00 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "55aba2515173873c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:00 DEBUG : file1: Remove: 2024/04/26 06:10:00 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:10:00 DEBUG : file1: >Remove: err= 2024/04/26 06:10:00 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "55aba2515173873c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "55aba2515173873c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/04/26 06:10:00 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/04/26 06:10:00 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:00 DEBUG : : Looking for writers 2024/04/26 06:10:00 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (2.30s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:10:00 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:10:00 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:10:00 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:10:00 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:10:00 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:10:00 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:10:00 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:10:00 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:10:00 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (2 bytes), uploading instead of streaming 2024/04/26 06:10:02 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "533bc8c69258ba51", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:02 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "533bc8c69258ba51", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:02 DEBUG : file1: Remove: 2024/04/26 06:10:02 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:10:02 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "533bc8c69258ba51", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/04/26 06:10:02 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:02 DEBUG : : Looking for writers 2024/04/26 06:10:02 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.99s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:10:02 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:10:02 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:10:02 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:10:04 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:10:04 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:10:04 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:10:04 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:10:04 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:10:04 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:10:05 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2b6573361927089b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:05 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2b6573361927089b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:05 DEBUG : file1: Remove: 2024/04/26 06:10:05 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:10:05 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2b6573361927089b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/04/26 06:10:05 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/26 06:10:05 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/04/26 06:10:05 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:05 DEBUG : : Looking for writers 2024/04/26 06:10:05 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (3.41s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-sakacer2pejasad7kewenom9", Local "Local file system at /tmp/rclone213528184", Modify Window "876000h0m0s" 2024/04/26 06:10:05 INFO : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: poll-interval is not supported by this remote 2024/04/26 06:10:05 NOTICE: QingStor bucket rclone-test-sakacer2pejasad7kewenom9: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:10:05 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:10:06 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:10:06 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:10:06 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:10:06 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:10:06 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:10:06 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: File to upload is small (100 bytes), uploading instead of streaming 2024/04/26 06:10:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "067572150a1cb12e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:06 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "067572150a1cb12e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:06 DEBUG : file1: Remove: 2024/04/26 06:10:06 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:10:06 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "067572150a1cb12e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/04/26 06:10:06 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/26 06:10:06 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/04/26 06:10:06 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:06 DEBUG : : Looking for writers 2024/04/26 06:10:06 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.32s) FAIL 2024/04/26 06:10:07 DEBUG : QingStor bucket rclone-test-sakacer2pejasad7kewenom9: Purge dir "" 2024/04/26 06:10:07 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "53644ce8e9288acf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:07 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 6m36.298489936s (try 2/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]