"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 5/5) 2024/04/25 06:47:08 DEBUG : Creating backend with remote "TestQingStor:rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:08 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/25 06:47:08 DEBUG : Creating backend with remote "/tmp/rclone2740296403" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:08 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:08 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62104f7411050af4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:10 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:10 DEBUG : : Looking for writers 2024/04/25 06:47:10 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (2.68s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:11 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:11 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a2bcc60ae2aa6320", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:12 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:12 DEBUG : : Looking for writers 2024/04/25 06:47:12 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (2.02s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:13 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:13 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4b2bdbae67f8d353", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:13 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:13 DEBUG : : Looking for writers 2024/04/25 06:47:13 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (0.89s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:14 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:14 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4855342c6dc9a375", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:14 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:14 DEBUG : : Looking for writers 2024/04/25 06:47:14 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (0.89s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:15 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:15 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8f26963474dadf18", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:15 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:15 DEBUG : : Looking for writers 2024/04/25 06:47:15 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (0.89s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:15 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:15 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "77ed19716585f399", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:16 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:16 DEBUG : : Looking for writers 2024/04/25 06:47:16 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (1.39s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:17 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:17 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b52479b867aa3269", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:18 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:18 DEBUG : : Looking for writers 2024/04/25 06:47:18 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (1.06s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:18 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:18 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9356db20304d481e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:19 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:19 DEBUG : : Looking for writers 2024/04/25 06:47:19 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (0.90s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:19 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:19 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1ffea130b9060a7b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:19 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:19 DEBUG : : Looking for writers 2024/04/25 06:47:19 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (1.37s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:20 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:20 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a0cb640123c0b917", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:21 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:21 DEBUG : : Looking for writers 2024/04/25 06:47:21 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (0.88s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:21 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:21 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a844455815be2d62", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:22 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:22 DEBUG : : Looking for writers 2024/04/25 06:47:22 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (1.36s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:22 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:22 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "629ac4131742659e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:23 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:23 DEBUG : : Looking for writers 2024/04/25 06:47:23 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (1.37s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:24 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:24 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "54ece70933dea27d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:24 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:24 DEBUG : : Looking for writers 2024/04/25 06:47:24 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (0.88s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:25 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:25 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "19f8229f9d87c510", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:25 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:25 DEBUG : : Looking for writers 2024/04/25 06:47:25 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (0.89s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:26 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:26 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bcb7c2f24e22580d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:26 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:26 DEBUG : : Looking for writers 2024/04/25 06:47:26 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (0.89s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:26 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:26 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "733a063241efcf20", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:27 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:27 DEBUG : : Looking for writers 2024/04/25 06:47:27 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (0.89s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:27 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:27 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "452c59a454c27760", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:28 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:28 DEBUG : : Looking for writers 2024/04/25 06:47:28 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (0.89s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:28 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:28 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "eb3a65fd0d7893a8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:29 DEBUG : : Looking for writers 2024/04/25 06:47:29 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (1.37s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:30 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:30 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c50d9625ba31f16b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:30 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:30 DEBUG : : Looking for writers 2024/04/25 06:47:30 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (0.89s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:30 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:30 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b22f156195c3af8f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:31 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:31 DEBUG : : Looking for writers 2024/04/25 06:47:31 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:31 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:31 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cf4ee4a4e90c1c3e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:32 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:32 DEBUG : : Looking for writers 2024/04/25 06:47:32 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:32 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:32 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "57bab4b4b62abf36", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:33 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:33 DEBUG : : Looking for writers 2024/04/25 06:47:33 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:33 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:33 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:33 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:33 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:33 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cda27079faa16a1a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:34 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:34 DEBUG : : Looking for writers 2024/04/25 06:47:34 DEBUG : >WaitForWriters: 2024/04/25 06:47:34 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:34 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:34 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:34 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:34 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:34 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:34 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:34 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5187c0155762b619", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:35 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:35 DEBUG : : Looking for writers 2024/04/25 06:47:35 DEBUG : >WaitForWriters: 2024/04/25 06:47:35 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:35 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:35 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:35 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:35 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:35 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:35 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:35 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "860db1c110f568af", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:35 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:35 DEBUG : : Looking for writers 2024/04/25 06:47:35 DEBUG : >WaitForWriters: 2024/04/25 06:47:35 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (5.30s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (0.89s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (0.88s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (0.89s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (0.87s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (0.88s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (0.89s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:36 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:36 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b3ba421718d3c5aa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:37 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:37 DEBUG : : Looking for writers 2024/04/25 06:47:37 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (1.37s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:37 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:37 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8ba5927929de31f7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:38 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:38 DEBUG : : Looking for writers 2024/04/25 06:47:38 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (1.40s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:39 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:39 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e9d2931cc9a1db88", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:39 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:39 DEBUG : : Looking for writers 2024/04/25 06:47:39 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (1.38s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:40 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:40 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0c9127ba301adec2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:41 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:41 DEBUG : : Looking for writers 2024/04/25 06:47:41 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (0.88s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:41 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:41 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "629602b2a2d2d51f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:41 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:41 DEBUG : : Looking for writers 2024/04/25 06:47:41 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (0.89s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:42 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:42 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "95eafe5b729147d5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:42 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:42 DEBUG : : Looking for writers 2024/04/25 06:47:42 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:43 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:43 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:47:43 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:43 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "12b4bbb872d05d06", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:43 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:43 DEBUG : : Looking for writers 2024/04/25 06:47:43 DEBUG : >WaitForWriters: 2024/04/25 06:47:43 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:43 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:43 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:47:43 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:43 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:43 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d5e260f52d864436", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:44 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:44 DEBUG : : Looking for writers 2024/04/25 06:47:44 DEBUG : >WaitForWriters: 2024/04/25 06:47:44 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:44 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:44 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:44 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:44 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:44 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:44 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:44 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "51731e8c69b8a1bf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:46 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:46 DEBUG : : Looking for writers 2024/04/25 06:47:46 DEBUG : >WaitForWriters: 2024/04/25 06:47:46 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:47 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:47 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:47 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:47 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:47 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:47 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:47 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "88121108689242fd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:48 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:48 DEBUG : : Looking for writers 2024/04/25 06:47:48 DEBUG : >WaitForWriters: 2024/04/25 06:47:48 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:48 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:48 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:48 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:48 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:48 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:48 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:48 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6fd124c36f19c5ab", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:48 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:48 DEBUG : : Looking for writers 2024/04/25 06:47:48 DEBUG : >WaitForWriters: 2024/04/25 06:47:48 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (7.06s) --- FAIL: TestFileRename/off,forceCache=false (0.89s) --- FAIL: TestFileRename/minimal,forceCache=false (0.89s) --- FAIL: TestFileRename/minimal,forceCache=true (0.88s) --- FAIL: TestFileRename/writes,forceCache=false (2.66s) --- FAIL: TestFileRename/writes,forceCache=true (0.87s) --- FAIL: TestFileRename/full,forceCache=false (0.87s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:49 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:49 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a35cbb33d0be3542", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:49 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:49 DEBUG : : Looking for writers 2024/04/25 06:47:49 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (0.87s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:50 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:50 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d0ade4c1f854b51e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:51 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:51 DEBUG : : Looking for writers 2024/04/25 06:47:51 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (1.36s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:51 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:51 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6db81dcd3e60959c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:52 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:52 DEBUG : : Looking for writers 2024/04/25 06:47:52 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (0.97s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:52 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:52 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cdacad2558419502", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:53 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:53 DEBUG : : Looking for writers 2024/04/25 06:47:53 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (0.88s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:53 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:53 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bf0f35a5f53aa9a4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:54 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:54 DEBUG : : Looking for writers 2024/04/25 06:47:54 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (1.84s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:55 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:55 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:55 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c90fd940e7984445", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:55 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:55 DEBUG : : Looking for writers 2024/04/25 06:47:55 DEBUG : >WaitForWriters: 2024/04/25 06:47:55 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (0.84s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:55 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:55 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:55 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:55 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "55527a22ae1d0f15", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:56 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:56 DEBUG : : Looking for writers 2024/04/25 06:47:56 DEBUG : >WaitForWriters: 2024/04/25 06:47:56 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (0.87s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:56 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:56 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:56 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:56 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:56 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:56 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "548e84054a1c0fb7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:57 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:57 DEBUG : : Looking for writers 2024/04/25 06:47:57 DEBUG : >WaitForWriters: 2024/04/25 06:47:57 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (0.86s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:57 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:57 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:57 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:57 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:57 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:57 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:57 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0394c3cfb30634a6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:58 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:58 DEBUG : : Looking for writers 2024/04/25 06:47:58 DEBUG : >WaitForWriters: 2024/04/25 06:47:58 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (1.37s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:47:59 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:47:59 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:47:59 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:59 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:47:59 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d4fb99b83769efb0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:00 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : >WaitForWriters: 2024/04/25 06:48:00 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (1.34s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:48:00 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:48:00 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:48:00 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:48:00 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:48:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:48:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:48:00 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:48:00 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:48:00 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:48:00 DEBUG : file1: newRWFileHandle: 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): openPending: 2024/04/25 06:48:00 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:48:00 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): >openPending: err= 2024/04/25 06:48:00 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:48:00 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:48:00 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:48:00 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): _writeAt: size=5, off=0 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): >_writeAt: n=5, err= 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): _writeAt: size=7, off=5 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): >_writeAt: n=7, err= 2024/04/25 06:48:00 DEBUG : file1: vfs cache: truncate to size=11 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): close: 2024/04/25 06:48:00 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:48:00.676417123 +0000 UTC m=+52.166332596 2024/04/25 06:48:00 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): >close: err= 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): close: 2024/04/25 06:48:00 DEBUG : file1(0xc0002b9b00): >close: err=file already closed 2024/04/25 06:48:00 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : file1: reading active writers 2024/04/25 06:48:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : file1: reading active writers 2024/04/25 06:48:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : file1: reading active writers 2024/04/25 06:48:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : file1: reading active writers 2024/04/25 06:48:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:48:00 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : file1: reading active writers 2024/04/25 06:48:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:48:00 DEBUG : : Looking for writers 2024/04/25 06:48:00 DEBUG : file1: reading active writers 2024/04/25 06:48:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:48:01 DEBUG : : Looking for writers 2024/04/25 06:48:01 DEBUG : file1: reading active writers 2024/04/25 06:48:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:48:01 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "598d747fb170db38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:01 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "598d747fb170db38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:01 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:01 DEBUG : : Looking for writers 2024/04/25 06:48:01 DEBUG : file1: reading active writers 2024/04/25 06:48:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:02 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "029b8329c72e5371", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:02 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "029b8329c72e5371", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:02 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:02 DEBUG : : Looking for writers 2024/04/25 06:48:02 DEBUG : file1: reading active writers 2024/04/25 06:48:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:03 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "10c3b56e603bd849", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:03 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "10c3b56e603bd849", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:03 DEBUG : : Looking for writers 2024/04/25 06:48:03 DEBUG : file1: reading active writers 2024/04/25 06:48:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:04 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:04 DEBUG : : Looking for writers 2024/04/25 06:48:04 DEBUG : file1: reading active writers 2024/04/25 06:48:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:05 DEBUG : : Looking for writers 2024/04/25 06:48:05 DEBUG : file1: reading active writers 2024/04/25 06:48:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "36186ee368905850", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:06 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "36186ee368905850", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:06 DEBUG : : Looking for writers 2024/04/25 06:48:06 DEBUG : file1: reading active writers 2024/04/25 06:48:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:07 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:07 DEBUG : : Looking for writers 2024/04/25 06:48:07 DEBUG : file1: reading active writers 2024/04/25 06:48:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:08 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ad72eb333d206483", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:08 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ad72eb333d206483", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:08 DEBUG : : Looking for writers 2024/04/25 06:48:08 DEBUG : file1: reading active writers 2024/04/25 06:48:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:09 DEBUG : : Looking for writers 2024/04/25 06:48:09 DEBUG : file1: reading active writers 2024/04/25 06:48:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:10 DEBUG : : Looking for writers 2024/04/25 06:48:10 DEBUG : file1: reading active writers 2024/04/25 06:48:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:11 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:11 DEBUG : : Looking for writers 2024/04/25 06:48:11 DEBUG : file1: reading active writers 2024/04/25 06:48:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:12 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bcd7a96f1ae5f6dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:12 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bcd7a96f1ae5f6dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:12 DEBUG : : Looking for writers 2024/04/25 06:48:12 DEBUG : file1: reading active writers 2024/04/25 06:48:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:13 DEBUG : : Looking for writers 2024/04/25 06:48:13 DEBUG : file1: reading active writers 2024/04/25 06:48:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:14 DEBUG : : Looking for writers 2024/04/25 06:48:14 DEBUG : file1: reading active writers 2024/04/25 06:48:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:15 DEBUG : : Looking for writers 2024/04/25 06:48:15 DEBUG : file1: reading active writers 2024/04/25 06:48:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:16 DEBUG : : Looking for writers 2024/04/25 06:48:16 DEBUG : file1: reading active writers 2024/04/25 06:48:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:17 DEBUG : : Looking for writers 2024/04/25 06:48:17 DEBUG : file1: reading active writers 2024/04/25 06:48:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:18 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:18 DEBUG : : Looking for writers 2024/04/25 06:48:18 DEBUG : file1: reading active writers 2024/04/25 06:48:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:19 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "405b2e8cc5bfee5c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:19 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "405b2e8cc5bfee5c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:19 DEBUG : : Looking for writers 2024/04/25 06:48:19 DEBUG : file1: reading active writers 2024/04/25 06:48:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:20 DEBUG : : Looking for writers 2024/04/25 06:48:20 DEBUG : file1: reading active writers 2024/04/25 06:48:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:21 DEBUG : : Looking for writers 2024/04/25 06:48:21 DEBUG : file1: reading active writers 2024/04/25 06:48:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:22 DEBUG : : Looking for writers 2024/04/25 06:48:22 DEBUG : file1: reading active writers 2024/04/25 06:48:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:23 DEBUG : : Looking for writers 2024/04/25 06:48:23 DEBUG : file1: reading active writers 2024/04/25 06:48:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:24 DEBUG : : Looking for writers 2024/04/25 06:48:24 DEBUG : file1: reading active writers 2024/04/25 06:48:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:25 DEBUG : : Looking for writers 2024/04/25 06:48:25 DEBUG : file1: reading active writers 2024/04/25 06:48:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:26 DEBUG : : Looking for writers 2024/04/25 06:48:26 DEBUG : file1: reading active writers 2024/04/25 06:48:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:27 DEBUG : : Looking for writers 2024/04/25 06:48:27 DEBUG : file1: reading active writers 2024/04/25 06:48:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:28 DEBUG : : Looking for writers 2024/04/25 06:48:28 DEBUG : file1: reading active writers 2024/04/25 06:48:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:29 DEBUG : : Looking for writers 2024/04/25 06:48:29 DEBUG : file1: reading active writers 2024/04/25 06:48:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:30 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0009ea008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824644116544} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880054654193251 ext:52166332596 loc:0x3a135e0} ATime:{wall:13943880054654203710 ext:52166343056 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:48:30 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:48:32 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:48:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "421663d93bf4719a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:32 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "421663d93bf4719a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/04/25 06:48:38 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:48:38 DEBUG : : Looking for writers 2024/04/25 06:48:38 DEBUG : file1: reading active writers 2024/04/25 06:48:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:48:38 DEBUG : : Looking for writers 2024/04/25 06:48:38 DEBUG : file1: reading active writers 2024/04/25 06:48:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:48:38 DEBUG : : Looking for writers 2024/04/25 06:48:38 DEBUG : file1: reading active writers 2024/04/25 06:48:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:48:38 DEBUG : : Looking for writers 2024/04/25 06:48:38 DEBUG : file1: reading active writers 2024/04/25 06:48:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:48:38 DEBUG : : Looking for writers 2024/04/25 06:48:38 DEBUG : file1: reading active writers 2024/04/25 06:48:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:48:38 DEBUG : : Looking for writers 2024/04/25 06:48:38 DEBUG : file1: reading active writers 2024/04/25 06:48:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:48:39 DEBUG : : Looking for writers 2024/04/25 06:48:39 DEBUG : file1: reading active writers 2024/04/25 06:48:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:48:39 DEBUG : : Looking for writers 2024/04/25 06:48:39 DEBUG : file1: reading active writers 2024/04/25 06:48:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:40 DEBUG : : Looking for writers 2024/04/25 06:48:40 DEBUG : file1: reading active writers 2024/04/25 06:48:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:41 DEBUG : : Looking for writers 2024/04/25 06:48:41 DEBUG : file1: reading active writers 2024/04/25 06:48:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:42 DEBUG : : Looking for writers 2024/04/25 06:48:42 DEBUG : file1: reading active writers 2024/04/25 06:48:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:43 DEBUG : : Looking for writers 2024/04/25 06:48:43 DEBUG : file1: reading active writers 2024/04/25 06:48:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:44 DEBUG : : Looking for writers 2024/04/25 06:48:44 DEBUG : file1: reading active writers 2024/04/25 06:48:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:45 DEBUG : : Looking for writers 2024/04/25 06:48:45 DEBUG : file1: reading active writers 2024/04/25 06:48:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:46 DEBUG : : Looking for writers 2024/04/25 06:48:46 DEBUG : file1: reading active writers 2024/04/25 06:48:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:47 DEBUG : : Looking for writers 2024/04/25 06:48:47 DEBUG : file1: reading active writers 2024/04/25 06:48:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:48 DEBUG : : Looking for writers 2024/04/25 06:48:48 DEBUG : file1: reading active writers 2024/04/25 06:48:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:49 DEBUG : : Looking for writers 2024/04/25 06:48:49 DEBUG : file1: reading active writers 2024/04/25 06:48:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:50 DEBUG : : Looking for writers 2024/04/25 06:48:50 DEBUG : file1: reading active writers 2024/04/25 06:48:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:51 DEBUG : : Looking for writers 2024/04/25 06:48:51 DEBUG : file1: reading active writers 2024/04/25 06:48:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:52 DEBUG : : Looking for writers 2024/04/25 06:48:52 DEBUG : file1: reading active writers 2024/04/25 06:48:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:53 DEBUG : : Looking for writers 2024/04/25 06:48:53 DEBUG : file1: reading active writers 2024/04/25 06:48:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:54 DEBUG : : Looking for writers 2024/04/25 06:48:54 DEBUG : file1: reading active writers 2024/04/25 06:48:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:55 DEBUG : : Looking for writers 2024/04/25 06:48:55 DEBUG : file1: reading active writers 2024/04/25 06:48:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:56 DEBUG : : Looking for writers 2024/04/25 06:48:56 DEBUG : file1: reading active writers 2024/04/25 06:48:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:57 DEBUG : : Looking for writers 2024/04/25 06:48:57 DEBUG : file1: reading active writers 2024/04/25 06:48:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:58 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:48:58 DEBUG : : Looking for writers 2024/04/25 06:48:58 DEBUG : file1: reading active writers 2024/04/25 06:48:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:48:59 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7d59c8e344fa309f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:59 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7d59c8e344fa309f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:48:59 DEBUG : : Looking for writers 2024/04/25 06:48:59 DEBUG : file1: reading active writers 2024/04/25 06:48:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:00 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:49:00 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/25 06:49:00 DEBUG : : Looking for writers 2024/04/25 06:49:00 DEBUG : file1: reading active writers 2024/04/25 06:49:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:01 DEBUG : : Looking for writers 2024/04/25 06:49:01 DEBUG : file1: reading active writers 2024/04/25 06:49:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:02 DEBUG : : Looking for writers 2024/04/25 06:49:02 DEBUG : file1: reading active writers 2024/04/25 06:49:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:03 DEBUG : : Looking for writers 2024/04/25 06:49:03 DEBUG : file1: reading active writers 2024/04/25 06:49:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:04 DEBUG : : Looking for writers 2024/04/25 06:49:04 DEBUG : file1: reading active writers 2024/04/25 06:49:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:05 DEBUG : : Looking for writers 2024/04/25 06:49:05 DEBUG : file1: reading active writers 2024/04/25 06:49:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:06 DEBUG : : Looking for writers 2024/04/25 06:49:06 DEBUG : file1: reading active writers 2024/04/25 06:49:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:07 DEBUG : : Looking for writers 2024/04/25 06:49:07 DEBUG : file1: reading active writers 2024/04/25 06:49:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:08 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0009ea008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824644116544} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880054654193251 ext:52166332596 loc:0x3a135e0} ATime:{wall:13943880054654203710 ext:52166343056 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:49:08 DEBUG : >WaitForWriters: 2024/04/25 06:49:08 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (68.90s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:49:09 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:49:09 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:49:09 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:49:09 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:49:09 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:49:09 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:49:09 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:49:09 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:49:09 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:49:09 DEBUG : file1: newRWFileHandle: 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): openPending: 2024/04/25 06:49:09 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:49:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): >openPending: err= 2024/04/25 06:49:09 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:49:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:49:09 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:49:09 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): _writeAt: size=7, off=0 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): >_writeAt: n=7, err= 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): _writeAt: size=6, off=5 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): >_writeAt: n=6, err= 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): close: 2024/04/25 06:49:09 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:49:09.572873017 +0000 UTC m=+121.062788492 2024/04/25 06:49:09 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): >close: err= 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): _writeAt: size=5, off=0 2024/04/25 06:49:09 DEBUG : file1(0xc000bb87c0): >_writeAt: n=0, err=file already closed 2024/04/25 06:49:09 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:49:09 DEBUG : : Looking for writers 2024/04/25 06:49:09 DEBUG : file1: reading active writers 2024/04/25 06:49:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:49:09 DEBUG : : Looking for writers 2024/04/25 06:49:09 DEBUG : file1: reading active writers 2024/04/25 06:49:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:49:09 DEBUG : : Looking for writers 2024/04/25 06:49:09 DEBUG : file1: reading active writers 2024/04/25 06:49:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:49:09 DEBUG : : Looking for writers 2024/04/25 06:49:09 DEBUG : file1: reading active writers 2024/04/25 06:49:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:49:09 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:09 DEBUG : : Looking for writers 2024/04/25 06:49:09 DEBUG : file1: reading active writers 2024/04/25 06:49:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:49:09 DEBUG : : Looking for writers 2024/04/25 06:49:09 DEBUG : file1: reading active writers 2024/04/25 06:49:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:49:10 DEBUG : : Looking for writers 2024/04/25 06:49:10 DEBUG : file1: reading active writers 2024/04/25 06:49:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:49:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "24597905dd2188dc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:10 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "24597905dd2188dc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:10 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:10 DEBUG : : Looking for writers 2024/04/25 06:49:10 DEBUG : file1: reading active writers 2024/04/25 06:49:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "926b70bed412f587", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:11 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "926b70bed412f587", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:11 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:11 DEBUG : : Looking for writers 2024/04/25 06:49:11 DEBUG : file1: reading active writers 2024/04/25 06:49:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:12 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4e021fef3d0e131a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:12 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4e021fef3d0e131a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:12 DEBUG : : Looking for writers 2024/04/25 06:49:12 DEBUG : file1: reading active writers 2024/04/25 06:49:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:13 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:13 DEBUG : : Looking for writers 2024/04/25 06:49:13 DEBUG : file1: reading active writers 2024/04/25 06:49:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e4616130e1755fa2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:14 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e4616130e1755fa2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:14 DEBUG : : Looking for writers 2024/04/25 06:49:14 DEBUG : file1: reading active writers 2024/04/25 06:49:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:15 DEBUG : : Looking for writers 2024/04/25 06:49:15 DEBUG : file1: reading active writers 2024/04/25 06:49:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:16 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:16 DEBUG : : Looking for writers 2024/04/25 06:49:16 DEBUG : file1: reading active writers 2024/04/25 06:49:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:16 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5a242671f4ca7ac6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:16 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5a242671f4ca7ac6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:17 DEBUG : : Looking for writers 2024/04/25 06:49:17 DEBUG : file1: reading active writers 2024/04/25 06:49:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:18 DEBUG : : Looking for writers 2024/04/25 06:49:18 DEBUG : file1: reading active writers 2024/04/25 06:49:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:19 DEBUG : : Looking for writers 2024/04/25 06:49:19 DEBUG : file1: reading active writers 2024/04/25 06:49:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:20 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:20 DEBUG : : Looking for writers 2024/04/25 06:49:20 DEBUG : file1: reading active writers 2024/04/25 06:49:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:21 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b502f37ac6228924", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:21 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b502f37ac6228924", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:21 DEBUG : : Looking for writers 2024/04/25 06:49:21 DEBUG : file1: reading active writers 2024/04/25 06:49:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:22 DEBUG : : Looking for writers 2024/04/25 06:49:22 DEBUG : file1: reading active writers 2024/04/25 06:49:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:23 DEBUG : : Looking for writers 2024/04/25 06:49:23 DEBUG : file1: reading active writers 2024/04/25 06:49:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:24 DEBUG : : Looking for writers 2024/04/25 06:49:24 DEBUG : file1: reading active writers 2024/04/25 06:49:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:25 DEBUG : : Looking for writers 2024/04/25 06:49:25 DEBUG : file1: reading active writers 2024/04/25 06:49:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:26 DEBUG : : Looking for writers 2024/04/25 06:49:26 DEBUG : file1: reading active writers 2024/04/25 06:49:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:27 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:49:27 DEBUG : : Looking for writers 2024/04/25 06:49:27 DEBUG : file1: reading active writers 2024/04/25 06:49:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:28 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5ec72b975cace5cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:28 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5ec72b975cace5cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:28 DEBUG : : Looking for writers 2024/04/25 06:49:28 DEBUG : file1: reading active writers 2024/04/25 06:49:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:29 DEBUG : : Looking for writers 2024/04/25 06:49:29 DEBUG : file1: reading active writers 2024/04/25 06:49:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:30 DEBUG : : Looking for writers 2024/04/25 06:49:30 DEBUG : file1: reading active writers 2024/04/25 06:49:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:31 DEBUG : : Looking for writers 2024/04/25 06:49:31 DEBUG : file1: reading active writers 2024/04/25 06:49:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:32 DEBUG : : Looking for writers 2024/04/25 06:49:32 DEBUG : file1: reading active writers 2024/04/25 06:49:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:33 DEBUG : : Looking for writers 2024/04/25 06:49:33 DEBUG : file1: reading active writers 2024/04/25 06:49:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:34 DEBUG : : Looking for writers 2024/04/25 06:49:34 DEBUG : file1: reading active writers 2024/04/25 06:49:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:35 DEBUG : : Looking for writers 2024/04/25 06:49:35 DEBUG : file1: reading active writers 2024/04/25 06:49:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:36 DEBUG : : Looking for writers 2024/04/25 06:49:36 DEBUG : file1: reading active writers 2024/04/25 06:49:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:37 DEBUG : : Looking for writers 2024/04/25 06:49:37 DEBUG : file1: reading active writers 2024/04/25 06:49:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:38 DEBUG : : Looking for writers 2024/04/25 06:49:38 DEBUG : file1: reading active writers 2024/04/25 06:49:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:39 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e4b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0009ea408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824644117568} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880128638835001 ext:121062788492 loc:0x3a135e0} ATime:{wall:13943880128638851843 ext:121062805333 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:49:39 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:49:41 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:49:41 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a9bee91fd70c6a97", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:49:41 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a9bee91fd70c6a97", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/04/25 06:49:47 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:49:47 DEBUG : : Looking for writers 2024/04/25 06:49:47 DEBUG : file1: reading active writers 2024/04/25 06:49:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:49:48 DEBUG : : Looking for writers 2024/04/25 06:49:48 DEBUG : file1: reading active writers 2024/04/25 06:49:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:49 DEBUG : : Looking for writers 2024/04/25 06:49:49 DEBUG : file1: reading active writers 2024/04/25 06:49:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:50 DEBUG : : Looking for writers 2024/04/25 06:49:50 DEBUG : file1: reading active writers 2024/04/25 06:49:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:51 DEBUG : : Looking for writers 2024/04/25 06:49:51 DEBUG : file1: reading active writers 2024/04/25 06:49:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:52 DEBUG : : Looking for writers 2024/04/25 06:49:52 DEBUG : file1: reading active writers 2024/04/25 06:49:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:53 DEBUG : : Looking for writers 2024/04/25 06:49:53 DEBUG : file1: reading active writers 2024/04/25 06:49:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:54 DEBUG : : Looking for writers 2024/04/25 06:49:54 DEBUG : file1: reading active writers 2024/04/25 06:49:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:55 DEBUG : : Looking for writers 2024/04/25 06:49:55 DEBUG : file1: reading active writers 2024/04/25 06:49:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:56 DEBUG : : Looking for writers 2024/04/25 06:49:56 DEBUG : file1: reading active writers 2024/04/25 06:49:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:57 DEBUG : : Looking for writers 2024/04/25 06:49:57 DEBUG : file1: reading active writers 2024/04/25 06:49:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:58 DEBUG : : Looking for writers 2024/04/25 06:49:58 DEBUG : file1: reading active writers 2024/04/25 06:49:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:49:59 DEBUG : : Looking for writers 2024/04/25 06:49:59 DEBUG : file1: reading active writers 2024/04/25 06:49:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:00 DEBUG : : Looking for writers 2024/04/25 06:50:00 DEBUG : file1: reading active writers 2024/04/25 06:50:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:01 DEBUG : : Looking for writers 2024/04/25 06:50:01 DEBUG : file1: reading active writers 2024/04/25 06:50:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:02 DEBUG : : Looking for writers 2024/04/25 06:50:02 DEBUG : file1: reading active writers 2024/04/25 06:50:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:03 DEBUG : : Looking for writers 2024/04/25 06:50:03 DEBUG : file1: reading active writers 2024/04/25 06:50:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:04 DEBUG : : Looking for writers 2024/04/25 06:50:04 DEBUG : file1: reading active writers 2024/04/25 06:50:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:05 DEBUG : : Looking for writers 2024/04/25 06:50:05 DEBUG : file1: reading active writers 2024/04/25 06:50:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:06 DEBUG : : Looking for writers 2024/04/25 06:50:06 DEBUG : file1: reading active writers 2024/04/25 06:50:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:07 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:07 DEBUG : : Looking for writers 2024/04/25 06:50:07 DEBUG : file1: reading active writers 2024/04/25 06:50:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:07 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "14f3a1f702d8a3f1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:07 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "14f3a1f702d8a3f1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:08 DEBUG : : Looking for writers 2024/04/25 06:50:08 DEBUG : file1: reading active writers 2024/04/25 06:50:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:09 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:50:09 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/25 06:50:09 DEBUG : : Looking for writers 2024/04/25 06:50:09 DEBUG : file1: reading active writers 2024/04/25 06:50:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:10 DEBUG : : Looking for writers 2024/04/25 06:50:10 DEBUG : file1: reading active writers 2024/04/25 06:50:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:11 DEBUG : : Looking for writers 2024/04/25 06:50:11 DEBUG : file1: reading active writers 2024/04/25 06:50:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:12 DEBUG : : Looking for writers 2024/04/25 06:50:12 DEBUG : file1: reading active writers 2024/04/25 06:50:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:13 DEBUG : : Looking for writers 2024/04/25 06:50:13 DEBUG : file1: reading active writers 2024/04/25 06:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:14 DEBUG : : Looking for writers 2024/04/25 06:50:14 DEBUG : file1: reading active writers 2024/04/25 06:50:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:15 DEBUG : : Looking for writers 2024/04/25 06:50:15 DEBUG : file1: reading active writers 2024/04/25 06:50:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:16 DEBUG : : Looking for writers 2024/04/25 06:50:16 DEBUG : file1: reading active writers 2024/04/25 06:50:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:50:17 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e4b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0009ea408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824644117568} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880128638835001 ext:121062788492 loc:0x3a135e0} ATime:{wall:13943880128638851843 ext:121062805333 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:50:17 DEBUG : >WaitForWriters: 2024/04/25 06:50:17 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (68.24s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:50:17 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:50:17 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:50:17 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:50:17 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:50:17 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:50:17 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:50:17 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:50:17 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:50:18 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:50:18 DEBUG : file1: newRWFileHandle: 2024/04/25 06:50:18 DEBUG : file1(0xc000b86b00): openPending: 2024/04/25 06:50:18 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:50:18 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:50:18 DEBUG : file1(0xc000b86b00): >openPending: err= 2024/04/25 06:50:18 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:50:18 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:50:18 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:50:18 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:50:18 DEBUG : file1(0xc000b86b00): close: 2024/04/25 06:50:18 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:50:18.317504651 +0000 UTC m=+189.807420155 2024/04/25 06:50:18 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:50:18 DEBUG : file1(0xc000b86b00): >close: err= 2024/04/25 06:50:18 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/04/25 06:50:18 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/04/25 06:50:18 DEBUG : file2: newRWFileHandle: 2024/04/25 06:50:18 DEBUG : file2(0xc000b86bc0): openPending: 2024/04/25 06:50:18 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:50:18 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/25 06:50:18 DEBUG : file2(0xc000b86bc0): >openPending: err= 2024/04/25 06:50:18 DEBUG : file2: >newRWFileHandle: err= 2024/04/25 06:50:18 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/25 06:50:18 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/04/25 06:50:18 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/04/25 06:50:18 DEBUG : file2(0xc000b86bc0): RWFileHandle.Flush 2024/04/25 06:50:18 DEBUG : file2(0xc000b86bc0): RWFileHandle.Release 2024/04/25 06:50:18 DEBUG : file2(0xc000b86bc0): close: 2024/04/25 06:50:18 DEBUG : file2: vfs cache: setting modification time to 2024-04-25 06:50:18.318571242 +0000 UTC m=+189.808486746 2024/04/25 06:50:18 INFO : file2: vfs cache: queuing for upload in 100ms 2024/04/25 06:50:18 DEBUG : file2(0xc000b86bc0): >close: err= 2024/04/25 06:50:18 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/25 06:50:18 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:18 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/25 06:50:18 DEBUG : : Looking for writers 2024/04/25 06:50:18 DEBUG : file2: reading active writers 2024/04/25 06:50:18 DEBUG : file1: reading active writers 2024/04/25 06:50:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/25 06:50:19 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "15b83745d3dc8edb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:19 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "15b83745d3dc8edb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:19 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:19 DEBUG : : Looking for writers 2024/04/25 06:50:19 DEBUG : file1: reading active writers 2024/04/25 06:50:19 DEBUG : file2: reading active writers 2024/04/25 06:50:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:19 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3dcec74ff7922047", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:19 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3dcec74ff7922047", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:19 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:20 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d0a3a539c2ad87f9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:20 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d0a3a539c2ad87f9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:20 DEBUG : : Looking for writers 2024/04/25 06:50:20 DEBUG : file1: reading active writers 2024/04/25 06:50:20 DEBUG : file2: reading active writers 2024/04/25 06:50:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:20 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:20 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e56320c957f548cc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:20 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e56320c957f548cc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:21 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:21 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f6397d1845b879b0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:21 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f6397d1845b879b0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:21 DEBUG : : Looking for writers 2024/04/25 06:50:21 DEBUG : file1: reading active writers 2024/04/25 06:50:21 DEBUG : file2: reading active writers 2024/04/25 06:50:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:21 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "beedcbc5f4d9abb7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:21 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "beedcbc5f4d9abb7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:22 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:22 DEBUG : : Looking for writers 2024/04/25 06:50:22 DEBUG : file1: reading active writers 2024/04/25 06:50:22 DEBUG : file2: reading active writers 2024/04/25 06:50:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "aa48a448fdf0e222", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:22 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "aa48a448fdf0e222", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:22 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:23 DEBUG : : Looking for writers 2024/04/25 06:50:23 DEBUG : file1: reading active writers 2024/04/25 06:50:23 DEBUG : file2: reading active writers 2024/04/25 06:50:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:23 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d844dec8fffda537", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:23 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d844dec8fffda537", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:24 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:24 DEBUG : : Looking for writers 2024/04/25 06:50:24 DEBUG : file1: reading active writers 2024/04/25 06:50:24 DEBUG : file2: reading active writers 2024/04/25 06:50:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:24 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7270fa9eb9bd90dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:24 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7270fa9eb9bd90dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:25 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:25 DEBUG : : Looking for writers 2024/04/25 06:50:25 DEBUG : file1: reading active writers 2024/04/25 06:50:25 DEBUG : file2: reading active writers 2024/04/25 06:50:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:25 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "136503dd577c54fc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:25 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "136503dd577c54fc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:26 DEBUG : : Looking for writers 2024/04/25 06:50:26 DEBUG : file1: reading active writers 2024/04/25 06:50:26 DEBUG : file2: reading active writers 2024/04/25 06:50:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:27 DEBUG : : Looking for writers 2024/04/25 06:50:27 DEBUG : file1: reading active writers 2024/04/25 06:50:27 DEBUG : file2: reading active writers 2024/04/25 06:50:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:28 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:28 DEBUG : : Looking for writers 2024/04/25 06:50:28 DEBUG : file2: reading active writers 2024/04/25 06:50:28 DEBUG : file1: reading active writers 2024/04/25 06:50:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:28 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9240078bfdedb54f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:28 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9240078bfdedb54f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:29 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:29 DEBUG : : Looking for writers 2024/04/25 06:50:29 DEBUG : file1: reading active writers 2024/04/25 06:50:29 DEBUG : file2: reading active writers 2024/04/25 06:50:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:29 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d79be78b52020a18", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:29 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d79be78b52020a18", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:30 DEBUG : : Looking for writers 2024/04/25 06:50:30 DEBUG : file1: reading active writers 2024/04/25 06:50:30 DEBUG : file2: reading active writers 2024/04/25 06:50:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:31 DEBUG : : Looking for writers 2024/04/25 06:50:31 DEBUG : file1: reading active writers 2024/04/25 06:50:31 DEBUG : file2: reading active writers 2024/04/25 06:50:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:32 DEBUG : : Looking for writers 2024/04/25 06:50:32 DEBUG : file1: reading active writers 2024/04/25 06:50:32 DEBUG : file2: reading active writers 2024/04/25 06:50:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:33 DEBUG : : Looking for writers 2024/04/25 06:50:33 DEBUG : file1: reading active writers 2024/04/25 06:50:33 DEBUG : file2: reading active writers 2024/04/25 06:50:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:34 DEBUG : : Looking for writers 2024/04/25 06:50:34 DEBUG : file1: reading active writers 2024/04/25 06:50:34 DEBUG : file2: reading active writers 2024/04/25 06:50:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:35 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:35 DEBUG : : Looking for writers 2024/04/25 06:50:35 DEBUG : file1: reading active writers 2024/04/25 06:50:35 DEBUG : file2: reading active writers 2024/04/25 06:50:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:36 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2574a5579e2b59fb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:36 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2574a5579e2b59fb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:36 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:50:36 DEBUG : : Looking for writers 2024/04/25 06:50:36 DEBUG : file1: reading active writers 2024/04/25 06:50:36 DEBUG : file2: reading active writers 2024/04/25 06:50:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:36 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ab13dbb292a418c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:36 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ab13dbb292a418c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:37 DEBUG : : Looking for writers 2024/04/25 06:50:37 DEBUG : file1: reading active writers 2024/04/25 06:50:37 DEBUG : file2: reading active writers 2024/04/25 06:50:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:38 DEBUG : : Looking for writers 2024/04/25 06:50:38 DEBUG : file1: reading active writers 2024/04/25 06:50:38 DEBUG : file2: reading active writers 2024/04/25 06:50:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:39 DEBUG : : Looking for writers 2024/04/25 06:50:39 DEBUG : file1: reading active writers 2024/04/25 06:50:39 DEBUG : file2: reading active writers 2024/04/25 06:50:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:40 DEBUG : : Looking for writers 2024/04/25 06:50:40 DEBUG : file1: reading active writers 2024/04/25 06:50:40 DEBUG : file2: reading active writers 2024/04/25 06:50:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:41 DEBUG : : Looking for writers 2024/04/25 06:50:41 DEBUG : file1: reading active writers 2024/04/25 06:50:41 DEBUG : file2: reading active writers 2024/04/25 06:50:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:42 DEBUG : : Looking for writers 2024/04/25 06:50:42 DEBUG : file1: reading active writers 2024/04/25 06:50:42 DEBUG : file2: reading active writers 2024/04/25 06:50:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:43 DEBUG : : Looking for writers 2024/04/25 06:50:43 DEBUG : file1: reading active writers 2024/04/25 06:50:43 DEBUG : file2: reading active writers 2024/04/25 06:50:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:44 DEBUG : : Looking for writers 2024/04/25 06:50:44 DEBUG : file1: reading active writers 2024/04/25 06:50:44 DEBUG : file2: reading active writers 2024/04/25 06:50:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:45 DEBUG : : Looking for writers 2024/04/25 06:50:45 DEBUG : file1: reading active writers 2024/04/25 06:50:45 DEBUG : file2: reading active writers 2024/04/25 06:50:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:46 DEBUG : : Looking for writers 2024/04/25 06:50:46 DEBUG : file1: reading active writers 2024/04/25 06:50:46 DEBUG : file2: reading active writers 2024/04/25 06:50:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:47 DEBUG : : Looking for writers 2024/04/25 06:50:47 DEBUG : file1: reading active writers 2024/04/25 06:50:47 DEBUG : file2: reading active writers 2024/04/25 06:50:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:48 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e5a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000c42708 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824646575936} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880202471652491 ext:189807420155 loc:0x3a135e0} ATime:{wall:13943880202471903532 ext:189807671205 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc000b5e5a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000c42808 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824646576192} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880202472719082 ext:189808486746 loc:0x3a135e0} ATime:{wall:13943880202472886496 ext:189808654160 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:50:48 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:50:48 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:50:49 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed0e673f65f55df3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:49 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed0e673f65f55df3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:49 DEBUG : file2: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:50:50 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "aff0c0e13e55f30a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:50:50 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "aff0c0e13e55f30a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:197: Not found "file1" fstest.go:197: Not found "file2" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/04/25 06:50:56 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/25 06:50:56 DEBUG : : Looking for writers 2024/04/25 06:50:56 DEBUG : file2: reading active writers 2024/04/25 06:50:56 DEBUG : file1: reading active writers 2024/04/25 06:50:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/25 06:50:57 DEBUG : : Looking for writers 2024/04/25 06:50:57 DEBUG : file1: reading active writers 2024/04/25 06:50:57 DEBUG : file2: reading active writers 2024/04/25 06:50:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:58 DEBUG : : Looking for writers 2024/04/25 06:50:58 DEBUG : file1: reading active writers 2024/04/25 06:50:58 DEBUG : file2: reading active writers 2024/04/25 06:50:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:50:59 DEBUG : : Looking for writers 2024/04/25 06:50:59 DEBUG : file1: reading active writers 2024/04/25 06:50:59 DEBUG : file2: reading active writers 2024/04/25 06:50:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:00 DEBUG : : Looking for writers 2024/04/25 06:51:00 DEBUG : file1: reading active writers 2024/04/25 06:51:00 DEBUG : file2: reading active writers 2024/04/25 06:51:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:01 DEBUG : : Looking for writers 2024/04/25 06:51:01 DEBUG : file1: reading active writers 2024/04/25 06:51:01 DEBUG : file2: reading active writers 2024/04/25 06:51:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:02 DEBUG : : Looking for writers 2024/04/25 06:51:02 DEBUG : file1: reading active writers 2024/04/25 06:51:02 DEBUG : file2: reading active writers 2024/04/25 06:51:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:03 DEBUG : : Looking for writers 2024/04/25 06:51:03 DEBUG : file1: reading active writers 2024/04/25 06:51:03 DEBUG : file2: reading active writers 2024/04/25 06:51:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:04 DEBUG : : Looking for writers 2024/04/25 06:51:04 DEBUG : file1: reading active writers 2024/04/25 06:51:04 DEBUG : file2: reading active writers 2024/04/25 06:51:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:05 DEBUG : : Looking for writers 2024/04/25 06:51:05 DEBUG : file1: reading active writers 2024/04/25 06:51:05 DEBUG : file2: reading active writers 2024/04/25 06:51:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:06 DEBUG : : Looking for writers 2024/04/25 06:51:06 DEBUG : file1: reading active writers 2024/04/25 06:51:06 DEBUG : file2: reading active writers 2024/04/25 06:51:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:07 DEBUG : : Looking for writers 2024/04/25 06:51:07 DEBUG : file1: reading active writers 2024/04/25 06:51:07 DEBUG : file2: reading active writers 2024/04/25 06:51:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:08 DEBUG : : Looking for writers 2024/04/25 06:51:08 DEBUG : file1: reading active writers 2024/04/25 06:51:08 DEBUG : file2: reading active writers 2024/04/25 06:51:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:09 DEBUG : : Looking for writers 2024/04/25 06:51:09 DEBUG : file1: reading active writers 2024/04/25 06:51:09 DEBUG : file2: reading active writers 2024/04/25 06:51:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:10 DEBUG : : Looking for writers 2024/04/25 06:51:10 DEBUG : file1: reading active writers 2024/04/25 06:51:10 DEBUG : file2: reading active writers 2024/04/25 06:51:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:11 DEBUG : : Looking for writers 2024/04/25 06:51:11 DEBUG : file1: reading active writers 2024/04/25 06:51:11 DEBUG : file2: reading active writers 2024/04/25 06:51:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:12 DEBUG : : Looking for writers 2024/04/25 06:51:12 DEBUG : file1: reading active writers 2024/04/25 06:51:12 DEBUG : file2: reading active writers 2024/04/25 06:51:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:13 DEBUG : : Looking for writers 2024/04/25 06:51:13 DEBUG : file1: reading active writers 2024/04/25 06:51:13 DEBUG : file2: reading active writers 2024/04/25 06:51:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:14 DEBUG : : Looking for writers 2024/04/25 06:51:14 DEBUG : file1: reading active writers 2024/04/25 06:51:14 DEBUG : file2: reading active writers 2024/04/25 06:51:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:15 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:51:15 DEBUG : : Looking for writers 2024/04/25 06:51:15 DEBUG : file1: reading active writers 2024/04/25 06:51:15 DEBUG : file2: reading active writers 2024/04/25 06:51:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:15 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "67658ef8f763a71b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:15 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "67658ef8f763a71b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:15 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:51:16 DEBUG : : Looking for writers 2024/04/25 06:51:16 DEBUG : file1: reading active writers 2024/04/25 06:51:16 DEBUG : file2: reading active writers 2024/04/25 06:51:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:17 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5f17425fc1723cb9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:17 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5f17425fc1723cb9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:17 DEBUG : : Looking for writers 2024/04/25 06:51:17 DEBUG : file2: reading active writers 2024/04/25 06:51:17 DEBUG : file1: reading active writers 2024/04/25 06:51:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:17 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:51:17 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/04/25 06:51:17 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/04/25 06:51:18 DEBUG : : Looking for writers 2024/04/25 06:51:18 DEBUG : file1: reading active writers 2024/04/25 06:51:18 DEBUG : file2: reading active writers 2024/04/25 06:51:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:19 DEBUG : : Looking for writers 2024/04/25 06:51:19 DEBUG : file1: reading active writers 2024/04/25 06:51:19 DEBUG : file2: reading active writers 2024/04/25 06:51:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:20 DEBUG : : Looking for writers 2024/04/25 06:51:20 DEBUG : file1: reading active writers 2024/04/25 06:51:20 DEBUG : file2: reading active writers 2024/04/25 06:51:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:21 DEBUG : : Looking for writers 2024/04/25 06:51:21 DEBUG : file2: reading active writers 2024/04/25 06:51:21 DEBUG : file1: reading active writers 2024/04/25 06:51:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:22 DEBUG : : Looking for writers 2024/04/25 06:51:22 DEBUG : file1: reading active writers 2024/04/25 06:51:22 DEBUG : file2: reading active writers 2024/04/25 06:51:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:23 DEBUG : : Looking for writers 2024/04/25 06:51:23 DEBUG : file1: reading active writers 2024/04/25 06:51:23 DEBUG : file2: reading active writers 2024/04/25 06:51:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:24 DEBUG : : Looking for writers 2024/04/25 06:51:24 DEBUG : file1: reading active writers 2024/04/25 06:51:24 DEBUG : file2: reading active writers 2024/04/25 06:51:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:25 DEBUG : : Looking for writers 2024/04/25 06:51:25 DEBUG : file1: reading active writers 2024/04/25 06:51:25 DEBUG : file2: reading active writers 2024/04/25 06:51:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:51:26 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e5a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000c42708 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824646575936} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880202471652491 ext:189807420155 loc:0x3a135e0} ATime:{wall:13943880202471903532 ext:189807671205 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc000b5e5a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000c42808 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824646576192} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943880202472719082 ext:189808486746 loc:0x3a135e0} ATime:{wall:13943880202472886496 ext:189808654160 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:51:26 DEBUG : >WaitForWriters: 2024/04/25 06:51:26 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (68.94s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:51:26 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:51:26 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:51:26 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:26 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:26 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:26 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:26 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c454566e16c4146b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:27 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:51:27 DEBUG : : Looking for writers 2024/04/25 06:51:27 DEBUG : >WaitForWriters: 2024/04/25 06:51:27 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (1.01s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:51:27 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:51:27 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:51:27 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:27 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:27 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:27 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:27 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "456d286bf681deeb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:28 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:51:28 DEBUG : : Looking for writers 2024/04/25 06:51:28 DEBUG : >WaitForWriters: 2024/04/25 06:51:28 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (0.84s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:51:28 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:51:28 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:51:28 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:28 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:28 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:28 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-zehuxuq9cifafaf4puhudul7" 2024/04/25 06:51:28 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:51:28 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:51:28 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:51:28 DEBUG : file1: newRWFileHandle: 2024/04/25 06:51:28 DEBUG : file1(0xc000b87840): openPending: 2024/04/25 06:51:28 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:51:28 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:51:28 DEBUG : file1(0xc000b87840): >openPending: err= 2024/04/25 06:51:28 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:51:28 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:51:28 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:51:28 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6b8d5a32f3ad3ab0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:51:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:51:29 DEBUG : : Looking for writers 2024/04/25 06:51:29 DEBUG : file1: reading active writers 2024/04/25 06:51:29 DEBUG : file1: active writers 1 2024/04/25 06:51:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:51:30 DEBUG : : Looking for writers 2024/04/25 06:51:30 DEBUG : file1: reading active writers 2024/04/25 06:51:30 DEBUG : file1: active writers 1 2024/04/25 06:51:30 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:31 DEBUG : : Looking for writers 2024/04/25 06:51:31 DEBUG : file1: reading active writers 2024/04/25 06:51:31 DEBUG : file1: active writers 1 2024/04/25 06:51:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:32 DEBUG : : Looking for writers 2024/04/25 06:51:32 DEBUG : file1: reading active writers 2024/04/25 06:51:32 DEBUG : file1: active writers 1 2024/04/25 06:51:32 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:33 DEBUG : : Looking for writers 2024/04/25 06:51:33 DEBUG : file1: reading active writers 2024/04/25 06:51:33 DEBUG : file1: active writers 1 2024/04/25 06:51:33 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:34 DEBUG : : Looking for writers 2024/04/25 06:51:34 DEBUG : file1: reading active writers 2024/04/25 06:51:34 DEBUG : file1: active writers 1 2024/04/25 06:51:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:35 DEBUG : : Looking for writers 2024/04/25 06:51:35 DEBUG : file1: reading active writers 2024/04/25 06:51:35 DEBUG : file1: active writers 1 2024/04/25 06:51:35 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:36 DEBUG : : Looking for writers 2024/04/25 06:51:36 DEBUG : file1: reading active writers 2024/04/25 06:51:36 DEBUG : file1: active writers 1 2024/04/25 06:51:36 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:37 DEBUG : : Looking for writers 2024/04/25 06:51:37 DEBUG : file1: reading active writers 2024/04/25 06:51:37 DEBUG : file1: active writers 1 2024/04/25 06:51:37 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:38 DEBUG : : Looking for writers 2024/04/25 06:51:38 DEBUG : file1: reading active writers 2024/04/25 06:51:38 DEBUG : file1: active writers 1 2024/04/25 06:51:38 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:39 DEBUG : : Looking for writers 2024/04/25 06:51:39 DEBUG : file1: reading active writers 2024/04/25 06:51:39 DEBUG : file1: active writers 1 2024/04/25 06:51:39 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:40 DEBUG : : Looking for writers 2024/04/25 06:51:40 DEBUG : file1: reading active writers 2024/04/25 06:51:40 DEBUG : file1: active writers 1 2024/04/25 06:51:40 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:41 DEBUG : : Looking for writers 2024/04/25 06:51:41 DEBUG : file1: reading active writers 2024/04/25 06:51:41 DEBUG : file1: active writers 1 2024/04/25 06:51:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:42 DEBUG : : Looking for writers 2024/04/25 06:51:42 DEBUG : file1: reading active writers 2024/04/25 06:51:42 DEBUG : file1: active writers 1 2024/04/25 06:51:42 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:43 DEBUG : : Looking for writers 2024/04/25 06:51:43 DEBUG : file1: reading active writers 2024/04/25 06:51:43 DEBUG : file1: active writers 1 2024/04/25 06:51:43 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:44 DEBUG : : Looking for writers 2024/04/25 06:51:44 DEBUG : file1: reading active writers 2024/04/25 06:51:44 DEBUG : file1: active writers 1 2024/04/25 06:51:44 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:45 DEBUG : : Looking for writers 2024/04/25 06:51:45 DEBUG : file1: reading active writers 2024/04/25 06:51:45 DEBUG : file1: active writers 1 2024/04/25 06:51:45 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:46 DEBUG : : Looking for writers 2024/04/25 06:51:46 DEBUG : file1: reading active writers 2024/04/25 06:51:46 DEBUG : file1: active writers 1 2024/04/25 06:51:46 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:47 DEBUG : : Looking for writers 2024/04/25 06:51:47 DEBUG : file1: reading active writers 2024/04/25 06:51:47 DEBUG : file1: active writers 1 2024/04/25 06:51:47 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:48 DEBUG : : Looking for writers 2024/04/25 06:51:48 DEBUG : file1: reading active writers 2024/04/25 06:51:48 DEBUG : file1: active writers 1 2024/04/25 06:51:48 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:49 DEBUG : : Looking for writers 2024/04/25 06:51:49 DEBUG : file1: reading active writers 2024/04/25 06:51:49 DEBUG : file1: active writers 1 2024/04/25 06:51:49 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:50 DEBUG : : Looking for writers 2024/04/25 06:51:50 DEBUG : file1: reading active writers 2024/04/25 06:51:50 DEBUG : file1: active writers 1 2024/04/25 06:51:50 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:51 DEBUG : : Looking for writers 2024/04/25 06:51:51 DEBUG : file1: reading active writers 2024/04/25 06:51:51 DEBUG : file1: active writers 1 2024/04/25 06:51:51 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:52 DEBUG : : Looking for writers 2024/04/25 06:51:52 DEBUG : file1: reading active writers 2024/04/25 06:51:52 DEBUG : file1: active writers 1 2024/04/25 06:51:52 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:53 DEBUG : : Looking for writers 2024/04/25 06:51:53 DEBUG : file1: reading active writers 2024/04/25 06:51:53 DEBUG : file1: active writers 1 2024/04/25 06:51:53 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:54 DEBUG : : Looking for writers 2024/04/25 06:51:54 DEBUG : file1: reading active writers 2024/04/25 06:51:54 DEBUG : file1: active writers 1 2024/04/25 06:51:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:55 DEBUG : : Looking for writers 2024/04/25 06:51:55 DEBUG : file1: reading active writers 2024/04/25 06:51:55 DEBUG : file1: active writers 1 2024/04/25 06:51:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:56 DEBUG : : Looking for writers 2024/04/25 06:51:56 DEBUG : file1: reading active writers 2024/04/25 06:51:56 DEBUG : file1: active writers 1 2024/04/25 06:51:56 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:57 DEBUG : : Looking for writers 2024/04/25 06:51:57 DEBUG : file1: reading active writers 2024/04/25 06:51:57 DEBUG : file1: active writers 1 2024/04/25 06:51:57 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:58 DEBUG : : Looking for writers 2024/04/25 06:51:58 DEBUG : file1: reading active writers 2024/04/25 06:51:58 DEBUG : file1: active writers 1 2024/04/25 06:51:58 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:51:59 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000b5e870 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aeb908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645171520} name:file1 opens:1 downloaders: o: fd:0xc00008b500 info:{ModTime:{wall:13943880277902553342 ext:260076393315 loc:0x3a135e0} ATime:{wall:13943880277902553342 ext:260076393315 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/04/25 06:51:59 DEBUG : >WaitForWriters: 2024/04/25 06:51:59 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.09s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "be4db14e9bb4a695", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (0.84s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "96e8b972195752bb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (1.28s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:01 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:01 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9311a613da519f86", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:02 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:02 DEBUG : : Looking for writers 2024/04/25 06:52:02 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (0.83s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:02 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:02 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "66f97009a689887a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:02 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:02 DEBUG : : Looking for writers 2024/04/25 06:52:02 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (0.84s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:03 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:03 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0e6f4940cdb6e0f6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:03 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:03 DEBUG : : Looking for writers 2024/04/25 06:52:03 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (0.83s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:04 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:04 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ff8aaf33475b3e3f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:04 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:04 DEBUG : : Looking for writers 2024/04/25 06:52:04 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (0.84s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:04 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:04 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:04 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:05 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:05 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:05 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:05 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:05 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:05 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/25 06:52:05 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/25 06:52:05 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/04/25 06:52:05 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (5 bytes), uploading instead of streaming 2024/04/25 06:52:05 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "269eacd791d24f38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:05 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "269eacd791d24f38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:05 DEBUG : file1: Remove: 2024/04/25 06:52:05 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:05 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "269eacd791d24f38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/04/25 06:52:13 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:13 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:13 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:13 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:13 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:13 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:13 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:52:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62baedaaacfd240e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:14 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62baedaaacfd240e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:14 DEBUG : file1: Remove: 2024/04/25 06:52:14 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:14 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62baedaaacfd240e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/04/25 06:52:14 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:14 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:14 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:14 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:14 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:14 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/04/25 06:52:14 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/04/25 06:52:14 DEBUG : : Looking for writers 2024/04/25 06:52:14 DEBUG : file1: reading active writers 2024/04/25 06:52:14 DEBUG : file1: active writers 1 2024/04/25 06:52:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/04/25 06:52:15 DEBUG : : Looking for writers 2024/04/25 06:52:15 DEBUG : file1: reading active writers 2024/04/25 06:52:15 DEBUG : file1: active writers 1 2024/04/25 06:52:15 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:16 DEBUG : : Looking for writers 2024/04/25 06:52:16 DEBUG : file1: reading active writers 2024/04/25 06:52:16 DEBUG : file1: active writers 1 2024/04/25 06:52:16 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:17 DEBUG : : Looking for writers 2024/04/25 06:52:17 DEBUG : file1: reading active writers 2024/04/25 06:52:17 DEBUG : file1: active writers 1 2024/04/25 06:52:17 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:18 DEBUG : : Looking for writers 2024/04/25 06:52:18 DEBUG : file1: reading active writers 2024/04/25 06:52:18 DEBUG : file1: active writers 1 2024/04/25 06:52:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:19 DEBUG : : Looking for writers 2024/04/25 06:52:19 DEBUG : file1: reading active writers 2024/04/25 06:52:19 DEBUG : file1: active writers 1 2024/04/25 06:52:19 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:20 DEBUG : : Looking for writers 2024/04/25 06:52:20 DEBUG : file1: reading active writers 2024/04/25 06:52:20 DEBUG : file1: active writers 1 2024/04/25 06:52:20 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:21 DEBUG : : Looking for writers 2024/04/25 06:52:21 DEBUG : file1: reading active writers 2024/04/25 06:52:21 DEBUG : file1: active writers 1 2024/04/25 06:52:21 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:22 DEBUG : : Looking for writers 2024/04/25 06:52:22 DEBUG : file1: reading active writers 2024/04/25 06:52:22 DEBUG : file1: active writers 1 2024/04/25 06:52:22 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:23 DEBUG : : Looking for writers 2024/04/25 06:52:23 DEBUG : file1: reading active writers 2024/04/25 06:52:23 DEBUG : file1: active writers 1 2024/04/25 06:52:23 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:24 DEBUG : : Looking for writers 2024/04/25 06:52:24 DEBUG : file1: reading active writers 2024/04/25 06:52:24 DEBUG : file1: active writers 1 2024/04/25 06:52:24 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:25 DEBUG : : Looking for writers 2024/04/25 06:52:25 DEBUG : file1: reading active writers 2024/04/25 06:52:25 DEBUG : file1: active writers 1 2024/04/25 06:52:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:26 DEBUG : : Looking for writers 2024/04/25 06:52:26 DEBUG : file1: reading active writers 2024/04/25 06:52:26 DEBUG : file1: active writers 1 2024/04/25 06:52:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:27 DEBUG : : Looking for writers 2024/04/25 06:52:27 DEBUG : file1: reading active writers 2024/04/25 06:52:27 DEBUG : file1: active writers 1 2024/04/25 06:52:27 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:28 DEBUG : : Looking for writers 2024/04/25 06:52:28 DEBUG : file1: reading active writers 2024/04/25 06:52:28 DEBUG : file1: active writers 1 2024/04/25 06:52:28 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:29 DEBUG : : Looking for writers 2024/04/25 06:52:29 DEBUG : file1: reading active writers 2024/04/25 06:52:29 DEBUG : file1: active writers 1 2024/04/25 06:52:29 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:30 DEBUG : : Looking for writers 2024/04/25 06:52:30 DEBUG : file1: reading active writers 2024/04/25 06:52:30 DEBUG : file1: active writers 1 2024/04/25 06:52:30 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:31 DEBUG : : Looking for writers 2024/04/25 06:52:31 DEBUG : file1: reading active writers 2024/04/25 06:52:31 DEBUG : file1: active writers 1 2024/04/25 06:52:31 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:32 DEBUG : : Looking for writers 2024/04/25 06:52:32 DEBUG : file1: reading active writers 2024/04/25 06:52:32 DEBUG : file1: active writers 1 2024/04/25 06:52:32 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:33 DEBUG : : Looking for writers 2024/04/25 06:52:33 DEBUG : file1: reading active writers 2024/04/25 06:52:33 DEBUG : file1: active writers 1 2024/04/25 06:52:33 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:34 DEBUG : : Looking for writers 2024/04/25 06:52:34 DEBUG : file1: reading active writers 2024/04/25 06:52:34 DEBUG : file1: active writers 1 2024/04/25 06:52:34 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:35 DEBUG : : Looking for writers 2024/04/25 06:52:35 DEBUG : file1: reading active writers 2024/04/25 06:52:35 DEBUG : file1: active writers 1 2024/04/25 06:52:35 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:36 DEBUG : : Looking for writers 2024/04/25 06:52:36 DEBUG : file1: reading active writers 2024/04/25 06:52:36 DEBUG : file1: active writers 1 2024/04/25 06:52:36 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:37 DEBUG : : Looking for writers 2024/04/25 06:52:37 DEBUG : file1: reading active writers 2024/04/25 06:52:37 DEBUG : file1: active writers 1 2024/04/25 06:52:37 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:38 DEBUG : : Looking for writers 2024/04/25 06:52:38 DEBUG : file1: reading active writers 2024/04/25 06:52:38 DEBUG : file1: active writers 1 2024/04/25 06:52:38 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:39 DEBUG : : Looking for writers 2024/04/25 06:52:39 DEBUG : file1: reading active writers 2024/04/25 06:52:39 DEBUG : file1: active writers 1 2024/04/25 06:52:39 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:40 DEBUG : : Looking for writers 2024/04/25 06:52:40 DEBUG : file1: reading active writers 2024/04/25 06:52:40 DEBUG : file1: active writers 1 2024/04/25 06:52:40 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:41 DEBUG : : Looking for writers 2024/04/25 06:52:41 DEBUG : file1: reading active writers 2024/04/25 06:52:41 DEBUG : file1: active writers 1 2024/04/25 06:52:41 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:42 DEBUG : : Looking for writers 2024/04/25 06:52:42 DEBUG : file1: reading active writers 2024/04/25 06:52:42 DEBUG : file1: active writers 1 2024/04/25 06:52:42 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:43 DEBUG : : Looking for writers 2024/04/25 06:52:43 DEBUG : file1: reading active writers 2024/04/25 06:52:43 DEBUG : file1: active writers 1 2024/04/25 06:52:43 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:52:44 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/04/25 06:52:44 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (39.40s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:44 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:44 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:44 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:44 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:44 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:44 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:44 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:44 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:44 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/04/25 06:52:45 DEBUG : file1: aborting in-sequence write wait, off=100 2024/04/25 06:52:45 DEBUG : file1: failed to wait for in-sequence write to 100 2024/04/25 06:52:45 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/04/25 06:52:45 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (11 bytes), uploading instead of streaming 2024/04/25 06:52:46 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2a1edba629f3ac0c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:46 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2a1edba629f3ac0c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:46 DEBUG : file1: Remove: 2024/04/25 06:52:46 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:46 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2a1edba629f3ac0c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/04/25 06:52:46 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/04/25 06:52:53 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:53 DEBUG : : Looking for writers 2024/04/25 06:52:53 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (9.88s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:54 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:54 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:54 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:54 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:54 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:54 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:54 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:54 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/04/25 06:52:54 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:54 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (5 bytes), uploading instead of streaming 2024/04/25 06:52:55 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f79de7e8cad9958", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:55 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f79de7e8cad9958", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:55 DEBUG : file1: Remove: 2024/04/25 06:52:55 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:55 DEBUG : file1: >Remove: err= 2024/04/25 06:52:55 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f79de7e8cad9958", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f79de7e8cad9958", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/04/25 06:52:55 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/04/25 06:52:55 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:55 DEBUG : : Looking for writers 2024/04/25 06:52:55 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (1.08s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:55 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:55 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:55 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:55 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:55 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:55 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:55 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:55 DEBUG : file1: WriteFileHandle.Release closing 2024/04/25 06:52:55 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:55 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:52:56 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0f14c6b6ea1e0441", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:56 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0f14c6b6ea1e0441", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:56 DEBUG : file1: Remove: 2024/04/25 06:52:56 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:56 DEBUG : file1: >Remove: err= 2024/04/25 06:52:56 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0f14c6b6ea1e0441", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0f14c6b6ea1e0441", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/04/25 06:52:56 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/04/25 06:52:56 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:56 DEBUG : : Looking for writers 2024/04/25 06:52:56 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.09s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:56 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:56 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:56 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:56 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:56 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:56 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:56 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:56 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:56 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (2 bytes), uploading instead of streaming 2024/04/25 06:52:57 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "95a6bccf42284782", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:57 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "95a6bccf42284782", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:57 DEBUG : file1: Remove: 2024/04/25 06:52:57 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:57 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "95a6bccf42284782", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/04/25 06:52:57 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:57 DEBUG : : Looking for writers 2024/04/25 06:52:57 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.08s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:57 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:57 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:57 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:57 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:57 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:57 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:57 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:57 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:57 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:52:58 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "73b4fbb42454541a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:58 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "73b4fbb42454541a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:58 DEBUG : file1: Remove: 2024/04/25 06:52:58 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:58 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "73b4fbb42454541a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/04/25 06:52:58 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/25 06:52:58 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/04/25 06:52:58 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:58 DEBUG : : Looking for writers 2024/04/25 06:52:58 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (1.08s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7", Local "Local file system at /tmp/rclone2740296403", Modify Window "876000h0m0s" 2024/04/25 06:52:58 INFO : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: poll-interval is not supported by this remote 2024/04/25 06:52:58 NOTICE: QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:52:58 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:52:58 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:52:58 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:58 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:52:58 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:52:58 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:52:58 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: File to upload is small (100 bytes), uploading instead of streaming 2024/04/25 06:52:59 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b7d229b3f04ee38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:59 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b7d229b3f04ee38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:52:59 DEBUG : file1: Remove: 2024/04/25 06:52:59 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:52:59 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b7d229b3f04ee38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/04/25 06:52:59 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/25 06:52:59 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/04/25 06:52:59 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:52:59 DEBUG : : Looking for writers 2024/04/25 06:52:59 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.08s) FAIL 2024/04/25 06:52:59 DEBUG : QingStor bucket rclone-test-zehuxuq9cifafaf4puhudul7: Purge dir "" 2024/04/25 06:53:00 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "fe99c6f6fd5b4f43", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:53:00 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 5m51.570623526s (try 5/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]