"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 4/5) 2024/04/25 06:41:19 DEBUG : Creating backend with remote "TestQingStor:rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:19 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/25 06:41:19 DEBUG : Creating backend with remote "/tmp/rclone2551513565" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:19 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:19 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3ed1d0f8ba7ec242", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:21 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:21 DEBUG : : Looking for writers 2024/04/25 06:41:21 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (2.16s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:21 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:21 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b3f0d7ba9c119c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:22 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:22 DEBUG : : Looking for writers 2024/04/25 06:41:22 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (1.35s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:23 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:23 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4207c6e28aa9d49f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:23 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:23 DEBUG : : Looking for writers 2024/04/25 06:41:23 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (0.81s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:24 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:24 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "46eb6a30574c5b38", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:24 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:24 DEBUG : : Looking for writers 2024/04/25 06:41:24 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (0.82s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:24 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:24 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9115006a763cb1a9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:25 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:25 DEBUG : : Looking for writers 2024/04/25 06:41:25 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (0.99s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:25 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:25 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2803996636601804", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:26 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:26 DEBUG : : Looking for writers 2024/04/25 06:41:26 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (0.84s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:26 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:26 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "41ff541650804dc4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:27 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:27 DEBUG : : Looking for writers 2024/04/25 06:41:27 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (0.83s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:27 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:27 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2e516a2d105136dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:28 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:28 DEBUG : : Looking for writers 2024/04/25 06:41:28 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (0.83s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:28 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:28 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e543bd7f2b53b01c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:28 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:28 DEBUG : : Looking for writers 2024/04/25 06:41:28 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (0.82s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:29 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:29 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2176d2cb4d434a95", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:29 DEBUG : : Looking for writers 2024/04/25 06:41:29 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (0.83s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:29 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:29 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7fec292855b758b0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:30 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:30 DEBUG : : Looking for writers 2024/04/25 06:41:30 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (0.84s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:30 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:30 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6d175301686afd11", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:31 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:31 DEBUG : : Looking for writers 2024/04/25 06:41:31 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (0.83s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:31 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:31 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b0531ec5e36dc63c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:32 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:32 DEBUG : : Looking for writers 2024/04/25 06:41:32 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (0.82s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:32 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:32 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "207fbf2f2eb14293", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:33 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:33 DEBUG : : Looking for writers 2024/04/25 06:41:33 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (0.83s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:33 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:33 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "755077dd28e890a6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:33 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:33 DEBUG : : Looking for writers 2024/04/25 06:41:33 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (0.83s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:34 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:34 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "55645088fe798536", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:35 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:35 DEBUG : : Looking for writers 2024/04/25 06:41:35 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (1.28s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:35 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:35 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bb123243d2dd1389", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:35 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:35 DEBUG : : Looking for writers 2024/04/25 06:41:35 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (0.82s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:36 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:36 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8fa043ad587e7ec6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:36 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:36 DEBUG : : Looking for writers 2024/04/25 06:41:36 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (0.83s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:37 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:37 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "299fd533959c7f3e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:37 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:37 DEBUG : : Looking for writers 2024/04/25 06:41:37 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (1.35s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:38 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:38 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6a98ca4d0d2244dc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:38 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:38 DEBUG : : Looking for writers 2024/04/25 06:41:38 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:39 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:39 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f1ccba6f38a77fb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:39 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:39 DEBUG : : Looking for writers 2024/04/25 06:41:39 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:40 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:40 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a012d302dfab584e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:40 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:40 DEBUG : : Looking for writers 2024/04/25 06:41:40 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:40 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:40 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:40 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:40 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:40 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1df0137d95ffd079", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:41 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:41 DEBUG : : Looking for writers 2024/04/25 06:41:41 DEBUG : >WaitForWriters: 2024/04/25 06:41:41 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:41 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:41 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:41 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:41 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:41 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cd0071a16366aac0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:42 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:42 DEBUG : : Looking for writers 2024/04/25 06:41:42 DEBUG : >WaitForWriters: 2024/04/25 06:41:42 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:42 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:42 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:42 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:42 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:42 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "23d0db9639298f3d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:43 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:43 DEBUG : : Looking for writers 2024/04/25 06:41:43 DEBUG : >WaitForWriters: 2024/04/25 06:41:43 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (5.01s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (0.84s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (0.83s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (0.83s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (0.83s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (0.84s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (0.83s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:43 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:43 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cad41d4b7c00fa04", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:43 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:43 DEBUG : : Looking for writers 2024/04/25 06:41:43 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (0.84s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:44 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:44 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72fd12f30a920e0e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:44 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:44 DEBUG : : Looking for writers 2024/04/25 06:41:44 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (0.83s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:45 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:45 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3141974d37263e71", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:45 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:45 DEBUG : : Looking for writers 2024/04/25 06:41:45 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (0.82s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:45 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:45 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c8c695e313d1661f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:46 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:46 DEBUG : : Looking for writers 2024/04/25 06:41:46 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (0.82s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:46 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:46 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6366d3337b6c090c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:47 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:47 DEBUG : : Looking for writers 2024/04/25 06:41:47 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (0.84s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:47 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:47 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1406b2b9256774f9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:48 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:48 DEBUG : : Looking for writers 2024/04/25 06:41:48 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:48 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:48 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:41:48 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:48 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:48 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:48 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:48 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:48 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "40ba62106e953cd1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:48 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:48 DEBUG : : Looking for writers 2024/04/25 06:41:48 DEBUG : >WaitForWriters: 2024/04/25 06:41:48 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:49 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:49 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:41:49 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:49 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:49 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:49 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:49 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:49 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "89107b5c83e2c8c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:49 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:49 DEBUG : : Looking for writers 2024/04/25 06:41:49 DEBUG : >WaitForWriters: 2024/04/25 06:41:49 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:50 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:50 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:50 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:50 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:50 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:50 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:50 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "19a036afe774db7d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:52 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:52 DEBUG : : Looking for writers 2024/04/25 06:41:52 DEBUG : >WaitForWriters: 2024/04/25 06:41:52 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:52 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:52 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:52 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:52 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:52 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d08c6e9ba59ea10d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:52 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:52 DEBUG : : Looking for writers 2024/04/25 06:41:52 DEBUG : >WaitForWriters: 2024/04/25 06:41:52 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:53 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:53 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:53 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:53 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:53 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a403740d346fe604", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:53 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:53 DEBUG : : Looking for writers 2024/04/25 06:41:53 DEBUG : >WaitForWriters: 2024/04/25 06:41:53 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (6.47s) --- FAIL: TestFileRename/off,forceCache=false (0.83s) --- FAIL: TestFileRename/minimal,forceCache=false (0.83s) --- FAIL: TestFileRename/minimal,forceCache=true (0.83s) --- FAIL: TestFileRename/writes,forceCache=false (2.29s) --- FAIL: TestFileRename/writes,forceCache=true (0.83s) --- FAIL: TestFileRename/full,forceCache=false (0.85s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:54 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:54 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5290228a7e0fa08a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:54 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:54 DEBUG : : Looking for writers 2024/04/25 06:41:54 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (0.84s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:54 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:54 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "376a9baeb5187807", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:55 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:55 DEBUG : : Looking for writers 2024/04/25 06:41:55 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (0.84s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:55 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:55 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "86fde2c1839d7b8f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:56 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:56 DEBUG : : Looking for writers 2024/04/25 06:41:56 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (0.85s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:56 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:56 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "99fc9b7d71f40dec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:57 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:57 DEBUG : : Looking for writers 2024/04/25 06:41:57 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (0.85s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:57 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:57 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c2e9d3c3a32261f9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:57 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:57 DEBUG : : Looking for writers 2024/04/25 06:41:57 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (0.86s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:58 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:58 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:58 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:58 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:58 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:58 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:58 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e6b26e79b60d46c7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:58 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:58 DEBUG : : Looking for writers 2024/04/25 06:41:58 DEBUG : >WaitForWriters: 2024/04/25 06:41:58 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (0.85s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:59 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:59 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:59 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0a89e6a725330455", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:41:59 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:41:59 DEBUG : : Looking for writers 2024/04/25 06:41:59 DEBUG : >WaitForWriters: 2024/04/25 06:41:59 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (0.85s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:41:59 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:41:59 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:41:59 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:41:59 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "962cb2875f1a236e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:00 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:42:00 DEBUG : : Looking for writers 2024/04/25 06:42:00 DEBUG : >WaitForWriters: 2024/04/25 06:42:00 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (0.83s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:42:00 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:42:00 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:42:00 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:00 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:00 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8f58a6e7e7cdf0bf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:01 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:42:01 DEBUG : : Looking for writers 2024/04/25 06:42:01 DEBUG : >WaitForWriters: 2024/04/25 06:42:01 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (0.85s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:42:01 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:42:01 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:42:01 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:01 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:01 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:01 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:01 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f5a22a7c45f3b45a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:02 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:42:02 DEBUG : : Looking for writers 2024/04/25 06:42:02 DEBUG : >WaitForWriters: 2024/04/25 06:42:02 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (0.83s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:42:02 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:42:02 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:42:02 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:02 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:02 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:02 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:42:02 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:42:02 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:42:02 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:42:02 DEBUG : file1: newRWFileHandle: 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): openPending: 2024/04/25 06:42:02 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:42:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): >openPending: err= 2024/04/25 06:42:02 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:42:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:42:02 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:42:02 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): _writeAt: size=5, off=0 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): >_writeAt: n=5, err= 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): _writeAt: size=7, off=5 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): >_writeAt: n=7, err= 2024/04/25 06:42:02 DEBUG : file1: vfs cache: truncate to size=11 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): close: 2024/04/25 06:42:02 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:42:02.708217178 +0000 UTC m=+43.066480311 2024/04/25 06:42:02 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): >close: err= 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): close: 2024/04/25 06:42:02 DEBUG : file1(0xc000b1c180): >close: err=file already closed 2024/04/25 06:42:02 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:42:02 DEBUG : : Looking for writers 2024/04/25 06:42:02 DEBUG : file1: reading active writers 2024/04/25 06:42:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:42:02 DEBUG : : Looking for writers 2024/04/25 06:42:02 DEBUG : file1: reading active writers 2024/04/25 06:42:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:42:02 DEBUG : : Looking for writers 2024/04/25 06:42:02 DEBUG : file1: reading active writers 2024/04/25 06:42:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:42:02 DEBUG : : Looking for writers 2024/04/25 06:42:02 DEBUG : file1: reading active writers 2024/04/25 06:42:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:42:02 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:02 DEBUG : : Looking for writers 2024/04/25 06:42:02 DEBUG : file1: reading active writers 2024/04/25 06:42:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:42:03 DEBUG : : Looking for writers 2024/04/25 06:42:03 DEBUG : file1: reading active writers 2024/04/25 06:42:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:42:03 DEBUG : : Looking for writers 2024/04/25 06:42:03 DEBUG : file1: reading active writers 2024/04/25 06:42:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:42:03 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e9068a4030363b2d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:03 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e9068a4030363b2d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:03 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:03 DEBUG : : Looking for writers 2024/04/25 06:42:03 DEBUG : file1: reading active writers 2024/04/25 06:42:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:04 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7b8a65bb24810389", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:04 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7b8a65bb24810389", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:04 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:04 DEBUG : : Looking for writers 2024/04/25 06:42:04 DEBUG : file1: reading active writers 2024/04/25 06:42:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:05 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "64d1b49986c41377", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:05 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "64d1b49986c41377", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:05 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:05 DEBUG : : Looking for writers 2024/04/25 06:42:05 DEBUG : file1: reading active writers 2024/04/25 06:42:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c65d8df3891a88cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:06 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c65d8df3891a88cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:06 DEBUG : : Looking for writers 2024/04/25 06:42:06 DEBUG : file1: reading active writers 2024/04/25 06:42:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:07 DEBUG : : Looking for writers 2024/04/25 06:42:07 DEBUG : file1: reading active writers 2024/04/25 06:42:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:08 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:08 DEBUG : : Looking for writers 2024/04/25 06:42:08 DEBUG : file1: reading active writers 2024/04/25 06:42:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0d63c352653a9273", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:09 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0d63c352653a9273", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:09 DEBUG : : Looking for writers 2024/04/25 06:42:09 DEBUG : file1: reading active writers 2024/04/25 06:42:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:10 DEBUG : : Looking for writers 2024/04/25 06:42:10 DEBUG : file1: reading active writers 2024/04/25 06:42:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:11 DEBUG : : Looking for writers 2024/04/25 06:42:11 DEBUG : file1: reading active writers 2024/04/25 06:42:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:12 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:12 DEBUG : : Looking for writers 2024/04/25 06:42:12 DEBUG : file1: reading active writers 2024/04/25 06:42:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:13 DEBUG : : Looking for writers 2024/04/25 06:42:13 DEBUG : file1: reading active writers 2024/04/25 06:42:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e4a9c67f19c5995f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:14 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e4a9c67f19c5995f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:14 DEBUG : : Looking for writers 2024/04/25 06:42:14 DEBUG : file1: reading active writers 2024/04/25 06:42:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:15 DEBUG : : Looking for writers 2024/04/25 06:42:15 DEBUG : file1: reading active writers 2024/04/25 06:42:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:16 DEBUG : : Looking for writers 2024/04/25 06:42:16 DEBUG : file1: reading active writers 2024/04/25 06:42:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:17 DEBUG : : Looking for writers 2024/04/25 06:42:17 DEBUG : file1: reading active writers 2024/04/25 06:42:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:18 DEBUG : : Looking for writers 2024/04/25 06:42:18 DEBUG : file1: reading active writers 2024/04/25 06:42:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:19 DEBUG : : Looking for writers 2024/04/25 06:42:19 DEBUG : file1: reading active writers 2024/04/25 06:42:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:20 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:42:20 DEBUG : : Looking for writers 2024/04/25 06:42:20 DEBUG : file1: reading active writers 2024/04/25 06:42:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:21 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "401b3722b8280839", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:21 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "401b3722b8280839", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:21 DEBUG : : Looking for writers 2024/04/25 06:42:21 DEBUG : file1: reading active writers 2024/04/25 06:42:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:22 DEBUG : : Looking for writers 2024/04/25 06:42:22 DEBUG : file1: reading active writers 2024/04/25 06:42:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:23 DEBUG : : Looking for writers 2024/04/25 06:42:23 DEBUG : file1: reading active writers 2024/04/25 06:42:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:24 DEBUG : : Looking for writers 2024/04/25 06:42:24 DEBUG : file1: reading active writers 2024/04/25 06:42:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:25 DEBUG : : Looking for writers 2024/04/25 06:42:25 DEBUG : file1: reading active writers 2024/04/25 06:42:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:26 DEBUG : : Looking for writers 2024/04/25 06:42:26 DEBUG : file1: reading active writers 2024/04/25 06:42:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:27 DEBUG : : Looking for writers 2024/04/25 06:42:27 DEBUG : file1: reading active writers 2024/04/25 06:42:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:28 DEBUG : : Looking for writers 2024/04/25 06:42:28 DEBUG : file1: reading active writers 2024/04/25 06:42:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:29 DEBUG : : Looking for writers 2024/04/25 06:42:29 DEBUG : file1: reading active writers 2024/04/25 06:42:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:30 DEBUG : : Looking for writers 2024/04/25 06:42:30 DEBUG : file1: reading active writers 2024/04/25 06:42:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:31 DEBUG : : Looking for writers 2024/04/25 06:42:31 DEBUG : file1: reading active writers 2024/04/25 06:42:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:32 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000a944b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aec008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645173312} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879670286420314 ext:43066480311 loc:0x3a135e0} ATime:{wall:13943879670286464377 ext:43066524374 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:42:32 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:42:33 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:42:34 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "594d5de9897912ea", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:42:34 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "594d5de9897912ea", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/04/25 06:42:40 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:42:40 DEBUG : : Looking for writers 2024/04/25 06:42:40 DEBUG : file1: reading active writers 2024/04/25 06:42:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:42:40 DEBUG : : Looking for writers 2024/04/25 06:42:40 DEBUG : file1: reading active writers 2024/04/25 06:42:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:42:40 DEBUG : : Looking for writers 2024/04/25 06:42:40 DEBUG : file1: reading active writers 2024/04/25 06:42:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:42:40 DEBUG : : Looking for writers 2024/04/25 06:42:40 DEBUG : file1: reading active writers 2024/04/25 06:42:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:42:40 DEBUG : : Looking for writers 2024/04/25 06:42:40 DEBUG : file1: reading active writers 2024/04/25 06:42:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:42:40 DEBUG : : Looking for writers 2024/04/25 06:42:40 DEBUG : file1: reading active writers 2024/04/25 06:42:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:42:41 DEBUG : : Looking for writers 2024/04/25 06:42:41 DEBUG : file1: reading active writers 2024/04/25 06:42:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:42:41 DEBUG : : Looking for writers 2024/04/25 06:42:41 DEBUG : file1: reading active writers 2024/04/25 06:42:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:42 DEBUG : : Looking for writers 2024/04/25 06:42:42 DEBUG : file1: reading active writers 2024/04/25 06:42:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:43 DEBUG : : Looking for writers 2024/04/25 06:42:43 DEBUG : file1: reading active writers 2024/04/25 06:42:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:44 DEBUG : : Looking for writers 2024/04/25 06:42:44 DEBUG : file1: reading active writers 2024/04/25 06:42:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:45 DEBUG : : Looking for writers 2024/04/25 06:42:45 DEBUG : file1: reading active writers 2024/04/25 06:42:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:46 DEBUG : : Looking for writers 2024/04/25 06:42:46 DEBUG : file1: reading active writers 2024/04/25 06:42:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:47 DEBUG : : Looking for writers 2024/04/25 06:42:47 DEBUG : file1: reading active writers 2024/04/25 06:42:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:48 DEBUG : : Looking for writers 2024/04/25 06:42:48 DEBUG : file1: reading active writers 2024/04/25 06:42:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:49 DEBUG : : Looking for writers 2024/04/25 06:42:49 DEBUG : file1: reading active writers 2024/04/25 06:42:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:50 DEBUG : : Looking for writers 2024/04/25 06:42:50 DEBUG : file1: reading active writers 2024/04/25 06:42:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:51 DEBUG : : Looking for writers 2024/04/25 06:42:51 DEBUG : file1: reading active writers 2024/04/25 06:42:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:52 DEBUG : : Looking for writers 2024/04/25 06:42:52 DEBUG : file1: reading active writers 2024/04/25 06:42:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:53 DEBUG : : Looking for writers 2024/04/25 06:42:53 DEBUG : file1: reading active writers 2024/04/25 06:42:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:54 DEBUG : : Looking for writers 2024/04/25 06:42:54 DEBUG : file1: reading active writers 2024/04/25 06:42:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:55 DEBUG : : Looking for writers 2024/04/25 06:42:55 DEBUG : file1: reading active writers 2024/04/25 06:42:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:56 DEBUG : : Looking for writers 2024/04/25 06:42:56 DEBUG : file1: reading active writers 2024/04/25 06:42:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:57 DEBUG : : Looking for writers 2024/04/25 06:42:57 DEBUG : file1: reading active writers 2024/04/25 06:42:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:58 DEBUG : : Looking for writers 2024/04/25 06:42:58 DEBUG : file1: reading active writers 2024/04/25 06:42:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:42:59 DEBUG : : Looking for writers 2024/04/25 06:42:59 DEBUG : file1: reading active writers 2024/04/25 06:42:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:00 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:00 DEBUG : : Looking for writers 2024/04/25 06:43:00 DEBUG : file1: reading active writers 2024/04/25 06:43:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:01 DEBUG : : Looking for writers 2024/04/25 06:43:01 DEBUG : file1: reading active writers 2024/04/25 06:43:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:01 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b5a756ded39d060a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:01 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b5a756ded39d060a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:02 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:43:02 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/25 06:43:02 DEBUG : : Looking for writers 2024/04/25 06:43:02 DEBUG : file1: reading active writers 2024/04/25 06:43:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:03 DEBUG : : Looking for writers 2024/04/25 06:43:03 DEBUG : file1: reading active writers 2024/04/25 06:43:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:04 DEBUG : : Looking for writers 2024/04/25 06:43:04 DEBUG : file1: reading active writers 2024/04/25 06:43:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:05 DEBUG : : Looking for writers 2024/04/25 06:43:05 DEBUG : file1: reading active writers 2024/04/25 06:43:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:06 DEBUG : : Looking for writers 2024/04/25 06:43:06 DEBUG : file1: reading active writers 2024/04/25 06:43:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:07 DEBUG : : Looking for writers 2024/04/25 06:43:07 DEBUG : file1: reading active writers 2024/04/25 06:43:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:08 DEBUG : : Looking for writers 2024/04/25 06:43:08 DEBUG : file1: reading active writers 2024/04/25 06:43:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:09 DEBUG : : Looking for writers 2024/04/25 06:43:09 DEBUG : file1: reading active writers 2024/04/25 06:43:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:10 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000a944b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aec008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645173312} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879670286420314 ext:43066480311 loc:0x3a135e0} ATime:{wall:13943879670286464377 ext:43066524374 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:43:10 DEBUG : >WaitForWriters: 2024/04/25 06:43:10 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (68.47s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:43:10 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:43:10 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:43:10 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:43:10 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:43:10 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:43:10 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:43:10 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:43:10 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:43:11 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:43:11 DEBUG : file1: newRWFileHandle: 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): openPending: 2024/04/25 06:43:11 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:43:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): >openPending: err= 2024/04/25 06:43:11 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:43:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:43:11 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:43:11 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): _writeAt: size=7, off=0 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): >_writeAt: n=7, err= 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): _writeAt: size=6, off=5 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): >_writeAt: n=6, err= 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): close: 2024/04/25 06:43:11 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:43:11.190982421 +0000 UTC m=+111.549245554 2024/04/25 06:43:11 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): >close: err= 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): _writeAt: size=5, off=0 2024/04/25 06:43:11 DEBUG : file1(0xc000b1ca00): >_writeAt: n=0, err=file already closed 2024/04/25 06:43:11 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:43:11 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:43:11 DEBUG : : Looking for writers 2024/04/25 06:43:11 DEBUG : file1: reading active writers 2024/04/25 06:43:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:43:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c011e1376848d057", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:11 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c011e1376848d057", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:12 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:12 DEBUG : : Looking for writers 2024/04/25 06:43:12 DEBUG : file1: reading active writers 2024/04/25 06:43:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:12 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5dbbcfe2ecb13be5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:12 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5dbbcfe2ecb13be5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:13 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:13 DEBUG : : Looking for writers 2024/04/25 06:43:13 DEBUG : file1: reading active writers 2024/04/25 06:43:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f37f30312053f66", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:14 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f37f30312053f66", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:14 DEBUG : : Looking for writers 2024/04/25 06:43:14 DEBUG : file1: reading active writers 2024/04/25 06:43:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:14 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:15 DEBUG : : Looking for writers 2024/04/25 06:43:15 DEBUG : file1: reading active writers 2024/04/25 06:43:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:15 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a1cb9d29c1033b35", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:15 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a1cb9d29c1033b35", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:16 DEBUG : : Looking for writers 2024/04/25 06:43:16 DEBUG : file1: reading active writers 2024/04/25 06:43:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:17 DEBUG : : Looking for writers 2024/04/25 06:43:17 DEBUG : file1: reading active writers 2024/04/25 06:43:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:17 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:18 DEBUG : : Looking for writers 2024/04/25 06:43:18 DEBUG : file1: reading active writers 2024/04/25 06:43:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:19 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a8782d355ea98fb4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:19 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a8782d355ea98fb4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:19 DEBUG : : Looking for writers 2024/04/25 06:43:19 DEBUG : file1: reading active writers 2024/04/25 06:43:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:20 DEBUG : : Looking for writers 2024/04/25 06:43:20 DEBUG : file1: reading active writers 2024/04/25 06:43:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:21 DEBUG : : Looking for writers 2024/04/25 06:43:21 DEBUG : file1: reading active writers 2024/04/25 06:43:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:22 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:22 DEBUG : : Looking for writers 2024/04/25 06:43:22 DEBUG : file1: reading active writers 2024/04/25 06:43:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "84cef15f7660c994", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:22 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "84cef15f7660c994", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:23 DEBUG : : Looking for writers 2024/04/25 06:43:23 DEBUG : file1: reading active writers 2024/04/25 06:43:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:24 DEBUG : : Looking for writers 2024/04/25 06:43:24 DEBUG : file1: reading active writers 2024/04/25 06:43:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:25 DEBUG : : Looking for writers 2024/04/25 06:43:25 DEBUG : file1: reading active writers 2024/04/25 06:43:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:26 DEBUG : : Looking for writers 2024/04/25 06:43:26 DEBUG : file1: reading active writers 2024/04/25 06:43:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:27 DEBUG : : Looking for writers 2024/04/25 06:43:27 DEBUG : file1: reading active writers 2024/04/25 06:43:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:28 DEBUG : : Looking for writers 2024/04/25 06:43:28 DEBUG : file1: reading active writers 2024/04/25 06:43:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:29 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:29 DEBUG : : Looking for writers 2024/04/25 06:43:29 DEBUG : file1: reading active writers 2024/04/25 06:43:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:29 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0fdc29ac93f5f589", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:29 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0fdc29ac93f5f589", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:30 DEBUG : : Looking for writers 2024/04/25 06:43:30 DEBUG : file1: reading active writers 2024/04/25 06:43:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:31 DEBUG : : Looking for writers 2024/04/25 06:43:31 DEBUG : file1: reading active writers 2024/04/25 06:43:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:32 DEBUG : : Looking for writers 2024/04/25 06:43:32 DEBUG : file1: reading active writers 2024/04/25 06:43:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:33 DEBUG : : Looking for writers 2024/04/25 06:43:33 DEBUG : file1: reading active writers 2024/04/25 06:43:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:34 DEBUG : : Looking for writers 2024/04/25 06:43:34 DEBUG : file1: reading active writers 2024/04/25 06:43:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:35 DEBUG : : Looking for writers 2024/04/25 06:43:35 DEBUG : file1: reading active writers 2024/04/25 06:43:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:36 DEBUG : : Looking for writers 2024/04/25 06:43:36 DEBUG : file1: reading active writers 2024/04/25 06:43:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:37 DEBUG : : Looking for writers 2024/04/25 06:43:37 DEBUG : file1: reading active writers 2024/04/25 06:43:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:38 DEBUG : : Looking for writers 2024/04/25 06:43:38 DEBUG : file1: reading active writers 2024/04/25 06:43:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:39 DEBUG : : Looking for writers 2024/04/25 06:43:39 DEBUG : file1: reading active writers 2024/04/25 06:43:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:40 DEBUG : : Looking for writers 2024/04/25 06:43:40 DEBUG : file1: reading active writers 2024/04/25 06:43:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:41 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0007561e0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aec508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645174592} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879743857371413 ext:111549245554 loc:0x3a135e0} ATime:{wall:13943879743857391912 ext:111549266053 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:43:41 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:43:42 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:43:43 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7cf8053b65c7f5aa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:43:43 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7cf8053b65c7f5aa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/04/25 06:43:48 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:43:48 DEBUG : : Looking for writers 2024/04/25 06:43:48 DEBUG : file1: reading active writers 2024/04/25 06:43:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:43:48 DEBUG : : Looking for writers 2024/04/25 06:43:48 DEBUG : file1: reading active writers 2024/04/25 06:43:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:43:49 DEBUG : : Looking for writers 2024/04/25 06:43:49 DEBUG : file1: reading active writers 2024/04/25 06:43:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:43:49 DEBUG : : Looking for writers 2024/04/25 06:43:49 DEBUG : file1: reading active writers 2024/04/25 06:43:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:43:49 DEBUG : : Looking for writers 2024/04/25 06:43:49 DEBUG : file1: reading active writers 2024/04/25 06:43:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:43:49 DEBUG : : Looking for writers 2024/04/25 06:43:49 DEBUG : file1: reading active writers 2024/04/25 06:43:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:43:49 DEBUG : : Looking for writers 2024/04/25 06:43:49 DEBUG : file1: reading active writers 2024/04/25 06:43:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:43:50 DEBUG : : Looking for writers 2024/04/25 06:43:50 DEBUG : file1: reading active writers 2024/04/25 06:43:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:51 DEBUG : : Looking for writers 2024/04/25 06:43:51 DEBUG : file1: reading active writers 2024/04/25 06:43:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:52 DEBUG : : Looking for writers 2024/04/25 06:43:52 DEBUG : file1: reading active writers 2024/04/25 06:43:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:53 DEBUG : : Looking for writers 2024/04/25 06:43:53 DEBUG : file1: reading active writers 2024/04/25 06:43:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:54 DEBUG : : Looking for writers 2024/04/25 06:43:54 DEBUG : file1: reading active writers 2024/04/25 06:43:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:55 DEBUG : : Looking for writers 2024/04/25 06:43:55 DEBUG : file1: reading active writers 2024/04/25 06:43:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:56 DEBUG : : Looking for writers 2024/04/25 06:43:56 DEBUG : file1: reading active writers 2024/04/25 06:43:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:57 DEBUG : : Looking for writers 2024/04/25 06:43:57 DEBUG : file1: reading active writers 2024/04/25 06:43:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:58 DEBUG : : Looking for writers 2024/04/25 06:43:58 DEBUG : file1: reading active writers 2024/04/25 06:43:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:43:59 DEBUG : : Looking for writers 2024/04/25 06:43:59 DEBUG : file1: reading active writers 2024/04/25 06:43:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:00 DEBUG : : Looking for writers 2024/04/25 06:44:00 DEBUG : file1: reading active writers 2024/04/25 06:44:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:01 DEBUG : : Looking for writers 2024/04/25 06:44:01 DEBUG : file1: reading active writers 2024/04/25 06:44:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:02 DEBUG : : Looking for writers 2024/04/25 06:44:02 DEBUG : file1: reading active writers 2024/04/25 06:44:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:03 DEBUG : : Looking for writers 2024/04/25 06:44:03 DEBUG : file1: reading active writers 2024/04/25 06:44:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:04 DEBUG : : Looking for writers 2024/04/25 06:44:04 DEBUG : file1: reading active writers 2024/04/25 06:44:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:05 DEBUG : : Looking for writers 2024/04/25 06:44:05 DEBUG : file1: reading active writers 2024/04/25 06:44:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:06 DEBUG : : Looking for writers 2024/04/25 06:44:06 DEBUG : file1: reading active writers 2024/04/25 06:44:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:07 DEBUG : : Looking for writers 2024/04/25 06:44:07 DEBUG : file1: reading active writers 2024/04/25 06:44:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:08 DEBUG : : Looking for writers 2024/04/25 06:44:08 DEBUG : file1: reading active writers 2024/04/25 06:44:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:09 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:09 DEBUG : : Looking for writers 2024/04/25 06:44:09 DEBUG : file1: reading active writers 2024/04/25 06:44:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "76dd363bd6cf1cac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:09 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "76dd363bd6cf1cac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:10 DEBUG : : Looking for writers 2024/04/25 06:44:10 DEBUG : file1: reading active writers 2024/04/25 06:44:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:10 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:44:10 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/25 06:44:11 DEBUG : : Looking for writers 2024/04/25 06:44:11 DEBUG : file1: reading active writers 2024/04/25 06:44:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:12 DEBUG : : Looking for writers 2024/04/25 06:44:12 DEBUG : file1: reading active writers 2024/04/25 06:44:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:13 DEBUG : : Looking for writers 2024/04/25 06:44:13 DEBUG : file1: reading active writers 2024/04/25 06:44:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:14 DEBUG : : Looking for writers 2024/04/25 06:44:14 DEBUG : file1: reading active writers 2024/04/25 06:44:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:15 DEBUG : : Looking for writers 2024/04/25 06:44:15 DEBUG : file1: reading active writers 2024/04/25 06:44:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:16 DEBUG : : Looking for writers 2024/04/25 06:44:16 DEBUG : file1: reading active writers 2024/04/25 06:44:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:17 DEBUG : : Looking for writers 2024/04/25 06:44:17 DEBUG : file1: reading active writers 2024/04/25 06:44:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:18 DEBUG : : Looking for writers 2024/04/25 06:44:18 DEBUG : file1: reading active writers 2024/04/25 06:44:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:44:18 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0007561e0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aec508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645174592} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879743857371413 ext:111549245554 loc:0x3a135e0} ATime:{wall:13943879743857391912 ext:111549266053 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:44:18 DEBUG : >WaitForWriters: 2024/04/25 06:44:18 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (68.78s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:44:19 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:44:19 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:44:19 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:44:19 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:44:19 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:44:19 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:44:19 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:44:19 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:44:19 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:44:19 DEBUG : file1: newRWFileHandle: 2024/04/25 06:44:19 DEBUG : file1(0xc0006b0480): openPending: 2024/04/25 06:44:19 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:44:19 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:44:19 DEBUG : file1(0xc0006b0480): >openPending: err= 2024/04/25 06:44:19 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:44:19 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:44:19 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:44:19 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:44:19 DEBUG : file1(0xc0006b0480): close: 2024/04/25 06:44:19 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:44:19.974969902 +0000 UTC m=+180.333233004 2024/04/25 06:44:19 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:44:19 DEBUG : file1(0xc0006b0480): >close: err= 2024/04/25 06:44:19 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/04/25 06:44:19 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/04/25 06:44:19 DEBUG : file2: newRWFileHandle: 2024/04/25 06:44:19 DEBUG : file2(0xc0006b05c0): openPending: 2024/04/25 06:44:19 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:44:19 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/25 06:44:19 DEBUG : file2(0xc0006b05c0): >openPending: err= 2024/04/25 06:44:19 DEBUG : file2: >newRWFileHandle: err= 2024/04/25 06:44:19 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/25 06:44:19 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/04/25 06:44:19 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/04/25 06:44:19 DEBUG : file2(0xc0006b05c0): RWFileHandle.Flush 2024/04/25 06:44:19 DEBUG : file2(0xc0006b05c0): RWFileHandle.Release 2024/04/25 06:44:19 DEBUG : file2(0xc0006b05c0): close: 2024/04/25 06:44:19 DEBUG : file2: vfs cache: setting modification time to 2024-04-25 06:44:19.975671567 +0000 UTC m=+180.333934670 2024/04/25 06:44:19 INFO : file2: vfs cache: queuing for upload in 100ms 2024/04/25 06:44:19 DEBUG : file2(0xc0006b05c0): >close: err= 2024/04/25 06:44:19 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:44:19 DEBUG : : Looking for writers 2024/04/25 06:44:19 DEBUG : file1: reading active writers 2024/04/25 06:44:19 DEBUG : file2: reading active writers 2024/04/25 06:44:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/25 06:44:19 DEBUG : : Looking for writers 2024/04/25 06:44:19 DEBUG : file1: reading active writers 2024/04/25 06:44:19 DEBUG : file2: reading active writers 2024/04/25 06:44:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/25 06:44:20 DEBUG : : Looking for writers 2024/04/25 06:44:20 DEBUG : file1: reading active writers 2024/04/25 06:44:20 DEBUG : file2: reading active writers 2024/04/25 06:44:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/25 06:44:20 DEBUG : : Looking for writers 2024/04/25 06:44:20 DEBUG : file1: reading active writers 2024/04/25 06:44:20 DEBUG : file2: reading active writers 2024/04/25 06:44:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/25 06:44:20 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:20 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:20 DEBUG : : Looking for writers 2024/04/25 06:44:20 DEBUG : file1: reading active writers 2024/04/25 06:44:20 DEBUG : file2: reading active writers 2024/04/25 06:44:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/25 06:44:20 DEBUG : : Looking for writers 2024/04/25 06:44:20 DEBUG : file1: reading active writers 2024/04/25 06:44:20 DEBUG : file2: reading active writers 2024/04/25 06:44:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/25 06:44:20 DEBUG : : Looking for writers 2024/04/25 06:44:20 DEBUG : file1: reading active writers 2024/04/25 06:44:20 DEBUG : file2: reading active writers 2024/04/25 06:44:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/25 06:44:20 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e602966ccb475701", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:20 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e602966ccb475701", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:20 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:21 DEBUG : : Looking for writers 2024/04/25 06:44:21 DEBUG : file2: reading active writers 2024/04/25 06:44:21 DEBUG : file1: reading active writers 2024/04/25 06:44:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:21 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "59e86fdf0cb0969f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:21 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "59e86fdf0cb0969f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:21 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:21 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed2ba9f1a5bb63e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:21 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed2ba9f1a5bb63e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:22 DEBUG : : Looking for writers 2024/04/25 06:44:22 DEBUG : file1: reading active writers 2024/04/25 06:44:22 DEBUG : file2: reading active writers 2024/04/25 06:44:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:22 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d26dd09d463da962", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:22 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d26dd09d463da962", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:22 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:23 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b9ce18f303b126b9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:23 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b9ce18f303b126b9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:23 DEBUG : : Looking for writers 2024/04/25 06:44:23 DEBUG : file1: reading active writers 2024/04/25 06:44:23 DEBUG : file2: reading active writers 2024/04/25 06:44:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "90c3a7104079c6b3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:23 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "90c3a7104079c6b3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:24 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:24 DEBUG : : Looking for writers 2024/04/25 06:44:24 DEBUG : file1: reading active writers 2024/04/25 06:44:24 DEBUG : file2: reading active writers 2024/04/25 06:44:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:24 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ee307d8dce142f80", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:24 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ee307d8dce142f80", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:24 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:25 DEBUG : : Looking for writers 2024/04/25 06:44:25 DEBUG : file1: reading active writers 2024/04/25 06:44:25 DEBUG : file2: reading active writers 2024/04/25 06:44:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:26 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:26 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "172e62ed8c74b26d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:26 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "172e62ed8c74b26d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:26 DEBUG : : Looking for writers 2024/04/25 06:44:26 DEBUG : file1: reading active writers 2024/04/25 06:44:26 DEBUG : file2: reading active writers 2024/04/25 06:44:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:26 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d22ea61794b23a91", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:26 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d22ea61794b23a91", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:27 DEBUG : : Looking for writers 2024/04/25 06:44:27 DEBUG : file1: reading active writers 2024/04/25 06:44:27 DEBUG : file2: reading active writers 2024/04/25 06:44:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:27 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:28 DEBUG : : Looking for writers 2024/04/25 06:44:28 DEBUG : file1: reading active writers 2024/04/25 06:44:28 DEBUG : file2: reading active writers 2024/04/25 06:44:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:28 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fc05f8850549d1a3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:28 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fc05f8850549d1a3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:29 DEBUG : : Looking for writers 2024/04/25 06:44:29 DEBUG : file1: reading active writers 2024/04/25 06:44:29 DEBUG : file2: reading active writers 2024/04/25 06:44:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:30 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:30 DEBUG : : Looking for writers 2024/04/25 06:44:30 DEBUG : file2: reading active writers 2024/04/25 06:44:30 DEBUG : file1: reading active writers 2024/04/25 06:44:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:30 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b698b6d585c7540d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:30 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b698b6d585c7540d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:31 DEBUG : : Looking for writers 2024/04/25 06:44:31 DEBUG : file1: reading active writers 2024/04/25 06:44:31 DEBUG : file2: reading active writers 2024/04/25 06:44:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:31 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "848e187a3cade084", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:32 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "848e187a3cade084", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:32 DEBUG : : Looking for writers 2024/04/25 06:44:32 DEBUG : file1: reading active writers 2024/04/25 06:44:32 DEBUG : file2: reading active writers 2024/04/25 06:44:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:33 DEBUG : : Looking for writers 2024/04/25 06:44:33 DEBUG : file1: reading active writers 2024/04/25 06:44:33 DEBUG : file2: reading active writers 2024/04/25 06:44:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:34 DEBUG : : Looking for writers 2024/04/25 06:44:34 DEBUG : file1: reading active writers 2024/04/25 06:44:34 DEBUG : file2: reading active writers 2024/04/25 06:44:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:35 DEBUG : : Looking for writers 2024/04/25 06:44:35 DEBUG : file1: reading active writers 2024/04/25 06:44:35 DEBUG : file2: reading active writers 2024/04/25 06:44:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:36 DEBUG : : Looking for writers 2024/04/25 06:44:36 DEBUG : file1: reading active writers 2024/04/25 06:44:36 DEBUG : file2: reading active writers 2024/04/25 06:44:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:37 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:37 DEBUG : : Looking for writers 2024/04/25 06:44:37 DEBUG : file2: reading active writers 2024/04/25 06:44:37 DEBUG : file1: reading active writers 2024/04/25 06:44:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:37 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "60cd92429c46c0b0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:37 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "60cd92429c46c0b0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:38 DEBUG : : Looking for writers 2024/04/25 06:44:38 DEBUG : file1: reading active writers 2024/04/25 06:44:38 DEBUG : file2: reading active writers 2024/04/25 06:44:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:38 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:39 DEBUG : : Looking for writers 2024/04/25 06:44:39 DEBUG : file2: reading active writers 2024/04/25 06:44:39 DEBUG : file1: reading active writers 2024/04/25 06:44:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:39 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "82a690e8e1eeafeb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:39 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "82a690e8e1eeafeb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:40 DEBUG : : Looking for writers 2024/04/25 06:44:40 DEBUG : file2: reading active writers 2024/04/25 06:44:40 DEBUG : file1: reading active writers 2024/04/25 06:44:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:41 DEBUG : : Looking for writers 2024/04/25 06:44:41 DEBUG : file1: reading active writers 2024/04/25 06:44:41 DEBUG : file2: reading active writers 2024/04/25 06:44:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:42 DEBUG : : Looking for writers 2024/04/25 06:44:42 DEBUG : file1: reading active writers 2024/04/25 06:44:42 DEBUG : file2: reading active writers 2024/04/25 06:44:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:43 DEBUG : : Looking for writers 2024/04/25 06:44:43 DEBUG : file1: reading active writers 2024/04/25 06:44:43 DEBUG : file2: reading active writers 2024/04/25 06:44:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:44 DEBUG : : Looking for writers 2024/04/25 06:44:44 DEBUG : file1: reading active writers 2024/04/25 06:44:44 DEBUG : file2: reading active writers 2024/04/25 06:44:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:45 DEBUG : : Looking for writers 2024/04/25 06:44:45 DEBUG : file1: reading active writers 2024/04/25 06:44:45 DEBUG : file2: reading active writers 2024/04/25 06:44:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:46 DEBUG : : Looking for writers 2024/04/25 06:44:46 DEBUG : file1: reading active writers 2024/04/25 06:44:46 DEBUG : file2: reading active writers 2024/04/25 06:44:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:47 DEBUG : : Looking for writers 2024/04/25 06:44:47 DEBUG : file1: reading active writers 2024/04/25 06:44:47 DEBUG : file2: reading active writers 2024/04/25 06:44:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:48 DEBUG : : Looking for writers 2024/04/25 06:44:48 DEBUG : file1: reading active writers 2024/04/25 06:44:48 DEBUG : file2: reading active writers 2024/04/25 06:44:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:49 DEBUG : : Looking for writers 2024/04/25 06:44:49 DEBUG : file1: reading active writers 2024/04/25 06:44:49 DEBUG : file2: reading active writers 2024/04/25 06:44:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:44:49 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc000a945a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aec908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645175616} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879817655802926 ext:180333233004 loc:0x3a135e0} ATime:{wall:13943879817655954339 ext:180333384419 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc000a945a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aeca08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645175872} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879817656504591 ext:180333934670 loc:0x3a135e0} ATime:{wall:13943879817656582649 ext:180334012727 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:44:49 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:44:50 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:44:51 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ffc66953f8771932", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:51 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ffc66953f8771932", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:44:52 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:44:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "38f507f454673ae8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:44:52 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "38f507f454673ae8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:197: Not found "file1" fstest.go:197: Not found "file2" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/04/25 06:44:58 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:44:58 DEBUG : : Looking for writers 2024/04/25 06:44:58 DEBUG : file1: reading active writers 2024/04/25 06:44:58 DEBUG : file2: reading active writers 2024/04/25 06:44:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/25 06:44:58 DEBUG : : Looking for writers 2024/04/25 06:44:58 DEBUG : file2: reading active writers 2024/04/25 06:44:58 DEBUG : file1: reading active writers 2024/04/25 06:44:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/25 06:44:58 DEBUG : : Looking for writers 2024/04/25 06:44:58 DEBUG : file1: reading active writers 2024/04/25 06:44:58 DEBUG : file2: reading active writers 2024/04/25 06:44:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/25 06:44:58 DEBUG : : Looking for writers 2024/04/25 06:44:58 DEBUG : file1: reading active writers 2024/04/25 06:44:58 DEBUG : file2: reading active writers 2024/04/25 06:44:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/25 06:44:58 DEBUG : : Looking for writers 2024/04/25 06:44:58 DEBUG : file1: reading active writers 2024/04/25 06:44:58 DEBUG : file2: reading active writers 2024/04/25 06:44:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/25 06:44:58 DEBUG : : Looking for writers 2024/04/25 06:44:58 DEBUG : file1: reading active writers 2024/04/25 06:44:58 DEBUG : file2: reading active writers 2024/04/25 06:44:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/25 06:44:59 DEBUG : : Looking for writers 2024/04/25 06:44:59 DEBUG : file1: reading active writers 2024/04/25 06:44:59 DEBUG : file2: reading active writers 2024/04/25 06:44:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/25 06:44:59 DEBUG : : Looking for writers 2024/04/25 06:44:59 DEBUG : file1: reading active writers 2024/04/25 06:44:59 DEBUG : file2: reading active writers 2024/04/25 06:44:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:00 DEBUG : : Looking for writers 2024/04/25 06:45:00 DEBUG : file1: reading active writers 2024/04/25 06:45:00 DEBUG : file2: reading active writers 2024/04/25 06:45:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:01 DEBUG : : Looking for writers 2024/04/25 06:45:01 DEBUG : file1: reading active writers 2024/04/25 06:45:01 DEBUG : file2: reading active writers 2024/04/25 06:45:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:02 DEBUG : : Looking for writers 2024/04/25 06:45:02 DEBUG : file1: reading active writers 2024/04/25 06:45:02 DEBUG : file2: reading active writers 2024/04/25 06:45:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:03 DEBUG : : Looking for writers 2024/04/25 06:45:03 DEBUG : file1: reading active writers 2024/04/25 06:45:03 DEBUG : file2: reading active writers 2024/04/25 06:45:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:04 DEBUG : : Looking for writers 2024/04/25 06:45:04 DEBUG : file1: reading active writers 2024/04/25 06:45:04 DEBUG : file2: reading active writers 2024/04/25 06:45:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:05 DEBUG : : Looking for writers 2024/04/25 06:45:05 DEBUG : file1: reading active writers 2024/04/25 06:45:05 DEBUG : file2: reading active writers 2024/04/25 06:45:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:06 DEBUG : : Looking for writers 2024/04/25 06:45:06 DEBUG : file1: reading active writers 2024/04/25 06:45:06 DEBUG : file2: reading active writers 2024/04/25 06:45:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:07 DEBUG : : Looking for writers 2024/04/25 06:45:07 DEBUG : file2: reading active writers 2024/04/25 06:45:07 DEBUG : file1: reading active writers 2024/04/25 06:45:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:08 DEBUG : : Looking for writers 2024/04/25 06:45:08 DEBUG : file1: reading active writers 2024/04/25 06:45:08 DEBUG : file2: reading active writers 2024/04/25 06:45:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:09 DEBUG : : Looking for writers 2024/04/25 06:45:09 DEBUG : file1: reading active writers 2024/04/25 06:45:09 DEBUG : file2: reading active writers 2024/04/25 06:45:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:10 DEBUG : : Looking for writers 2024/04/25 06:45:10 DEBUG : file1: reading active writers 2024/04/25 06:45:10 DEBUG : file2: reading active writers 2024/04/25 06:45:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:11 DEBUG : : Looking for writers 2024/04/25 06:45:11 DEBUG : file1: reading active writers 2024/04/25 06:45:11 DEBUG : file2: reading active writers 2024/04/25 06:45:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:12 DEBUG : : Looking for writers 2024/04/25 06:45:12 DEBUG : file1: reading active writers 2024/04/25 06:45:12 DEBUG : file2: reading active writers 2024/04/25 06:45:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:13 DEBUG : : Looking for writers 2024/04/25 06:45:13 DEBUG : file1: reading active writers 2024/04/25 06:45:13 DEBUG : file2: reading active writers 2024/04/25 06:45:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:14 DEBUG : : Looking for writers 2024/04/25 06:45:14 DEBUG : file2: reading active writers 2024/04/25 06:45:14 DEBUG : file1: reading active writers 2024/04/25 06:45:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:15 DEBUG : : Looking for writers 2024/04/25 06:45:15 DEBUG : file1: reading active writers 2024/04/25 06:45:15 DEBUG : file2: reading active writers 2024/04/25 06:45:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:16 DEBUG : : Looking for writers 2024/04/25 06:45:16 DEBUG : file1: reading active writers 2024/04/25 06:45:16 DEBUG : file2: reading active writers 2024/04/25 06:45:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:17 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:45:17 DEBUG : : Looking for writers 2024/04/25 06:45:17 DEBUG : file1: reading active writers 2024/04/25 06:45:17 DEBUG : file2: reading active writers 2024/04/25 06:45:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:18 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5bc8f8b29a79f34e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:18 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5bc8f8b29a79f34e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:18 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:45:18 DEBUG : : Looking for writers 2024/04/25 06:45:18 DEBUG : file1: reading active writers 2024/04/25 06:45:18 DEBUG : file2: reading active writers 2024/04/25 06:45:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:18 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0266be78b0dfd27d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:18 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0266be78b0dfd27d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:19 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:45:19 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/04/25 06:45:19 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/04/25 06:45:19 DEBUG : : Looking for writers 2024/04/25 06:45:19 DEBUG : file1: reading active writers 2024/04/25 06:45:19 DEBUG : file2: reading active writers 2024/04/25 06:45:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:20 DEBUG : : Looking for writers 2024/04/25 06:45:20 DEBUG : file1: reading active writers 2024/04/25 06:45:20 DEBUG : file2: reading active writers 2024/04/25 06:45:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:21 DEBUG : : Looking for writers 2024/04/25 06:45:21 DEBUG : file1: reading active writers 2024/04/25 06:45:21 DEBUG : file2: reading active writers 2024/04/25 06:45:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:22 DEBUG : : Looking for writers 2024/04/25 06:45:22 DEBUG : file1: reading active writers 2024/04/25 06:45:22 DEBUG : file2: reading active writers 2024/04/25 06:45:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:23 DEBUG : : Looking for writers 2024/04/25 06:45:23 DEBUG : file1: reading active writers 2024/04/25 06:45:23 DEBUG : file2: reading active writers 2024/04/25 06:45:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:24 DEBUG : : Looking for writers 2024/04/25 06:45:24 DEBUG : file1: reading active writers 2024/04/25 06:45:24 DEBUG : file2: reading active writers 2024/04/25 06:45:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:25 DEBUG : : Looking for writers 2024/04/25 06:45:25 DEBUG : file1: reading active writers 2024/04/25 06:45:25 DEBUG : file2: reading active writers 2024/04/25 06:45:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:26 DEBUG : : Looking for writers 2024/04/25 06:45:26 DEBUG : file1: reading active writers 2024/04/25 06:45:26 DEBUG : file2: reading active writers 2024/04/25 06:45:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:27 DEBUG : : Looking for writers 2024/04/25 06:45:27 DEBUG : file1: reading active writers 2024/04/25 06:45:27 DEBUG : file2: reading active writers 2024/04/25 06:45:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:45:28 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc000a945a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aec908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645175616} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879817655802926 ext:180333233004 loc:0x3a135e0} ATime:{wall:13943879817655954339 ext:180333384419 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc000a945a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aeca08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645175872} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879817656504591 ext:180333934670 loc:0x3a135e0} ATime:{wall:13943879817656582649 ext:180334012727 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:45:28 DEBUG : >WaitForWriters: 2024/04/25 06:45:28 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (69.20s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:45:28 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:45:28 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:45:28 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:28 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:28 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:28 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:28 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4b698ac1bf66bbc7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:45:29 DEBUG : : Looking for writers 2024/04/25 06:45:29 DEBUG : >WaitForWriters: 2024/04/25 06:45:29 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (0.95s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:45:29 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:45:29 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:45:29 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:29 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:29 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:29 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:29 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1bc72e28018691d8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:30 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:45:30 DEBUG : : Looking for writers 2024/04/25 06:45:30 DEBUG : >WaitForWriters: 2024/04/25 06:45:30 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (0.85s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:45:30 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:45:30 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:45:30 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:30 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-kulomeh8zegaqus9gicujuw8" 2024/04/25 06:45:30 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:45:30 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:45:30 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:45:30 DEBUG : file1: newRWFileHandle: 2024/04/25 06:45:30 DEBUG : file1(0xc0006b1a80): openPending: 2024/04/25 06:45:30 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:45:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:45:30 DEBUG : file1(0xc0006b1a80): >openPending: err= 2024/04/25 06:45:30 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:45:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:45:30 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:45:30 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9901a8d12e728468", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:45:31 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:45:31 DEBUG : : Looking for writers 2024/04/25 06:45:31 DEBUG : file1: reading active writers 2024/04/25 06:45:31 DEBUG : file1: active writers 1 2024/04/25 06:45:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:45:31 DEBUG : : Looking for writers 2024/04/25 06:45:31 DEBUG : file1: reading active writers 2024/04/25 06:45:31 DEBUG : file1: active writers 1 2024/04/25 06:45:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:45:31 DEBUG : : Looking for writers 2024/04/25 06:45:31 DEBUG : file1: reading active writers 2024/04/25 06:45:31 DEBUG : file1: active writers 1 2024/04/25 06:45:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:45:31 DEBUG : : Looking for writers 2024/04/25 06:45:31 DEBUG : file1: reading active writers 2024/04/25 06:45:31 DEBUG : file1: active writers 1 2024/04/25 06:45:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:45:31 DEBUG : : Looking for writers 2024/04/25 06:45:31 DEBUG : file1: reading active writers 2024/04/25 06:45:31 DEBUG : file1: active writers 1 2024/04/25 06:45:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:45:31 DEBUG : : Looking for writers 2024/04/25 06:45:31 DEBUG : file1: reading active writers 2024/04/25 06:45:31 DEBUG : file1: active writers 1 2024/04/25 06:45:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:45:32 DEBUG : : Looking for writers 2024/04/25 06:45:32 DEBUG : file1: reading active writers 2024/04/25 06:45:32 DEBUG : file1: active writers 1 2024/04/25 06:45:32 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:45:32 DEBUG : : Looking for writers 2024/04/25 06:45:32 DEBUG : file1: reading active writers 2024/04/25 06:45:32 DEBUG : file1: active writers 1 2024/04/25 06:45:32 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:33 DEBUG : : Looking for writers 2024/04/25 06:45:33 DEBUG : file1: reading active writers 2024/04/25 06:45:33 DEBUG : file1: active writers 1 2024/04/25 06:45:33 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:34 DEBUG : : Looking for writers 2024/04/25 06:45:34 DEBUG : file1: reading active writers 2024/04/25 06:45:34 DEBUG : file1: active writers 1 2024/04/25 06:45:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:35 DEBUG : : Looking for writers 2024/04/25 06:45:35 DEBUG : file1: reading active writers 2024/04/25 06:45:35 DEBUG : file1: active writers 1 2024/04/25 06:45:35 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:36 DEBUG : : Looking for writers 2024/04/25 06:45:36 DEBUG : file1: reading active writers 2024/04/25 06:45:36 DEBUG : file1: active writers 1 2024/04/25 06:45:36 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:37 DEBUG : : Looking for writers 2024/04/25 06:45:37 DEBUG : file1: reading active writers 2024/04/25 06:45:37 DEBUG : file1: active writers 1 2024/04/25 06:45:37 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:38 DEBUG : : Looking for writers 2024/04/25 06:45:38 DEBUG : file1: reading active writers 2024/04/25 06:45:38 DEBUG : file1: active writers 1 2024/04/25 06:45:38 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:39 DEBUG : : Looking for writers 2024/04/25 06:45:39 DEBUG : file1: reading active writers 2024/04/25 06:45:39 DEBUG : file1: active writers 1 2024/04/25 06:45:39 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:40 DEBUG : : Looking for writers 2024/04/25 06:45:40 DEBUG : file1: reading active writers 2024/04/25 06:45:40 DEBUG : file1: active writers 1 2024/04/25 06:45:40 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:41 DEBUG : : Looking for writers 2024/04/25 06:45:41 DEBUG : file1: reading active writers 2024/04/25 06:45:41 DEBUG : file1: active writers 1 2024/04/25 06:45:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:42 DEBUG : : Looking for writers 2024/04/25 06:45:42 DEBUG : file1: reading active writers 2024/04/25 06:45:42 DEBUG : file1: active writers 1 2024/04/25 06:45:42 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:43 DEBUG : : Looking for writers 2024/04/25 06:45:43 DEBUG : file1: reading active writers 2024/04/25 06:45:43 DEBUG : file1: active writers 1 2024/04/25 06:45:43 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:44 DEBUG : : Looking for writers 2024/04/25 06:45:44 DEBUG : file1: reading active writers 2024/04/25 06:45:44 DEBUG : file1: active writers 1 2024/04/25 06:45:44 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:45 DEBUG : : Looking for writers 2024/04/25 06:45:45 DEBUG : file1: reading active writers 2024/04/25 06:45:45 DEBUG : file1: active writers 1 2024/04/25 06:45:45 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:46 DEBUG : : Looking for writers 2024/04/25 06:45:46 DEBUG : file1: reading active writers 2024/04/25 06:45:46 DEBUG : file1: active writers 1 2024/04/25 06:45:46 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:47 DEBUG : : Looking for writers 2024/04/25 06:45:47 DEBUG : file1: reading active writers 2024/04/25 06:45:47 DEBUG : file1: active writers 1 2024/04/25 06:45:47 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:48 DEBUG : : Looking for writers 2024/04/25 06:45:48 DEBUG : file1: reading active writers 2024/04/25 06:45:48 DEBUG : file1: active writers 1 2024/04/25 06:45:48 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:49 DEBUG : : Looking for writers 2024/04/25 06:45:49 DEBUG : file1: reading active writers 2024/04/25 06:45:49 DEBUG : file1: active writers 1 2024/04/25 06:45:49 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:50 DEBUG : : Looking for writers 2024/04/25 06:45:50 DEBUG : file1: reading active writers 2024/04/25 06:45:50 DEBUG : file1: active writers 1 2024/04/25 06:45:50 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:51 DEBUG : : Looking for writers 2024/04/25 06:45:51 DEBUG : file1: reading active writers 2024/04/25 06:45:51 DEBUG : file1: active writers 1 2024/04/25 06:45:51 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:52 DEBUG : : Looking for writers 2024/04/25 06:45:52 DEBUG : file1: reading active writers 2024/04/25 06:45:52 DEBUG : file1: active writers 1 2024/04/25 06:45:52 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:53 DEBUG : : Looking for writers 2024/04/25 06:45:53 DEBUG : file1: reading active writers 2024/04/25 06:45:53 DEBUG : file1: active writers 1 2024/04/25 06:45:53 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:54 DEBUG : : Looking for writers 2024/04/25 06:45:54 DEBUG : file1: reading active writers 2024/04/25 06:45:54 DEBUG : file1: active writers 1 2024/04/25 06:45:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:55 DEBUG : : Looking for writers 2024/04/25 06:45:55 DEBUG : file1: reading active writers 2024/04/25 06:45:55 DEBUG : file1: active writers 1 2024/04/25 06:45:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:56 DEBUG : : Looking for writers 2024/04/25 06:45:56 DEBUG : file1: reading active writers 2024/04/25 06:45:56 DEBUG : file1: active writers 1 2024/04/25 06:45:56 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:57 DEBUG : : Looking for writers 2024/04/25 06:45:57 DEBUG : file1: reading active writers 2024/04/25 06:45:57 DEBUG : file1: active writers 1 2024/04/25 06:45:57 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:58 DEBUG : : Looking for writers 2024/04/25 06:45:58 DEBUG : file1: reading active writers 2024/04/25 06:45:58 DEBUG : file1: active writers 1 2024/04/25 06:45:58 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:45:59 DEBUG : : Looking for writers 2024/04/25 06:45:59 DEBUG : file1: reading active writers 2024/04/25 06:45:59 DEBUG : file1: active writers 1 2024/04/25 06:45:59 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:46:00 DEBUG : : Looking for writers 2024/04/25 06:46:00 DEBUG : file1: reading active writers 2024/04/25 06:46:00 DEBUG : file1: active writers 1 2024/04/25 06:46:00 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:46:01 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0007564b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000aed708 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645179200} name:file1 opens:1 downloaders: o: fd:0xc0008cc540 info:{ModTime:{wall:13943879893893057131 ext:251334817706 loc:0x3a135e0} ATime:{wall:13943879893893057131 ext:251334817706 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/04/25 06:46:01 DEBUG : >WaitForWriters: 2024/04/25 06:46:01 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.12s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8b480d5474c1c1ea", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (0.99s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d470c8ea5e134007", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (2.07s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:04 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:04 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a342c82c5937e829", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:05 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:46:05 DEBUG : : Looking for writers 2024/04/25 06:46:05 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (0.87s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:05 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:05 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ce4883dcd3f20536", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:06 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:46:06 DEBUG : : Looking for writers 2024/04/25 06:46:06 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (1.34s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:07 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:07 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b63348cceb00a874", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:07 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:46:07 DEBUG : : Looking for writers 2024/04/25 06:46:07 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (0.87s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:07 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:07 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "16793614becf33d2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:08 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:46:08 DEBUG : : Looking for writers 2024/04/25 06:46:08 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (0.86s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:08 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:08 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:46:08 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:46:09 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:46:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:09 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:46:09 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:46:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:09 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/25 06:46:09 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/25 06:46:09 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/04/25 06:46:09 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (5 bytes), uploading instead of streaming 2024/04/25 06:46:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5d7e4f1fe91673cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:09 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5d7e4f1fe91673cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:09 DEBUG : file1: Remove: 2024/04/25 06:46:09 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:46:09 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5d7e4f1fe91673cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/04/25 06:46:17 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:46:17 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:46:17 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:17 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:46:17 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:46:17 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:17 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:46:18 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3ea8649821fdcc23", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:18 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3ea8649821fdcc23", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:18 DEBUG : file1: Remove: 2024/04/25 06:46:18 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:46:18 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3ea8649821fdcc23", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/04/25 06:46:18 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:46:18 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:46:18 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:18 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:46:18 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:46:18 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/04/25 06:46:18 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:46:18 DEBUG : : Looking for writers 2024/04/25 06:46:18 DEBUG : file1: reading active writers 2024/04/25 06:46:18 DEBUG : file1: active writers 1 2024/04/25 06:46:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/04/25 06:46:18 DEBUG : : Looking for writers 2024/04/25 06:46:18 DEBUG : file1: reading active writers 2024/04/25 06:46:18 DEBUG : file1: active writers 1 2024/04/25 06:46:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/04/25 06:46:18 DEBUG : : Looking for writers 2024/04/25 06:46:18 DEBUG : file1: reading active writers 2024/04/25 06:46:18 DEBUG : file1: active writers 1 2024/04/25 06:46:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/04/25 06:46:18 DEBUG : : Looking for writers 2024/04/25 06:46:18 DEBUG : file1: reading active writers 2024/04/25 06:46:18 DEBUG : file1: active writers 1 2024/04/25 06:46:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/04/25 06:46:18 DEBUG : : Looking for writers 2024/04/25 06:46:18 DEBUG : file1: reading active writers 2024/04/25 06:46:18 DEBUG : file1: active writers 1 2024/04/25 06:46:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/04/25 06:46:18 DEBUG : : Looking for writers 2024/04/25 06:46:18 DEBUG : file1: reading active writers 2024/04/25 06:46:18 DEBUG : file1: active writers 1 2024/04/25 06:46:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/04/25 06:46:19 DEBUG : : Looking for writers 2024/04/25 06:46:19 DEBUG : file1: reading active writers 2024/04/25 06:46:19 DEBUG : file1: active writers 1 2024/04/25 06:46:19 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/04/25 06:46:19 DEBUG : : Looking for writers 2024/04/25 06:46:19 DEBUG : file1: reading active writers 2024/04/25 06:46:19 DEBUG : file1: active writers 1 2024/04/25 06:46:19 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:20 DEBUG : : Looking for writers 2024/04/25 06:46:20 DEBUG : file1: reading active writers 2024/04/25 06:46:20 DEBUG : file1: active writers 1 2024/04/25 06:46:20 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:21 DEBUG : : Looking for writers 2024/04/25 06:46:21 DEBUG : file1: reading active writers 2024/04/25 06:46:21 DEBUG : file1: active writers 1 2024/04/25 06:46:21 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:22 DEBUG : : Looking for writers 2024/04/25 06:46:22 DEBUG : file1: reading active writers 2024/04/25 06:46:22 DEBUG : file1: active writers 1 2024/04/25 06:46:22 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:23 DEBUG : : Looking for writers 2024/04/25 06:46:23 DEBUG : file1: reading active writers 2024/04/25 06:46:23 DEBUG : file1: active writers 1 2024/04/25 06:46:23 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:24 DEBUG : : Looking for writers 2024/04/25 06:46:24 DEBUG : file1: reading active writers 2024/04/25 06:46:24 DEBUG : file1: active writers 1 2024/04/25 06:46:24 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:25 DEBUG : : Looking for writers 2024/04/25 06:46:25 DEBUG : file1: reading active writers 2024/04/25 06:46:25 DEBUG : file1: active writers 1 2024/04/25 06:46:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:26 DEBUG : : Looking for writers 2024/04/25 06:46:26 DEBUG : file1: reading active writers 2024/04/25 06:46:26 DEBUG : file1: active writers 1 2024/04/25 06:46:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:27 DEBUG : : Looking for writers 2024/04/25 06:46:27 DEBUG : file1: reading active writers 2024/04/25 06:46:27 DEBUG : file1: active writers 1 2024/04/25 06:46:27 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:28 DEBUG : : Looking for writers 2024/04/25 06:46:28 DEBUG : file1: reading active writers 2024/04/25 06:46:28 DEBUG : file1: active writers 1 2024/04/25 06:46:28 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:29 DEBUG : : Looking for writers 2024/04/25 06:46:29 DEBUG : file1: reading active writers 2024/04/25 06:46:29 DEBUG : file1: active writers 1 2024/04/25 06:46:29 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:30 DEBUG : : Looking for writers 2024/04/25 06:46:30 DEBUG : file1: reading active writers 2024/04/25 06:46:30 DEBUG : file1: active writers 1 2024/04/25 06:46:30 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:31 DEBUG : : Looking for writers 2024/04/25 06:46:31 DEBUG : file1: reading active writers 2024/04/25 06:46:31 DEBUG : file1: active writers 1 2024/04/25 06:46:31 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:32 DEBUG : : Looking for writers 2024/04/25 06:46:32 DEBUG : file1: reading active writers 2024/04/25 06:46:32 DEBUG : file1: active writers 1 2024/04/25 06:46:32 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:33 DEBUG : : Looking for writers 2024/04/25 06:46:33 DEBUG : file1: reading active writers 2024/04/25 06:46:33 DEBUG : file1: active writers 1 2024/04/25 06:46:33 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:34 DEBUG : : Looking for writers 2024/04/25 06:46:34 DEBUG : file1: reading active writers 2024/04/25 06:46:34 DEBUG : file1: active writers 1 2024/04/25 06:46:34 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:35 DEBUG : : Looking for writers 2024/04/25 06:46:35 DEBUG : file1: reading active writers 2024/04/25 06:46:35 DEBUG : file1: active writers 1 2024/04/25 06:46:35 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:36 DEBUG : : Looking for writers 2024/04/25 06:46:36 DEBUG : file1: reading active writers 2024/04/25 06:46:36 DEBUG : file1: active writers 1 2024/04/25 06:46:36 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:37 DEBUG : : Looking for writers 2024/04/25 06:46:37 DEBUG : file1: reading active writers 2024/04/25 06:46:37 DEBUG : file1: active writers 1 2024/04/25 06:46:37 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:38 DEBUG : : Looking for writers 2024/04/25 06:46:38 DEBUG : file1: reading active writers 2024/04/25 06:46:38 DEBUG : file1: active writers 1 2024/04/25 06:46:38 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:39 DEBUG : : Looking for writers 2024/04/25 06:46:39 DEBUG : file1: reading active writers 2024/04/25 06:46:39 DEBUG : file1: active writers 1 2024/04/25 06:46:39 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:40 DEBUG : : Looking for writers 2024/04/25 06:46:40 DEBUG : file1: reading active writers 2024/04/25 06:46:40 DEBUG : file1: active writers 1 2024/04/25 06:46:40 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:41 DEBUG : : Looking for writers 2024/04/25 06:46:41 DEBUG : file1: reading active writers 2024/04/25 06:46:41 DEBUG : file1: active writers 1 2024/04/25 06:46:41 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:42 DEBUG : : Looking for writers 2024/04/25 06:46:42 DEBUG : file1: reading active writers 2024/04/25 06:46:42 DEBUG : file1: active writers 1 2024/04/25 06:46:42 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:43 DEBUG : : Looking for writers 2024/04/25 06:46:43 DEBUG : file1: reading active writers 2024/04/25 06:46:43 DEBUG : file1: active writers 1 2024/04/25 06:46:43 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:44 DEBUG : : Looking for writers 2024/04/25 06:46:44 DEBUG : file1: reading active writers 2024/04/25 06:46:44 DEBUG : file1: active writers 1 2024/04/25 06:46:44 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:45 DEBUG : : Looking for writers 2024/04/25 06:46:45 DEBUG : file1: reading active writers 2024/04/25 06:46:45 DEBUG : file1: active writers 1 2024/04/25 06:46:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:46 DEBUG : : Looking for writers 2024/04/25 06:46:46 DEBUG : file1: reading active writers 2024/04/25 06:46:46 DEBUG : file1: active writers 1 2024/04/25 06:46:46 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:47 DEBUG : : Looking for writers 2024/04/25 06:46:47 DEBUG : file1: reading active writers 2024/04/25 06:46:47 DEBUG : file1: active writers 1 2024/04/25 06:46:47 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:46:48 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/04/25 06:46:48 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (40.51s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:49 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:49 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:46:49 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:46:49 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:46:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:49 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:46:49 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:46:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:46:49 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/04/25 06:46:50 DEBUG : file1: aborting in-sequence write wait, off=100 2024/04/25 06:46:50 DEBUG : file1: failed to wait for in-sequence write to 100 2024/04/25 06:46:50 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/04/25 06:46:50 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (11 bytes), uploading instead of streaming 2024/04/25 06:46:51 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ec17ff9f8e77873b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:51 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ec17ff9f8e77873b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:46:51 DEBUG : file1: Remove: 2024/04/25 06:46:51 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:46:51 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ec17ff9f8e77873b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/04/25 06:46:51 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/04/25 06:46:59 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:46:59 DEBUG : : Looking for writers 2024/04/25 06:46:59 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (10.03s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:46:59 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:46:59 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:46:59 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:47:00 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:47:00 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:00 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:47:00 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:47:00 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/04/25 06:47:00 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:00 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (5 bytes), uploading instead of streaming 2024/04/25 06:47:00 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f52882e3d103429", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:00 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f52882e3d103429", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:00 DEBUG : file1: Remove: 2024/04/25 06:47:00 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:47:00 DEBUG : file1: >Remove: err= 2024/04/25 06:47:00 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f52882e3d103429", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f52882e3d103429", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/04/25 06:47:00 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/04/25 06:47:00 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:00 DEBUG : : Looking for writers 2024/04/25 06:47:00 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (1.60s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:47:00 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:47:00 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:47:00 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:47:01 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:47:01 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:01 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:47:01 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:47:01 DEBUG : file1: WriteFileHandle.Release closing 2024/04/25 06:47:01 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:01 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:47:01 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "30cdd5aca3a95490", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:01 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "30cdd5aca3a95490", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:01 DEBUG : file1: Remove: 2024/04/25 06:47:01 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:47:01 DEBUG : file1: >Remove: err= 2024/04/25 06:47:01 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "30cdd5aca3a95490", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "30cdd5aca3a95490", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/04/25 06:47:01 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/04/25 06:47:01 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:01 DEBUG : : Looking for writers 2024/04/25 06:47:01 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.12s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:47:02 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:47:02 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:47:02 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:47:02 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:47:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:02 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:47:02 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:47:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:02 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (2 bytes), uploading instead of streaming 2024/04/25 06:47:03 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8927685b56c02936", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:03 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8927685b56c02936", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:03 DEBUG : file1: Remove: 2024/04/25 06:47:03 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:47:03 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8927685b56c02936", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/04/25 06:47:03 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:03 DEBUG : : Looking for writers 2024/04/25 06:47:03 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.20s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:47:03 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:47:03 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:47:03 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:47:03 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:47:03 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:03 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:47:03 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:47:03 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:03 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:47:04 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "365d2db4910158df", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:04 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "365d2db4910158df", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:04 DEBUG : file1: Remove: 2024/04/25 06:47:04 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:47:04 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "365d2db4910158df", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/04/25 06:47:04 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/25 06:47:04 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/04/25 06:47:04 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:04 DEBUG : : Looking for writers 2024/04/25 06:47:04 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (1.61s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8", Local "Local file system at /tmp/rclone2551513565", Modify Window "876000h0m0s" 2024/04/25 06:47:04 INFO : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: poll-interval is not supported by this remote 2024/04/25 06:47:04 NOTICE: QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:47:04 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:47:05 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:47:05 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:05 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:47:05 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:47:05 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:47:05 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: File to upload is small (100 bytes), uploading instead of streaming 2024/04/25 06:47:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b6a7bc492d7b05e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:06 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b6a7bc492d7b05e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:06 DEBUG : file1: Remove: 2024/04/25 06:47:06 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:47:06 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b6a7bc492d7b05e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/04/25 06:47:06 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/25 06:47:06 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/04/25 06:47:06 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:47:06 DEBUG : : Looking for writers 2024/04/25 06:47:06 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (2.09s) FAIL 2024/04/25 06:47:07 DEBUG : QingStor bucket rclone-test-kulomeh8zegaqus9gicujuw8: Purge dir "" 2024/04/25 06:47:08 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "9cfd38168a5366c8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:47:08 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 5m48.857845281s (try 4/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]