"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 5/5) 2024/05/06 03:55:12 DEBUG : Creating backend with remote "TestQingStor:rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:12 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/05/06 03:55:12 DEBUG : Creating backend with remote "/tmp/rclone4086543499" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:12 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:12 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fbc0f6f3c44fe6c6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:14 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:14 DEBUG : : Looking for writers 2024/05/06 03:55:14 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (2.31s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:14 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:14 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a35ba4bf498b344b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:15 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:15 DEBUG : : Looking for writers 2024/05/06 03:55:15 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (0.89s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:15 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:15 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "45b695971ed77241", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:16 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:16 DEBUG : : Looking for writers 2024/05/06 03:55:16 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (0.89s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:16 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:16 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bb2256d5baddf498", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:17 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:17 DEBUG : : Looking for writers 2024/05/06 03:55:17 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (0.89s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:17 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:17 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8862739a74251b67", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:18 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:18 DEBUG : : Looking for writers 2024/05/06 03:55:18 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (0.89s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:18 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:18 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "06287e955988689b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:18 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:18 DEBUG : : Looking for writers 2024/05/06 03:55:18 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (0.89s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:19 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:19 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ba6204e9548fd298", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:19 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:19 DEBUG : : Looking for writers 2024/05/06 03:55:19 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (0.89s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:20 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:20 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1d47fd6cb69a302e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:20 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:20 DEBUG : : Looking for writers 2024/05/06 03:55:20 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (0.89s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:21 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:21 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "774e3ec0fe69ef84", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:21 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:21 DEBUG : : Looking for writers 2024/05/06 03:55:21 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (0.89s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:21 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:21 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4d138b3d508463fd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:22 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:22 DEBUG : : Looking for writers 2024/05/06 03:55:22 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (0.89s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:22 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:22 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e5fe5d7c3cf6bd2a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:23 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:23 DEBUG : : Looking for writers 2024/05/06 03:55:23 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (0.89s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:23 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:23 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "102b29baccf8240c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:24 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:24 DEBUG : : Looking for writers 2024/05/06 03:55:24 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (0.89s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:24 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:24 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "061c039dccddf944", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:25 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:25 DEBUG : : Looking for writers 2024/05/06 03:55:25 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (0.89s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:25 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:25 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b84a36648768ce9f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:26 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:26 DEBUG : : Looking for writers 2024/05/06 03:55:26 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (0.89s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:26 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:26 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "51c681342495b6c4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:26 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:26 DEBUG : : Looking for writers 2024/05/06 03:55:26 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (0.89s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:27 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:27 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ab0cf783df6de40e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:27 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:27 DEBUG : : Looking for writers 2024/05/06 03:55:27 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (0.89s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:28 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:28 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "29eb1f1fb8c19eb2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:28 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:28 DEBUG : : Looking for writers 2024/05/06 03:55:28 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (0.89s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:29 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:29 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f9b1c22cb5b914f8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:29 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:29 DEBUG : : Looking for writers 2024/05/06 03:55:29 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (0.89s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:29 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:29 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9cd1c88e123553ff", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:30 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:30 DEBUG : : Looking for writers 2024/05/06 03:55:30 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (0.89s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:30 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:30 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34e984ca41723df5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:31 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:31 DEBUG : : Looking for writers 2024/05/06 03:55:31 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:31 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:31 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6526ec250c55756a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:32 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:32 DEBUG : : Looking for writers 2024/05/06 03:55:32 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:32 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:32 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "186919bee77409a8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:33 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:33 DEBUG : : Looking for writers 2024/05/06 03:55:33 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:33 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:33 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:33 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:33 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:33 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72a60602e2f0ba88", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:34 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:34 DEBUG : : Looking for writers 2024/05/06 03:55:34 DEBUG : >WaitForWriters: 2024/05/06 03:55:34 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:34 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:34 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:34 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:34 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:34 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:34 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:34 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "92af605dfe086ef6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:35 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:35 DEBUG : : Looking for writers 2024/05/06 03:55:35 DEBUG : >WaitForWriters: 2024/05/06 03:55:35 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:35 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:35 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:35 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:35 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:35 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:35 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:35 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1e624d5335d8a51a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:35 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:35 DEBUG : : Looking for writers 2024/05/06 03:55:35 DEBUG : >WaitForWriters: 2024/05/06 03:55:35 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (5.34s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (0.89s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (0.89s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (0.89s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (0.89s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (0.89s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (0.88s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:36 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:36 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ebc13a9df507d532", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:36 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:36 DEBUG : : Looking for writers 2024/05/06 03:55:36 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (0.89s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:37 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:37 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5895acc7c8501bf4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:37 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:37 DEBUG : : Looking for writers 2024/05/06 03:55:37 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (0.89s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:37 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:37 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f46554ffff52a702", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:38 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:38 DEBUG : : Looking for writers 2024/05/06 03:55:38 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (0.89s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:38 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:38 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "69183e85bf2d620e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:39 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:39 DEBUG : : Looking for writers 2024/05/06 03:55:39 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (0.89s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:39 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:39 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0ffd9d9dc614d869", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:40 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:40 DEBUG : : Looking for writers 2024/05/06 03:55:40 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (0.89s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:40 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:40 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "43c35613401f72ff", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:41 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:41 DEBUG : : Looking for writers 2024/05/06 03:55:41 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:41 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:41 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:41 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:41 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:41 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:41 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "05acfef2224fffe6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:42 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:42 DEBUG : : Looking for writers 2024/05/06 03:55:42 DEBUG : >WaitForWriters: 2024/05/06 03:55:42 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:42 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:42 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:42 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:42 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:42 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:42 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "836ee551847442f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:42 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:42 DEBUG : : Looking for writers 2024/05/06 03:55:42 DEBUG : >WaitForWriters: 2024/05/06 03:55:43 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:43 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:43 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:43 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:43 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:43 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8f087edfffc69774", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:44 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:44 DEBUG : : Looking for writers 2024/05/06 03:55:44 DEBUG : >WaitForWriters: 2024/05/06 03:55:44 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:45 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:45 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:45 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:45 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:45 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:45 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:45 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c1b980f73edcae93", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:45 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:45 DEBUG : : Looking for writers 2024/05/06 03:55:45 DEBUG : >WaitForWriters: 2024/05/06 03:55:45 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:46 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:46 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:46 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:46 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:46 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:46 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:46 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "26316a974a0420dc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:46 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:46 DEBUG : : Looking for writers 2024/05/06 03:55:46 DEBUG : >WaitForWriters: 2024/05/06 03:55:46 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (6.31s) --- FAIL: TestFileRename/off,forceCache=false (0.89s) --- FAIL: TestFileRename/minimal,forceCache=false (0.89s) --- FAIL: TestFileRename/minimal,forceCache=true (0.89s) --- FAIL: TestFileRename/writes,forceCache=false (1.96s) --- FAIL: TestFileRename/writes,forceCache=true (0.84s) --- FAIL: TestFileRename/full,forceCache=false (0.83s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:46 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:46 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e1746791c44cdff6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:47 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:47 DEBUG : : Looking for writers 2024/05/06 03:55:47 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (0.83s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:47 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:47 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "27664ffc7a544f26", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:48 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:48 DEBUG : : Looking for writers 2024/05/06 03:55:48 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (0.83s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:48 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:48 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8bbfa20880b10a31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:49 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:49 DEBUG : : Looking for writers 2024/05/06 03:55:49 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (0.84s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:49 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:49 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6a6fa72d8e7d7b95", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:49 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:49 DEBUG : : Looking for writers 2024/05/06 03:55:49 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (0.83s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:50 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:50 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "562914a961083cbd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:50 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:50 DEBUG : : Looking for writers 2024/05/06 03:55:50 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (0.84s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:51 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:51 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:51 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d4bb6c9add14808c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:51 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:51 DEBUG : : Looking for writers 2024/05/06 03:55:51 DEBUG : >WaitForWriters: 2024/05/06 03:55:51 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (0.84s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:51 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:51 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:51 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:51 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "956f980bb3c023ef", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:52 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:52 DEBUG : : Looking for writers 2024/05/06 03:55:52 DEBUG : >WaitForWriters: 2024/05/06 03:55:52 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (0.84s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:52 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:52 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:52 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:52 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:52 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "48d5c4046ac35a89", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:53 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:53 DEBUG : : Looking for writers 2024/05/06 03:55:53 DEBUG : >WaitForWriters: 2024/05/06 03:55:53 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (0.84s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:53 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:53 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:53 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:53 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:53 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "73297a62b00cab69", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:54 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:54 DEBUG : : Looking for writers 2024/05/06 03:55:54 DEBUG : >WaitForWriters: 2024/05/06 03:55:54 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (0.84s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:54 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:54 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:54 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:54 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:54 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9cb5f46622adb7ff", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:55 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : >WaitForWriters: 2024/05/06 03:55:55 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (0.84s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:55:55 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:55:55 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:55:55 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:55 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:55:55 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:55:55 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:55:55 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:55:55 DEBUG : file1: newRWFileHandle: 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): openPending: 2024/05/06 03:55:55 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:55:55 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): >openPending: err= 2024/05/06 03:55:55 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:55:55 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:55 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:55:55 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): _writeAt: size=5, off=0 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): >_writeAt: n=5, err= 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): _writeAt: size=7, off=5 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): >_writeAt: n=7, err= 2024/05/06 03:55:55 DEBUG : file1: vfs cache: truncate to size=11 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): close: 2024/05/06 03:55:55 DEBUG : file1: vfs cache: setting modification time to 2024-05-06 03:55:55.53931323 +0000 UTC m=+43.053991372 2024/05/06 03:55:55 INFO : file1: vfs cache: queuing for upload in 100ms 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): >close: err= 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): close: 2024/05/06 03:55:55 DEBUG : file1(0xc000815c80): >close: err=file already closed 2024/05/06 03:55:55 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : file1: reading active writers 2024/05/06 03:55:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : file1: reading active writers 2024/05/06 03:55:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : file1: reading active writers 2024/05/06 03:55:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : file1: reading active writers 2024/05/06 03:55:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:55:55 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : file1: reading active writers 2024/05/06 03:55:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:55:55 DEBUG : : Looking for writers 2024/05/06 03:55:55 DEBUG : file1: reading active writers 2024/05/06 03:55:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:55:56 DEBUG : : Looking for writers 2024/05/06 03:55:56 DEBUG : file1: reading active writers 2024/05/06 03:55:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:55:56 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8cf33c45011c4b7a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:56 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8cf33c45011c4b7a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:56 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:55:56 DEBUG : : Looking for writers 2024/05/06 03:55:56 DEBUG : file1: reading active writers 2024/05/06 03:55:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:55:57 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2eee4275aa81e619", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:57 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2eee4275aa81e619", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:57 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:55:57 DEBUG : : Looking for writers 2024/05/06 03:55:57 DEBUG : file1: reading active writers 2024/05/06 03:55:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:55:58 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d20389502ae35c1f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:58 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d20389502ae35c1f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:58 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:55:58 DEBUG : : Looking for writers 2024/05/06 03:55:58 DEBUG : file1: reading active writers 2024/05/06 03:55:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:55:59 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "791f73cf93ff7d2d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:59 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "791f73cf93ff7d2d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:59 DEBUG : : Looking for writers 2024/05/06 03:55:59 DEBUG : file1: reading active writers 2024/05/06 03:55:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:00 DEBUG : : Looking for writers 2024/05/06 03:56:00 DEBUG : file1: reading active writers 2024/05/06 03:56:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:01 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:56:01 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "42052f5fd0890721", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:01 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "42052f5fd0890721", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:01 DEBUG : : Looking for writers 2024/05/06 03:56:01 DEBUG : file1: reading active writers 2024/05/06 03:56:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:02 DEBUG : : Looking for writers 2024/05/06 03:56:02 DEBUG : file1: reading active writers 2024/05/06 03:56:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:03 DEBUG : : Looking for writers 2024/05/06 03:56:03 DEBUG : file1: reading active writers 2024/05/06 03:56:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:04 DEBUG : : Looking for writers 2024/05/06 03:56:04 DEBUG : file1: reading active writers 2024/05/06 03:56:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:04 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:56:05 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0bd6c2612091ab50", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:05 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0bd6c2612091ab50", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:05 DEBUG : : Looking for writers 2024/05/06 03:56:05 DEBUG : file1: reading active writers 2024/05/06 03:56:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:06 DEBUG : : Looking for writers 2024/05/06 03:56:06 DEBUG : file1: reading active writers 2024/05/06 03:56:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:07 DEBUG : : Looking for writers 2024/05/06 03:56:07 DEBUG : file1: reading active writers 2024/05/06 03:56:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:08 DEBUG : : Looking for writers 2024/05/06 03:56:08 DEBUG : file1: reading active writers 2024/05/06 03:56:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:09 DEBUG : : Looking for writers 2024/05/06 03:56:09 DEBUG : file1: reading active writers 2024/05/06 03:56:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:10 DEBUG : : Looking for writers 2024/05/06 03:56:10 DEBUG : file1: reading active writers 2024/05/06 03:56:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:11 DEBUG : : Looking for writers 2024/05/06 03:56:11 DEBUG : file1: reading active writers 2024/05/06 03:56:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:11 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:56:12 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "33a0177649a05fdf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:12 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "33a0177649a05fdf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:12 DEBUG : : Looking for writers 2024/05/06 03:56:12 DEBUG : file1: reading active writers 2024/05/06 03:56:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:13 DEBUG : : Looking for writers 2024/05/06 03:56:13 DEBUG : file1: reading active writers 2024/05/06 03:56:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:14 DEBUG : : Looking for writers 2024/05/06 03:56:14 DEBUG : file1: reading active writers 2024/05/06 03:56:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:15 DEBUG : : Looking for writers 2024/05/06 03:56:15 DEBUG : file1: reading active writers 2024/05/06 03:56:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:16 DEBUG : : Looking for writers 2024/05/06 03:56:16 DEBUG : file1: reading active writers 2024/05/06 03:56:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:17 DEBUG : : Looking for writers 2024/05/06 03:56:17 DEBUG : file1: reading active writers 2024/05/06 03:56:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:18 DEBUG : : Looking for writers 2024/05/06 03:56:18 DEBUG : file1: reading active writers 2024/05/06 03:56:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:19 DEBUG : : Looking for writers 2024/05/06 03:56:19 DEBUG : file1: reading active writers 2024/05/06 03:56:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:20 DEBUG : : Looking for writers 2024/05/06 03:56:20 DEBUG : file1: reading active writers 2024/05/06 03:56:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:21 DEBUG : : Looking for writers 2024/05/06 03:56:21 DEBUG : file1: reading active writers 2024/05/06 03:56:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:22 DEBUG : : Looking for writers 2024/05/06 03:56:22 DEBUG : file1: reading active writers 2024/05/06 03:56:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:23 DEBUG : : Looking for writers 2024/05/06 03:56:23 DEBUG : file1: reading active writers 2024/05/06 03:56:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:24 DEBUG : : Looking for writers 2024/05/06 03:56:24 DEBUG : file1: reading active writers 2024/05/06 03:56:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:25 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:56:25 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000904000 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0004eab08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824638876480} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889452362286158 ext:43053991372 loc:0x3a12660} ATime:{wall:13944889452362301968 ext:43054007172 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:56:25 DEBUG : >WaitForWriters: fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 2024/05/06 03:56:26 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ebb84ded22003f20", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:26 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ebb84ded22003f20", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/05/06 03:56:33 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:56:33 DEBUG : : Looking for writers 2024/05/06 03:56:33 DEBUG : file1: reading active writers 2024/05/06 03:56:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:56:34 DEBUG : : Looking for writers 2024/05/06 03:56:34 DEBUG : file1: reading active writers 2024/05/06 03:56:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:35 DEBUG : : Looking for writers 2024/05/06 03:56:35 DEBUG : file1: reading active writers 2024/05/06 03:56:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:36 DEBUG : : Looking for writers 2024/05/06 03:56:36 DEBUG : file1: reading active writers 2024/05/06 03:56:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:37 DEBUG : : Looking for writers 2024/05/06 03:56:37 DEBUG : file1: reading active writers 2024/05/06 03:56:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:38 DEBUG : : Looking for writers 2024/05/06 03:56:38 DEBUG : file1: reading active writers 2024/05/06 03:56:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:39 DEBUG : : Looking for writers 2024/05/06 03:56:39 DEBUG : file1: reading active writers 2024/05/06 03:56:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:40 DEBUG : : Looking for writers 2024/05/06 03:56:40 DEBUG : file1: reading active writers 2024/05/06 03:56:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:41 DEBUG : : Looking for writers 2024/05/06 03:56:41 DEBUG : file1: reading active writers 2024/05/06 03:56:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:42 DEBUG : : Looking for writers 2024/05/06 03:56:42 DEBUG : file1: reading active writers 2024/05/06 03:56:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:43 DEBUG : : Looking for writers 2024/05/06 03:56:43 DEBUG : file1: reading active writers 2024/05/06 03:56:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:44 DEBUG : : Looking for writers 2024/05/06 03:56:44 DEBUG : file1: reading active writers 2024/05/06 03:56:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:45 DEBUG : : Looking for writers 2024/05/06 03:56:45 DEBUG : file1: reading active writers 2024/05/06 03:56:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:46 DEBUG : : Looking for writers 2024/05/06 03:56:46 DEBUG : file1: reading active writers 2024/05/06 03:56:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:47 DEBUG : : Looking for writers 2024/05/06 03:56:47 DEBUG : file1: reading active writers 2024/05/06 03:56:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:48 DEBUG : : Looking for writers 2024/05/06 03:56:48 DEBUG : file1: reading active writers 2024/05/06 03:56:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:49 DEBUG : : Looking for writers 2024/05/06 03:56:49 DEBUG : file1: reading active writers 2024/05/06 03:56:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:50 DEBUG : : Looking for writers 2024/05/06 03:56:50 DEBUG : file1: reading active writers 2024/05/06 03:56:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:51 DEBUG : : Looking for writers 2024/05/06 03:56:51 DEBUG : file1: reading active writers 2024/05/06 03:56:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:51 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:56:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9dde9c077b678291", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:52 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9dde9c077b678291", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:56:52 DEBUG : : Looking for writers 2024/05/06 03:56:52 DEBUG : file1: reading active writers 2024/05/06 03:56:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:53 DEBUG : : Looking for writers 2024/05/06 03:56:53 DEBUG : file1: reading active writers 2024/05/06 03:56:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:54 DEBUG : : Looking for writers 2024/05/06 03:56:54 DEBUG : file1: reading active writers 2024/05/06 03:56:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:55 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/05/06 03:56:55 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/05/06 03:56:55 DEBUG : : Looking for writers 2024/05/06 03:56:55 DEBUG : file1: reading active writers 2024/05/06 03:56:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:56 DEBUG : : Looking for writers 2024/05/06 03:56:56 DEBUG : file1: reading active writers 2024/05/06 03:56:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:57 DEBUG : : Looking for writers 2024/05/06 03:56:57 DEBUG : file1: reading active writers 2024/05/06 03:56:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:58 DEBUG : : Looking for writers 2024/05/06 03:56:58 DEBUG : file1: reading active writers 2024/05/06 03:56:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:56:59 DEBUG : : Looking for writers 2024/05/06 03:56:59 DEBUG : file1: reading active writers 2024/05/06 03:56:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:00 DEBUG : : Looking for writers 2024/05/06 03:57:00 DEBUG : file1: reading active writers 2024/05/06 03:57:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:01 DEBUG : : Looking for writers 2024/05/06 03:57:01 DEBUG : file1: reading active writers 2024/05/06 03:57:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:02 DEBUG : : Looking for writers 2024/05/06 03:57:02 DEBUG : file1: reading active writers 2024/05/06 03:57:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:03 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000904000 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0004eab08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824638876480} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889452362286158 ext:43053991372 loc:0x3a12660} ATime:{wall:13944889452362301968 ext:43054007172 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:57:03 DEBUG : >WaitForWriters: 2024/05/06 03:57:03 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (68.30s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:57:03 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:57:03 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:57:03 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:57:03 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:57:03 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:57:03 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:57:03 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:57:03 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:57:03 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:57:03 DEBUG : file1: newRWFileHandle: 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): openPending: 2024/05/06 03:57:03 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:57:03 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): >openPending: err= 2024/05/06 03:57:03 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:57:03 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:57:03 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:57:03 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): _writeAt: size=7, off=0 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): >_writeAt: n=7, err= 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): _writeAt: size=6, off=5 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): >_writeAt: n=6, err= 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): close: 2024/05/06 03:57:03 DEBUG : file1: vfs cache: setting modification time to 2024-05-06 03:57:03.835182331 +0000 UTC m=+111.349860472 2024/05/06 03:57:03 INFO : file1: vfs cache: queuing for upload in 100ms 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): >close: err= 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): _writeAt: size=5, off=0 2024/05/06 03:57:03 DEBUG : file1(0xc000b06400): >_writeAt: n=0, err=file already closed 2024/05/06 03:57:03 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:57:03 DEBUG : : Looking for writers 2024/05/06 03:57:03 DEBUG : file1: reading active writers 2024/05/06 03:57:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:57:03 DEBUG : : Looking for writers 2024/05/06 03:57:03 DEBUG : file1: reading active writers 2024/05/06 03:57:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:57:03 DEBUG : : Looking for writers 2024/05/06 03:57:03 DEBUG : file1: reading active writers 2024/05/06 03:57:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:57:03 DEBUG : : Looking for writers 2024/05/06 03:57:03 DEBUG : file1: reading active writers 2024/05/06 03:57:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:57:03 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:03 DEBUG : : Looking for writers 2024/05/06 03:57:03 DEBUG : file1: reading active writers 2024/05/06 03:57:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:57:04 DEBUG : : Looking for writers 2024/05/06 03:57:04 DEBUG : file1: reading active writers 2024/05/06 03:57:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:57:04 DEBUG : : Looking for writers 2024/05/06 03:57:04 DEBUG : file1: reading active writers 2024/05/06 03:57:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:57:04 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7fd55857c225d63e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:04 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7fd55857c225d63e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:04 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:05 DEBUG : : Looking for writers 2024/05/06 03:57:05 DEBUG : file1: reading active writers 2024/05/06 03:57:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:05 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "48e7cf987c798b31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:05 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "48e7cf987c798b31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:05 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:06 DEBUG : : Looking for writers 2024/05/06 03:57:06 DEBUG : file1: reading active writers 2024/05/06 03:57:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62ac19607f21d424", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:06 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62ac19607f21d424", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:07 DEBUG : : Looking for writers 2024/05/06 03:57:07 DEBUG : file1: reading active writers 2024/05/06 03:57:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:07 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:07 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dfbf9bb0e204736d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:07 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dfbf9bb0e204736d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:08 DEBUG : : Looking for writers 2024/05/06 03:57:08 DEBUG : file1: reading active writers 2024/05/06 03:57:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:09 DEBUG : : Looking for writers 2024/05/06 03:57:09 DEBUG : file1: reading active writers 2024/05/06 03:57:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:09 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:10 DEBUG : : Looking for writers 2024/05/06 03:57:10 DEBUG : file1: reading active writers 2024/05/06 03:57:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1816a1544a5d3c2f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:10 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1816a1544a5d3c2f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:11 DEBUG : : Looking for writers 2024/05/06 03:57:11 DEBUG : file1: reading active writers 2024/05/06 03:57:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:12 DEBUG : : Looking for writers 2024/05/06 03:57:12 DEBUG : file1: reading active writers 2024/05/06 03:57:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:13 DEBUG : : Looking for writers 2024/05/06 03:57:13 DEBUG : file1: reading active writers 2024/05/06 03:57:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:13 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:13 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "006d4e03e8db43e3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:13 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "006d4e03e8db43e3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:14 DEBUG : : Looking for writers 2024/05/06 03:57:14 DEBUG : file1: reading active writers 2024/05/06 03:57:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:15 DEBUG : : Looking for writers 2024/05/06 03:57:15 DEBUG : file1: reading active writers 2024/05/06 03:57:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:16 DEBUG : : Looking for writers 2024/05/06 03:57:16 DEBUG : file1: reading active writers 2024/05/06 03:57:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:17 DEBUG : : Looking for writers 2024/05/06 03:57:17 DEBUG : file1: reading active writers 2024/05/06 03:57:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:18 DEBUG : : Looking for writers 2024/05/06 03:57:18 DEBUG : file1: reading active writers 2024/05/06 03:57:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:19 DEBUG : : Looking for writers 2024/05/06 03:57:19 DEBUG : file1: reading active writers 2024/05/06 03:57:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:20 DEBUG : : Looking for writers 2024/05/06 03:57:20 DEBUG : file1: reading active writers 2024/05/06 03:57:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:20 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:20 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "77444c4516992156", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:20 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "77444c4516992156", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:21 DEBUG : : Looking for writers 2024/05/06 03:57:21 DEBUG : file1: reading active writers 2024/05/06 03:57:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:22 DEBUG : : Looking for writers 2024/05/06 03:57:22 DEBUG : file1: reading active writers 2024/05/06 03:57:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:23 DEBUG : : Looking for writers 2024/05/06 03:57:23 DEBUG : file1: reading active writers 2024/05/06 03:57:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:24 DEBUG : : Looking for writers 2024/05/06 03:57:24 DEBUG : file1: reading active writers 2024/05/06 03:57:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:25 DEBUG : : Looking for writers 2024/05/06 03:57:25 DEBUG : file1: reading active writers 2024/05/06 03:57:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:26 DEBUG : : Looking for writers 2024/05/06 03:57:26 DEBUG : file1: reading active writers 2024/05/06 03:57:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:27 DEBUG : : Looking for writers 2024/05/06 03:57:27 DEBUG : file1: reading active writers 2024/05/06 03:57:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:28 DEBUG : : Looking for writers 2024/05/06 03:57:28 DEBUG : file1: reading active writers 2024/05/06 03:57:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:29 DEBUG : : Looking for writers 2024/05/06 03:57:29 DEBUG : file1: reading active writers 2024/05/06 03:57:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:30 DEBUG : : Looking for writers 2024/05/06 03:57:30 DEBUG : file1: reading active writers 2024/05/06 03:57:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:31 DEBUG : : Looking for writers 2024/05/06 03:57:31 DEBUG : file1: reading active writers 2024/05/06 03:57:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:32 DEBUG : : Looking for writers 2024/05/06 03:57:32 DEBUG : file1: reading active writers 2024/05/06 03:57:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:33 DEBUG : : Looking for writers 2024/05/06 03:57:33 DEBUG : file1: reading active writers 2024/05/06 03:57:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:33 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:57:33 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0007dc4b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000906008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643182656} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889525672599291 ext:111349860472 loc:0x3a12660} ATime:{wall:13944889525672630739 ext:111349891922 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:57:33 DEBUG : >WaitForWriters: fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 2024/05/06 03:57:34 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79640a6960552917", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:57:34 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79640a6960552917", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/05/06 03:57:41 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:57:41 DEBUG : : Looking for writers 2024/05/06 03:57:41 DEBUG : file1: reading active writers 2024/05/06 03:57:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:57:41 DEBUG : : Looking for writers 2024/05/06 03:57:41 DEBUG : file1: reading active writers 2024/05/06 03:57:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:57:41 DEBUG : : Looking for writers 2024/05/06 03:57:41 DEBUG : file1: reading active writers 2024/05/06 03:57:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:57:41 DEBUG : : Looking for writers 2024/05/06 03:57:41 DEBUG : file1: reading active writers 2024/05/06 03:57:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:57:41 DEBUG : : Looking for writers 2024/05/06 03:57:41 DEBUG : file1: reading active writers 2024/05/06 03:57:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:57:42 DEBUG : : Looking for writers 2024/05/06 03:57:42 DEBUG : file1: reading active writers 2024/05/06 03:57:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:57:42 DEBUG : : Looking for writers 2024/05/06 03:57:42 DEBUG : file1: reading active writers 2024/05/06 03:57:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:57:43 DEBUG : : Looking for writers 2024/05/06 03:57:43 DEBUG : file1: reading active writers 2024/05/06 03:57:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:44 DEBUG : : Looking for writers 2024/05/06 03:57:44 DEBUG : file1: reading active writers 2024/05/06 03:57:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:45 DEBUG : : Looking for writers 2024/05/06 03:57:45 DEBUG : file1: reading active writers 2024/05/06 03:57:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:46 DEBUG : : Looking for writers 2024/05/06 03:57:46 DEBUG : file1: reading active writers 2024/05/06 03:57:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:47 DEBUG : : Looking for writers 2024/05/06 03:57:47 DEBUG : file1: reading active writers 2024/05/06 03:57:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:48 DEBUG : : Looking for writers 2024/05/06 03:57:48 DEBUG : file1: reading active writers 2024/05/06 03:57:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:49 DEBUG : : Looking for writers 2024/05/06 03:57:49 DEBUG : file1: reading active writers 2024/05/06 03:57:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:50 DEBUG : : Looking for writers 2024/05/06 03:57:50 DEBUG : file1: reading active writers 2024/05/06 03:57:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:51 DEBUG : : Looking for writers 2024/05/06 03:57:51 DEBUG : file1: reading active writers 2024/05/06 03:57:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:52 DEBUG : : Looking for writers 2024/05/06 03:57:52 DEBUG : file1: reading active writers 2024/05/06 03:57:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:53 DEBUG : : Looking for writers 2024/05/06 03:57:53 DEBUG : file1: reading active writers 2024/05/06 03:57:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:54 DEBUG : : Looking for writers 2024/05/06 03:57:54 DEBUG : file1: reading active writers 2024/05/06 03:57:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:55 DEBUG : : Looking for writers 2024/05/06 03:57:55 DEBUG : file1: reading active writers 2024/05/06 03:57:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:56 DEBUG : : Looking for writers 2024/05/06 03:57:56 DEBUG : file1: reading active writers 2024/05/06 03:57:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:57 DEBUG : : Looking for writers 2024/05/06 03:57:57 DEBUG : file1: reading active writers 2024/05/06 03:57:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:58 DEBUG : : Looking for writers 2024/05/06 03:57:58 DEBUG : file1: reading active writers 2024/05/06 03:57:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:57:59 DEBUG : : Looking for writers 2024/05/06 03:57:59 DEBUG : file1: reading active writers 2024/05/06 03:57:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:00 DEBUG : : Looking for writers 2024/05/06 03:58:00 DEBUG : file1: reading active writers 2024/05/06 03:58:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:00 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:00 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fc81d2a34e617dd4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:00 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fc81d2a34e617dd4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:01 DEBUG : : Looking for writers 2024/05/06 03:58:01 DEBUG : file1: reading active writers 2024/05/06 03:58:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:02 DEBUG : : Looking for writers 2024/05/06 03:58:02 DEBUG : file1: reading active writers 2024/05/06 03:58:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:03 DEBUG : : Looking for writers 2024/05/06 03:58:03 DEBUG : file1: reading active writers 2024/05/06 03:58:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:03 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/05/06 03:58:03 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/05/06 03:58:04 DEBUG : : Looking for writers 2024/05/06 03:58:04 DEBUG : file1: reading active writers 2024/05/06 03:58:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:05 DEBUG : : Looking for writers 2024/05/06 03:58:05 DEBUG : file1: reading active writers 2024/05/06 03:58:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:06 DEBUG : : Looking for writers 2024/05/06 03:58:06 DEBUG : file1: reading active writers 2024/05/06 03:58:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:07 DEBUG : : Looking for writers 2024/05/06 03:58:07 DEBUG : file1: reading active writers 2024/05/06 03:58:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:08 DEBUG : : Looking for writers 2024/05/06 03:58:08 DEBUG : file1: reading active writers 2024/05/06 03:58:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:09 DEBUG : : Looking for writers 2024/05/06 03:58:09 DEBUG : file1: reading active writers 2024/05/06 03:58:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:10 DEBUG : : Looking for writers 2024/05/06 03:58:10 DEBUG : file1: reading active writers 2024/05/06 03:58:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:11 DEBUG : : Looking for writers 2024/05/06 03:58:11 DEBUG : file1: reading active writers 2024/05/06 03:58:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:58:11 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0007dc4b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000906008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643182656} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889525672599291 ext:111349860472 loc:0x3a12660} ATime:{wall:13944889525672630739 ext:111349891922 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:58:11 DEBUG : >WaitForWriters: 2024/05/06 03:58:11 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (68.41s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:58:11 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:58:11 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:58:11 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:58:11 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:58:11 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:58:11 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:58:11 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:58:11 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:58:12 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:58:12 DEBUG : file1: newRWFileHandle: 2024/05/06 03:58:12 DEBUG : file1(0xc00058e280): openPending: 2024/05/06 03:58:12 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:58:12 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:58:12 DEBUG : file1(0xc00058e280): >openPending: err= 2024/05/06 03:58:12 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:58:12 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:58:12 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:58:12 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/05/06 03:58:12 DEBUG : file1(0xc00058e280): close: 2024/05/06 03:58:12 DEBUG : file1: vfs cache: setting modification time to 2024-05-06 03:58:12.253496212 +0000 UTC m=+179.768174334 2024/05/06 03:58:12 INFO : file1: vfs cache: queuing for upload in 100ms 2024/05/06 03:58:12 DEBUG : file1(0xc00058e280): >close: err= 2024/05/06 03:58:12 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/05/06 03:58:12 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/05/06 03:58:12 DEBUG : file2: newRWFileHandle: 2024/05/06 03:58:12 DEBUG : file2(0xc00058e540): openPending: 2024/05/06 03:58:12 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:58:12 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/05/06 03:58:12 DEBUG : file2(0xc00058e540): >openPending: err= 2024/05/06 03:58:12 DEBUG : file2: >newRWFileHandle: err= 2024/05/06 03:58:12 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/05/06 03:58:12 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/05/06 03:58:12 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/05/06 03:58:12 DEBUG : file2(0xc00058e540): RWFileHandle.Flush 2024/05/06 03:58:12 DEBUG : file2(0xc00058e540): RWFileHandle.Release 2024/05/06 03:58:12 DEBUG : file2(0xc00058e540): close: 2024/05/06 03:58:12 DEBUG : file2: vfs cache: setting modification time to 2024-05-06 03:58:12.254591797 +0000 UTC m=+179.769269919 2024/05/06 03:58:12 INFO : file2: vfs cache: queuing for upload in 100ms 2024/05/06 03:58:12 DEBUG : file2(0xc00058e540): >close: err= 2024/05/06 03:58:12 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/05/06 03:58:12 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:12 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/05/06 03:58:12 DEBUG : : Looking for writers 2024/05/06 03:58:12 DEBUG : file1: reading active writers 2024/05/06 03:58:12 DEBUG : file2: reading active writers 2024/05/06 03:58:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/05/06 03:58:13 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "efc4b703ac482713", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:13 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "efc4b703ac482713", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:13 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:13 DEBUG : : Looking for writers 2024/05/06 03:58:13 DEBUG : file1: reading active writers 2024/05/06 03:58:13 DEBUG : file2: reading active writers 2024/05/06 03:58:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:13 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "707a7ab745800c61", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:13 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "707a7ab745800c61", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:13 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:14 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "674fe68bbbbbc752", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:14 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "674fe68bbbbbc752", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:14 DEBUG : : Looking for writers 2024/05/06 03:58:14 DEBUG : file1: reading active writers 2024/05/06 03:58:14 DEBUG : file2: reading active writers 2024/05/06 03:58:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:14 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e5ee1b1225129d8b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:14 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e5ee1b1225129d8b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:15 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:15 DEBUG : : Looking for writers 2024/05/06 03:58:15 DEBUG : file1: reading active writers 2024/05/06 03:58:15 DEBUG : file2: reading active writers 2024/05/06 03:58:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:15 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "40f00c98cfe24fe1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:15 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "40f00c98cfe24fe1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:16 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0387ad972135c73a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:16 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0387ad972135c73a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:16 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:16 DEBUG : : Looking for writers 2024/05/06 03:58:16 DEBUG : file1: reading active writers 2024/05/06 03:58:16 DEBUG : file2: reading active writers 2024/05/06 03:58:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:16 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:16 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2333d73d68fe81b7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:16 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2333d73d68fe81b7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:17 DEBUG : : Looking for writers 2024/05/06 03:58:17 DEBUG : file1: reading active writers 2024/05/06 03:58:17 DEBUG : file2: reading active writers 2024/05/06 03:58:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:17 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5300717dda433f64", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:17 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5300717dda433f64", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:18 DEBUG : : Looking for writers 2024/05/06 03:58:18 DEBUG : file1: reading active writers 2024/05/06 03:58:18 DEBUG : file2: reading active writers 2024/05/06 03:58:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:18 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:19 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:19 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9841a917a008d28d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:19 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9841a917a008d28d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:19 DEBUG : : Looking for writers 2024/05/06 03:58:19 DEBUG : file1: reading active writers 2024/05/06 03:58:19 DEBUG : file2: reading active writers 2024/05/06 03:58:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:19 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62e09b9635320558", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:19 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "62e09b9635320558", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:20 DEBUG : : Looking for writers 2024/05/06 03:58:20 DEBUG : file1: reading active writers 2024/05/06 03:58:20 DEBUG : file2: reading active writers 2024/05/06 03:58:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:21 DEBUG : : Looking for writers 2024/05/06 03:58:21 DEBUG : file1: reading active writers 2024/05/06 03:58:21 DEBUG : file2: reading active writers 2024/05/06 03:58:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:22 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:22 DEBUG : : Looking for writers 2024/05/06 03:58:22 DEBUG : file1: reading active writers 2024/05/06 03:58:22 DEBUG : file2: reading active writers 2024/05/06 03:58:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:22 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:22 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34e4d6624dd26fa5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:22 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34e4d6624dd26fa5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:23 DEBUG : : Looking for writers 2024/05/06 03:58:23 DEBUG : file1: reading active writers 2024/05/06 03:58:23 DEBUG : file2: reading active writers 2024/05/06 03:58:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c9c9507bd6e9ef32", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:23 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c9c9507bd6e9ef32", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:24 DEBUG : : Looking for writers 2024/05/06 03:58:24 DEBUG : file1: reading active writers 2024/05/06 03:58:24 DEBUG : file2: reading active writers 2024/05/06 03:58:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:25 DEBUG : : Looking for writers 2024/05/06 03:58:25 DEBUG : file1: reading active writers 2024/05/06 03:58:25 DEBUG : file2: reading active writers 2024/05/06 03:58:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:26 DEBUG : : Looking for writers 2024/05/06 03:58:26 DEBUG : file1: reading active writers 2024/05/06 03:58:26 DEBUG : file2: reading active writers 2024/05/06 03:58:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:27 DEBUG : : Looking for writers 2024/05/06 03:58:27 DEBUG : file1: reading active writers 2024/05/06 03:58:27 DEBUG : file2: reading active writers 2024/05/06 03:58:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:28 DEBUG : : Looking for writers 2024/05/06 03:58:28 DEBUG : file1: reading active writers 2024/05/06 03:58:28 DEBUG : file2: reading active writers 2024/05/06 03:58:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:29 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:29 DEBUG : : Looking for writers 2024/05/06 03:58:29 DEBUG : file1: reading active writers 2024/05/06 03:58:29 DEBUG : file2: reading active writers 2024/05/06 03:58:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:30 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:58:30 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2640c499c2afe312", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:30 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2640c499c2afe312", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:30 DEBUG : : Looking for writers 2024/05/06 03:58:30 DEBUG : file1: reading active writers 2024/05/06 03:58:30 DEBUG : file2: reading active writers 2024/05/06 03:58:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:30 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "05eba25c1a88027e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:30 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "05eba25c1a88027e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:31 DEBUG : : Looking for writers 2024/05/06 03:58:31 DEBUG : file1: reading active writers 2024/05/06 03:58:31 DEBUG : file2: reading active writers 2024/05/06 03:58:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:32 DEBUG : : Looking for writers 2024/05/06 03:58:32 DEBUG : file1: reading active writers 2024/05/06 03:58:32 DEBUG : file2: reading active writers 2024/05/06 03:58:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:33 DEBUG : : Looking for writers 2024/05/06 03:58:33 DEBUG : file1: reading active writers 2024/05/06 03:58:33 DEBUG : file2: reading active writers 2024/05/06 03:58:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:34 DEBUG : : Looking for writers 2024/05/06 03:58:34 DEBUG : file1: reading active writers 2024/05/06 03:58:34 DEBUG : file2: reading active writers 2024/05/06 03:58:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:35 DEBUG : : Looking for writers 2024/05/06 03:58:35 DEBUG : file1: reading active writers 2024/05/06 03:58:35 DEBUG : file2: reading active writers 2024/05/06 03:58:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:36 DEBUG : : Looking for writers 2024/05/06 03:58:36 DEBUG : file1: reading active writers 2024/05/06 03:58:36 DEBUG : file2: reading active writers 2024/05/06 03:58:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:37 DEBUG : : Looking for writers 2024/05/06 03:58:37 DEBUG : file1: reading active writers 2024/05/06 03:58:37 DEBUG : file2: reading active writers 2024/05/06 03:58:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:38 DEBUG : : Looking for writers 2024/05/06 03:58:38 DEBUG : file1: reading active writers 2024/05/06 03:58:38 DEBUG : file2: reading active writers 2024/05/06 03:58:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:39 DEBUG : : Looking for writers 2024/05/06 03:58:39 DEBUG : file1: reading active writers 2024/05/06 03:58:39 DEBUG : file2: reading active writers 2024/05/06 03:58:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:40 DEBUG : : Looking for writers 2024/05/06 03:58:40 DEBUG : file1: reading active writers 2024/05/06 03:58:40 DEBUG : file2: reading active writers 2024/05/06 03:58:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:41 DEBUG : : Looking for writers 2024/05/06 03:58:41 DEBUG : file1: reading active writers 2024/05/06 03:58:41 DEBUG : file2: reading active writers 2024/05/06 03:58:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:42 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc00057e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000906808 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643184704} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889599179099028 ext:179768174334 loc:0x3a12660} ATime:{wall:13944889599179367501 ext:179768442807 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc00057e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000906908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643184960} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889599180194613 ext:179769269919 loc:0x3a12660} ATime:{wall:13944889599180318435 ext:179769393732 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:58:42 DEBUG : >WaitForWriters: fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 2024/05/06 03:58:42 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:58:43 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "41566f857d59f65a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:43 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "41566f857d59f65a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:43 DEBUG : file1: vfs cache: starting upload fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 2024/05/06 03:58:44 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "32af7bff22566b5d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:58:44 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "32af7bff22566b5d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:198: Not found "file1" fstest.go:198: Not found "file2" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/05/06 03:58:50 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/05/06 03:58:50 DEBUG : : Looking for writers 2024/05/06 03:58:50 DEBUG : file1: reading active writers 2024/05/06 03:58:50 DEBUG : file2: reading active writers 2024/05/06 03:58:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/05/06 03:58:51 DEBUG : : Looking for writers 2024/05/06 03:58:51 DEBUG : file1: reading active writers 2024/05/06 03:58:51 DEBUG : file2: reading active writers 2024/05/06 03:58:51 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:52 DEBUG : : Looking for writers 2024/05/06 03:58:52 DEBUG : file1: reading active writers 2024/05/06 03:58:52 DEBUG : file2: reading active writers 2024/05/06 03:58:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:53 DEBUG : : Looking for writers 2024/05/06 03:58:53 DEBUG : file1: reading active writers 2024/05/06 03:58:53 DEBUG : file2: reading active writers 2024/05/06 03:58:53 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:54 DEBUG : : Looking for writers 2024/05/06 03:58:54 DEBUG : file1: reading active writers 2024/05/06 03:58:54 DEBUG : file2: reading active writers 2024/05/06 03:58:54 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:55 DEBUG : : Looking for writers 2024/05/06 03:58:55 DEBUG : file1: reading active writers 2024/05/06 03:58:55 DEBUG : file2: reading active writers 2024/05/06 03:58:55 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:56 DEBUG : : Looking for writers 2024/05/06 03:58:56 DEBUG : file1: reading active writers 2024/05/06 03:58:56 DEBUG : file2: reading active writers 2024/05/06 03:58:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:57 DEBUG : : Looking for writers 2024/05/06 03:58:57 DEBUG : file1: reading active writers 2024/05/06 03:58:57 DEBUG : file2: reading active writers 2024/05/06 03:58:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:58 DEBUG : : Looking for writers 2024/05/06 03:58:58 DEBUG : file1: reading active writers 2024/05/06 03:58:58 DEBUG : file2: reading active writers 2024/05/06 03:58:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:58:59 DEBUG : : Looking for writers 2024/05/06 03:58:59 DEBUG : file1: reading active writers 2024/05/06 03:58:59 DEBUG : file2: reading active writers 2024/05/06 03:58:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:00 DEBUG : : Looking for writers 2024/05/06 03:59:00 DEBUG : file2: reading active writers 2024/05/06 03:59:00 DEBUG : file1: reading active writers 2024/05/06 03:59:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:01 DEBUG : : Looking for writers 2024/05/06 03:59:01 DEBUG : file1: reading active writers 2024/05/06 03:59:01 DEBUG : file2: reading active writers 2024/05/06 03:59:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:02 DEBUG : : Looking for writers 2024/05/06 03:59:02 DEBUG : file1: reading active writers 2024/05/06 03:59:02 DEBUG : file2: reading active writers 2024/05/06 03:59:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:03 DEBUG : : Looking for writers 2024/05/06 03:59:03 DEBUG : file1: reading active writers 2024/05/06 03:59:03 DEBUG : file2: reading active writers 2024/05/06 03:59:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:04 DEBUG : : Looking for writers 2024/05/06 03:59:04 DEBUG : file2: reading active writers 2024/05/06 03:59:04 DEBUG : file1: reading active writers 2024/05/06 03:59:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:05 DEBUG : : Looking for writers 2024/05/06 03:59:05 DEBUG : file1: reading active writers 2024/05/06 03:59:05 DEBUG : file2: reading active writers 2024/05/06 03:59:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:06 DEBUG : : Looking for writers 2024/05/06 03:59:06 DEBUG : file1: reading active writers 2024/05/06 03:59:06 DEBUG : file2: reading active writers 2024/05/06 03:59:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:07 DEBUG : : Looking for writers 2024/05/06 03:59:07 DEBUG : file1: reading active writers 2024/05/06 03:59:07 DEBUG : file2: reading active writers 2024/05/06 03:59:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:08 DEBUG : : Looking for writers 2024/05/06 03:59:08 DEBUG : file1: reading active writers 2024/05/06 03:59:08 DEBUG : file2: reading active writers 2024/05/06 03:59:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:09 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:59:09 DEBUG : : Looking for writers 2024/05/06 03:59:09 DEBUG : file1: reading active writers 2024/05/06 03:59:09 DEBUG : file2: reading active writers 2024/05/06 03:59:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:09 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6fd338eedad9d75d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:09 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6fd338eedad9d75d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:09 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:59:10 DEBUG : : Looking for writers 2024/05/06 03:59:10 DEBUG : file1: reading active writers 2024/05/06 03:59:10 DEBUG : file2: reading active writers 2024/05/06 03:59:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f6be0d948f763644", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:10 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f6be0d948f763644", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:11 DEBUG : : Looking for writers 2024/05/06 03:59:11 DEBUG : file1: reading active writers 2024/05/06 03:59:11 DEBUG : file2: reading active writers 2024/05/06 03:59:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:11 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/05/06 03:59:11 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/05/06 03:59:11 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/05/06 03:59:12 DEBUG : : Looking for writers 2024/05/06 03:59:12 DEBUG : file1: reading active writers 2024/05/06 03:59:12 DEBUG : file2: reading active writers 2024/05/06 03:59:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:13 DEBUG : : Looking for writers 2024/05/06 03:59:13 DEBUG : file1: reading active writers 2024/05/06 03:59:13 DEBUG : file2: reading active writers 2024/05/06 03:59:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:14 DEBUG : : Looking for writers 2024/05/06 03:59:14 DEBUG : file1: reading active writers 2024/05/06 03:59:14 DEBUG : file2: reading active writers 2024/05/06 03:59:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:15 DEBUG : : Looking for writers 2024/05/06 03:59:15 DEBUG : file1: reading active writers 2024/05/06 03:59:15 DEBUG : file2: reading active writers 2024/05/06 03:59:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:16 DEBUG : : Looking for writers 2024/05/06 03:59:16 DEBUG : file1: reading active writers 2024/05/06 03:59:16 DEBUG : file2: reading active writers 2024/05/06 03:59:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:17 DEBUG : : Looking for writers 2024/05/06 03:59:17 DEBUG : file1: reading active writers 2024/05/06 03:59:17 DEBUG : file2: reading active writers 2024/05/06 03:59:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:18 DEBUG : : Looking for writers 2024/05/06 03:59:18 DEBUG : file1: reading active writers 2024/05/06 03:59:18 DEBUG : file2: reading active writers 2024/05/06 03:59:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:19 DEBUG : : Looking for writers 2024/05/06 03:59:19 DEBUG : file1: reading active writers 2024/05/06 03:59:19 DEBUG : file2: reading active writers 2024/05/06 03:59:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:59:20 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc00057e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000906808 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643184704} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889599179099028 ext:179768174334 loc:0x3a12660} ATime:{wall:13944889599179367501 ext:179768442807 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc00057e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000906908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824643184960} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889599180194613 ext:179769269919 loc:0x3a12660} ATime:{wall:13944889599180318435 ext:179769393732 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:59:20 DEBUG : >WaitForWriters: 2024/05/06 03:59:20 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (68.48s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:20 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:20 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:59:20 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:20 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:20 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:20 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:20 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8d69ef62a9d5547c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:21 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:21 DEBUG : : Looking for writers 2024/05/06 03:59:21 DEBUG : >WaitForWriters: 2024/05/06 03:59:21 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (0.93s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:21 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:21 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:59:21 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:21 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:21 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e2d6e1d92cc3732a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:22 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:22 DEBUG : : Looking for writers 2024/05/06 03:59:22 DEBUG : >WaitForWriters: 2024/05/06 03:59:22 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (0.88s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:22 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:22 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:59:22 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:22 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-moniquy3yanipuq6ronazin0" 2024/05/06 03:59:22 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:59:22 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:59:22 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:59:22 DEBUG : file1: newRWFileHandle: 2024/05/06 03:59:22 DEBUG : file1(0xc000b07740): openPending: 2024/05/06 03:59:22 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:59:22 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:59:22 DEBUG : file1(0xc000b07740): >openPending: err= 2024/05/06 03:59:22 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:59:22 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:59:22 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:59:22 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fed873265e2d41c6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:23 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:59:23 DEBUG : : Looking for writers 2024/05/06 03:59:23 DEBUG : file1: reading active writers 2024/05/06 03:59:23 DEBUG : file1: active writers 1 2024/05/06 03:59:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:59:24 DEBUG : : Looking for writers 2024/05/06 03:59:24 DEBUG : file1: reading active writers 2024/05/06 03:59:24 DEBUG : file1: active writers 1 2024/05/06 03:59:24 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:25 DEBUG : : Looking for writers 2024/05/06 03:59:25 DEBUG : file1: reading active writers 2024/05/06 03:59:25 DEBUG : file1: active writers 1 2024/05/06 03:59:25 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:26 DEBUG : : Looking for writers 2024/05/06 03:59:26 DEBUG : file1: reading active writers 2024/05/06 03:59:26 DEBUG : file1: active writers 1 2024/05/06 03:59:26 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:27 DEBUG : : Looking for writers 2024/05/06 03:59:27 DEBUG : file1: reading active writers 2024/05/06 03:59:27 DEBUG : file1: active writers 1 2024/05/06 03:59:27 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:28 DEBUG : : Looking for writers 2024/05/06 03:59:28 DEBUG : file1: reading active writers 2024/05/06 03:59:28 DEBUG : file1: active writers 1 2024/05/06 03:59:28 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:29 DEBUG : : Looking for writers 2024/05/06 03:59:29 DEBUG : file1: reading active writers 2024/05/06 03:59:29 DEBUG : file1: active writers 1 2024/05/06 03:59:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:30 DEBUG : : Looking for writers 2024/05/06 03:59:30 DEBUG : file1: reading active writers 2024/05/06 03:59:30 DEBUG : file1: active writers 1 2024/05/06 03:59:30 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:31 DEBUG : : Looking for writers 2024/05/06 03:59:31 DEBUG : file1: reading active writers 2024/05/06 03:59:31 DEBUG : file1: active writers 1 2024/05/06 03:59:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:32 DEBUG : : Looking for writers 2024/05/06 03:59:32 DEBUG : file1: reading active writers 2024/05/06 03:59:32 DEBUG : file1: active writers 1 2024/05/06 03:59:32 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:33 DEBUG : : Looking for writers 2024/05/06 03:59:33 DEBUG : file1: reading active writers 2024/05/06 03:59:33 DEBUG : file1: active writers 1 2024/05/06 03:59:33 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:34 DEBUG : : Looking for writers 2024/05/06 03:59:34 DEBUG : file1: reading active writers 2024/05/06 03:59:34 DEBUG : file1: active writers 1 2024/05/06 03:59:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:35 DEBUG : : Looking for writers 2024/05/06 03:59:35 DEBUG : file1: reading active writers 2024/05/06 03:59:35 DEBUG : file1: active writers 1 2024/05/06 03:59:35 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:36 DEBUG : : Looking for writers 2024/05/06 03:59:36 DEBUG : file1: reading active writers 2024/05/06 03:59:36 DEBUG : file1: active writers 1 2024/05/06 03:59:36 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:37 DEBUG : : Looking for writers 2024/05/06 03:59:37 DEBUG : file1: reading active writers 2024/05/06 03:59:37 DEBUG : file1: active writers 1 2024/05/06 03:59:37 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:38 DEBUG : : Looking for writers 2024/05/06 03:59:38 DEBUG : file1: reading active writers 2024/05/06 03:59:38 DEBUG : file1: active writers 1 2024/05/06 03:59:38 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:39 DEBUG : : Looking for writers 2024/05/06 03:59:39 DEBUG : file1: reading active writers 2024/05/06 03:59:39 DEBUG : file1: active writers 1 2024/05/06 03:59:39 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:40 DEBUG : : Looking for writers 2024/05/06 03:59:40 DEBUG : file1: reading active writers 2024/05/06 03:59:40 DEBUG : file1: active writers 1 2024/05/06 03:59:40 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:41 DEBUG : : Looking for writers 2024/05/06 03:59:41 DEBUG : file1: reading active writers 2024/05/06 03:59:41 DEBUG : file1: active writers 1 2024/05/06 03:59:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:42 DEBUG : : Looking for writers 2024/05/06 03:59:42 DEBUG : file1: reading active writers 2024/05/06 03:59:42 DEBUG : file1: active writers 1 2024/05/06 03:59:42 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:43 DEBUG : : Looking for writers 2024/05/06 03:59:43 DEBUG : file1: reading active writers 2024/05/06 03:59:43 DEBUG : file1: active writers 1 2024/05/06 03:59:43 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:44 DEBUG : : Looking for writers 2024/05/06 03:59:44 DEBUG : file1: reading active writers 2024/05/06 03:59:44 DEBUG : file1: active writers 1 2024/05/06 03:59:44 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:45 DEBUG : : Looking for writers 2024/05/06 03:59:45 DEBUG : file1: reading active writers 2024/05/06 03:59:45 DEBUG : file1: active writers 1 2024/05/06 03:59:45 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:46 DEBUG : : Looking for writers 2024/05/06 03:59:46 DEBUG : file1: reading active writers 2024/05/06 03:59:46 DEBUG : file1: active writers 1 2024/05/06 03:59:46 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:47 DEBUG : : Looking for writers 2024/05/06 03:59:47 DEBUG : file1: reading active writers 2024/05/06 03:59:47 DEBUG : file1: active writers 1 2024/05/06 03:59:47 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:48 DEBUG : : Looking for writers 2024/05/06 03:59:48 DEBUG : file1: reading active writers 2024/05/06 03:59:48 DEBUG : file1: active writers 1 2024/05/06 03:59:48 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:49 DEBUG : : Looking for writers 2024/05/06 03:59:49 DEBUG : file1: reading active writers 2024/05/06 03:59:49 DEBUG : file1: active writers 1 2024/05/06 03:59:49 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:50 DEBUG : : Looking for writers 2024/05/06 03:59:50 DEBUG : file1: reading active writers 2024/05/06 03:59:50 DEBUG : file1: active writers 1 2024/05/06 03:59:50 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:51 DEBUG : : Looking for writers 2024/05/06 03:59:51 DEBUG : file1: reading active writers 2024/05/06 03:59:51 DEBUG : file1: active writers 1 2024/05/06 03:59:51 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:52 DEBUG : : Looking for writers 2024/05/06 03:59:52 DEBUG : file1: reading active writers 2024/05/06 03:59:52 DEBUG : file1: active writers 1 2024/05/06 03:59:52 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:59:53 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0007dc5a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000853308 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642450240} name:file1 opens:1 downloaders: o: fd:0xc00008a880 info:{ModTime:{wall:13944889674640907015 ext:250068054622 loc:0x3a12660} ATime:{wall:13944889674640907015 ext:250068054622 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/05/06 03:59:53 DEBUG : >WaitForWriters: 2024/05/06 03:59:53 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.14s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cbc1baba277b8e53", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (0.88s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2b0f3c5b6688ecc2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (0.87s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:55 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:55 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6bffbbfee22b99d7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:55 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:55 DEBUG : : Looking for writers 2024/05/06 03:59:55 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (0.88s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:56 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:56 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d485b4175726ee14", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:56 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:56 DEBUG : : Looking for writers 2024/05/06 03:59:56 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (0.88s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:56 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:56 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e1e5e6b2dfc778a6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:57 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:57 DEBUG : : Looking for writers 2024/05/06 03:59:57 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (0.88s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:57 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:57 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "03d7ec484a8417e7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:58 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:59:58 DEBUG : : Looking for writers 2024/05/06 03:59:58 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (0.88s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 03:59:58 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 03:59:58 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:59:58 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:59:58 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:59:58 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:59:58 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:59:58 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:59:58 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:59:58 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/05/06 03:59:58 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/05/06 03:59:58 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/05/06 03:59:58 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (5 bytes), uploading instead of streaming 2024/05/06 03:59:59 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bbc2fbf8f4e7fe8b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:59 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bbc2fbf8f4e7fe8b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:59:59 DEBUG : file1: Remove: 2024/05/06 03:59:59 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:59:59 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bbc2fbf8f4e7fe8b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/05/06 04:00:07 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:07 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:07 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:07 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:07 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:07 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:07 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (0 bytes), uploading instead of streaming 2024/05/06 04:00:07 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c0d082b83cf9aaec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:07 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c0d082b83cf9aaec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:07 DEBUG : file1: Remove: 2024/05/06 04:00:07 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:07 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c0d082b83cf9aaec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/05/06 04:00:07 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:07 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:07 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:07 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:07 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:07 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/05/06 04:00:07 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:07 DEBUG : : Looking for writers 2024/05/06 04:00:07 DEBUG : file1: reading active writers 2024/05/06 04:00:07 DEBUG : file1: active writers 1 2024/05/06 04:00:07 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/05/06 04:00:07 DEBUG : : Looking for writers 2024/05/06 04:00:07 DEBUG : file1: reading active writers 2024/05/06 04:00:07 DEBUG : file1: active writers 1 2024/05/06 04:00:07 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/05/06 04:00:08 DEBUG : : Looking for writers 2024/05/06 04:00:08 DEBUG : file1: reading active writers 2024/05/06 04:00:08 DEBUG : file1: active writers 1 2024/05/06 04:00:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/05/06 04:00:08 DEBUG : : Looking for writers 2024/05/06 04:00:08 DEBUG : file1: reading active writers 2024/05/06 04:00:08 DEBUG : file1: active writers 1 2024/05/06 04:00:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/05/06 04:00:08 DEBUG : : Looking for writers 2024/05/06 04:00:08 DEBUG : file1: reading active writers 2024/05/06 04:00:08 DEBUG : file1: active writers 1 2024/05/06 04:00:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/05/06 04:00:08 DEBUG : : Looking for writers 2024/05/06 04:00:08 DEBUG : file1: reading active writers 2024/05/06 04:00:08 DEBUG : file1: active writers 1 2024/05/06 04:00:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/05/06 04:00:08 DEBUG : : Looking for writers 2024/05/06 04:00:08 DEBUG : file1: reading active writers 2024/05/06 04:00:08 DEBUG : file1: active writers 1 2024/05/06 04:00:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/05/06 04:00:09 DEBUG : : Looking for writers 2024/05/06 04:00:09 DEBUG : file1: reading active writers 2024/05/06 04:00:09 DEBUG : file1: active writers 1 2024/05/06 04:00:09 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:10 DEBUG : : Looking for writers 2024/05/06 04:00:10 DEBUG : file1: reading active writers 2024/05/06 04:00:10 DEBUG : file1: active writers 1 2024/05/06 04:00:10 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:11 DEBUG : : Looking for writers 2024/05/06 04:00:11 DEBUG : file1: reading active writers 2024/05/06 04:00:11 DEBUG : file1: active writers 1 2024/05/06 04:00:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:12 DEBUG : : Looking for writers 2024/05/06 04:00:12 DEBUG : file1: reading active writers 2024/05/06 04:00:12 DEBUG : file1: active writers 1 2024/05/06 04:00:12 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:13 DEBUG : : Looking for writers 2024/05/06 04:00:13 DEBUG : file1: reading active writers 2024/05/06 04:00:13 DEBUG : file1: active writers 1 2024/05/06 04:00:13 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:14 DEBUG : : Looking for writers 2024/05/06 04:00:14 DEBUG : file1: reading active writers 2024/05/06 04:00:14 DEBUG : file1: active writers 1 2024/05/06 04:00:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:15 DEBUG : : Looking for writers 2024/05/06 04:00:15 DEBUG : file1: reading active writers 2024/05/06 04:00:15 DEBUG : file1: active writers 1 2024/05/06 04:00:15 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:16 DEBUG : : Looking for writers 2024/05/06 04:00:16 DEBUG : file1: reading active writers 2024/05/06 04:00:16 DEBUG : file1: active writers 1 2024/05/06 04:00:16 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:17 DEBUG : : Looking for writers 2024/05/06 04:00:17 DEBUG : file1: reading active writers 2024/05/06 04:00:17 DEBUG : file1: active writers 1 2024/05/06 04:00:17 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:18 DEBUG : : Looking for writers 2024/05/06 04:00:18 DEBUG : file1: reading active writers 2024/05/06 04:00:18 DEBUG : file1: active writers 1 2024/05/06 04:00:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:19 DEBUG : : Looking for writers 2024/05/06 04:00:19 DEBUG : file1: reading active writers 2024/05/06 04:00:19 DEBUG : file1: active writers 1 2024/05/06 04:00:19 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:20 DEBUG : : Looking for writers 2024/05/06 04:00:20 DEBUG : file1: reading active writers 2024/05/06 04:00:20 DEBUG : file1: active writers 1 2024/05/06 04:00:20 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:21 DEBUG : : Looking for writers 2024/05/06 04:00:21 DEBUG : file1: reading active writers 2024/05/06 04:00:21 DEBUG : file1: active writers 1 2024/05/06 04:00:21 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:22 DEBUG : : Looking for writers 2024/05/06 04:00:22 DEBUG : file1: reading active writers 2024/05/06 04:00:22 DEBUG : file1: active writers 1 2024/05/06 04:00:22 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:23 DEBUG : : Looking for writers 2024/05/06 04:00:23 DEBUG : file1: reading active writers 2024/05/06 04:00:23 DEBUG : file1: active writers 1 2024/05/06 04:00:23 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:24 DEBUG : : Looking for writers 2024/05/06 04:00:24 DEBUG : file1: reading active writers 2024/05/06 04:00:24 DEBUG : file1: active writers 1 2024/05/06 04:00:24 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:25 DEBUG : : Looking for writers 2024/05/06 04:00:25 DEBUG : file1: reading active writers 2024/05/06 04:00:25 DEBUG : file1: active writers 1 2024/05/06 04:00:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:26 DEBUG : : Looking for writers 2024/05/06 04:00:26 DEBUG : file1: reading active writers 2024/05/06 04:00:26 DEBUG : file1: active writers 1 2024/05/06 04:00:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:27 DEBUG : : Looking for writers 2024/05/06 04:00:27 DEBUG : file1: reading active writers 2024/05/06 04:00:27 DEBUG : file1: active writers 1 2024/05/06 04:00:27 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:28 DEBUG : : Looking for writers 2024/05/06 04:00:28 DEBUG : file1: reading active writers 2024/05/06 04:00:28 DEBUG : file1: active writers 1 2024/05/06 04:00:28 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:29 DEBUG : : Looking for writers 2024/05/06 04:00:29 DEBUG : file1: reading active writers 2024/05/06 04:00:29 DEBUG : file1: active writers 1 2024/05/06 04:00:29 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:30 DEBUG : : Looking for writers 2024/05/06 04:00:30 DEBUG : file1: reading active writers 2024/05/06 04:00:30 DEBUG : file1: active writers 1 2024/05/06 04:00:30 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:31 DEBUG : : Looking for writers 2024/05/06 04:00:31 DEBUG : file1: reading active writers 2024/05/06 04:00:31 DEBUG : file1: active writers 1 2024/05/06 04:00:31 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:32 DEBUG : : Looking for writers 2024/05/06 04:00:32 DEBUG : file1: reading active writers 2024/05/06 04:00:32 DEBUG : file1: active writers 1 2024/05/06 04:00:32 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:33 DEBUG : : Looking for writers 2024/05/06 04:00:33 DEBUG : file1: reading active writers 2024/05/06 04:00:33 DEBUG : file1: active writers 1 2024/05/06 04:00:33 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:34 DEBUG : : Looking for writers 2024/05/06 04:00:34 DEBUG : file1: reading active writers 2024/05/06 04:00:34 DEBUG : file1: active writers 1 2024/05/06 04:00:34 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:35 DEBUG : : Looking for writers 2024/05/06 04:00:35 DEBUG : file1: reading active writers 2024/05/06 04:00:35 DEBUG : file1: active writers 1 2024/05/06 04:00:35 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:36 DEBUG : : Looking for writers 2024/05/06 04:00:36 DEBUG : file1: reading active writers 2024/05/06 04:00:36 DEBUG : file1: active writers 1 2024/05/06 04:00:36 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:37 DEBUG : : Looking for writers 2024/05/06 04:00:37 DEBUG : file1: reading active writers 2024/05/06 04:00:37 DEBUG : file1: active writers 1 2024/05/06 04:00:37 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 04:00:37 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/05/06 04:00:37 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (39.55s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 04:00:38 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 04:00:38 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 04:00:38 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:38 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:38 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:38 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:38 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:38 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:38 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/05/06 04:00:39 DEBUG : file1: aborting in-sequence write wait, off=100 2024/05/06 04:00:39 DEBUG : file1: failed to wait for in-sequence write to 100 2024/05/06 04:00:39 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/05/06 04:00:39 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (11 bytes), uploading instead of streaming 2024/05/06 04:00:40 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1ca0eba4725642e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:40 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1ca0eba4725642e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:40 DEBUG : file1: Remove: 2024/05/06 04:00:40 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:40 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1ca0eba4725642e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/05/06 04:00:40 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/05/06 04:00:47 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:47 DEBUG : : Looking for writers 2024/05/06 04:00:47 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (9.99s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 04:00:48 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 04:00:48 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 04:00:48 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:48 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:48 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:48 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:48 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:48 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/05/06 04:00:48 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:48 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (5 bytes), uploading instead of streaming 2024/05/06 04:00:49 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ad7166a91b1e14f5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:49 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ad7166a91b1e14f5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:49 DEBUG : file1: Remove: 2024/05/06 04:00:49 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:49 DEBUG : file1: >Remove: err= 2024/05/06 04:00:49 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ad7166a91b1e14f5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ad7166a91b1e14f5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/05/06 04:00:49 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/05/06 04:00:49 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:49 DEBUG : : Looking for writers 2024/05/06 04:00:49 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (1.14s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 04:00:49 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 04:00:49 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 04:00:49 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:49 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:49 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:49 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:49 DEBUG : file1: WriteFileHandle.Release closing 2024/05/06 04:00:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:49 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (0 bytes), uploading instead of streaming 2024/05/06 04:00:50 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "68c20af953d256d2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:50 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "68c20af953d256d2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:50 DEBUG : file1: Remove: 2024/05/06 04:00:50 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:50 DEBUG : file1: >Remove: err= 2024/05/06 04:00:50 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "68c20af953d256d2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "68c20af953d256d2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/05/06 04:00:50 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/05/06 04:00:50 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:50 DEBUG : : Looking for writers 2024/05/06 04:00:50 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.14s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 04:00:50 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 04:00:50 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 04:00:50 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:50 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:50 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:50 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:50 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:50 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:50 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (2 bytes), uploading instead of streaming 2024/05/06 04:00:51 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "49e57e81964d5836", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:51 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "49e57e81964d5836", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:51 DEBUG : file1: Remove: 2024/05/06 04:00:51 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:51 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "49e57e81964d5836", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/05/06 04:00:51 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:51 DEBUG : : Looking for writers 2024/05/06 04:00:51 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.14s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 04:00:51 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 04:00:51 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 04:00:51 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:51 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:51 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:51 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:51 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:51 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:51 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (0 bytes), uploading instead of streaming 2024/05/06 04:00:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8ac86eda5af2c5f8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:52 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8ac86eda5af2c5f8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:52 DEBUG : file1: Remove: 2024/05/06 04:00:52 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:52 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8ac86eda5af2c5f8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/05/06 04:00:52 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/05/06 04:00:52 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/05/06 04:00:52 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:52 DEBUG : : Looking for writers 2024/05/06 04:00:52 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (1.14s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-moniquy3yanipuq6ronazin0", Local "Local file system at /tmp/rclone4086543499", Modify Window "876000h0m0s" 2024/05/06 04:00:52 INFO : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: poll-interval is not supported by this remote 2024/05/06 04:00:52 NOTICE: QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 04:00:52 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 04:00:53 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 04:00:53 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:53 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 04:00:53 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 04:00:53 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 04:00:53 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: File to upload is small (100 bytes), uploading instead of streaming 2024/05/06 04:00:53 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3d8527c68e3936cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:53 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3d8527c68e3936cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:53 DEBUG : file1: Remove: 2024/05/06 04:00:53 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 04:00:53 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3d8527c68e3936cd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/05/06 04:00:53 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/05/06 04:00:53 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/05/06 04:00:53 DEBUG : WaitForWriters: timeout=30s 2024/05/06 04:00:53 DEBUG : : Looking for writers 2024/05/06 04:00:53 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.14s) FAIL 2024/05/06 04:00:54 DEBUG : QingStor bucket rclone-test-moniquy3yanipuq6ronazin0: Purge dir "" 2024/05/06 04:00:54 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "d4116f95a0d4d166", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 04:00:54 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 5m41.984636856s (try 5/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]