"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 4/5) 2024/04/26 06:16:41 DEBUG : Creating backend with remote "TestQingStor:rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:16:41 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 06:16:41 DEBUG : Creating backend with remote "/tmp/rclone3491450313" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:41 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:41 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ccb69241b55f211", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:44 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:44 DEBUG : : Looking for writers 2024/04/26 06:16:44 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (4.07s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:45 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:45 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79a36a6b2e553f0b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:46 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:46 DEBUG : : Looking for writers 2024/04/26 06:16:46 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (1.66s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:46 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:46 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e6cca4f2715e5296", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:47 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:47 DEBUG : : Looking for writers 2024/04/26 06:16:47 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (1.63s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:48 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:48 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "07ecc23fdbb50969", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:49 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:49 DEBUG : : Looking for writers 2024/04/26 06:16:49 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (1.04s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:49 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:49 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cd66d2225bb3aba6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:50 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:50 DEBUG : : Looking for writers 2024/04/26 06:16:50 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (1.61s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:51 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:51 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "22b5dc71cca61106", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:51 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:51 DEBUG : : Looking for writers 2024/04/26 06:16:51 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (1.04s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:52 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:52 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "969d1d8ddc26c795", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:52 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:52 DEBUG : : Looking for writers 2024/04/26 06:16:52 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (1.04s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:53 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:53 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bccb4bb509be00c9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:56 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:56 DEBUG : : Looking for writers 2024/04/26 06:16:56 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (3.24s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:56 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:56 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34ad879b23919cc9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:57 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:57 DEBUG : : Looking for writers 2024/04/26 06:16:57 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (1.59s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:58 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:58 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f3cdda23b89b1913", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:58 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:58 DEBUG : : Looking for writers 2024/04/26 06:16:58 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (1.04s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:16:59 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:16:59 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1cc6f084e6b21988", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:59 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:59 DEBUG : : Looking for writers 2024/04/26 06:16:59 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (1.04s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:00 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:00 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d2a973d82703fdf4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:00 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:00 DEBUG : : Looking for writers 2024/04/26 06:17:00 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (1.04s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:01 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:01 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6c7e568af8571dca", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:03 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:03 DEBUG : : Looking for writers 2024/04/26 06:17:03 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (2.11s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:03 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:03 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d8b46b9b1640d579", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:04 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:04 DEBUG : : Looking for writers 2024/04/26 06:17:04 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (1.57s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:04 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:04 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e69f409a07176179", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:06 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:06 DEBUG : : Looking for writers 2024/04/26 06:17:06 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (1.58s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:06 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:06 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f4551720b904999", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:07 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:07 DEBUG : : Looking for writers 2024/04/26 06:17:07 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (1.57s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:08 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:08 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8b671f0c0845e2bd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:10 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:10 DEBUG : : Looking for writers 2024/04/26 06:17:10 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (3.22s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:11 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:11 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8a6d419f8de28b90", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:12 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:12 DEBUG : : Looking for writers 2024/04/26 06:17:12 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (1.57s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:12 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:12 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34652b981037c4bd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:15 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:15 DEBUG : : Looking for writers 2024/04/26 06:17:15 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (3.20s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:16 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:16 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "df98ffb97d5434e5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:16 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:16 DEBUG : : Looking for writers 2024/04/26 06:17:16 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:17 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:17 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2f44c26ac7217145", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:18 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:18 DEBUG : : Looking for writers 2024/04/26 06:17:18 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:19 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:19 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3d2a70c7469c3add", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:20 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:20 DEBUG : : Looking for writers 2024/04/26 06:17:20 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:23 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:23 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:23 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:23 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:23 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:23 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:23 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1b4af05cb56b9443", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:24 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:24 DEBUG : : Looking for writers 2024/04/26 06:17:24 DEBUG : >WaitForWriters: 2024/04/26 06:17:24 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:25 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:25 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:25 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:25 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:25 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:25 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:25 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8b347b5047e57234", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:25 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:25 DEBUG : : Looking for writers 2024/04/26 06:17:25 DEBUG : >WaitForWriters: 2024/04/26 06:17:25 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:26 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:26 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:26 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:26 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:26 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:26 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:26 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f928b4144c801a9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:27 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:27 DEBUG : : Looking for writers 2024/04/26 06:17:27 DEBUG : >WaitForWriters: 2024/04/26 06:17:27 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (11.81s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (1.58s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (2.11s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (3.36s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (2.13s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (1.58s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (1.04s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:27 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:27 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "848915e389bbc2b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:29 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:29 DEBUG : : Looking for writers 2024/04/26 06:17:29 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (2.42s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:30 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:30 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3e69ea75df054283", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:30 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:30 DEBUG : : Looking for writers 2024/04/26 06:17:30 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (1.04s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:31 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:31 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d4e921feb63b6a31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:32 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:32 DEBUG : : Looking for writers 2024/04/26 06:17:32 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (1.04s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:32 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:32 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d1ffe8f626889800", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:34 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:34 DEBUG : : Looking for writers 2024/04/26 06:17:34 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (2.13s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:34 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:34 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4d9867bc2f144ade", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:35 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:35 DEBUG : : Looking for writers 2024/04/26 06:17:35 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (1.24s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:35 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:35 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f29e3e952a9c924", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:36 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:36 DEBUG : : Looking for writers 2024/04/26 06:17:36 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:37 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:37 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:17:37 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:37 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:37 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:37 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:37 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:37 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d5f5331aa12aa56d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:39 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:39 DEBUG : : Looking for writers 2024/04/26 06:17:39 DEBUG : >WaitForWriters: 2024/04/26 06:17:39 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:39 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:39 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:17:39 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:39 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:39 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:39 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:39 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:39 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6c3025191789921c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:40 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:40 DEBUG : : Looking for writers 2024/04/26 06:17:40 DEBUG : >WaitForWriters: 2024/04/26 06:17:40 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:40 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:40 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:40 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:40 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:40 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "11cbe7a95c1a9686", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:43 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:43 DEBUG : : Looking for writers 2024/04/26 06:17:43 DEBUG : >WaitForWriters: 2024/04/26 06:17:43 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:44 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:44 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:44 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:44 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:44 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:44 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:44 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bdb3d1db16ce0d42", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:44 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:44 DEBUG : : Looking for writers 2024/04/26 06:17:44 DEBUG : >WaitForWriters: 2024/04/26 06:17:44 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:45 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:45 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:45 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:45 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:45 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:45 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:45 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "73d4d6c416093604", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:45 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:45 DEBUG : : Looking for writers 2024/04/26 06:17:45 DEBUG : >WaitForWriters: 2024/04/26 06:17:45 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (10.51s) --- FAIL: TestFileRename/off,forceCache=false (1.58s) --- FAIL: TestFileRename/minimal,forceCache=false (2.11s) --- FAIL: TestFileRename/minimal,forceCache=true (1.04s) --- FAIL: TestFileRename/writes,forceCache=false (3.77s) --- FAIL: TestFileRename/writes,forceCache=true (1.00s) --- FAIL: TestFileRename/full,forceCache=false (1.00s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:46 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:46 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4bf325bbc89e05a5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:46 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:46 DEBUG : : Looking for writers 2024/04/26 06:17:46 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (1.00s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:47 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:47 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "622334816b4a762b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:47 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:47 DEBUG : : Looking for writers 2024/04/26 06:17:47 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (1.55s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:48 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:48 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7e061215eb96c4b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:50 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:50 DEBUG : : Looking for writers 2024/04/26 06:17:50 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (1.55s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:50 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:50 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "eb6c3eb3d6e09f17", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:51 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:51 DEBUG : : Looking for writers 2024/04/26 06:17:51 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (1.53s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:51 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:51 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9a6c6d4705c03c02", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:53 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:53 DEBUG : : Looking for writers 2024/04/26 06:17:53 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (1.52s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:53 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:53 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:53 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:53 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:53 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ccbdef5d0388d0bb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:54 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:54 DEBUG : : Looking for writers 2024/04/26 06:17:54 DEBUG : >WaitForWriters: 2024/04/26 06:17:54 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (1.00s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:54 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:54 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:54 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:54 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:54 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1c68fea6085d8286", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:55 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:55 DEBUG : : Looking for writers 2024/04/26 06:17:55 DEBUG : >WaitForWriters: 2024/04/26 06:17:55 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (1.00s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:55 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:55 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:55 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:55 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:55 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:55 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "352d04ea4cea595a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:56 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:56 DEBUG : : Looking for writers 2024/04/26 06:17:56 DEBUG : >WaitForWriters: 2024/04/26 06:17:56 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (1.00s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:56 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:56 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:56 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:56 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:56 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:56 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5e3de1c339068501", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:57 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:57 DEBUG : : Looking for writers 2024/04/26 06:17:57 DEBUG : >WaitForWriters: 2024/04/26 06:17:57 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (1.01s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:57 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:57 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:57 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:57 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:57 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:57 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:57 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f8a8590ee84d398b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:17:58 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:17:58 DEBUG : : Looking for writers 2024/04/26 06:17:58 DEBUG : >WaitForWriters: 2024/04/26 06:17:58 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (1.55s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:17:58 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:17:58 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:17:58 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:58 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:58 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:58 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:17:58 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:17:58 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:18:02 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:18:02 DEBUG : file1: newRWFileHandle: 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): openPending: 2024/04/26 06:18:02 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:18:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): >openPending: err= 2024/04/26 06:18:02 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:18:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:18:02 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:18:02 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): _writeAt: size=5, off=0 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): >_writeAt: n=5, err= 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): _writeAt: size=7, off=5 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): >_writeAt: n=7, err= 2024/04/26 06:18:02 DEBUG : file1: vfs cache: truncate to size=11 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): close: 2024/04/26 06:18:02 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:18:02.89649221 +0000 UTC m=+81.717093701 2024/04/26 06:18:02 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): >close: err= 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): close: 2024/04/26 06:18:02 DEBUG : file1(0xc0006b1000): >close: err=file already closed 2024/04/26 06:18:02 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:18:02 DEBUG : : Looking for writers 2024/04/26 06:18:02 DEBUG : file1: reading active writers 2024/04/26 06:18:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:18:02 DEBUG : : Looking for writers 2024/04/26 06:18:02 DEBUG : file1: reading active writers 2024/04/26 06:18:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:18:02 DEBUG : : Looking for writers 2024/04/26 06:18:02 DEBUG : file1: reading active writers 2024/04/26 06:18:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:18:02 DEBUG : : Looking for writers 2024/04/26 06:18:02 DEBUG : file1: reading active writers 2024/04/26 06:18:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:18:02 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:03 DEBUG : : Looking for writers 2024/04/26 06:18:03 DEBUG : file1: reading active writers 2024/04/26 06:18:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:18:03 DEBUG : : Looking for writers 2024/04/26 06:18:03 DEBUG : file1: reading active writers 2024/04/26 06:18:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:18:03 DEBUG : : Looking for writers 2024/04/26 06:18:03 DEBUG : file1: reading active writers 2024/04/26 06:18:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:18:04 DEBUG : : Looking for writers 2024/04/26 06:18:04 DEBUG : file1: reading active writers 2024/04/26 06:18:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:04 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "24b5ca20ebad3392", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:04 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "24b5ca20ebad3392", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:04 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:05 DEBUG : : Looking for writers 2024/04/26 06:18:05 DEBUG : file1: reading active writers 2024/04/26 06:18:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:05 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ac3c6bedd0f9642f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:05 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ac3c6bedd0f9642f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:06 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:06 DEBUG : : Looking for writers 2024/04/26 06:18:06 DEBUG : file1: reading active writers 2024/04/26 06:18:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:07 DEBUG : : Looking for writers 2024/04/26 06:18:07 DEBUG : file1: reading active writers 2024/04/26 06:18:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:07 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "93da0127920e29e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:07 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "93da0127920e29e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:08 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:08 DEBUG : : Looking for writers 2024/04/26 06:18:08 DEBUG : file1: reading active writers 2024/04/26 06:18:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:08 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6aa5562cfb2fabc8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:08 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6aa5562cfb2fabc8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:09 DEBUG : : Looking for writers 2024/04/26 06:18:09 DEBUG : file1: reading active writers 2024/04/26 06:18:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:10 DEBUG : : Looking for writers 2024/04/26 06:18:10 DEBUG : file1: reading active writers 2024/04/26 06:18:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:10 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:11 DEBUG : : Looking for writers 2024/04/26 06:18:11 DEBUG : file1: reading active writers 2024/04/26 06:18:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c84f248a75ebf353", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:11 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c84f248a75ebf353", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:12 DEBUG : : Looking for writers 2024/04/26 06:18:12 DEBUG : file1: reading active writers 2024/04/26 06:18:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:13 DEBUG : : Looking for writers 2024/04/26 06:18:13 DEBUG : file1: reading active writers 2024/04/26 06:18:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:14 DEBUG : : Looking for writers 2024/04/26 06:18:14 DEBUG : file1: reading active writers 2024/04/26 06:18:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:14 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:15 DEBUG : : Looking for writers 2024/04/26 06:18:15 DEBUG : file1: reading active writers 2024/04/26 06:18:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:15 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3fe7fda7801e0466", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:15 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3fe7fda7801e0466", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:16 DEBUG : : Looking for writers 2024/04/26 06:18:16 DEBUG : file1: reading active writers 2024/04/26 06:18:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:17 DEBUG : : Looking for writers 2024/04/26 06:18:17 DEBUG : file1: reading active writers 2024/04/26 06:18:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:18 DEBUG : : Looking for writers 2024/04/26 06:18:18 DEBUG : file1: reading active writers 2024/04/26 06:18:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:19 DEBUG : : Looking for writers 2024/04/26 06:18:19 DEBUG : file1: reading active writers 2024/04/26 06:18:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:20 DEBUG : : Looking for writers 2024/04/26 06:18:20 DEBUG : file1: reading active writers 2024/04/26 06:18:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:21 DEBUG : : Looking for writers 2024/04/26 06:18:21 DEBUG : file1: reading active writers 2024/04/26 06:18:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:21 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:18:22 DEBUG : : Looking for writers 2024/04/26 06:18:22 DEBUG : file1: reading active writers 2024/04/26 06:18:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9743066872c13048", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:22 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9743066872c13048", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:23 DEBUG : : Looking for writers 2024/04/26 06:18:23 DEBUG : file1: reading active writers 2024/04/26 06:18:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:24 DEBUG : : Looking for writers 2024/04/26 06:18:24 DEBUG : file1: reading active writers 2024/04/26 06:18:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:25 DEBUG : : Looking for writers 2024/04/26 06:18:25 DEBUG : file1: reading active writers 2024/04/26 06:18:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:26 DEBUG : : Looking for writers 2024/04/26 06:18:26 DEBUG : file1: reading active writers 2024/04/26 06:18:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:27 DEBUG : : Looking for writers 2024/04/26 06:18:27 DEBUG : file1: reading active writers 2024/04/26 06:18:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:28 DEBUG : : Looking for writers 2024/04/26 06:18:28 DEBUG : file1: reading active writers 2024/04/26 06:18:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:29 DEBUG : : Looking for writers 2024/04/26 06:18:29 DEBUG : file1: reading active writers 2024/04/26 06:18:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:30 DEBUG : : Looking for writers 2024/04/26 06:18:30 DEBUG : file1: reading active writers 2024/04/26 06:18:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:31 DEBUG : : Looking for writers 2024/04/26 06:18:31 DEBUG : file1: reading active writers 2024/04/26 06:18:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:32 DEBUG : : Looking for writers 2024/04/26 06:18:32 DEBUG : file1: reading active writers 2024/04/26 06:18:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:32 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc00080e2d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0007f0608 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642045504} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970895580062386 ext:81717093701 loc:0x3a12660} ATime:{wall:13943970895580090830 ext:81717122134 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:18:32 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:18:35 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 2024/04/26 06:18:37 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5410e691e67adfd2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:18:37 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5410e691e67adfd2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/04/26 06:18:41 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:18:41 DEBUG : : Looking for writers 2024/04/26 06:18:41 DEBUG : file1: reading active writers 2024/04/26 06:18:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:18:41 DEBUG : : Looking for writers 2024/04/26 06:18:41 DEBUG : file1: reading active writers 2024/04/26 06:18:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:18:41 DEBUG : : Looking for writers 2024/04/26 06:18:41 DEBUG : file1: reading active writers 2024/04/26 06:18:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:18:41 DEBUG : : Looking for writers 2024/04/26 06:18:41 DEBUG : file1: reading active writers 2024/04/26 06:18:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:18:41 DEBUG : : Looking for writers 2024/04/26 06:18:41 DEBUG : file1: reading active writers 2024/04/26 06:18:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:18:41 DEBUG : : Looking for writers 2024/04/26 06:18:41 DEBUG : file1: reading active writers 2024/04/26 06:18:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:18:42 DEBUG : : Looking for writers 2024/04/26 06:18:42 DEBUG : file1: reading active writers 2024/04/26 06:18:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:18:42 DEBUG : : Looking for writers 2024/04/26 06:18:42 DEBUG : file1: reading active writers 2024/04/26 06:18:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:43 DEBUG : : Looking for writers 2024/04/26 06:18:43 DEBUG : file1: reading active writers 2024/04/26 06:18:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:44 DEBUG : : Looking for writers 2024/04/26 06:18:44 DEBUG : file1: reading active writers 2024/04/26 06:18:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:45 DEBUG : : Looking for writers 2024/04/26 06:18:45 DEBUG : file1: reading active writers 2024/04/26 06:18:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:46 DEBUG : : Looking for writers 2024/04/26 06:18:46 DEBUG : file1: reading active writers 2024/04/26 06:18:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:47 DEBUG : : Looking for writers 2024/04/26 06:18:47 DEBUG : file1: reading active writers 2024/04/26 06:18:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:48 DEBUG : : Looking for writers 2024/04/26 06:18:48 DEBUG : file1: reading active writers 2024/04/26 06:18:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:49 DEBUG : : Looking for writers 2024/04/26 06:18:49 DEBUG : file1: reading active writers 2024/04/26 06:18:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:50 DEBUG : : Looking for writers 2024/04/26 06:18:50 DEBUG : file1: reading active writers 2024/04/26 06:18:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:51 DEBUG : : Looking for writers 2024/04/26 06:18:51 DEBUG : file1: reading active writers 2024/04/26 06:18:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:52 DEBUG : : Looking for writers 2024/04/26 06:18:52 DEBUG : file1: reading active writers 2024/04/26 06:18:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:53 DEBUG : : Looking for writers 2024/04/26 06:18:53 DEBUG : file1: reading active writers 2024/04/26 06:18:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:54 DEBUG : : Looking for writers 2024/04/26 06:18:54 DEBUG : file1: reading active writers 2024/04/26 06:18:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:55 DEBUG : : Looking for writers 2024/04/26 06:18:55 DEBUG : file1: reading active writers 2024/04/26 06:18:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:56 DEBUG : : Looking for writers 2024/04/26 06:18:56 DEBUG : file1: reading active writers 2024/04/26 06:18:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:57 DEBUG : : Looking for writers 2024/04/26 06:18:57 DEBUG : file1: reading active writers 2024/04/26 06:18:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:58 DEBUG : : Looking for writers 2024/04/26 06:18:58 DEBUG : file1: reading active writers 2024/04/26 06:18:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:18:58 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:18:58 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/26 06:18:59 DEBUG : : Looking for writers 2024/04/26 06:18:59 DEBUG : file1: reading active writers 2024/04/26 06:18:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:00 DEBUG : : Looking for writers 2024/04/26 06:19:00 DEBUG : file1: reading active writers 2024/04/26 06:19:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:01 DEBUG : : Looking for writers 2024/04/26 06:19:01 DEBUG : file1: reading active writers 2024/04/26 06:19:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:02 DEBUG : : Looking for writers 2024/04/26 06:19:02 DEBUG : file1: reading active writers 2024/04/26 06:19:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:03 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:03 DEBUG : : Looking for writers 2024/04/26 06:19:03 DEBUG : file1: reading active writers 2024/04/26 06:19:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:04 DEBUG : : Looking for writers 2024/04/26 06:19:04 DEBUG : file1: reading active writers 2024/04/26 06:19:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:05 DEBUG : : Looking for writers 2024/04/26 06:19:05 DEBUG : file1: reading active writers 2024/04/26 06:19:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:06 DEBUG : : Looking for writers 2024/04/26 06:19:06 DEBUG : file1: reading active writers 2024/04/26 06:19:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:07 DEBUG : : Looking for writers 2024/04/26 06:19:07 DEBUG : file1: reading active writers 2024/04/26 06:19:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:08 DEBUG : : Looking for writers 2024/04/26 06:19:08 DEBUG : file1: reading active writers 2024/04/26 06:19:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:09 DEBUG : : Looking for writers 2024/04/26 06:19:09 DEBUG : file1: reading active writers 2024/04/26 06:19:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:10 DEBUG : : Looking for writers 2024/04/26 06:19:10 DEBUG : file1: reading active writers 2024/04/26 06:19:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "530c06ca7aa70bfd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:10 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "530c06ca7aa70bfd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:11 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc00080e2d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0007f0608 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642045504} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970895580062386 ext:81717093701 loc:0x3a12660} ATime:{wall:13943970895580090830 ext:81717122134 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:19:11 DEBUG : >WaitForWriters: 2024/04/26 06:19:11 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (73.52s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:19:12 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:19:12 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:19:12 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:19:12 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:19:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:19:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:19:12 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:19:12 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:19:12 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:19:12 DEBUG : file1: newRWFileHandle: 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): openPending: 2024/04/26 06:19:12 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:19:12 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): >openPending: err= 2024/04/26 06:19:12 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:19:12 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:19:12 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:19:12 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): _writeAt: size=7, off=0 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): >_writeAt: n=7, err= 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): _writeAt: size=6, off=5 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): >_writeAt: n=6, err= 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): close: 2024/04/26 06:19:12 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:19:12.758528237 +0000 UTC m=+151.579129679 2024/04/26 06:19:12 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): >close: err= 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): _writeAt: size=5, off=0 2024/04/26 06:19:12 DEBUG : file1(0xc0006b0180): >_writeAt: n=0, err=file already closed 2024/04/26 06:19:12 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:19:12 DEBUG : : Looking for writers 2024/04/26 06:19:12 DEBUG : file1: reading active writers 2024/04/26 06:19:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:19:12 DEBUG : : Looking for writers 2024/04/26 06:19:12 DEBUG : file1: reading active writers 2024/04/26 06:19:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:19:12 DEBUG : : Looking for writers 2024/04/26 06:19:12 DEBUG : file1: reading active writers 2024/04/26 06:19:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:19:12 DEBUG : : Looking for writers 2024/04/26 06:19:12 DEBUG : file1: reading active writers 2024/04/26 06:19:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:19:12 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:12 DEBUG : : Looking for writers 2024/04/26 06:19:12 DEBUG : file1: reading active writers 2024/04/26 06:19:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:19:13 DEBUG : : Looking for writers 2024/04/26 06:19:13 DEBUG : file1: reading active writers 2024/04/26 06:19:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:19:13 DEBUG : : Looking for writers 2024/04/26 06:19:13 DEBUG : file1: reading active writers 2024/04/26 06:19:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:19:13 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "04b21c5132e73dfe", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:13 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "04b21c5132e73dfe", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:13 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:14 DEBUG : : Looking for writers 2024/04/26 06:19:14 DEBUG : file1: reading active writers 2024/04/26 06:19:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "110a454cee1352f0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:14 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "110a454cee1352f0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:14 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:15 DEBUG : : Looking for writers 2024/04/26 06:19:15 DEBUG : file1: reading active writers 2024/04/26 06:19:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:15 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f8bd07223bdea8c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:15 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f8bd07223bdea8c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:16 DEBUG : : Looking for writers 2024/04/26 06:19:16 DEBUG : file1: reading active writers 2024/04/26 06:19:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:16 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:17 DEBUG : : Looking for writers 2024/04/26 06:19:17 DEBUG : file1: reading active writers 2024/04/26 06:19:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:17 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "26eeafb96a6e95b8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:17 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "26eeafb96a6e95b8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:18 DEBUG : : Looking for writers 2024/04/26 06:19:18 DEBUG : file1: reading active writers 2024/04/26 06:19:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:19 DEBUG : : Looking for writers 2024/04/26 06:19:19 DEBUG : file1: reading active writers 2024/04/26 06:19:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:19 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:20 DEBUG : : Looking for writers 2024/04/26 06:19:20 DEBUG : file1: reading active writers 2024/04/26 06:19:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:20 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1bfefde2e058d001", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:20 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1bfefde2e058d001", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:21 DEBUG : : Looking for writers 2024/04/26 06:19:21 DEBUG : file1: reading active writers 2024/04/26 06:19:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:22 DEBUG : : Looking for writers 2024/04/26 06:19:22 DEBUG : file1: reading active writers 2024/04/26 06:19:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:23 DEBUG : : Looking for writers 2024/04/26 06:19:23 DEBUG : file1: reading active writers 2024/04/26 06:19:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:23 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:24 DEBUG : : Looking for writers 2024/04/26 06:19:24 DEBUG : file1: reading active writers 2024/04/26 06:19:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:24 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79b5da9bf4cf436c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:24 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79b5da9bf4cf436c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:25 DEBUG : : Looking for writers 2024/04/26 06:19:25 DEBUG : file1: reading active writers 2024/04/26 06:19:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:26 DEBUG : : Looking for writers 2024/04/26 06:19:26 DEBUG : file1: reading active writers 2024/04/26 06:19:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:27 DEBUG : : Looking for writers 2024/04/26 06:19:27 DEBUG : file1: reading active writers 2024/04/26 06:19:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:28 DEBUG : : Looking for writers 2024/04/26 06:19:28 DEBUG : file1: reading active writers 2024/04/26 06:19:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:29 DEBUG : : Looking for writers 2024/04/26 06:19:29 DEBUG : file1: reading active writers 2024/04/26 06:19:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:30 DEBUG : : Looking for writers 2024/04/26 06:19:30 DEBUG : file1: reading active writers 2024/04/26 06:19:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:30 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:19:31 DEBUG : : Looking for writers 2024/04/26 06:19:31 DEBUG : file1: reading active writers 2024/04/26 06:19:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:31 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "503fdf3391eea6b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:31 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "503fdf3391eea6b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:32 DEBUG : : Looking for writers 2024/04/26 06:19:32 DEBUG : file1: reading active writers 2024/04/26 06:19:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:33 DEBUG : : Looking for writers 2024/04/26 06:19:33 DEBUG : file1: reading active writers 2024/04/26 06:19:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:34 DEBUG : : Looking for writers 2024/04/26 06:19:34 DEBUG : file1: reading active writers 2024/04/26 06:19:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:35 DEBUG : : Looking for writers 2024/04/26 06:19:35 DEBUG : file1: reading active writers 2024/04/26 06:19:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:36 DEBUG : : Looking for writers 2024/04/26 06:19:36 DEBUG : file1: reading active writers 2024/04/26 06:19:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:37 DEBUG : : Looking for writers 2024/04/26 06:19:37 DEBUG : file1: reading active writers 2024/04/26 06:19:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:38 DEBUG : : Looking for writers 2024/04/26 06:19:38 DEBUG : file1: reading active writers 2024/04/26 06:19:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:39 DEBUG : : Looking for writers 2024/04/26 06:19:39 DEBUG : file1: reading active writers 2024/04/26 06:19:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:40 DEBUG : : Looking for writers 2024/04/26 06:19:40 DEBUG : file1: reading active writers 2024/04/26 06:19:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:41 DEBUG : : Looking for writers 2024/04/26 06:19:41 DEBUG : file1: reading active writers 2024/04/26 06:19:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:42 DEBUG : : Looking for writers 2024/04/26 06:19:42 DEBUG : file1: reading active writers 2024/04/26 06:19:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:42 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc00014a870 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000530008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639160384} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970970604026093 ext:151579129679 loc:0x3a12660} ATime:{wall:13943970970604044719 ext:151579148303 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:19:42 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/26 06:19:44 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:19:45 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3f8c62d2669cb7b2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:19:45 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3f8c62d2669cb7b2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/04/26 06:19:50 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:19:50 DEBUG : : Looking for writers 2024/04/26 06:19:50 DEBUG : file1: reading active writers 2024/04/26 06:19:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:19:50 DEBUG : : Looking for writers 2024/04/26 06:19:50 DEBUG : file1: reading active writers 2024/04/26 06:19:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:19:50 DEBUG : : Looking for writers 2024/04/26 06:19:50 DEBUG : file1: reading active writers 2024/04/26 06:19:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:19:50 DEBUG : : Looking for writers 2024/04/26 06:19:50 DEBUG : file1: reading active writers 2024/04/26 06:19:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:19:50 DEBUG : : Looking for writers 2024/04/26 06:19:50 DEBUG : file1: reading active writers 2024/04/26 06:19:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:19:51 DEBUG : : Looking for writers 2024/04/26 06:19:51 DEBUG : file1: reading active writers 2024/04/26 06:19:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:19:51 DEBUG : : Looking for writers 2024/04/26 06:19:51 DEBUG : file1: reading active writers 2024/04/26 06:19:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:19:51 DEBUG : : Looking for writers 2024/04/26 06:19:51 DEBUG : file1: reading active writers 2024/04/26 06:19:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:52 DEBUG : : Looking for writers 2024/04/26 06:19:52 DEBUG : file1: reading active writers 2024/04/26 06:19:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:53 DEBUG : : Looking for writers 2024/04/26 06:19:53 DEBUG : file1: reading active writers 2024/04/26 06:19:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:54 DEBUG : : Looking for writers 2024/04/26 06:19:54 DEBUG : file1: reading active writers 2024/04/26 06:19:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:55 DEBUG : : Looking for writers 2024/04/26 06:19:55 DEBUG : file1: reading active writers 2024/04/26 06:19:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:56 DEBUG : : Looking for writers 2024/04/26 06:19:56 DEBUG : file1: reading active writers 2024/04/26 06:19:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:57 DEBUG : : Looking for writers 2024/04/26 06:19:57 DEBUG : file1: reading active writers 2024/04/26 06:19:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:58 DEBUG : : Looking for writers 2024/04/26 06:19:58 DEBUG : file1: reading active writers 2024/04/26 06:19:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:19:59 DEBUG : : Looking for writers 2024/04/26 06:19:59 DEBUG : file1: reading active writers 2024/04/26 06:19:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:00 DEBUG : : Looking for writers 2024/04/26 06:20:00 DEBUG : file1: reading active writers 2024/04/26 06:20:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:01 DEBUG : : Looking for writers 2024/04/26 06:20:01 DEBUG : file1: reading active writers 2024/04/26 06:20:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:02 DEBUG : : Looking for writers 2024/04/26 06:20:02 DEBUG : file1: reading active writers 2024/04/26 06:20:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:03 DEBUG : : Looking for writers 2024/04/26 06:20:03 DEBUG : file1: reading active writers 2024/04/26 06:20:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:04 DEBUG : : Looking for writers 2024/04/26 06:20:04 DEBUG : file1: reading active writers 2024/04/26 06:20:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:05 DEBUG : : Looking for writers 2024/04/26 06:20:05 DEBUG : file1: reading active writers 2024/04/26 06:20:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:06 DEBUG : : Looking for writers 2024/04/26 06:20:06 DEBUG : file1: reading active writers 2024/04/26 06:20:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:07 DEBUG : : Looking for writers 2024/04/26 06:20:07 DEBUG : file1: reading active writers 2024/04/26 06:20:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:08 DEBUG : : Looking for writers 2024/04/26 06:20:08 DEBUG : file1: reading active writers 2024/04/26 06:20:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:09 DEBUG : : Looking for writers 2024/04/26 06:20:09 DEBUG : file1: reading active writers 2024/04/26 06:20:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:10 DEBUG : : Looking for writers 2024/04/26 06:20:10 DEBUG : file1: reading active writers 2024/04/26 06:20:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:11 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:11 DEBUG : : Looking for writers 2024/04/26 06:20:11 DEBUG : file1: reading active writers 2024/04/26 06:20:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:12 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:20:12 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 0, uploading 1, total size 11 (was 11) 2024/04/26 06:20:12 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d7cceb510964bfe3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:12 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d7cceb510964bfe3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:12 DEBUG : : Looking for writers 2024/04/26 06:20:12 DEBUG : file1: reading active writers 2024/04/26 06:20:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:13 DEBUG : : Looking for writers 2024/04/26 06:20:13 DEBUG : file1: reading active writers 2024/04/26 06:20:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:14 DEBUG : : Looking for writers 2024/04/26 06:20:14 DEBUG : file1: reading active writers 2024/04/26 06:20:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:15 DEBUG : : Looking for writers 2024/04/26 06:20:15 DEBUG : file1: reading active writers 2024/04/26 06:20:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:16 DEBUG : : Looking for writers 2024/04/26 06:20:16 DEBUG : file1: reading active writers 2024/04/26 06:20:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:17 DEBUG : : Looking for writers 2024/04/26 06:20:17 DEBUG : file1: reading active writers 2024/04/26 06:20:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:18 DEBUG : : Looking for writers 2024/04/26 06:20:18 DEBUG : file1: reading active writers 2024/04/26 06:20:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:19 DEBUG : : Looking for writers 2024/04/26 06:20:19 DEBUG : file1: reading active writers 2024/04/26 06:20:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:20:20 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc00014a870 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000530008 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639160384} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970970604026093 ext:151579129679 loc:0x3a12660} ATime:{wall:13943970970604044719 ext:151579148303 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:20:20 DEBUG : >WaitForWriters: 2024/04/26 06:20:20 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (69.16s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:20:21 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:20:21 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:20:21 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:20:21 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:20:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:20:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:20:21 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:20:21 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:20:21 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:20:21 DEBUG : file1: newRWFileHandle: 2024/04/26 06:20:21 DEBUG : file1(0xc0006b0d40): openPending: 2024/04/26 06:20:21 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:20:21 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:20:21 DEBUG : file1(0xc0006b0d40): >openPending: err= 2024/04/26 06:20:21 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:20:21 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:20:21 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:20:21 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:20:21 DEBUG : file1(0xc0006b0d40): close: 2024/04/26 06:20:21 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:20:21.919484474 +0000 UTC m=+220.740085915 2024/04/26 06:20:21 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:20:21 DEBUG : file1(0xc0006b0d40): >close: err= 2024/04/26 06:20:21 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/04/26 06:20:21 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/04/26 06:20:21 DEBUG : file2: newRWFileHandle: 2024/04/26 06:20:21 DEBUG : file2(0xc0006b0e00): openPending: 2024/04/26 06:20:21 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:20:21 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/26 06:20:21 DEBUG : file2(0xc0006b0e00): >openPending: err= 2024/04/26 06:20:21 DEBUG : file2: >newRWFileHandle: err= 2024/04/26 06:20:21 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/26 06:20:21 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/04/26 06:20:21 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/04/26 06:20:21 DEBUG : file2(0xc0006b0e00): RWFileHandle.Flush 2024/04/26 06:20:21 DEBUG : file2(0xc0006b0e00): RWFileHandle.Release 2024/04/26 06:20:21 DEBUG : file2(0xc0006b0e00): close: 2024/04/26 06:20:21 DEBUG : file2: vfs cache: setting modification time to 2024-04-26 06:20:21.920176703 +0000 UTC m=+220.740778134 2024/04/26 06:20:21 INFO : file2: vfs cache: queuing for upload in 100ms 2024/04/26 06:20:21 DEBUG : file2(0xc0006b0e00): >close: err= 2024/04/26 06:20:21 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:20:21 DEBUG : : Looking for writers 2024/04/26 06:20:21 DEBUG : file1: reading active writers 2024/04/26 06:20:21 DEBUG : file2: reading active writers 2024/04/26 06:20:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/26 06:20:21 DEBUG : : Looking for writers 2024/04/26 06:20:21 DEBUG : file1: reading active writers 2024/04/26 06:20:21 DEBUG : file2: reading active writers 2024/04/26 06:20:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/26 06:20:21 DEBUG : : Looking for writers 2024/04/26 06:20:21 DEBUG : file1: reading active writers 2024/04/26 06:20:21 DEBUG : file2: reading active writers 2024/04/26 06:20:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/26 06:20:21 DEBUG : : Looking for writers 2024/04/26 06:20:21 DEBUG : file1: reading active writers 2024/04/26 06:20:21 DEBUG : file2: reading active writers 2024/04/26 06:20:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/26 06:20:22 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:22 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:22 DEBUG : : Looking for writers 2024/04/26 06:20:22 DEBUG : file1: reading active writers 2024/04/26 06:20:22 DEBUG : file2: reading active writers 2024/04/26 06:20:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/26 06:20:22 DEBUG : : Looking for writers 2024/04/26 06:20:22 DEBUG : file1: reading active writers 2024/04/26 06:20:22 DEBUG : file2: reading active writers 2024/04/26 06:20:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/26 06:20:22 DEBUG : : Looking for writers 2024/04/26 06:20:22 DEBUG : file1: reading active writers 2024/04/26 06:20:22 DEBUG : file2: reading active writers 2024/04/26 06:20:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/26 06:20:22 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "06065499b09bf06e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:22 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "06065499b09bf06e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:22 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:23 DEBUG : : Looking for writers 2024/04/26 06:20:23 DEBUG : file1: reading active writers 2024/04/26 06:20:23 DEBUG : file2: reading active writers 2024/04/26 06:20:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6b02743c76fcfcd4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:23 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6b02743c76fcfcd4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:23 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:24 DEBUG : : Looking for writers 2024/04/26 06:20:24 DEBUG : file1: reading active writers 2024/04/26 06:20:24 DEBUG : file2: reading active writers 2024/04/26 06:20:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:24 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6cfa5b700d3444dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:24 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6cfa5b700d3444dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:24 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:25 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f9afd8151646740", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:25 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f9afd8151646740", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:25 DEBUG : : Looking for writers 2024/04/26 06:20:25 DEBUG : file1: reading active writers 2024/04/26 06:20:25 DEBUG : file2: reading active writers 2024/04/26 06:20:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:25 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:25 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "418d66c4d358fe0b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:25 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "418d66c4d358fe0b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:26 DEBUG : : Looking for writers 2024/04/26 06:20:26 DEBUG : file1: reading active writers 2024/04/26 06:20:26 DEBUG : file2: reading active writers 2024/04/26 06:20:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:26 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "850eb64ff1d6a55a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:26 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "850eb64ff1d6a55a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:26 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:27 DEBUG : : Looking for writers 2024/04/26 06:20:27 DEBUG : file1: reading active writers 2024/04/26 06:20:27 DEBUG : file2: reading active writers 2024/04/26 06:20:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:27 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:28 DEBUG : : Looking for writers 2024/04/26 06:20:28 DEBUG : file1: reading active writers 2024/04/26 06:20:28 DEBUG : file2: reading active writers 2024/04/26 06:20:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:28 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2f03b4977e13e9a5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:28 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2f03b4977e13e9a5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:29 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7850150ab499d8d8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:29 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7850150ab499d8d8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:29 DEBUG : : Looking for writers 2024/04/26 06:20:29 DEBUG : file1: reading active writers 2024/04/26 06:20:29 DEBUG : file2: reading active writers 2024/04/26 06:20:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:30 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:30 DEBUG : : Looking for writers 2024/04/26 06:20:30 DEBUG : file1: reading active writers 2024/04/26 06:20:30 DEBUG : file2: reading active writers 2024/04/26 06:20:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:30 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:30 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0975835a42399e5e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:30 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0975835a42399e5e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:31 DEBUG : : Looking for writers 2024/04/26 06:20:31 DEBUG : file1: reading active writers 2024/04/26 06:20:31 DEBUG : file2: reading active writers 2024/04/26 06:20:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:31 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7584e853748202a3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:31 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7584e853748202a3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:32 DEBUG : : Looking for writers 2024/04/26 06:20:32 DEBUG : file1: reading active writers 2024/04/26 06:20:32 DEBUG : file2: reading active writers 2024/04/26 06:20:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:33 DEBUG : : Looking for writers 2024/04/26 06:20:33 DEBUG : file1: reading active writers 2024/04/26 06:20:33 DEBUG : file2: reading active writers 2024/04/26 06:20:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:33 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:34 DEBUG : : Looking for writers 2024/04/26 06:20:34 DEBUG : file1: reading active writers 2024/04/26 06:20:34 DEBUG : file2: reading active writers 2024/04/26 06:20:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:34 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:35 DEBUG : : Looking for writers 2024/04/26 06:20:35 DEBUG : file1: reading active writers 2024/04/26 06:20:35 DEBUG : file2: reading active writers 2024/04/26 06:20:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:36 DEBUG : : Looking for writers 2024/04/26 06:20:36 DEBUG : file1: reading active writers 2024/04/26 06:20:36 DEBUG : file2: reading active writers 2024/04/26 06:20:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:36 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3364f88995be0355", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:36 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3364f88995be0355", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:37 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ddedf2c90a8303f3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:37 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ddedf2c90a8303f3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:37 DEBUG : : Looking for writers 2024/04/26 06:20:37 DEBUG : file1: reading active writers 2024/04/26 06:20:37 DEBUG : file2: reading active writers 2024/04/26 06:20:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:38 DEBUG : : Looking for writers 2024/04/26 06:20:38 DEBUG : file1: reading active writers 2024/04/26 06:20:38 DEBUG : file2: reading active writers 2024/04/26 06:20:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:39 DEBUG : : Looking for writers 2024/04/26 06:20:39 DEBUG : file1: reading active writers 2024/04/26 06:20:39 DEBUG : file2: reading active writers 2024/04/26 06:20:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:40 DEBUG : : Looking for writers 2024/04/26 06:20:40 DEBUG : file1: reading active writers 2024/04/26 06:20:40 DEBUG : file2: reading active writers 2024/04/26 06:20:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:41 DEBUG : : Looking for writers 2024/04/26 06:20:41 DEBUG : file1: reading active writers 2024/04/26 06:20:41 DEBUG : file2: reading active writers 2024/04/26 06:20:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:42 DEBUG : : Looking for writers 2024/04/26 06:20:42 DEBUG : file1: reading active writers 2024/04/26 06:20:42 DEBUG : file2: reading active writers 2024/04/26 06:20:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:42 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:20:43 DEBUG : : Looking for writers 2024/04/26 06:20:43 DEBUG : file1: reading active writers 2024/04/26 06:20:43 DEBUG : file2: reading active writers 2024/04/26 06:20:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:43 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:43 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "50aba0486b56f548", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:43 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "50aba0486b56f548", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:44 DEBUG : : Looking for writers 2024/04/26 06:20:44 DEBUG : file1: reading active writers 2024/04/26 06:20:44 DEBUG : file2: reading active writers 2024/04/26 06:20:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:44 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5f3e784dfb9b4fef", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:44 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5f3e784dfb9b4fef", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:45 DEBUG : : Looking for writers 2024/04/26 06:20:45 DEBUG : file1: reading active writers 2024/04/26 06:20:45 DEBUG : file2: reading active writers 2024/04/26 06:20:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:46 DEBUG : : Looking for writers 2024/04/26 06:20:46 DEBUG : file1: reading active writers 2024/04/26 06:20:46 DEBUG : file2: reading active writers 2024/04/26 06:20:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:47 DEBUG : : Looking for writers 2024/04/26 06:20:47 DEBUG : file1: reading active writers 2024/04/26 06:20:47 DEBUG : file2: reading active writers 2024/04/26 06:20:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:48 DEBUG : : Looking for writers 2024/04/26 06:20:48 DEBUG : file1: reading active writers 2024/04/26 06:20:48 DEBUG : file2: reading active writers 2024/04/26 06:20:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:49 DEBUG : : Looking for writers 2024/04/26 06:20:49 DEBUG : file1: reading active writers 2024/04/26 06:20:49 DEBUG : file2: reading active writers 2024/04/26 06:20:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:50 DEBUG : : Looking for writers 2024/04/26 06:20:50 DEBUG : file1: reading active writers 2024/04/26 06:20:50 DEBUG : file2: reading active writers 2024/04/26 06:20:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:51 DEBUG : : Looking for writers 2024/04/26 06:20:51 DEBUG : file1: reading active writers 2024/04/26 06:20:51 DEBUG : file2: reading active writers 2024/04/26 06:20:51 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:20:51 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0007505a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000530408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639161408} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943971044853168186 ext:220740085915 loc:0x3a12660} ATime:{wall:13943971044853318058 ext:220740235787 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0007505a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000530a08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639162944} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943971044853860415 ext:220740778134 loc:0x3a12660} ATime:{wall:13943971044853949632 ext:220740867361 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:20:51 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:20:56 DEBUG : file2: vfs cache: starting upload fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 2024/04/26 06:20:57 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "528cb3853f9cb12e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:57 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "528cb3853f9cb12e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:57 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:20:59 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "08cc957d6dd36988", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:20:59 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "08cc957d6dd36988", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:197: Not found "file1" fstest.go:197: Not found "file2" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/04/26 06:21:00 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:21:00 DEBUG : : Looking for writers 2024/04/26 06:21:00 DEBUG : file1: reading active writers 2024/04/26 06:21:00 DEBUG : file2: reading active writers 2024/04/26 06:21:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/26 06:21:00 DEBUG : : Looking for writers 2024/04/26 06:21:00 DEBUG : file1: reading active writers 2024/04/26 06:21:00 DEBUG : file2: reading active writers 2024/04/26 06:21:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/26 06:21:00 DEBUG : : Looking for writers 2024/04/26 06:21:00 DEBUG : file1: reading active writers 2024/04/26 06:21:00 DEBUG : file2: reading active writers 2024/04/26 06:21:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/26 06:21:00 DEBUG : : Looking for writers 2024/04/26 06:21:00 DEBUG : file1: reading active writers 2024/04/26 06:21:00 DEBUG : file2: reading active writers 2024/04/26 06:21:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/26 06:21:00 DEBUG : : Looking for writers 2024/04/26 06:21:00 DEBUG : file1: reading active writers 2024/04/26 06:21:00 DEBUG : file2: reading active writers 2024/04/26 06:21:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/26 06:21:00 DEBUG : : Looking for writers 2024/04/26 06:21:00 DEBUG : file1: reading active writers 2024/04/26 06:21:00 DEBUG : file2: reading active writers 2024/04/26 06:21:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/26 06:21:01 DEBUG : : Looking for writers 2024/04/26 06:21:01 DEBUG : file2: reading active writers 2024/04/26 06:21:01 DEBUG : file1: reading active writers 2024/04/26 06:21:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/26 06:21:01 DEBUG : : Looking for writers 2024/04/26 06:21:01 DEBUG : file1: reading active writers 2024/04/26 06:21:01 DEBUG : file2: reading active writers 2024/04/26 06:21:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:02 DEBUG : : Looking for writers 2024/04/26 06:21:02 DEBUG : file1: reading active writers 2024/04/26 06:21:02 DEBUG : file2: reading active writers 2024/04/26 06:21:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:03 DEBUG : : Looking for writers 2024/04/26 06:21:03 DEBUG : file2: reading active writers 2024/04/26 06:21:03 DEBUG : file1: reading active writers 2024/04/26 06:21:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:04 DEBUG : : Looking for writers 2024/04/26 06:21:04 DEBUG : file1: reading active writers 2024/04/26 06:21:04 DEBUG : file2: reading active writers 2024/04/26 06:21:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:05 DEBUG : : Looking for writers 2024/04/26 06:21:05 DEBUG : file2: reading active writers 2024/04/26 06:21:05 DEBUG : file1: reading active writers 2024/04/26 06:21:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:06 DEBUG : : Looking for writers 2024/04/26 06:21:06 DEBUG : file1: reading active writers 2024/04/26 06:21:06 DEBUG : file2: reading active writers 2024/04/26 06:21:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:07 DEBUG : : Looking for writers 2024/04/26 06:21:07 DEBUG : file1: reading active writers 2024/04/26 06:21:07 DEBUG : file2: reading active writers 2024/04/26 06:21:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:08 DEBUG : : Looking for writers 2024/04/26 06:21:08 DEBUG : file2: reading active writers 2024/04/26 06:21:08 DEBUG : file1: reading active writers 2024/04/26 06:21:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:09 DEBUG : : Looking for writers 2024/04/26 06:21:09 DEBUG : file2: reading active writers 2024/04/26 06:21:09 DEBUG : file1: reading active writers 2024/04/26 06:21:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:10 DEBUG : : Looking for writers 2024/04/26 06:21:10 DEBUG : file1: reading active writers 2024/04/26 06:21:10 DEBUG : file2: reading active writers 2024/04/26 06:21:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:11 DEBUG : : Looking for writers 2024/04/26 06:21:11 DEBUG : file1: reading active writers 2024/04/26 06:21:11 DEBUG : file2: reading active writers 2024/04/26 06:21:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:12 DEBUG : : Looking for writers 2024/04/26 06:21:12 DEBUG : file1: reading active writers 2024/04/26 06:21:12 DEBUG : file2: reading active writers 2024/04/26 06:21:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:13 DEBUG : : Looking for writers 2024/04/26 06:21:13 DEBUG : file1: reading active writers 2024/04/26 06:21:13 DEBUG : file2: reading active writers 2024/04/26 06:21:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:14 DEBUG : : Looking for writers 2024/04/26 06:21:14 DEBUG : file1: reading active writers 2024/04/26 06:21:14 DEBUG : file2: reading active writers 2024/04/26 06:21:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:15 DEBUG : : Looking for writers 2024/04/26 06:21:15 DEBUG : file2: reading active writers 2024/04/26 06:21:15 DEBUG : file1: reading active writers 2024/04/26 06:21:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:16 DEBUG : : Looking for writers 2024/04/26 06:21:16 DEBUG : file1: reading active writers 2024/04/26 06:21:16 DEBUG : file2: reading active writers 2024/04/26 06:21:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:17 DEBUG : : Looking for writers 2024/04/26 06:21:17 DEBUG : file1: reading active writers 2024/04/26 06:21:17 DEBUG : file2: reading active writers 2024/04/26 06:21:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:18 DEBUG : : Looking for writers 2024/04/26 06:21:18 DEBUG : file1: reading active writers 2024/04/26 06:21:18 DEBUG : file2: reading active writers 2024/04/26 06:21:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:19 DEBUG : : Looking for writers 2024/04/26 06:21:19 DEBUG : file1: reading active writers 2024/04/26 06:21:19 DEBUG : file2: reading active writers 2024/04/26 06:21:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:20 DEBUG : : Looking for writers 2024/04/26 06:21:20 DEBUG : file1: reading active writers 2024/04/26 06:21:20 DEBUG : file2: reading active writers 2024/04/26 06:21:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:21 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:21:21 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/04/26 06:21:21 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/04/26 06:21:21 DEBUG : : Looking for writers 2024/04/26 06:21:21 DEBUG : file1: reading active writers 2024/04/26 06:21:21 DEBUG : file2: reading active writers 2024/04/26 06:21:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:22 DEBUG : : Looking for writers 2024/04/26 06:21:22 DEBUG : file2: reading active writers 2024/04/26 06:21:22 DEBUG : file1: reading active writers 2024/04/26 06:21:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:22 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:21:23 DEBUG : : Looking for writers 2024/04/26 06:21:23 DEBUG : file1: reading active writers 2024/04/26 06:21:23 DEBUG : file2: reading active writers 2024/04/26 06:21:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:24 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34c7ff960be206c0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:24 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34c7ff960be206c0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:24 DEBUG : : Looking for writers 2024/04/26 06:21:24 DEBUG : file1: reading active writers 2024/04/26 06:21:24 DEBUG : file2: reading active writers 2024/04/26 06:21:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:25 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:21:25 DEBUG : : Looking for writers 2024/04/26 06:21:25 DEBUG : file1: reading active writers 2024/04/26 06:21:25 DEBUG : file2: reading active writers 2024/04/26 06:21:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:26 DEBUG : : Looking for writers 2024/04/26 06:21:26 DEBUG : file2: reading active writers 2024/04/26 06:21:26 DEBUG : file1: reading active writers 2024/04/26 06:21:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:27 DEBUG : : Looking for writers 2024/04/26 06:21:27 DEBUG : file1: reading active writers 2024/04/26 06:21:27 DEBUG : file2: reading active writers 2024/04/26 06:21:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:28 DEBUG : : Looking for writers 2024/04/26 06:21:28 DEBUG : file1: reading active writers 2024/04/26 06:21:28 DEBUG : file2: reading active writers 2024/04/26 06:21:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:28 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b4259ae2530d719", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:28 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0b4259ae2530d719", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:29 DEBUG : : Looking for writers 2024/04/26 06:21:29 DEBUG : file2: reading active writers 2024/04/26 06:21:29 DEBUG : file1: reading active writers 2024/04/26 06:21:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:21:30 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0007505a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000530408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639161408} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943971044853168186 ext:220740085915 loc:0x3a12660} ATime:{wall:13943971044853318058 ext:220740235787 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0007505a0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000530a08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639162944} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943971044853860415 ext:220740778134 loc:0x3a12660} ATime:{wall:13943971044853949632 ext:220740867361 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:21:30 DEBUG : >WaitForWriters: 2024/04/26 06:21:30 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (69.11s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:21:30 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:21:30 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:21:30 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:30 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:30 DEBUG : Config file has changed externally - reloading 2024/04/26 06:21:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:30 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "440a65a6641ad471", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:31 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:21:31 DEBUG : : Looking for writers 2024/04/26 06:21:31 DEBUG : >WaitForWriters: 2024/04/26 06:21:31 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (1.01s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:21:31 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:21:31 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:21:31 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:31 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:31 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:31 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:31 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ce3c9da254d64e93", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:32 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:21:32 DEBUG : : Looking for writers 2024/04/26 06:21:32 DEBUG : >WaitForWriters: 2024/04/26 06:21:32 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (1.56s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:21:33 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:21:33 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:21:33 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:33 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-dotiyos8xuforoj6yevefic2" 2024/04/26 06:21:33 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:21:33 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:21:33 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:21:33 DEBUG : file1: newRWFileHandle: 2024/04/26 06:21:33 DEBUG : file1(0xc000984c80): openPending: 2024/04/26 06:21:33 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:21:33 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:21:33 DEBUG : file1(0xc000984c80): >openPending: err= 2024/04/26 06:21:33 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:21:33 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:21:33 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:21:33 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "396d0fd915ba27c2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:21:34 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:21:34 DEBUG : : Looking for writers 2024/04/26 06:21:34 DEBUG : file1: reading active writers 2024/04/26 06:21:34 DEBUG : file1: active writers 1 2024/04/26 06:21:34 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:21:35 DEBUG : : Looking for writers 2024/04/26 06:21:35 DEBUG : file1: reading active writers 2024/04/26 06:21:35 DEBUG : file1: active writers 1 2024/04/26 06:21:35 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:36 DEBUG : : Looking for writers 2024/04/26 06:21:36 DEBUG : file1: reading active writers 2024/04/26 06:21:36 DEBUG : file1: active writers 1 2024/04/26 06:21:36 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:37 DEBUG : : Looking for writers 2024/04/26 06:21:37 DEBUG : file1: reading active writers 2024/04/26 06:21:37 DEBUG : file1: active writers 1 2024/04/26 06:21:37 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:38 DEBUG : : Looking for writers 2024/04/26 06:21:38 DEBUG : file1: reading active writers 2024/04/26 06:21:38 DEBUG : file1: active writers 1 2024/04/26 06:21:38 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:39 DEBUG : : Looking for writers 2024/04/26 06:21:39 DEBUG : file1: reading active writers 2024/04/26 06:21:39 DEBUG : file1: active writers 1 2024/04/26 06:21:39 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:40 DEBUG : : Looking for writers 2024/04/26 06:21:40 DEBUG : file1: reading active writers 2024/04/26 06:21:40 DEBUG : file1: active writers 1 2024/04/26 06:21:40 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:41 DEBUG : : Looking for writers 2024/04/26 06:21:41 DEBUG : file1: reading active writers 2024/04/26 06:21:41 DEBUG : file1: active writers 1 2024/04/26 06:21:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:42 DEBUG : : Looking for writers 2024/04/26 06:21:42 DEBUG : file1: reading active writers 2024/04/26 06:21:42 DEBUG : file1: active writers 1 2024/04/26 06:21:42 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:43 DEBUG : : Looking for writers 2024/04/26 06:21:43 DEBUG : file1: reading active writers 2024/04/26 06:21:43 DEBUG : file1: active writers 1 2024/04/26 06:21:43 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:44 DEBUG : : Looking for writers 2024/04/26 06:21:44 DEBUG : file1: reading active writers 2024/04/26 06:21:44 DEBUG : file1: active writers 1 2024/04/26 06:21:44 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:45 DEBUG : : Looking for writers 2024/04/26 06:21:45 DEBUG : file1: reading active writers 2024/04/26 06:21:45 DEBUG : file1: active writers 1 2024/04/26 06:21:45 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:46 DEBUG : : Looking for writers 2024/04/26 06:21:46 DEBUG : file1: reading active writers 2024/04/26 06:21:46 DEBUG : file1: active writers 1 2024/04/26 06:21:46 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:47 DEBUG : : Looking for writers 2024/04/26 06:21:47 DEBUG : file1: reading active writers 2024/04/26 06:21:47 DEBUG : file1: active writers 1 2024/04/26 06:21:47 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:48 DEBUG : : Looking for writers 2024/04/26 06:21:48 DEBUG : file1: reading active writers 2024/04/26 06:21:48 DEBUG : file1: active writers 1 2024/04/26 06:21:48 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:49 DEBUG : : Looking for writers 2024/04/26 06:21:49 DEBUG : file1: reading active writers 2024/04/26 06:21:49 DEBUG : file1: active writers 1 2024/04/26 06:21:49 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:50 DEBUG : : Looking for writers 2024/04/26 06:21:50 DEBUG : file1: reading active writers 2024/04/26 06:21:50 DEBUG : file1: active writers 1 2024/04/26 06:21:50 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:51 DEBUG : : Looking for writers 2024/04/26 06:21:51 DEBUG : file1: reading active writers 2024/04/26 06:21:51 DEBUG : file1: active writers 1 2024/04/26 06:21:51 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:52 DEBUG : : Looking for writers 2024/04/26 06:21:52 DEBUG : file1: reading active writers 2024/04/26 06:21:52 DEBUG : file1: active writers 1 2024/04/26 06:21:52 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:53 DEBUG : : Looking for writers 2024/04/26 06:21:53 DEBUG : file1: reading active writers 2024/04/26 06:21:53 DEBUG : file1: active writers 1 2024/04/26 06:21:53 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:54 DEBUG : : Looking for writers 2024/04/26 06:21:54 DEBUG : file1: reading active writers 2024/04/26 06:21:54 DEBUG : file1: active writers 1 2024/04/26 06:21:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:55 DEBUG : : Looking for writers 2024/04/26 06:21:55 DEBUG : file1: reading active writers 2024/04/26 06:21:55 DEBUG : file1: active writers 1 2024/04/26 06:21:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:56 DEBUG : : Looking for writers 2024/04/26 06:21:56 DEBUG : file1: reading active writers 2024/04/26 06:21:56 DEBUG : file1: active writers 1 2024/04/26 06:21:56 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:57 DEBUG : : Looking for writers 2024/04/26 06:21:57 DEBUG : file1: reading active writers 2024/04/26 06:21:57 DEBUG : file1: active writers 1 2024/04/26 06:21:57 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:58 DEBUG : : Looking for writers 2024/04/26 06:21:58 DEBUG : file1: reading active writers 2024/04/26 06:21:58 DEBUG : file1: active writers 1 2024/04/26 06:21:58 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:21:59 DEBUG : : Looking for writers 2024/04/26 06:21:59 DEBUG : file1: reading active writers 2024/04/26 06:21:59 DEBUG : file1: active writers 1 2024/04/26 06:21:59 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:22:00 DEBUG : : Looking for writers 2024/04/26 06:22:00 DEBUG : file1: reading active writers 2024/04/26 06:22:00 DEBUG : file1: active writers 1 2024/04/26 06:22:00 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:22:01 DEBUG : : Looking for writers 2024/04/26 06:22:01 DEBUG : file1: reading active writers 2024/04/26 06:22:01 DEBUG : file1: active writers 1 2024/04/26 06:22:01 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:22:02 DEBUG : : Looking for writers 2024/04/26 06:22:02 DEBUG : file1: reading active writers 2024/04/26 06:22:02 DEBUG : file1: active writers 1 2024/04/26 06:22:02 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:22:03 DEBUG : : Looking for writers 2024/04/26 06:22:03 DEBUG : file1: reading active writers 2024/04/26 06:22:03 DEBUG : file1: active writers 1 2024/04/26 06:22:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:22:04 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc00080e3c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0007f0208 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824642044480} name:file1 opens:1 downloaders: o: fd:0xc0006102a8 info:{ModTime:{wall:13943971121835930302 ext:292413436703 loc:0x3a12660} ATime:{wall:13943971121835930302 ext:292413436703 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/04/26 06:22:04 DEBUG : >WaitForWriters: 2024/04/26 06:22:04 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.31s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c503cdc441878e8e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (1.00s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dc2f93070752fde1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (1.02s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:22:06 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:22:06 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "38f7f6494d4ec016", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:09 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:22:09 DEBUG : : Looking for writers 2024/04/26 06:22:09 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (3.14s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:22:09 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:22:09 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e5ed6499223f7bf3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:10 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:22:10 DEBUG : : Looking for writers 2024/04/26 06:22:10 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (1.53s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:22:11 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:22:11 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b6821f12a5b0e451", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:12 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:22:12 DEBUG : : Looking for writers 2024/04/26 06:22:12 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (1.54s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:22:12 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:22:12 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4dfc6910f592aa3c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:13 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:22:13 DEBUG : : Looking for writers 2024/04/26 06:22:13 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (1.00s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:22:13 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:22:13 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:22:13 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:22:14 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:22:14 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:14 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:22:14 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:22:14 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:14 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/26 06:22:14 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/26 06:22:14 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/04/26 06:22:14 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (5 bytes), uploading instead of streaming 2024/04/26 06:22:16 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed2e04892883fb32", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:16 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed2e04892883fb32", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:16 DEBUG : file1: Remove: 2024/04/26 06:22:16 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:22:16 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed2e04892883fb32", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/04/26 06:22:25 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:22:25 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:22:25 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:25 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:22:25 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:22:25 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:25 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:22:26 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f0d2c20dea021c36", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:26 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f0d2c20dea021c36", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:26 DEBUG : file1: Remove: 2024/04/26 06:22:26 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:22:26 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f0d2c20dea021c36", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/04/26 06:22:26 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:22:26 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:22:26 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:26 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:22:26 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:22:26 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/04/26 06:22:26 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/04/26 06:22:26 DEBUG : : Looking for writers 2024/04/26 06:22:26 DEBUG : file1: reading active writers 2024/04/26 06:22:26 DEBUG : file1: active writers 1 2024/04/26 06:22:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/04/26 06:22:27 DEBUG : : Looking for writers 2024/04/26 06:22:27 DEBUG : file1: reading active writers 2024/04/26 06:22:27 DEBUG : file1: active writers 1 2024/04/26 06:22:27 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:28 DEBUG : : Looking for writers 2024/04/26 06:22:28 DEBUG : file1: reading active writers 2024/04/26 06:22:28 DEBUG : file1: active writers 1 2024/04/26 06:22:28 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:29 DEBUG : : Looking for writers 2024/04/26 06:22:29 DEBUG : file1: reading active writers 2024/04/26 06:22:29 DEBUG : file1: active writers 1 2024/04/26 06:22:29 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:30 DEBUG : : Looking for writers 2024/04/26 06:22:30 DEBUG : file1: reading active writers 2024/04/26 06:22:30 DEBUG : file1: active writers 1 2024/04/26 06:22:30 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:31 DEBUG : : Looking for writers 2024/04/26 06:22:31 DEBUG : file1: reading active writers 2024/04/26 06:22:31 DEBUG : file1: active writers 1 2024/04/26 06:22:31 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:32 DEBUG : : Looking for writers 2024/04/26 06:22:32 DEBUG : file1: reading active writers 2024/04/26 06:22:32 DEBUG : file1: active writers 1 2024/04/26 06:22:32 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:33 DEBUG : : Looking for writers 2024/04/26 06:22:33 DEBUG : file1: reading active writers 2024/04/26 06:22:33 DEBUG : file1: active writers 1 2024/04/26 06:22:33 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:34 DEBUG : : Looking for writers 2024/04/26 06:22:34 DEBUG : file1: reading active writers 2024/04/26 06:22:34 DEBUG : file1: active writers 1 2024/04/26 06:22:34 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:35 DEBUG : : Looking for writers 2024/04/26 06:22:35 DEBUG : file1: reading active writers 2024/04/26 06:22:35 DEBUG : file1: active writers 1 2024/04/26 06:22:35 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:36 DEBUG : : Looking for writers 2024/04/26 06:22:36 DEBUG : file1: reading active writers 2024/04/26 06:22:36 DEBUG : file1: active writers 1 2024/04/26 06:22:36 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:37 DEBUG : : Looking for writers 2024/04/26 06:22:37 DEBUG : file1: reading active writers 2024/04/26 06:22:37 DEBUG : file1: active writers 1 2024/04/26 06:22:37 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:38 DEBUG : : Looking for writers 2024/04/26 06:22:38 DEBUG : file1: reading active writers 2024/04/26 06:22:38 DEBUG : file1: active writers 1 2024/04/26 06:22:38 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:39 DEBUG : : Looking for writers 2024/04/26 06:22:39 DEBUG : file1: reading active writers 2024/04/26 06:22:39 DEBUG : file1: active writers 1 2024/04/26 06:22:39 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:40 DEBUG : : Looking for writers 2024/04/26 06:22:40 DEBUG : file1: reading active writers 2024/04/26 06:22:40 DEBUG : file1: active writers 1 2024/04/26 06:22:40 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:41 DEBUG : : Looking for writers 2024/04/26 06:22:41 DEBUG : file1: reading active writers 2024/04/26 06:22:41 DEBUG : file1: active writers 1 2024/04/26 06:22:41 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:42 DEBUG : : Looking for writers 2024/04/26 06:22:42 DEBUG : file1: reading active writers 2024/04/26 06:22:42 DEBUG : file1: active writers 1 2024/04/26 06:22:42 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:43 DEBUG : : Looking for writers 2024/04/26 06:22:43 DEBUG : file1: reading active writers 2024/04/26 06:22:43 DEBUG : file1: active writers 1 2024/04/26 06:22:43 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:44 DEBUG : : Looking for writers 2024/04/26 06:22:44 DEBUG : file1: reading active writers 2024/04/26 06:22:44 DEBUG : file1: active writers 1 2024/04/26 06:22:44 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:45 DEBUG : : Looking for writers 2024/04/26 06:22:45 DEBUG : file1: reading active writers 2024/04/26 06:22:45 DEBUG : file1: active writers 1 2024/04/26 06:22:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:46 DEBUG : : Looking for writers 2024/04/26 06:22:46 DEBUG : file1: reading active writers 2024/04/26 06:22:46 DEBUG : file1: active writers 1 2024/04/26 06:22:46 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:47 DEBUG : : Looking for writers 2024/04/26 06:22:47 DEBUG : file1: reading active writers 2024/04/26 06:22:47 DEBUG : file1: active writers 1 2024/04/26 06:22:47 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:48 DEBUG : : Looking for writers 2024/04/26 06:22:48 DEBUG : file1: reading active writers 2024/04/26 06:22:48 DEBUG : file1: active writers 1 2024/04/26 06:22:48 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:49 DEBUG : : Looking for writers 2024/04/26 06:22:49 DEBUG : file1: reading active writers 2024/04/26 06:22:49 DEBUG : file1: active writers 1 2024/04/26 06:22:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:50 DEBUG : : Looking for writers 2024/04/26 06:22:50 DEBUG : file1: reading active writers 2024/04/26 06:22:50 DEBUG : file1: active writers 1 2024/04/26 06:22:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:51 DEBUG : : Looking for writers 2024/04/26 06:22:51 DEBUG : file1: reading active writers 2024/04/26 06:22:51 DEBUG : file1: active writers 1 2024/04/26 06:22:51 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:52 DEBUG : : Looking for writers 2024/04/26 06:22:52 DEBUG : file1: reading active writers 2024/04/26 06:22:52 DEBUG : file1: active writers 1 2024/04/26 06:22:52 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:53 DEBUG : : Looking for writers 2024/04/26 06:22:53 DEBUG : file1: reading active writers 2024/04/26 06:22:53 DEBUG : file1: active writers 1 2024/04/26 06:22:53 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:54 DEBUG : : Looking for writers 2024/04/26 06:22:54 DEBUG : file1: reading active writers 2024/04/26 06:22:54 DEBUG : file1: active writers 1 2024/04/26 06:22:54 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:55 DEBUG : : Looking for writers 2024/04/26 06:22:55 DEBUG : file1: reading active writers 2024/04/26 06:22:55 DEBUG : file1: active writers 1 2024/04/26 06:22:55 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:22:56 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/04/26 06:22:56 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (42.56s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:22:56 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:22:56 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:22:56 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:22:56 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:22:56 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:56 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:22:56 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:22:56 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:22:56 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/04/26 06:22:57 DEBUG : file1: aborting in-sequence write wait, off=100 2024/04/26 06:22:57 DEBUG : file1: failed to wait for in-sequence write to 100 2024/04/26 06:22:57 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/04/26 06:22:57 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (11 bytes), uploading instead of streaming 2024/04/26 06:22:58 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ba61ebd20aa70668", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:58 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ba61ebd20aa70668", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:22:58 DEBUG : file1: Remove: 2024/04/26 06:22:58 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:22:58 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ba61ebd20aa70668", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/04/26 06:22:58 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/04/26 06:23:06 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:23:06 DEBUG : : Looking for writers 2024/04/26 06:23:06 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (12.39s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:23:08 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:23:08 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:23:08 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:23:09 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:23:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:09 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:23:09 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:23:09 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/04/26 06:23:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:09 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (5 bytes), uploading instead of streaming 2024/04/26 06:23:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f2b7bcf30d088702", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:09 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f2b7bcf30d088702", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:09 DEBUG : file1: Remove: 2024/04/26 06:23:09 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:23:09 DEBUG : file1: >Remove: err= 2024/04/26 06:23:09 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f2b7bcf30d088702", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f2b7bcf30d088702", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/04/26 06:23:09 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/04/26 06:23:09 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:23:09 DEBUG : : Looking for writers 2024/04/26 06:23:09 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (1.31s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:23:10 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:23:10 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:23:10 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:23:10 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:23:10 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:10 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:23:10 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:23:10 DEBUG : file1: WriteFileHandle.Release closing 2024/04/26 06:23:10 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:10 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:23:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ecb1198dea6f03e6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:11 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ecb1198dea6f03e6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:11 DEBUG : file1: Remove: 2024/04/26 06:23:11 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:23:11 DEBUG : file1: >Remove: err= 2024/04/26 06:23:11 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ecb1198dea6f03e6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ecb1198dea6f03e6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/04/26 06:23:11 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/04/26 06:23:11 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:23:11 DEBUG : : Looking for writers 2024/04/26 06:23:11 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.30s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:23:11 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:23:11 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:23:11 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:23:11 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:23:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:11 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:23:11 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:23:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:11 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (2 bytes), uploading instead of streaming 2024/04/26 06:23:12 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "54696ab463d00970", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:12 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "54696ab463d00970", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:12 DEBUG : file1: Remove: 2024/04/26 06:23:12 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:23:12 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "54696ab463d00970", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/04/26 06:23:12 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:23:12 DEBUG : : Looking for writers 2024/04/26 06:23:12 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.31s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:23:12 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:23:12 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:23:12 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:23:13 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:23:13 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:13 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:23:13 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:23:13 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:13 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:23:13 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "63b7359c6ae8bf62", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:13 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "63b7359c6ae8bf62", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:13 DEBUG : file1: Remove: 2024/04/26 06:23:13 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:23:13 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "63b7359c6ae8bf62", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/04/26 06:23:13 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/26 06:23:13 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/04/26 06:23:13 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:23:13 DEBUG : : Looking for writers 2024/04/26 06:23:13 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (1.84s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2", Local "Local file system at /tmp/rclone3491450313", Modify Window "876000h0m0s" 2024/04/26 06:23:14 INFO : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: poll-interval is not supported by this remote 2024/04/26 06:23:14 NOTICE: QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:23:14 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:23:14 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:23:14 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:14 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:23:14 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:23:14 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:23:14 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: File to upload is small (100 bytes), uploading instead of streaming 2024/04/26 06:23:15 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8c408528453170f6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:15 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8c408528453170f6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:15 DEBUG : file1: Remove: 2024/04/26 06:23:15 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:23:15 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8c408528453170f6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/04/26 06:23:15 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/26 06:23:15 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/04/26 06:23:15 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:23:15 DEBUG : : Looking for writers 2024/04/26 06:23:15 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.31s) FAIL 2024/04/26 06:23:17 DEBUG : QingStor bucket rclone-test-dotiyos8xuforoj6yevefic2: Purge dir "" 2024/04/26 06:23:17 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "66197c500e7b1d0c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:23:17 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 6m36.361466082s (try 4/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]