"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 2/5) 2024/04/25 06:29:52 DEBUG : Creating backend with remote "TestQingStor:rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:29:52 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/25 06:29:52 DEBUG : Creating backend with remote "/tmp/rclone3998889360" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:52 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:52 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "260047869d50ffb5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:53 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:53 DEBUG : : Looking for writers 2024/04/25 06:29:53 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (1.89s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:54 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:54 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "557a3b1bee251b4e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:54 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:54 DEBUG : : Looking for writers 2024/04/25 06:29:54 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (0.83s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:54 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:54 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "37e2c790f3572a69", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:55 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:55 DEBUG : : Looking for writers 2024/04/25 06:29:55 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (0.84s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:55 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:55 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "71ab3b03a72604de", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:56 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:56 DEBUG : : Looking for writers 2024/04/25 06:29:56 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (0.84s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:56 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:56 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f5720bf070cdb68", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:57 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:57 DEBUG : : Looking for writers 2024/04/25 06:29:57 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (0.82s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:57 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:57 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5a7156171f6839c2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:59 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:59 DEBUG : : Looking for writers 2024/04/25 06:29:59 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (1.82s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:29:59 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:29:59 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2da9372797a30949", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:29:59 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:29:59 DEBUG : : Looking for writers 2024/04/25 06:29:59 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (0.82s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:00 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:00 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "92cb4391e2ebe7d2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:00 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:00 DEBUG : : Looking for writers 2024/04/25 06:30:00 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (0.83s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:00 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:00 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "33c443d371a3d40b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:01 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:01 DEBUG : : Looking for writers 2024/04/25 06:30:01 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (0.82s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:01 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:01 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8800b9710ed1d34c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:02 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:02 DEBUG : : Looking for writers 2024/04/25 06:30:02 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (0.83s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:02 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:02 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "06e54c5800f008b1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:03 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:03 DEBUG : : Looking for writers 2024/04/25 06:30:03 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (1.28s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:03 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:03 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2826ad9d5056f9b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:04 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:04 DEBUG : : Looking for writers 2024/04/25 06:30:04 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (0.82s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:04 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:04 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "803c96843be5c6de", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:05 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:05 DEBUG : : Looking for writers 2024/04/25 06:30:05 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (0.82s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:05 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:05 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "44496d97adcabe42", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:06 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:06 DEBUG : : Looking for writers 2024/04/25 06:30:06 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (0.83s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:06 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:06 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e3ed13ac40f53f16", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:06 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:06 DEBUG : : Looking for writers 2024/04/25 06:30:06 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (0.82s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:07 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:07 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "13390b4668c9ba42", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:07 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:07 DEBUG : : Looking for writers 2024/04/25 06:30:07 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (0.83s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:07 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:07 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "29e4455df53eb2ef", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:08 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:08 DEBUG : : Looking for writers 2024/04/25 06:30:08 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (0.82s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:08 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:08 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c4ca0f0cad573e70", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:09 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:09 DEBUG : : Looking for writers 2024/04/25 06:30:09 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (0.82s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:09 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:09 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ff06af2b929aa795", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:10 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:10 DEBUG : : Looking for writers 2024/04/25 06:30:10 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (0.82s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:10 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:10 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7eccccc1f3f1fb9c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:11 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:11 DEBUG : : Looking for writers 2024/04/25 06:30:11 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:11 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:11 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "44063e7152fa9e07", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:11 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:11 DEBUG : : Looking for writers 2024/04/25 06:30:11 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:12 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:12 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9a28a45f7e6d1d50", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:12 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:12 DEBUG : : Looking for writers 2024/04/25 06:30:12 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:12 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:12 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:12 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:12 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:12 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1236cae9092f6bc9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:13 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:13 DEBUG : : Looking for writers 2024/04/25 06:30:13 DEBUG : >WaitForWriters: 2024/04/25 06:30:13 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:13 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:13 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:13 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:13 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:13 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:13 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:13 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6f2b9c0f566bb9e9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:14 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:14 DEBUG : : Looking for writers 2024/04/25 06:30:14 DEBUG : >WaitForWriters: 2024/04/25 06:30:14 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:14 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:14 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:14 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:14 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:14 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:14 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:14 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f2c34c95f8fc1575", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:15 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:15 DEBUG : : Looking for writers 2024/04/25 06:30:15 DEBUG : >WaitForWriters: 2024/04/25 06:30:15 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (4.94s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (0.83s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (0.82s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (0.82s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (0.82s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (0.82s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (0.82s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:15 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:15 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "257fae284b9247e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:16 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:16 DEBUG : : Looking for writers 2024/04/25 06:30:16 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (1.26s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:16 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:16 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "187db77d29faed65", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:17 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:17 DEBUG : : Looking for writers 2024/04/25 06:30:17 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (0.82s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:17 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:17 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2dd4eb3467ac9dc7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:18 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:18 DEBUG : : Looking for writers 2024/04/25 06:30:18 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (0.83s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:18 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:18 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5694a1b35f48aadb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:18 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:18 DEBUG : : Looking for writers 2024/04/25 06:30:18 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (0.82s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:19 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:19 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5311e3b74d0561b1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:19 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:19 DEBUG : : Looking for writers 2024/04/25 06:30:19 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (1.26s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:20 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:20 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "89f1fc569124d026", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:20 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:20 DEBUG : : Looking for writers 2024/04/25 06:30:20 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:21 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:21 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:30:21 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:21 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:21 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:21 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "39a6824e5139f464", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:21 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:21 DEBUG : : Looking for writers 2024/04/25 06:30:21 DEBUG : >WaitForWriters: 2024/04/25 06:30:21 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:22 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:22 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:30:22 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:22 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1c1bd2af21654550", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:22 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:22 DEBUG : : Looking for writers 2024/04/25 06:30:22 DEBUG : >WaitForWriters: 2024/04/25 06:30:22 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:22 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:22 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:22 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:22 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8ae617556fbd64a6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:24 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:24 DEBUG : : Looking for writers 2024/04/25 06:30:24 DEBUG : >WaitForWriters: 2024/04/25 06:30:24 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:24 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:24 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:24 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:24 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:24 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:24 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:24 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c4c559af918e4593", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:25 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:25 DEBUG : : Looking for writers 2024/04/25 06:30:25 DEBUG : >WaitForWriters: 2024/04/25 06:30:25 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:25 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:25 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:25 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:25 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:25 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:25 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:25 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c90190d52ff0419f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:26 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:26 DEBUG : : Looking for writers 2024/04/25 06:30:26 DEBUG : >WaitForWriters: 2024/04/25 06:30:26 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (6.21s) --- FAIL: TestFileRename/off,forceCache=false (0.82s) --- FAIL: TestFileRename/minimal,forceCache=false (0.83s) --- FAIL: TestFileRename/minimal,forceCache=true (0.82s) --- FAIL: TestFileRename/writes,forceCache=false (2.02s) --- FAIL: TestFileRename/writes,forceCache=true (0.86s) --- FAIL: TestFileRename/full,forceCache=false (0.86s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:26 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:26 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7e805363c0397460", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:27 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:27 DEBUG : : Looking for writers 2024/04/25 06:30:27 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (0.86s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:27 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:27 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3f7e1ffc0d262ed7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:28 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:28 DEBUG : : Looking for writers 2024/04/25 06:30:28 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (0.85s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:28 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:28 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "43a91a59757b74f8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:28 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:28 DEBUG : : Looking for writers 2024/04/25 06:30:28 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (0.86s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:29 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:29 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0d8fd7bb492fe1c2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:29 DEBUG : : Looking for writers 2024/04/25 06:30:29 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (0.86s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:30 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:30 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7d1b635e36944a1e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:30 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:30 DEBUG : : Looking for writers 2024/04/25 06:30:30 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (0.86s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:30 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:30 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:30 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:30 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:30 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:30 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f52088ad754ac0e4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:31 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:31 DEBUG : : Looking for writers 2024/04/25 06:30:31 DEBUG : >WaitForWriters: 2024/04/25 06:30:31 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (0.86s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:31 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:31 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:31 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:31 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:31 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:31 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:31 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6313e6984dd0e6b7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:32 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:32 DEBUG : : Looking for writers 2024/04/25 06:30:32 DEBUG : >WaitForWriters: 2024/04/25 06:30:32 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (0.86s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:32 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:32 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:32 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:32 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:32 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:32 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:32 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1c28e5e0ac72de19", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:33 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:33 DEBUG : : Looking for writers 2024/04/25 06:30:33 DEBUG : >WaitForWriters: 2024/04/25 06:30:33 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (0.86s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:33 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:33 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:33 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:33 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:33 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1376160860c90f9f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:34 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:34 DEBUG : : Looking for writers 2024/04/25 06:30:34 DEBUG : >WaitForWriters: 2024/04/25 06:30:34 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (0.86s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:34 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:34 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:34 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:34 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:34 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:34 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:34 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3e2117dc5119e6e7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:34 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:34 DEBUG : : Looking for writers 2024/04/25 06:30:34 DEBUG : >WaitForWriters: 2024/04/25 06:30:34 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (0.87s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:30:35 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:30:35 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:30:35 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:35 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:35 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:35 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:30:35 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:30:35 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:30:35 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:30:35 DEBUG : file1: newRWFileHandle: 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): openPending: 2024/04/25 06:30:35 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:30:35 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): >openPending: err= 2024/04/25 06:30:35 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:30:35 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:30:35 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:30:35 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): _writeAt: size=5, off=0 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): >_writeAt: n=5, err= 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): _writeAt: size=7, off=5 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): >_writeAt: n=7, err= 2024/04/25 06:30:35 DEBUG : file1: vfs cache: truncate to size=11 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): close: 2024/04/25 06:30:35 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:30:35.456652574 +0000 UTC m=+43.243316176 2024/04/25 06:30:35 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): >close: err= 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): close: 2024/04/25 06:30:35 DEBUG : file1(0xc0000b1180): >close: err=file already closed 2024/04/25 06:30:35 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:30:35 DEBUG : : Looking for writers 2024/04/25 06:30:35 DEBUG : file1: reading active writers 2024/04/25 06:30:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:30:35 DEBUG : : Looking for writers 2024/04/25 06:30:35 DEBUG : file1: reading active writers 2024/04/25 06:30:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:30:35 DEBUG : : Looking for writers 2024/04/25 06:30:35 DEBUG : file1: reading active writers 2024/04/25 06:30:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:30:35 DEBUG : : Looking for writers 2024/04/25 06:30:35 DEBUG : file1: reading active writers 2024/04/25 06:30:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:30:35 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:35 DEBUG : : Looking for writers 2024/04/25 06:30:35 DEBUG : file1: reading active writers 2024/04/25 06:30:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:30:35 DEBUG : : Looking for writers 2024/04/25 06:30:35 DEBUG : file1: reading active writers 2024/04/25 06:30:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:30:36 DEBUG : : Looking for writers 2024/04/25 06:30:36 DEBUG : file1: reading active writers 2024/04/25 06:30:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:30:36 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "51ef7f61cb5dd093", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:36 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "51ef7f61cb5dd093", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:36 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:36 DEBUG : : Looking for writers 2024/04/25 06:30:36 DEBUG : file1: reading active writers 2024/04/25 06:30:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:36 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e1912a62a6db8b1a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:36 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e1912a62a6db8b1a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:37 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:37 DEBUG : : Looking for writers 2024/04/25 06:30:37 DEBUG : file1: reading active writers 2024/04/25 06:30:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:38 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b38a5ce9d7e71653", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:38 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b38a5ce9d7e71653", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:38 DEBUG : : Looking for writers 2024/04/25 06:30:38 DEBUG : file1: reading active writers 2024/04/25 06:30:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:38 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:39 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "225c7770ca8fc3bd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:39 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "225c7770ca8fc3bd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:39 DEBUG : : Looking for writers 2024/04/25 06:30:39 DEBUG : file1: reading active writers 2024/04/25 06:30:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:40 DEBUG : : Looking for writers 2024/04/25 06:30:40 DEBUG : file1: reading active writers 2024/04/25 06:30:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:41 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:41 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "990f8dc170e4b412", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:41 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "990f8dc170e4b412", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:41 DEBUG : : Looking for writers 2024/04/25 06:30:41 DEBUG : file1: reading active writers 2024/04/25 06:30:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:42 DEBUG : : Looking for writers 2024/04/25 06:30:42 DEBUG : file1: reading active writers 2024/04/25 06:30:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:43 DEBUG : : Looking for writers 2024/04/25 06:30:43 DEBUG : file1: reading active writers 2024/04/25 06:30:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:44 DEBUG : : Looking for writers 2024/04/25 06:30:44 DEBUG : file1: reading active writers 2024/04/25 06:30:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:44 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:45 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "228d0261ef43d059", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:45 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "228d0261ef43d059", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:45 DEBUG : : Looking for writers 2024/04/25 06:30:45 DEBUG : file1: reading active writers 2024/04/25 06:30:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:46 DEBUG : : Looking for writers 2024/04/25 06:30:46 DEBUG : file1: reading active writers 2024/04/25 06:30:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:47 DEBUG : : Looking for writers 2024/04/25 06:30:47 DEBUG : file1: reading active writers 2024/04/25 06:30:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:48 DEBUG : : Looking for writers 2024/04/25 06:30:48 DEBUG : file1: reading active writers 2024/04/25 06:30:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:49 DEBUG : : Looking for writers 2024/04/25 06:30:49 DEBUG : file1: reading active writers 2024/04/25 06:30:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:50 DEBUG : : Looking for writers 2024/04/25 06:30:50 DEBUG : file1: reading active writers 2024/04/25 06:30:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:51 DEBUG : : Looking for writers 2024/04/25 06:30:51 DEBUG : file1: reading active writers 2024/04/25 06:30:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:51 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:30:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5d23dc25445d1bd1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:52 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5d23dc25445d1bd1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:30:52 DEBUG : : Looking for writers 2024/04/25 06:30:52 DEBUG : file1: reading active writers 2024/04/25 06:30:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:53 DEBUG : : Looking for writers 2024/04/25 06:30:53 DEBUG : file1: reading active writers 2024/04/25 06:30:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:54 DEBUG : : Looking for writers 2024/04/25 06:30:54 DEBUG : file1: reading active writers 2024/04/25 06:30:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:55 DEBUG : : Looking for writers 2024/04/25 06:30:55 DEBUG : file1: reading active writers 2024/04/25 06:30:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:56 DEBUG : : Looking for writers 2024/04/25 06:30:56 DEBUG : file1: reading active writers 2024/04/25 06:30:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:57 DEBUG : : Looking for writers 2024/04/25 06:30:57 DEBUG : file1: reading active writers 2024/04/25 06:30:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:58 DEBUG : : Looking for writers 2024/04/25 06:30:58 DEBUG : file1: reading active writers 2024/04/25 06:30:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:30:59 DEBUG : : Looking for writers 2024/04/25 06:30:59 DEBUG : file1: reading active writers 2024/04/25 06:30:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:00 DEBUG : : Looking for writers 2024/04/25 06:31:00 DEBUG : file1: reading active writers 2024/04/25 06:31:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:01 DEBUG : : Looking for writers 2024/04/25 06:31:01 DEBUG : file1: reading active writers 2024/04/25 06:31:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:02 DEBUG : : Looking for writers 2024/04/25 06:31:02 DEBUG : file1: reading active writers 2024/04/25 06:31:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:03 DEBUG : : Looking for writers 2024/04/25 06:31:03 DEBUG : file1: reading active writers 2024/04/25 06:31:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:04 DEBUG : : Looking for writers 2024/04/25 06:31:04 DEBUG : file1: reading active writers 2024/04/25 06:31:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:05 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:05 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0006a23c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00078c608 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641635904} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943878932374222622 ext:43243316176 loc:0x3a135e0} ATime:{wall:13943878932374244573 ext:43243338127 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:31:05 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:31:06 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "691e3a1911ce692c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:06 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "691e3a1911ce692c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/04/25 06:31:13 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:31:13 DEBUG : : Looking for writers 2024/04/25 06:31:13 DEBUG : file1: reading active writers 2024/04/25 06:31:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:31:14 DEBUG : : Looking for writers 2024/04/25 06:31:14 DEBUG : file1: reading active writers 2024/04/25 06:31:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:15 DEBUG : : Looking for writers 2024/04/25 06:31:15 DEBUG : file1: reading active writers 2024/04/25 06:31:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:16 DEBUG : : Looking for writers 2024/04/25 06:31:16 DEBUG : file1: reading active writers 2024/04/25 06:31:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:17 DEBUG : : Looking for writers 2024/04/25 06:31:17 DEBUG : file1: reading active writers 2024/04/25 06:31:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:18 DEBUG : : Looking for writers 2024/04/25 06:31:18 DEBUG : file1: reading active writers 2024/04/25 06:31:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:19 DEBUG : : Looking for writers 2024/04/25 06:31:19 DEBUG : file1: reading active writers 2024/04/25 06:31:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:20 DEBUG : : Looking for writers 2024/04/25 06:31:20 DEBUG : file1: reading active writers 2024/04/25 06:31:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:21 DEBUG : : Looking for writers 2024/04/25 06:31:21 DEBUG : file1: reading active writers 2024/04/25 06:31:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:22 DEBUG : : Looking for writers 2024/04/25 06:31:22 DEBUG : file1: reading active writers 2024/04/25 06:31:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:23 DEBUG : : Looking for writers 2024/04/25 06:31:23 DEBUG : file1: reading active writers 2024/04/25 06:31:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:24 DEBUG : : Looking for writers 2024/04/25 06:31:24 DEBUG : file1: reading active writers 2024/04/25 06:31:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:25 DEBUG : : Looking for writers 2024/04/25 06:31:25 DEBUG : file1: reading active writers 2024/04/25 06:31:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:26 DEBUG : : Looking for writers 2024/04/25 06:31:26 DEBUG : file1: reading active writers 2024/04/25 06:31:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:27 DEBUG : : Looking for writers 2024/04/25 06:31:27 DEBUG : file1: reading active writers 2024/04/25 06:31:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:28 DEBUG : : Looking for writers 2024/04/25 06:31:28 DEBUG : file1: reading active writers 2024/04/25 06:31:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:29 DEBUG : : Looking for writers 2024/04/25 06:31:29 DEBUG : file1: reading active writers 2024/04/25 06:31:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:30 DEBUG : : Looking for writers 2024/04/25 06:31:30 DEBUG : file1: reading active writers 2024/04/25 06:31:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:31 DEBUG : : Looking for writers 2024/04/25 06:31:31 DEBUG : file1: reading active writers 2024/04/25 06:31:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:31 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cb7125c9151266ec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:32 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cb7125c9151266ec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:32 DEBUG : : Looking for writers 2024/04/25 06:31:32 DEBUG : file1: reading active writers 2024/04/25 06:31:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:33 DEBUG : : Looking for writers 2024/04/25 06:31:33 DEBUG : file1: reading active writers 2024/04/25 06:31:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:34 DEBUG : : Looking for writers 2024/04/25 06:31:34 DEBUG : file1: reading active writers 2024/04/25 06:31:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:35 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:31:35 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/25 06:31:35 DEBUG : : Looking for writers 2024/04/25 06:31:35 DEBUG : file1: reading active writers 2024/04/25 06:31:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:36 DEBUG : : Looking for writers 2024/04/25 06:31:36 DEBUG : file1: reading active writers 2024/04/25 06:31:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:37 DEBUG : : Looking for writers 2024/04/25 06:31:37 DEBUG : file1: reading active writers 2024/04/25 06:31:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:38 DEBUG : : Looking for writers 2024/04/25 06:31:38 DEBUG : file1: reading active writers 2024/04/25 06:31:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:39 DEBUG : : Looking for writers 2024/04/25 06:31:39 DEBUG : file1: reading active writers 2024/04/25 06:31:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:40 DEBUG : : Looking for writers 2024/04/25 06:31:40 DEBUG : file1: reading active writers 2024/04/25 06:31:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:41 DEBUG : : Looking for writers 2024/04/25 06:31:41 DEBUG : file1: reading active writers 2024/04/25 06:31:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:42 DEBUG : : Looking for writers 2024/04/25 06:31:42 DEBUG : file1: reading active writers 2024/04/25 06:31:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:43 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0006a23c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00078c608 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641635904} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943878932374222622 ext:43243316176 loc:0x3a135e0} ATime:{wall:13943878932374244573 ext:43243338127 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:31:43 DEBUG : >WaitForWriters: 2024/04/25 06:31:43 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (68.35s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:31:43 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:31:43 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:31:43 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:31:43 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:31:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:31:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:31:43 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:31:43 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:31:43 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:31:43 DEBUG : file1: newRWFileHandle: 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): openPending: 2024/04/25 06:31:43 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:31:43 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): >openPending: err= 2024/04/25 06:31:43 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:31:43 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:31:43 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:31:43 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): _writeAt: size=7, off=0 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): >_writeAt: n=7, err= 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): _writeAt: size=6, off=5 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): >_writeAt: n=6, err= 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): close: 2024/04/25 06:31:43 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:31:43.795751144 +0000 UTC m=+111.582414726 2024/04/25 06:31:43 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): >close: err= 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): _writeAt: size=5, off=0 2024/04/25 06:31:43 DEBUG : file1(0xc0002b7340): >_writeAt: n=0, err=file already closed 2024/04/25 06:31:43 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:31:43 DEBUG : : Looking for writers 2024/04/25 06:31:43 DEBUG : file1: reading active writers 2024/04/25 06:31:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:31:43 DEBUG : : Looking for writers 2024/04/25 06:31:43 DEBUG : file1: reading active writers 2024/04/25 06:31:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:31:43 DEBUG : : Looking for writers 2024/04/25 06:31:43 DEBUG : file1: reading active writers 2024/04/25 06:31:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:31:43 DEBUG : : Looking for writers 2024/04/25 06:31:43 DEBUG : file1: reading active writers 2024/04/25 06:31:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:31:43 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:43 DEBUG : : Looking for writers 2024/04/25 06:31:43 DEBUG : file1: reading active writers 2024/04/25 06:31:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:31:44 DEBUG : : Looking for writers 2024/04/25 06:31:44 DEBUG : file1: reading active writers 2024/04/25 06:31:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:31:44 DEBUG : : Looking for writers 2024/04/25 06:31:44 DEBUG : file1: reading active writers 2024/04/25 06:31:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:31:44 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d3896a967d29bc69", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:44 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d3896a967d29bc69", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:44 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:45 DEBUG : : Looking for writers 2024/04/25 06:31:45 DEBUG : file1: reading active writers 2024/04/25 06:31:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:45 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d279cedbfc8c3fd9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:45 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d279cedbfc8c3fd9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:45 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:46 DEBUG : : Looking for writers 2024/04/25 06:31:46 DEBUG : file1: reading active writers 2024/04/25 06:31:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:46 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5ed29b92aff489b2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:46 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5ed29b92aff489b2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:47 DEBUG : : Looking for writers 2024/04/25 06:31:47 DEBUG : file1: reading active writers 2024/04/25 06:31:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:47 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:47 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "76d56ea493fcc070", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:47 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "76d56ea493fcc070", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:48 DEBUG : : Looking for writers 2024/04/25 06:31:48 DEBUG : file1: reading active writers 2024/04/25 06:31:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:49 DEBUG : : Looking for writers 2024/04/25 06:31:49 DEBUG : file1: reading active writers 2024/04/25 06:31:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:49 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:49 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e713e97d1089707a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:49 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e713e97d1089707a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:50 DEBUG : : Looking for writers 2024/04/25 06:31:50 DEBUG : file1: reading active writers 2024/04/25 06:31:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:51 DEBUG : : Looking for writers 2024/04/25 06:31:51 DEBUG : file1: reading active writers 2024/04/25 06:31:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:52 DEBUG : : Looking for writers 2024/04/25 06:31:52 DEBUG : file1: reading active writers 2024/04/25 06:31:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:53 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:31:53 DEBUG : : Looking for writers 2024/04/25 06:31:53 DEBUG : file1: reading active writers 2024/04/25 06:31:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:53 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e104de77c58411a8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:53 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e104de77c58411a8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:31:54 DEBUG : : Looking for writers 2024/04/25 06:31:54 DEBUG : file1: reading active writers 2024/04/25 06:31:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:55 DEBUG : : Looking for writers 2024/04/25 06:31:55 DEBUG : file1: reading active writers 2024/04/25 06:31:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:56 DEBUG : : Looking for writers 2024/04/25 06:31:56 DEBUG : file1: reading active writers 2024/04/25 06:31:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:57 DEBUG : : Looking for writers 2024/04/25 06:31:57 DEBUG : file1: reading active writers 2024/04/25 06:31:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:58 DEBUG : : Looking for writers 2024/04/25 06:31:58 DEBUG : file1: reading active writers 2024/04/25 06:31:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:31:59 DEBUG : : Looking for writers 2024/04/25 06:31:59 DEBUG : file1: reading active writers 2024/04/25 06:31:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:00 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:00 DEBUG : : Looking for writers 2024/04/25 06:32:00 DEBUG : file1: reading active writers 2024/04/25 06:32:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:00 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "584c832407b84742", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:00 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "584c832407b84742", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:01 DEBUG : : Looking for writers 2024/04/25 06:32:01 DEBUG : file1: reading active writers 2024/04/25 06:32:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:02 DEBUG : : Looking for writers 2024/04/25 06:32:02 DEBUG : file1: reading active writers 2024/04/25 06:32:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:03 DEBUG : : Looking for writers 2024/04/25 06:32:03 DEBUG : file1: reading active writers 2024/04/25 06:32:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:04 DEBUG : : Looking for writers 2024/04/25 06:32:04 DEBUG : file1: reading active writers 2024/04/25 06:32:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:05 DEBUG : : Looking for writers 2024/04/25 06:32:05 DEBUG : file1: reading active writers 2024/04/25 06:32:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:06 DEBUG : : Looking for writers 2024/04/25 06:32:06 DEBUG : file1: reading active writers 2024/04/25 06:32:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:07 DEBUG : : Looking for writers 2024/04/25 06:32:07 DEBUG : file1: reading active writers 2024/04/25 06:32:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:08 DEBUG : : Looking for writers 2024/04/25 06:32:08 DEBUG : file1: reading active writers 2024/04/25 06:32:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:09 DEBUG : : Looking for writers 2024/04/25 06:32:09 DEBUG : file1: reading active writers 2024/04/25 06:32:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:10 DEBUG : : Looking for writers 2024/04/25 06:32:10 DEBUG : file1: reading active writers 2024/04/25 06:32:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:11 DEBUG : : Looking for writers 2024/04/25 06:32:11 DEBUG : file1: reading active writers 2024/04/25 06:32:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:12 DEBUG : : Looking for writers 2024/04/25 06:32:12 DEBUG : file1: reading active writers 2024/04/25 06:32:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:13 DEBUG : : Looking for writers 2024/04/25 06:32:13 DEBUG : file1: reading active writers 2024/04/25 06:32:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:13 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:13 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0009304b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00071c508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641176896} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879005727765224 ext:111582414726 loc:0x3a135e0} ATime:{wall:13943879005727782546 ext:111582432058 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:32:13 DEBUG : >WaitForWriters: 2024/04/25 06:32:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cde5843e81d8f64d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:14 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cde5843e81d8f64d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/04/25 06:32:21 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:32:21 DEBUG : : Looking for writers 2024/04/25 06:32:21 DEBUG : file1: reading active writers 2024/04/25 06:32:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:32:21 DEBUG : : Looking for writers 2024/04/25 06:32:21 DEBUG : file1: reading active writers 2024/04/25 06:32:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:32:21 DEBUG : : Looking for writers 2024/04/25 06:32:21 DEBUG : file1: reading active writers 2024/04/25 06:32:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:32:21 DEBUG : : Looking for writers 2024/04/25 06:32:21 DEBUG : file1: reading active writers 2024/04/25 06:32:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:32:21 DEBUG : : Looking for writers 2024/04/25 06:32:21 DEBUG : file1: reading active writers 2024/04/25 06:32:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:32:22 DEBUG : : Looking for writers 2024/04/25 06:32:22 DEBUG : file1: reading active writers 2024/04/25 06:32:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:32:22 DEBUG : : Looking for writers 2024/04/25 06:32:22 DEBUG : file1: reading active writers 2024/04/25 06:32:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:32:23 DEBUG : : Looking for writers 2024/04/25 06:32:23 DEBUG : file1: reading active writers 2024/04/25 06:32:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:24 DEBUG : : Looking for writers 2024/04/25 06:32:24 DEBUG : file1: reading active writers 2024/04/25 06:32:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:25 DEBUG : : Looking for writers 2024/04/25 06:32:25 DEBUG : file1: reading active writers 2024/04/25 06:32:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:26 DEBUG : : Looking for writers 2024/04/25 06:32:26 DEBUG : file1: reading active writers 2024/04/25 06:32:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:27 DEBUG : : Looking for writers 2024/04/25 06:32:27 DEBUG : file1: reading active writers 2024/04/25 06:32:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:28 DEBUG : : Looking for writers 2024/04/25 06:32:28 DEBUG : file1: reading active writers 2024/04/25 06:32:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:29 DEBUG : : Looking for writers 2024/04/25 06:32:29 DEBUG : file1: reading active writers 2024/04/25 06:32:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:30 DEBUG : : Looking for writers 2024/04/25 06:32:30 DEBUG : file1: reading active writers 2024/04/25 06:32:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:31 DEBUG : : Looking for writers 2024/04/25 06:32:31 DEBUG : file1: reading active writers 2024/04/25 06:32:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:32 DEBUG : : Looking for writers 2024/04/25 06:32:32 DEBUG : file1: reading active writers 2024/04/25 06:32:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:33 DEBUG : : Looking for writers 2024/04/25 06:32:33 DEBUG : file1: reading active writers 2024/04/25 06:32:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:34 DEBUG : : Looking for writers 2024/04/25 06:32:34 DEBUG : file1: reading active writers 2024/04/25 06:32:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:35 DEBUG : : Looking for writers 2024/04/25 06:32:35 DEBUG : file1: reading active writers 2024/04/25 06:32:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:36 DEBUG : : Looking for writers 2024/04/25 06:32:36 DEBUG : file1: reading active writers 2024/04/25 06:32:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:37 DEBUG : : Looking for writers 2024/04/25 06:32:37 DEBUG : file1: reading active writers 2024/04/25 06:32:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:38 DEBUG : : Looking for writers 2024/04/25 06:32:38 DEBUG : file1: reading active writers 2024/04/25 06:32:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:39 DEBUG : : Looking for writers 2024/04/25 06:32:39 DEBUG : file1: reading active writers 2024/04/25 06:32:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:39 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:40 DEBUG : : Looking for writers 2024/04/25 06:32:40 DEBUG : file1: reading active writers 2024/04/25 06:32:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:40 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7195aa85c9c3105f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:40 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7195aa85c9c3105f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:41 DEBUG : : Looking for writers 2024/04/25 06:32:41 DEBUG : file1: reading active writers 2024/04/25 06:32:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:42 DEBUG : : Looking for writers 2024/04/25 06:32:42 DEBUG : file1: reading active writers 2024/04/25 06:32:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:43 DEBUG : : Looking for writers 2024/04/25 06:32:43 DEBUG : file1: reading active writers 2024/04/25 06:32:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:43 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:32:43 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/25 06:32:44 DEBUG : : Looking for writers 2024/04/25 06:32:44 DEBUG : file1: reading active writers 2024/04/25 06:32:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:45 DEBUG : : Looking for writers 2024/04/25 06:32:45 DEBUG : file1: reading active writers 2024/04/25 06:32:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:46 DEBUG : : Looking for writers 2024/04/25 06:32:46 DEBUG : file1: reading active writers 2024/04/25 06:32:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:47 DEBUG : : Looking for writers 2024/04/25 06:32:47 DEBUG : file1: reading active writers 2024/04/25 06:32:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:48 DEBUG : : Looking for writers 2024/04/25 06:32:48 DEBUG : file1: reading active writers 2024/04/25 06:32:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:49 DEBUG : : Looking for writers 2024/04/25 06:32:49 DEBUG : file1: reading active writers 2024/04/25 06:32:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:50 DEBUG : : Looking for writers 2024/04/25 06:32:50 DEBUG : file1: reading active writers 2024/04/25 06:32:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:51 DEBUG : : Looking for writers 2024/04/25 06:32:51 DEBUG : file1: reading active writers 2024/04/25 06:32:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:32:51 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0009304b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00071c508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641176896} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879005727765224 ext:111582414726 loc:0x3a135e0} ATime:{wall:13943879005727782546 ext:111582432058 loc:0x3a135e0} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:32:51 DEBUG : >WaitForWriters: 2024/04/25 06:32:51 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (68.44s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:32:51 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:32:51 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:32:51 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:32:51 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:32:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:32:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:32:51 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:32:51 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:32:52 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:32:52 DEBUG : file1: newRWFileHandle: 2024/04/25 06:32:52 DEBUG : file1(0xc00053e8c0): openPending: 2024/04/25 06:32:52 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:32:52 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:32:52 DEBUG : file1(0xc00053e8c0): >openPending: err= 2024/04/25 06:32:52 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:32:52 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:32:52 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:32:52 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/25 06:32:52 DEBUG : file1(0xc00053e8c0): close: 2024/04/25 06:32:52 DEBUG : file1: vfs cache: setting modification time to 2024-04-25 06:32:52.236674066 +0000 UTC m=+180.023337689 2024/04/25 06:32:52 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/25 06:32:52 DEBUG : file1(0xc00053e8c0): >close: err= 2024/04/25 06:32:52 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/04/25 06:32:52 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/04/25 06:32:52 DEBUG : file2: newRWFileHandle: 2024/04/25 06:32:52 DEBUG : file2(0xc00053e980): openPending: 2024/04/25 06:32:52 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:32:52 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/25 06:32:52 DEBUG : file2(0xc00053e980): >openPending: err= 2024/04/25 06:32:52 DEBUG : file2: >newRWFileHandle: err= 2024/04/25 06:32:52 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/25 06:32:52 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/04/25 06:32:52 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/04/25 06:32:52 DEBUG : file2(0xc00053e980): RWFileHandle.Flush 2024/04/25 06:32:52 DEBUG : file2(0xc00053e980): RWFileHandle.Release 2024/04/25 06:32:52 DEBUG : file2(0xc00053e980): close: 2024/04/25 06:32:52 DEBUG : file2: vfs cache: setting modification time to 2024-04-25 06:32:52.238368166 +0000 UTC m=+180.025031778 2024/04/25 06:32:52 INFO : file2: vfs cache: queuing for upload in 100ms 2024/04/25 06:32:52 DEBUG : file2(0xc00053e980): >close: err= 2024/04/25 06:32:52 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/25 06:32:52 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:52 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/25 06:32:52 DEBUG : : Looking for writers 2024/04/25 06:32:52 DEBUG : file1: reading active writers 2024/04/25 06:32:52 DEBUG : file2: reading active writers 2024/04/25 06:32:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/25 06:32:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3d7e3eac8bd7db7d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:52 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3d7e3eac8bd7db7d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:53 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:53 DEBUG : : Looking for writers 2024/04/25 06:32:53 DEBUG : file1: reading active writers 2024/04/25 06:32:53 DEBUG : file2: reading active writers 2024/04/25 06:32:53 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:53 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "815e2153a9b34411", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:53 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "815e2153a9b34411", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:53 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:32:54 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "50089c348f18def9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:54 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "50089c348f18def9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:54 DEBUG : : Looking for writers 2024/04/25 06:32:54 DEBUG : file1: reading active writers 2024/04/25 06:32:54 DEBUG : file2: reading active writers 2024/04/25 06:32:54 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:54 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:54 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bff5c62428b5700d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:54 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bff5c62428b5700d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:55 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:32:55 DEBUG : : Looking for writers 2024/04/25 06:32:55 DEBUG : file1: reading active writers 2024/04/25 06:32:55 DEBUG : file2: reading active writers 2024/04/25 06:32:55 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:55 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e2837e3c20699df9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:55 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e2837e3c20699df9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:56 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d6b23eee346cb3a6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:56 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d6b23eee346cb3a6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:56 DEBUG : : Looking for writers 2024/04/25 06:32:56 DEBUG : file1: reading active writers 2024/04/25 06:32:56 DEBUG : file2: reading active writers 2024/04/25 06:32:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:56 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:57 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "247068c1f6bb4d48", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:57 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "247068c1f6bb4d48", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:57 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:32:57 DEBUG : : Looking for writers 2024/04/25 06:32:57 DEBUG : file1: reading active writers 2024/04/25 06:32:57 DEBUG : file2: reading active writers 2024/04/25 06:32:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:57 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cf854f7c5639a268", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:57 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cf854f7c5639a268", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:58 DEBUG : : Looking for writers 2024/04/25 06:32:58 DEBUG : file1: reading active writers 2024/04/25 06:32:58 DEBUG : file2: reading active writers 2024/04/25 06:32:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:58 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:32:59 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "65dd4f3f69816f7e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:59 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "65dd4f3f69816f7e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:59 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:32:59 DEBUG : : Looking for writers 2024/04/25 06:32:59 DEBUG : file1: reading active writers 2024/04/25 06:32:59 DEBUG : file2: reading active writers 2024/04/25 06:32:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:32:59 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6432a7a516c7cdfd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:32:59 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6432a7a516c7cdfd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:00 DEBUG : : Looking for writers 2024/04/25 06:33:00 DEBUG : file1: reading active writers 2024/04/25 06:33:00 DEBUG : file2: reading active writers 2024/04/25 06:33:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:01 DEBUG : : Looking for writers 2024/04/25 06:33:01 DEBUG : file1: reading active writers 2024/04/25 06:33:01 DEBUG : file2: reading active writers 2024/04/25 06:33:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:02 DEBUG : : Looking for writers 2024/04/25 06:33:02 DEBUG : file1: reading active writers 2024/04/25 06:33:02 DEBUG : file2: reading active writers 2024/04/25 06:33:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:02 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:33:03 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e3338068b7fd0d42", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:03 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e3338068b7fd0d42", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:03 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:33:03 DEBUG : : Looking for writers 2024/04/25 06:33:03 DEBUG : file1: reading active writers 2024/04/25 06:33:03 DEBUG : file2: reading active writers 2024/04/25 06:33:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:03 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8dd808203fd46d97", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:03 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8dd808203fd46d97", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:04 DEBUG : : Looking for writers 2024/04/25 06:33:04 DEBUG : file2: reading active writers 2024/04/25 06:33:04 DEBUG : file1: reading active writers 2024/04/25 06:33:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:05 DEBUG : : Looking for writers 2024/04/25 06:33:05 DEBUG : file1: reading active writers 2024/04/25 06:33:05 DEBUG : file2: reading active writers 2024/04/25 06:33:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:06 DEBUG : : Looking for writers 2024/04/25 06:33:06 DEBUG : file1: reading active writers 2024/04/25 06:33:06 DEBUG : file2: reading active writers 2024/04/25 06:33:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:07 DEBUG : : Looking for writers 2024/04/25 06:33:07 DEBUG : file1: reading active writers 2024/04/25 06:33:07 DEBUG : file2: reading active writers 2024/04/25 06:33:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:08 DEBUG : : Looking for writers 2024/04/25 06:33:08 DEBUG : file1: reading active writers 2024/04/25 06:33:08 DEBUG : file2: reading active writers 2024/04/25 06:33:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:09 DEBUG : : Looking for writers 2024/04/25 06:33:09 DEBUG : file2: reading active writers 2024/04/25 06:33:09 DEBUG : file1: reading active writers 2024/04/25 06:33:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:09 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:33:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79e526c767c37be8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:10 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79e526c767c37be8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:10 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:33:10 DEBUG : : Looking for writers 2024/04/25 06:33:10 DEBUG : file1: reading active writers 2024/04/25 06:33:10 DEBUG : file2: reading active writers 2024/04/25 06:33:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:10 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4a14a40d8c3d0365", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:10 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4a14a40d8c3d0365", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:11 DEBUG : : Looking for writers 2024/04/25 06:33:11 DEBUG : file1: reading active writers 2024/04/25 06:33:11 DEBUG : file2: reading active writers 2024/04/25 06:33:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:12 DEBUG : : Looking for writers 2024/04/25 06:33:12 DEBUG : file1: reading active writers 2024/04/25 06:33:12 DEBUG : file2: reading active writers 2024/04/25 06:33:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:13 DEBUG : : Looking for writers 2024/04/25 06:33:13 DEBUG : file1: reading active writers 2024/04/25 06:33:13 DEBUG : file2: reading active writers 2024/04/25 06:33:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:14 DEBUG : : Looking for writers 2024/04/25 06:33:14 DEBUG : file2: reading active writers 2024/04/25 06:33:14 DEBUG : file1: reading active writers 2024/04/25 06:33:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:15 DEBUG : : Looking for writers 2024/04/25 06:33:15 DEBUG : file1: reading active writers 2024/04/25 06:33:15 DEBUG : file2: reading active writers 2024/04/25 06:33:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:16 DEBUG : : Looking for writers 2024/04/25 06:33:16 DEBUG : file1: reading active writers 2024/04/25 06:33:16 DEBUG : file2: reading active writers 2024/04/25 06:33:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:17 DEBUG : : Looking for writers 2024/04/25 06:33:17 DEBUG : file1: reading active writers 2024/04/25 06:33:17 DEBUG : file2: reading active writers 2024/04/25 06:33:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:18 DEBUG : : Looking for writers 2024/04/25 06:33:18 DEBUG : file1: reading active writers 2024/04/25 06:33:18 DEBUG : file2: reading active writers 2024/04/25 06:33:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:19 DEBUG : : Looking for writers 2024/04/25 06:33:19 DEBUG : file1: reading active writers 2024/04/25 06:33:19 DEBUG : file2: reading active writers 2024/04/25 06:33:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:20 DEBUG : : Looking for writers 2024/04/25 06:33:20 DEBUG : file1: reading active writers 2024/04/25 06:33:20 DEBUG : file2: reading active writers 2024/04/25 06:33:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:21 DEBUG : : Looking for writers 2024/04/25 06:33:21 DEBUG : file1: reading active writers 2024/04/25 06:33:21 DEBUG : file2: reading active writers 2024/04/25 06:33:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:22 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0006a24b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00071ca08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641178176} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879079256874002 ext:180023337689 loc:0x3a135e0} ATime:{wall:13943879079257102951 ext:180023566628 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0006a24b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00071cb08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641178432} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879079258568102 ext:180025031778 loc:0x3a135e0} ATime:{wall:13943879079258793465 ext:180025257151 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:33:22 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/25 06:33:22 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:33:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72bdbc52f7ac8d72", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:23 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72bdbc52f7ac8d72", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:23 DEBUG : file2: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/25 06:33:24 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c981da870309bd7c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:24 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c981da870309bd7c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:197: Not found "file1" fstest.go:197: Not found "file2" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/04/25 06:33:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:33:29 DEBUG : : Looking for writers 2024/04/25 06:33:29 DEBUG : file1: reading active writers 2024/04/25 06:33:29 DEBUG : file2: reading active writers 2024/04/25 06:33:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/25 06:33:29 DEBUG : : Looking for writers 2024/04/25 06:33:29 DEBUG : file1: reading active writers 2024/04/25 06:33:29 DEBUG : file2: reading active writers 2024/04/25 06:33:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/25 06:33:30 DEBUG : : Looking for writers 2024/04/25 06:33:30 DEBUG : file1: reading active writers 2024/04/25 06:33:30 DEBUG : file2: reading active writers 2024/04/25 06:33:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/25 06:33:30 DEBUG : : Looking for writers 2024/04/25 06:33:30 DEBUG : file1: reading active writers 2024/04/25 06:33:30 DEBUG : file2: reading active writers 2024/04/25 06:33:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/25 06:33:30 DEBUG : : Looking for writers 2024/04/25 06:33:30 DEBUG : file1: reading active writers 2024/04/25 06:33:30 DEBUG : file2: reading active writers 2024/04/25 06:33:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/25 06:33:30 DEBUG : : Looking for writers 2024/04/25 06:33:30 DEBUG : file1: reading active writers 2024/04/25 06:33:30 DEBUG : file2: reading active writers 2024/04/25 06:33:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/25 06:33:30 DEBUG : : Looking for writers 2024/04/25 06:33:30 DEBUG : file1: reading active writers 2024/04/25 06:33:30 DEBUG : file2: reading active writers 2024/04/25 06:33:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/25 06:33:31 DEBUG : : Looking for writers 2024/04/25 06:33:31 DEBUG : file1: reading active writers 2024/04/25 06:33:31 DEBUG : file2: reading active writers 2024/04/25 06:33:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:32 DEBUG : : Looking for writers 2024/04/25 06:33:32 DEBUG : file1: reading active writers 2024/04/25 06:33:32 DEBUG : file2: reading active writers 2024/04/25 06:33:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:33 DEBUG : : Looking for writers 2024/04/25 06:33:33 DEBUG : file1: reading active writers 2024/04/25 06:33:33 DEBUG : file2: reading active writers 2024/04/25 06:33:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:34 DEBUG : : Looking for writers 2024/04/25 06:33:34 DEBUG : file1: reading active writers 2024/04/25 06:33:34 DEBUG : file2: reading active writers 2024/04/25 06:33:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:35 DEBUG : : Looking for writers 2024/04/25 06:33:35 DEBUG : file1: reading active writers 2024/04/25 06:33:35 DEBUG : file2: reading active writers 2024/04/25 06:33:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:36 DEBUG : : Looking for writers 2024/04/25 06:33:36 DEBUG : file1: reading active writers 2024/04/25 06:33:36 DEBUG : file2: reading active writers 2024/04/25 06:33:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:37 DEBUG : : Looking for writers 2024/04/25 06:33:37 DEBUG : file1: reading active writers 2024/04/25 06:33:37 DEBUG : file2: reading active writers 2024/04/25 06:33:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:38 DEBUG : : Looking for writers 2024/04/25 06:33:38 DEBUG : file1: reading active writers 2024/04/25 06:33:38 DEBUG : file2: reading active writers 2024/04/25 06:33:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:39 DEBUG : : Looking for writers 2024/04/25 06:33:39 DEBUG : file1: reading active writers 2024/04/25 06:33:39 DEBUG : file2: reading active writers 2024/04/25 06:33:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:40 DEBUG : : Looking for writers 2024/04/25 06:33:40 DEBUG : file1: reading active writers 2024/04/25 06:33:40 DEBUG : file2: reading active writers 2024/04/25 06:33:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:41 DEBUG : : Looking for writers 2024/04/25 06:33:41 DEBUG : file1: reading active writers 2024/04/25 06:33:41 DEBUG : file2: reading active writers 2024/04/25 06:33:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:42 DEBUG : : Looking for writers 2024/04/25 06:33:42 DEBUG : file1: reading active writers 2024/04/25 06:33:42 DEBUG : file2: reading active writers 2024/04/25 06:33:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:43 DEBUG : : Looking for writers 2024/04/25 06:33:43 DEBUG : file1: reading active writers 2024/04/25 06:33:43 DEBUG : file2: reading active writers 2024/04/25 06:33:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:44 DEBUG : : Looking for writers 2024/04/25 06:33:44 DEBUG : file1: reading active writers 2024/04/25 06:33:44 DEBUG : file2: reading active writers 2024/04/25 06:33:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:45 DEBUG : : Looking for writers 2024/04/25 06:33:45 DEBUG : file1: reading active writers 2024/04/25 06:33:45 DEBUG : file2: reading active writers 2024/04/25 06:33:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:46 DEBUG : : Looking for writers 2024/04/25 06:33:46 DEBUG : file1: reading active writers 2024/04/25 06:33:46 DEBUG : file2: reading active writers 2024/04/25 06:33:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:47 DEBUG : : Looking for writers 2024/04/25 06:33:47 DEBUG : file1: reading active writers 2024/04/25 06:33:47 DEBUG : file2: reading active writers 2024/04/25 06:33:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:48 DEBUG : : Looking for writers 2024/04/25 06:33:48 DEBUG : file1: reading active writers 2024/04/25 06:33:48 DEBUG : file2: reading active writers 2024/04/25 06:33:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:49 DEBUG : file1: vfs cache: starting upload 2024/04/25 06:33:49 DEBUG : : Looking for writers 2024/04/25 06:33:49 DEBUG : file1: reading active writers 2024/04/25 06:33:49 DEBUG : file2: reading active writers 2024/04/25 06:33:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:49 DEBUG : file2: vfs cache: starting upload 2024/04/25 06:33:50 DEBUG : : Looking for writers 2024/04/25 06:33:50 DEBUG : file1: reading active writers 2024/04/25 06:33:50 DEBUG : file2: reading active writers 2024/04/25 06:33:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:50 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "736cb65647e8983b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:50 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "736cb65647e8983b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:50 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dd0856c11b7af338", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:50 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dd0856c11b7af338", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:33:51 DEBUG : : Looking for writers 2024/04/25 06:33:51 DEBUG : file1: reading active writers 2024/04/25 06:33:51 DEBUG : file2: reading active writers 2024/04/25 06:33:51 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:51 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/25 06:33:51 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/04/25 06:33:51 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/04/25 06:33:52 DEBUG : : Looking for writers 2024/04/25 06:33:52 DEBUG : file1: reading active writers 2024/04/25 06:33:52 DEBUG : file2: reading active writers 2024/04/25 06:33:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:53 DEBUG : : Looking for writers 2024/04/25 06:33:53 DEBUG : file1: reading active writers 2024/04/25 06:33:53 DEBUG : file2: reading active writers 2024/04/25 06:33:53 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:54 DEBUG : : Looking for writers 2024/04/25 06:33:54 DEBUG : file1: reading active writers 2024/04/25 06:33:54 DEBUG : file2: reading active writers 2024/04/25 06:33:54 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:55 DEBUG : : Looking for writers 2024/04/25 06:33:55 DEBUG : file1: reading active writers 2024/04/25 06:33:55 DEBUG : file2: reading active writers 2024/04/25 06:33:55 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:56 DEBUG : : Looking for writers 2024/04/25 06:33:56 DEBUG : file1: reading active writers 2024/04/25 06:33:56 DEBUG : file2: reading active writers 2024/04/25 06:33:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:57 DEBUG : : Looking for writers 2024/04/25 06:33:57 DEBUG : file1: reading active writers 2024/04/25 06:33:57 DEBUG : file2: reading active writers 2024/04/25 06:33:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:58 DEBUG : : Looking for writers 2024/04/25 06:33:58 DEBUG : file1: reading active writers 2024/04/25 06:33:58 DEBUG : file2: reading active writers 2024/04/25 06:33:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:59 DEBUG : : Looking for writers 2024/04/25 06:33:59 DEBUG : file1: reading active writers 2024/04/25 06:33:59 DEBUG : file2: reading active writers 2024/04/25 06:33:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/25 06:33:59 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0006a24b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00071ca08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641178176} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879079256874002 ext:180023337689 loc:0x3a135e0} ATime:{wall:13943879079257102951 ext:180023566628 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0006a24b0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00071cb08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641178432} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943879079258568102 ext:180025031778 loc:0x3a135e0} ATime:{wall:13943879079258793465 ext:180025257151 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/25 06:33:59 DEBUG : >WaitForWriters: 2024/04/25 06:33:59 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (68.25s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:00 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:00 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:34:00 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:00 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:00 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8a5afc7e3e9dce91", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:00 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:00 DEBUG : : Looking for writers 2024/04/25 06:34:00 DEBUG : >WaitForWriters: 2024/04/25 06:34:00 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (0.96s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:01 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:01 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:34:01 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:01 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:01 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:01 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:01 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f8034a7892eb844c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:02 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:02 DEBUG : : Looking for writers 2024/04/25 06:34:02 DEBUG : >WaitForWriters: 2024/04/25 06:34:02 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (1.35s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:02 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:02 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/25 06:34:02 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:02 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:02 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:02 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-yesugaz6jitulof1viruxic7" 2024/04/25 06:34:02 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:34:02 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/25 06:34:02 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:34:02 DEBUG : file1: newRWFileHandle: 2024/04/25 06:34:02 DEBUG : file1(0xc000a4c9c0): openPending: 2024/04/25 06:34:02 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/25 06:34:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:02 DEBUG : file1(0xc000a4c9c0): >openPending: err= 2024/04/25 06:34:02 DEBUG : file1: >newRWFileHandle: err= 2024/04/25 06:34:02 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:02 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/25 06:34:02 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1300014b79073a2b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:03 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:03 DEBUG : : Looking for writers 2024/04/25 06:34:03 DEBUG : file1: reading active writers 2024/04/25 06:34:03 DEBUG : file1: active writers 1 2024/04/25 06:34:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/04/25 06:34:03 DEBUG : : Looking for writers 2024/04/25 06:34:03 DEBUG : file1: reading active writers 2024/04/25 06:34:03 DEBUG : file1: active writers 1 2024/04/25 06:34:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/04/25 06:34:03 DEBUG : : Looking for writers 2024/04/25 06:34:03 DEBUG : file1: reading active writers 2024/04/25 06:34:03 DEBUG : file1: active writers 1 2024/04/25 06:34:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/04/25 06:34:03 DEBUG : : Looking for writers 2024/04/25 06:34:03 DEBUG : file1: reading active writers 2024/04/25 06:34:03 DEBUG : file1: active writers 1 2024/04/25 06:34:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/04/25 06:34:03 DEBUG : : Looking for writers 2024/04/25 06:34:03 DEBUG : file1: reading active writers 2024/04/25 06:34:03 DEBUG : file1: active writers 1 2024/04/25 06:34:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/04/25 06:34:03 DEBUG : : Looking for writers 2024/04/25 06:34:03 DEBUG : file1: reading active writers 2024/04/25 06:34:03 DEBUG : file1: active writers 1 2024/04/25 06:34:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/04/25 06:34:04 DEBUG : : Looking for writers 2024/04/25 06:34:04 DEBUG : file1: reading active writers 2024/04/25 06:34:04 DEBUG : file1: active writers 1 2024/04/25 06:34:04 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/04/25 06:34:04 DEBUG : : Looking for writers 2024/04/25 06:34:04 DEBUG : file1: reading active writers 2024/04/25 06:34:04 DEBUG : file1: active writers 1 2024/04/25 06:34:04 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:05 DEBUG : : Looking for writers 2024/04/25 06:34:05 DEBUG : file1: reading active writers 2024/04/25 06:34:05 DEBUG : file1: active writers 1 2024/04/25 06:34:05 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:06 DEBUG : : Looking for writers 2024/04/25 06:34:06 DEBUG : file1: reading active writers 2024/04/25 06:34:06 DEBUG : file1: active writers 1 2024/04/25 06:34:06 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:07 DEBUG : : Looking for writers 2024/04/25 06:34:07 DEBUG : file1: reading active writers 2024/04/25 06:34:07 DEBUG : file1: active writers 1 2024/04/25 06:34:07 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:08 DEBUG : : Looking for writers 2024/04/25 06:34:08 DEBUG : file1: reading active writers 2024/04/25 06:34:08 DEBUG : file1: active writers 1 2024/04/25 06:34:08 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:09 DEBUG : : Looking for writers 2024/04/25 06:34:09 DEBUG : file1: reading active writers 2024/04/25 06:34:09 DEBUG : file1: active writers 1 2024/04/25 06:34:09 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:10 DEBUG : : Looking for writers 2024/04/25 06:34:10 DEBUG : file1: reading active writers 2024/04/25 06:34:10 DEBUG : file1: active writers 1 2024/04/25 06:34:10 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:11 DEBUG : : Looking for writers 2024/04/25 06:34:11 DEBUG : file1: reading active writers 2024/04/25 06:34:11 DEBUG : file1: active writers 1 2024/04/25 06:34:11 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:12 DEBUG : : Looking for writers 2024/04/25 06:34:12 DEBUG : file1: reading active writers 2024/04/25 06:34:12 DEBUG : file1: active writers 1 2024/04/25 06:34:12 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:13 DEBUG : : Looking for writers 2024/04/25 06:34:13 DEBUG : file1: reading active writers 2024/04/25 06:34:13 DEBUG : file1: active writers 1 2024/04/25 06:34:13 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:14 DEBUG : : Looking for writers 2024/04/25 06:34:14 DEBUG : file1: reading active writers 2024/04/25 06:34:14 DEBUG : file1: active writers 1 2024/04/25 06:34:14 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:15 DEBUG : : Looking for writers 2024/04/25 06:34:15 DEBUG : file1: reading active writers 2024/04/25 06:34:15 DEBUG : file1: active writers 1 2024/04/25 06:34:15 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:16 DEBUG : : Looking for writers 2024/04/25 06:34:16 DEBUG : file1: reading active writers 2024/04/25 06:34:16 DEBUG : file1: active writers 1 2024/04/25 06:34:16 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:17 DEBUG : : Looking for writers 2024/04/25 06:34:17 DEBUG : file1: reading active writers 2024/04/25 06:34:17 DEBUG : file1: active writers 1 2024/04/25 06:34:17 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:18 DEBUG : : Looking for writers 2024/04/25 06:34:18 DEBUG : file1: reading active writers 2024/04/25 06:34:18 DEBUG : file1: active writers 1 2024/04/25 06:34:18 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:19 DEBUG : : Looking for writers 2024/04/25 06:34:19 DEBUG : file1: reading active writers 2024/04/25 06:34:19 DEBUG : file1: active writers 1 2024/04/25 06:34:19 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:20 DEBUG : : Looking for writers 2024/04/25 06:34:20 DEBUG : file1: reading active writers 2024/04/25 06:34:20 DEBUG : file1: active writers 1 2024/04/25 06:34:20 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:21 DEBUG : : Looking for writers 2024/04/25 06:34:21 DEBUG : file1: reading active writers 2024/04/25 06:34:21 DEBUG : file1: active writers 1 2024/04/25 06:34:21 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:22 DEBUG : : Looking for writers 2024/04/25 06:34:22 DEBUG : file1: reading active writers 2024/04/25 06:34:22 DEBUG : file1: active writers 1 2024/04/25 06:34:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:23 DEBUG : : Looking for writers 2024/04/25 06:34:23 DEBUG : file1: reading active writers 2024/04/25 06:34:23 DEBUG : file1: active writers 1 2024/04/25 06:34:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:24 DEBUG : : Looking for writers 2024/04/25 06:34:24 DEBUG : file1: reading active writers 2024/04/25 06:34:24 DEBUG : file1: active writers 1 2024/04/25 06:34:24 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:25 DEBUG : : Looking for writers 2024/04/25 06:34:25 DEBUG : file1: reading active writers 2024/04/25 06:34:25 DEBUG : file1: active writers 1 2024/04/25 06:34:25 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:26 DEBUG : : Looking for writers 2024/04/25 06:34:26 DEBUG : file1: reading active writers 2024/04/25 06:34:26 DEBUG : file1: active writers 1 2024/04/25 06:34:26 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:27 DEBUG : : Looking for writers 2024/04/25 06:34:27 DEBUG : file1: reading active writers 2024/04/25 06:34:27 DEBUG : file1: active writers 1 2024/04/25 06:34:27 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:28 DEBUG : : Looking for writers 2024/04/25 06:34:28 DEBUG : file1: reading active writers 2024/04/25 06:34:28 DEBUG : file1: active writers 1 2024/04/25 06:34:28 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:29 DEBUG : : Looking for writers 2024/04/25 06:34:29 DEBUG : file1: reading active writers 2024/04/25 06:34:29 DEBUG : file1: active writers 1 2024/04/25 06:34:29 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:30 DEBUG : : Looking for writers 2024/04/25 06:34:30 DEBUG : file1: reading active writers 2024/04/25 06:34:30 DEBUG : file1: active writers 1 2024/04/25 06:34:30 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:31 DEBUG : : Looking for writers 2024/04/25 06:34:31 DEBUG : file1: reading active writers 2024/04/25 06:34:31 DEBUG : file1: active writers 1 2024/04/25 06:34:31 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:32 DEBUG : : Looking for writers 2024/04/25 06:34:32 DEBUG : file1: reading active writers 2024/04/25 06:34:32 DEBUG : file1: active writers 1 2024/04/25 06:34:32 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/25 06:34:33 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc00033c870 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000ae2d08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645135680} name:file1 opens:1 downloaders: o: fd:0xc00008a628 info:{ModTime:{wall:13943879154998103404 ext:250602639370 loc:0x3a135e0} ATime:{wall:13943879154998103404 ext:250602639370 loc:0x3a135e0} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/04/25 06:34:33 DEBUG : >WaitForWriters: 2024/04/25 06:34:33 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.62s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f8d34c56ceeaf4e2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (0.87s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b9a49f7377d72edb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (0.87s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:35 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:35 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ea4caa9c66006253", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:36 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:36 DEBUG : : Looking for writers 2024/04/25 06:34:36 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (1.36s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:37 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:37 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "618ca3c353fb15e5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:37 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:37 DEBUG : : Looking for writers 2024/04/25 06:34:37 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (0.87s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:38 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:38 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "88b9eafeda33849f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:38 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:38 DEBUG : : Looking for writers 2024/04/25 06:34:38 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (0.86s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:39 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:39 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7c2c05ba47d1a37c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:40 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:40 DEBUG : : Looking for writers 2024/04/25 06:34:40 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (1.33s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:34:40 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:34:40 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:34:40 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:34:40 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:34:40 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:40 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:34:40 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:34:40 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:40 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/25 06:34:40 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/25 06:34:40 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/04/25 06:34:40 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (5 bytes), uploading instead of streaming 2024/04/25 06:34:41 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e77abaf85e00f3a4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:41 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e77abaf85e00f3a4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:41 DEBUG : file1: Remove: 2024/04/25 06:34:41 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:34:41 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e77abaf85e00f3a4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/04/25 06:34:49 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:34:49 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:34:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:49 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:34:49 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:34:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:49 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:34:49 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "348526ba033b4b21", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:49 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "348526ba033b4b21", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:34:49 DEBUG : file1: Remove: 2024/04/25 06:34:49 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:34:49 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "348526ba033b4b21", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/04/25 06:34:49 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:34:49 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:34:49 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:34:49 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:34:49 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:34:49 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/04/25 06:34:49 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:34:49 DEBUG : : Looking for writers 2024/04/25 06:34:49 DEBUG : file1: reading active writers 2024/04/25 06:34:49 DEBUG : file1: active writers 1 2024/04/25 06:34:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/04/25 06:34:49 DEBUG : : Looking for writers 2024/04/25 06:34:49 DEBUG : file1: reading active writers 2024/04/25 06:34:49 DEBUG : file1: active writers 1 2024/04/25 06:34:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/04/25 06:34:49 DEBUG : : Looking for writers 2024/04/25 06:34:49 DEBUG : file1: reading active writers 2024/04/25 06:34:49 DEBUG : file1: active writers 1 2024/04/25 06:34:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/04/25 06:34:49 DEBUG : : Looking for writers 2024/04/25 06:34:49 DEBUG : file1: reading active writers 2024/04/25 06:34:49 DEBUG : file1: active writers 1 2024/04/25 06:34:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/04/25 06:34:49 DEBUG : : Looking for writers 2024/04/25 06:34:49 DEBUG : file1: reading active writers 2024/04/25 06:34:49 DEBUG : file1: active writers 1 2024/04/25 06:34:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/04/25 06:34:50 DEBUG : : Looking for writers 2024/04/25 06:34:50 DEBUG : file1: reading active writers 2024/04/25 06:34:50 DEBUG : file1: active writers 1 2024/04/25 06:34:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/04/25 06:34:50 DEBUG : : Looking for writers 2024/04/25 06:34:50 DEBUG : file1: reading active writers 2024/04/25 06:34:50 DEBUG : file1: active writers 1 2024/04/25 06:34:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/04/25 06:34:50 DEBUG : : Looking for writers 2024/04/25 06:34:50 DEBUG : file1: reading active writers 2024/04/25 06:34:50 DEBUG : file1: active writers 1 2024/04/25 06:34:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:51 DEBUG : : Looking for writers 2024/04/25 06:34:51 DEBUG : file1: reading active writers 2024/04/25 06:34:51 DEBUG : file1: active writers 1 2024/04/25 06:34:51 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:52 DEBUG : : Looking for writers 2024/04/25 06:34:52 DEBUG : file1: reading active writers 2024/04/25 06:34:52 DEBUG : file1: active writers 1 2024/04/25 06:34:52 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:53 DEBUG : : Looking for writers 2024/04/25 06:34:53 DEBUG : file1: reading active writers 2024/04/25 06:34:53 DEBUG : file1: active writers 1 2024/04/25 06:34:53 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:54 DEBUG : : Looking for writers 2024/04/25 06:34:54 DEBUG : file1: reading active writers 2024/04/25 06:34:54 DEBUG : file1: active writers 1 2024/04/25 06:34:54 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:55 DEBUG : : Looking for writers 2024/04/25 06:34:55 DEBUG : file1: reading active writers 2024/04/25 06:34:55 DEBUG : file1: active writers 1 2024/04/25 06:34:55 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:56 DEBUG : : Looking for writers 2024/04/25 06:34:56 DEBUG : file1: reading active writers 2024/04/25 06:34:56 DEBUG : file1: active writers 1 2024/04/25 06:34:56 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:57 DEBUG : : Looking for writers 2024/04/25 06:34:57 DEBUG : file1: reading active writers 2024/04/25 06:34:57 DEBUG : file1: active writers 1 2024/04/25 06:34:57 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:58 DEBUG : : Looking for writers 2024/04/25 06:34:58 DEBUG : file1: reading active writers 2024/04/25 06:34:58 DEBUG : file1: active writers 1 2024/04/25 06:34:58 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:34:59 DEBUG : : Looking for writers 2024/04/25 06:34:59 DEBUG : file1: reading active writers 2024/04/25 06:34:59 DEBUG : file1: active writers 1 2024/04/25 06:34:59 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:00 DEBUG : : Looking for writers 2024/04/25 06:35:00 DEBUG : file1: reading active writers 2024/04/25 06:35:00 DEBUG : file1: active writers 1 2024/04/25 06:35:00 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:01 DEBUG : : Looking for writers 2024/04/25 06:35:01 DEBUG : file1: reading active writers 2024/04/25 06:35:01 DEBUG : file1: active writers 1 2024/04/25 06:35:01 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:02 DEBUG : : Looking for writers 2024/04/25 06:35:02 DEBUG : file1: reading active writers 2024/04/25 06:35:02 DEBUG : file1: active writers 1 2024/04/25 06:35:02 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:03 DEBUG : : Looking for writers 2024/04/25 06:35:03 DEBUG : file1: reading active writers 2024/04/25 06:35:03 DEBUG : file1: active writers 1 2024/04/25 06:35:03 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:04 DEBUG : : Looking for writers 2024/04/25 06:35:04 DEBUG : file1: reading active writers 2024/04/25 06:35:04 DEBUG : file1: active writers 1 2024/04/25 06:35:04 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:05 DEBUG : : Looking for writers 2024/04/25 06:35:05 DEBUG : file1: reading active writers 2024/04/25 06:35:05 DEBUG : file1: active writers 1 2024/04/25 06:35:05 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:06 DEBUG : : Looking for writers 2024/04/25 06:35:06 DEBUG : file1: reading active writers 2024/04/25 06:35:06 DEBUG : file1: active writers 1 2024/04/25 06:35:06 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:07 DEBUG : : Looking for writers 2024/04/25 06:35:07 DEBUG : file1: reading active writers 2024/04/25 06:35:07 DEBUG : file1: active writers 1 2024/04/25 06:35:07 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:08 DEBUG : : Looking for writers 2024/04/25 06:35:08 DEBUG : file1: reading active writers 2024/04/25 06:35:08 DEBUG : file1: active writers 1 2024/04/25 06:35:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:09 DEBUG : : Looking for writers 2024/04/25 06:35:09 DEBUG : file1: reading active writers 2024/04/25 06:35:09 DEBUG : file1: active writers 1 2024/04/25 06:35:09 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:10 DEBUG : : Looking for writers 2024/04/25 06:35:10 DEBUG : file1: reading active writers 2024/04/25 06:35:10 DEBUG : file1: active writers 1 2024/04/25 06:35:10 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:11 DEBUG : : Looking for writers 2024/04/25 06:35:11 DEBUG : file1: reading active writers 2024/04/25 06:35:11 DEBUG : file1: active writers 1 2024/04/25 06:35:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:12 DEBUG : : Looking for writers 2024/04/25 06:35:12 DEBUG : file1: reading active writers 2024/04/25 06:35:12 DEBUG : file1: active writers 1 2024/04/25 06:35:12 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:13 DEBUG : : Looking for writers 2024/04/25 06:35:13 DEBUG : file1: reading active writers 2024/04/25 06:35:13 DEBUG : file1: active writers 1 2024/04/25 06:35:13 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:14 DEBUG : : Looking for writers 2024/04/25 06:35:14 DEBUG : file1: reading active writers 2024/04/25 06:35:14 DEBUG : file1: active writers 1 2024/04/25 06:35:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:15 DEBUG : : Looking for writers 2024/04/25 06:35:15 DEBUG : file1: reading active writers 2024/04/25 06:35:15 DEBUG : file1: active writers 1 2024/04/25 06:35:15 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:16 DEBUG : : Looking for writers 2024/04/25 06:35:16 DEBUG : file1: reading active writers 2024/04/25 06:35:16 DEBUG : file1: active writers 1 2024/04/25 06:35:16 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:17 DEBUG : : Looking for writers 2024/04/25 06:35:17 DEBUG : file1: reading active writers 2024/04/25 06:35:17 DEBUG : file1: active writers 1 2024/04/25 06:35:17 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:18 DEBUG : : Looking for writers 2024/04/25 06:35:18 DEBUG : file1: reading active writers 2024/04/25 06:35:18 DEBUG : file1: active writers 1 2024/04/25 06:35:18 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/25 06:35:19 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/04/25 06:35:19 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (39.62s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:35:19 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:35:19 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:35:19 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:35:20 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:35:20 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:20 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:35:20 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:35:20 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:20 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/04/25 06:35:21 DEBUG : file1: aborting in-sequence write wait, off=100 2024/04/25 06:35:21 DEBUG : file1: failed to wait for in-sequence write to 100 2024/04/25 06:35:21 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/04/25 06:35:21 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (11 bytes), uploading instead of streaming 2024/04/25 06:35:21 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f72c73b55a6a17e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:21 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f72c73b55a6a17e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:21 DEBUG : file1: Remove: 2024/04/25 06:35:21 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:35:21 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4f72c73b55a6a17e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/04/25 06:35:21 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/04/25 06:35:29 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:35:29 DEBUG : : Looking for writers 2024/04/25 06:35:29 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (9.98s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:35:29 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:35:29 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:35:29 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:35:30 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:35:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:30 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:35:30 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:35:30 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/04/25 06:35:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:30 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (5 bytes), uploading instead of streaming 2024/04/25 06:35:31 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c438ae720482cd6a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:31 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c438ae720482cd6a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:31 DEBUG : file1: Remove: 2024/04/25 06:35:31 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:35:31 DEBUG : file1: >Remove: err= 2024/04/25 06:35:31 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c438ae720482cd6a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c438ae720482cd6a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/04/25 06:35:31 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/04/25 06:35:31 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:35:31 DEBUG : : Looking for writers 2024/04/25 06:35:31 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (1.61s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:35:31 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:35:31 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:35:31 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:35:31 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:35:31 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:31 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:35:31 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:35:31 DEBUG : file1: WriteFileHandle.Release closing 2024/04/25 06:35:31 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:31 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:35:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "25cc22c8f2eabad3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:32 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "25cc22c8f2eabad3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:32 DEBUG : file1: Remove: 2024/04/25 06:35:32 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:35:32 DEBUG : file1: >Remove: err= 2024/04/25 06:35:32 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "25cc22c8f2eabad3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "25cc22c8f2eabad3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/04/25 06:35:32 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/04/25 06:35:32 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:35:32 DEBUG : : Looking for writers 2024/04/25 06:35:32 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.13s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:35:32 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:35:32 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:35:32 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:35:32 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:35:32 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:32 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:35:32 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:35:32 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:32 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (2 bytes), uploading instead of streaming 2024/04/25 06:35:33 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d47f75fdec0d106f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:33 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d47f75fdec0d106f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:33 DEBUG : file1: Remove: 2024/04/25 06:35:33 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:35:33 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d47f75fdec0d106f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/04/25 06:35:33 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:35:33 DEBUG : : Looking for writers 2024/04/25 06:35:33 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.13s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:35:33 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:35:33 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:35:33 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:35:34 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:35:34 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:34 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:35:34 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:35:34 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:34 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/25 06:35:34 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ae88fa63a574f0f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:34 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ae88fa63a574f0f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:34 DEBUG : file1: Remove: 2024/04/25 06:35:34 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:35:34 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ae88fa63a574f0f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/04/25 06:35:34 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/25 06:35:34 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/04/25 06:35:34 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:35:34 DEBUG : : Looking for writers 2024/04/25 06:35:34 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (1.13s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-yesugaz6jitulof1viruxic7", Local "Local file system at /tmp/rclone3998889360", Modify Window "876000h0m0s" 2024/04/25 06:35:34 INFO : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: poll-interval is not supported by this remote 2024/04/25 06:35:34 NOTICE: QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/25 06:35:34 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/25 06:35:35 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/25 06:35:35 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:35 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/25 06:35:35 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/25 06:35:35 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/25 06:35:35 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: File to upload is small (100 bytes), uploading instead of streaming 2024/04/25 06:35:35 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ef697d50b753065", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:35 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ef697d50b753065", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:35 DEBUG : file1: Remove: 2024/04/25 06:35:35 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/25 06:35:35 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ef697d50b753065", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/04/25 06:35:35 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/25 06:35:35 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/04/25 06:35:35 DEBUG : WaitForWriters: timeout=30s 2024/04/25 06:35:35 DEBUG : : Looking for writers 2024/04/25 06:35:35 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.14s) FAIL 2024/04/25 06:35:36 DEBUG : QingStor bucket rclone-test-yesugaz6jitulof1viruxic7: Purge dir "" 2024/04/25 06:35:36 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "bc3af0cc1c25c2f5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/25 06:35:36 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 5m44.398717816s (try 2/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]