"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 3/5) 2024/04/26 06:10:07 DEBUG : Creating backend with remote "TestQingStor:rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:07 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/04/26 06:10:07 DEBUG : Creating backend with remote "/tmp/rclone2381060657" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:07 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:07 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d16694f47aa16397", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:10 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:10 DEBUG : : Looking for writers 2024/04/26 06:10:10 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (3.29s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:11 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:11 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a3b5457000202991", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:13 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:13 DEBUG : : Looking for writers 2024/04/26 06:10:13 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (2.29s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:13 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:13 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8ba0bde2bada83ff", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:14 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:14 DEBUG : : Looking for writers 2024/04/26 06:10:14 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (1.55s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:14 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:14 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "83d755d750ce9b2e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:15 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:15 DEBUG : : Looking for writers 2024/04/26 06:10:15 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (1.04s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:15 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:15 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "914f8a4145d75035", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:16 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:16 DEBUG : : Looking for writers 2024/04/26 06:10:16 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (1.00s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:16 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:16 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c2b768d9ece9ec34", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:17 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:17 DEBUG : : Looking for writers 2024/04/26 06:10:17 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (1.00s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:17 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:17 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ed2d088ae1ebe903", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:18 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:18 DEBUG : : Looking for writers 2024/04/26 06:10:18 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (1.03s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:18 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:18 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "926a8f019ed454a0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:20 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:20 DEBUG : : Looking for writers 2024/04/26 06:10:20 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (2.08s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:21 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:21 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fc16d7b7efbf3a9d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:21 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:21 DEBUG : : Looking for writers 2024/04/26 06:10:21 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (1.01s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:22 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:22 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "14218f5bc046577d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:23 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:23 DEBUG : : Looking for writers 2024/04/26 06:10:23 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (2.57s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:24 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:24 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e568dd7f9ee1be67", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:25 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:25 DEBUG : : Looking for writers 2024/04/26 06:10:25 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (1.00s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:25 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:25 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2dbe72929fe35638", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:26 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:26 DEBUG : : Looking for writers 2024/04/26 06:10:26 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (1.54s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:27 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:27 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "74d58743a8203caa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:27 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:27 DEBUG : : Looking for writers 2024/04/26 06:10:27 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (1.01s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:28 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:28 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7e1304d9b171d271", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:28 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:28 DEBUG : : Looking for writers 2024/04/26 06:10:28 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (1.01s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:29 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:29 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "be188970b497f0ca", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:29 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:29 DEBUG : : Looking for writers 2024/04/26 06:10:29 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (1.55s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:30 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:30 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6bd0a1af3c7c9723", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:31 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:31 DEBUG : : Looking for writers 2024/04/26 06:10:31 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (1.54s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:32 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:32 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f7696075c979a5ee", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:32 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:32 DEBUG : : Looking for writers 2024/04/26 06:10:32 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (1.54s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:33 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:33 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "295f94ff049180bb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:34 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:34 DEBUG : : Looking for writers 2024/04/26 06:10:34 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (1.12s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:34 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:34 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "df76712c08f22fb2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:35 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:35 DEBUG : : Looking for writers 2024/04/26 06:10:35 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (2.08s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:37 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:37 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a7683285601b0a73", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:37 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:37 DEBUG : : Looking for writers 2024/04/26 06:10:37 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:38 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:38 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8d92d0086230bb00", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:39 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:39 DEBUG : : Looking for writers 2024/04/26 06:10:39 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:40 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:40 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1827c7335f0681ae", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:40 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:40 DEBUG : : Looking for writers 2024/04/26 06:10:40 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:41 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:41 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:10:41 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:41 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:41 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:41 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9eac5b2d9a57feba", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:41 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:41 DEBUG : : Looking for writers 2024/04/26 06:10:41 DEBUG : >WaitForWriters: 2024/04/26 06:10:41 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:42 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:42 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:10:42 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:42 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:42 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "15111c8ed5a8ee49", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:43 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:43 DEBUG : : Looking for writers 2024/04/26 06:10:43 DEBUG : >WaitForWriters: 2024/04/26 06:10:43 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:43 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:43 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:10:43 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:43 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:43 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:43 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "178ed66f35f715b4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:44 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:44 DEBUG : : Looking for writers 2024/04/26 06:10:44 DEBUG : >WaitForWriters: 2024/04/26 06:10:44 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (8.15s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (1.53s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (1.54s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (1.00s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (1.01s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (1.53s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (1.55s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:45 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:45 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f4dd1fe253b33ba3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:46 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:46 DEBUG : : Looking for writers 2024/04/26 06:10:46 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (1.54s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:46 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:46 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "86bc2682befb26c5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:47 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:47 DEBUG : : Looking for writers 2024/04/26 06:10:47 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (1.00s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:47 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:47 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5a8bd59bd3c252e8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:48 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:48 DEBUG : : Looking for writers 2024/04/26 06:10:48 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (1.00s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:48 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:48 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "41f622e02e03c49e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:50 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:50 DEBUG : : Looking for writers 2024/04/26 06:10:50 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (2.60s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:51 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:51 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f5531b721fecac1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:52 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:52 DEBUG : : Looking for writers 2024/04/26 06:10:52 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (1.54s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:52 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:52 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "93e02ec88349e1a4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:54 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:54 DEBUG : : Looking for writers 2024/04/26 06:10:54 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:54 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:54 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:10:54 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:10:54 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:54 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:54 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "59a4a73a82606e1a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:56 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:56 DEBUG : : Looking for writers 2024/04/26 06:10:56 DEBUG : >WaitForWriters: 2024/04/26 06:10:56 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:56 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:56 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:10:56 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:10:56 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:56 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:56 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:56 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:56 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1e60b5b0bd872f31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:10:58 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:10:58 DEBUG : : Looking for writers 2024/04/26 06:10:58 DEBUG : >WaitForWriters: 2024/04/26 06:10:58 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:10:59 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:10:59 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:10:59 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:59 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:10:59 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "56d64596067b4e2e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:03 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:03 DEBUG : : Looking for writers 2024/04/26 06:11:03 DEBUG : >WaitForWriters: 2024/04/26 06:11:03 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:03 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:03 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:03 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:03 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:03 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:03 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:03 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d3800eb3a5153e9a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:04 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:04 DEBUG : : Looking for writers 2024/04/26 06:11:04 DEBUG : >WaitForWriters: 2024/04/26 06:11:04 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:05 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:05 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:05 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:05 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:05 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:05 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:05 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a8a848809fc9f260", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:06 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:06 DEBUG : : Looking for writers 2024/04/26 06:11:06 DEBUG : >WaitForWriters: 2024/04/26 06:11:06 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (14.20s) --- FAIL: TestFileRename/off,forceCache=false (2.05s) --- FAIL: TestFileRename/minimal,forceCache=false (2.06s) --- FAIL: TestFileRename/minimal,forceCache=true (2.22s) --- FAIL: TestFileRename/writes,forceCache=false (4.59s) --- FAIL: TestFileRename/writes,forceCache=true (1.65s) --- FAIL: TestFileRename/full,forceCache=false (1.62s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:07 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:07 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "90535127d7b65506", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:08 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:08 DEBUG : : Looking for writers 2024/04/26 06:11:08 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (2.11s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:09 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:09 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b5f50b121c2b792c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:09 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:09 DEBUG : : Looking for writers 2024/04/26 06:11:09 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (2.11s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:11 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:11 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ca19e8cde48b7f70", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:13 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:13 DEBUG : : Looking for writers 2024/04/26 06:11:13 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (3.31s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:14 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:14 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "793c2f0e74c694ab", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:15 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:15 DEBUG : : Looking for writers 2024/04/26 06:11:15 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (1.01s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:15 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:15 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3989bf50d42daefc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:16 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:16 DEBUG : : Looking for writers 2024/04/26 06:11:16 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (1.00s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:16 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:16 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:16 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:16 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:16 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:16 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:16 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ecd67e1290270818", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:17 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:17 DEBUG : : Looking for writers 2024/04/26 06:11:17 DEBUG : >WaitForWriters: 2024/04/26 06:11:17 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (1.73s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:18 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:18 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:18 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:18 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:18 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:18 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:18 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1609e99c99423041", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:19 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:19 DEBUG : : Looking for writers 2024/04/26 06:11:19 DEBUG : >WaitForWriters: 2024/04/26 06:11:19 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (1.53s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:19 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:19 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:19 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:19 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:19 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:19 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:19 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5b5302aca292d931", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:21 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:21 DEBUG : : Looking for writers 2024/04/26 06:11:21 DEBUG : >WaitForWriters: 2024/04/26 06:11:21 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (1.53s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:21 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:21 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:21 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:21 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:21 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "871c19ddd13457a2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:22 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:22 DEBUG : : Looking for writers 2024/04/26 06:11:22 DEBUG : >WaitForWriters: 2024/04/26 06:11:22 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (1.01s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:22 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:22 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:22 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:22 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:22 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:22 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dfcc14cee5d7110f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:23 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:23 DEBUG : : Looking for writers 2024/04/26 06:11:23 DEBUG : >WaitForWriters: 2024/04/26 06:11:23 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (1.01s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:11:23 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:11:23 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:11:23 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:23 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:23 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:23 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:11:23 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:11:23 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:11:24 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:11:24 DEBUG : file1: newRWFileHandle: 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): openPending: 2024/04/26 06:11:24 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:11:24 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): >openPending: err= 2024/04/26 06:11:24 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:11:24 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:11:24 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:11:24 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): _writeAt: size=5, off=0 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): >_writeAt: n=5, err= 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): _writeAt: size=7, off=5 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): >_writeAt: n=7, err= 2024/04/26 06:11:24 DEBUG : file1: vfs cache: truncate to size=11 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): close: 2024/04/26 06:11:24 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:11:24.242407388 +0000 UTC m=+76.526166459 2024/04/26 06:11:24 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): >close: err= 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): close: 2024/04/26 06:11:24 DEBUG : file1(0xc000a39040): >close: err=file already closed 2024/04/26 06:11:24 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:11:24 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:11:24 DEBUG : : Looking for writers 2024/04/26 06:11:24 DEBUG : file1: reading active writers 2024/04/26 06:11:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:11:25 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e56735c1fd3a0f09", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:25 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e56735c1fd3a0f09", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:25 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:25 DEBUG : : Looking for writers 2024/04/26 06:11:25 DEBUG : file1: reading active writers 2024/04/26 06:11:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:25 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "847f4ca24f56d077", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:25 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "847f4ca24f56d077", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:26 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:26 DEBUG : : Looking for writers 2024/04/26 06:11:26 DEBUG : file1: reading active writers 2024/04/26 06:11:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:27 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a643c8c8f1fe2307", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:27 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a643c8c8f1fe2307", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:27 DEBUG : : Looking for writers 2024/04/26 06:11:27 DEBUG : file1: reading active writers 2024/04/26 06:11:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:27 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:28 DEBUG : : Looking for writers 2024/04/26 06:11:28 DEBUG : file1: reading active writers 2024/04/26 06:11:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:29 DEBUG : : Looking for writers 2024/04/26 06:11:29 DEBUG : file1: reading active writers 2024/04/26 06:11:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:29 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0d287f80ef984af4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:29 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0d287f80ef984af4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:30 DEBUG : : Looking for writers 2024/04/26 06:11:30 DEBUG : file1: reading active writers 2024/04/26 06:11:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:31 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:31 DEBUG : : Looking for writers 2024/04/26 06:11:31 DEBUG : file1: reading active writers 2024/04/26 06:11:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2a4664cb5bf56aec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:32 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "2a4664cb5bf56aec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:32 DEBUG : : Looking for writers 2024/04/26 06:11:32 DEBUG : file1: reading active writers 2024/04/26 06:11:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:33 DEBUG : : Looking for writers 2024/04/26 06:11:33 DEBUG : file1: reading active writers 2024/04/26 06:11:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:34 DEBUG : : Looking for writers 2024/04/26 06:11:34 DEBUG : file1: reading active writers 2024/04/26 06:11:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:35 DEBUG : : Looking for writers 2024/04/26 06:11:35 DEBUG : file1: reading active writers 2024/04/26 06:11:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:35 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:36 DEBUG : : Looking for writers 2024/04/26 06:11:36 DEBUG : file1: reading active writers 2024/04/26 06:11:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:37 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e479d3604e8e1e0c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:37 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e479d3604e8e1e0c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:37 DEBUG : : Looking for writers 2024/04/26 06:11:37 DEBUG : file1: reading active writers 2024/04/26 06:11:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:38 DEBUG : : Looking for writers 2024/04/26 06:11:38 DEBUG : file1: reading active writers 2024/04/26 06:11:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:39 DEBUG : : Looking for writers 2024/04/26 06:11:39 DEBUG : file1: reading active writers 2024/04/26 06:11:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:40 DEBUG : : Looking for writers 2024/04/26 06:11:40 DEBUG : file1: reading active writers 2024/04/26 06:11:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:41 DEBUG : : Looking for writers 2024/04/26 06:11:41 DEBUG : file1: reading active writers 2024/04/26 06:11:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:42 DEBUG : : Looking for writers 2024/04/26 06:11:42 DEBUG : file1: reading active writers 2024/04/26 06:11:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:43 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:11:43 DEBUG : : Looking for writers 2024/04/26 06:11:43 DEBUG : file1: reading active writers 2024/04/26 06:11:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:44 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "17dabe87420ba1f1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:44 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "17dabe87420ba1f1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:44 DEBUG : : Looking for writers 2024/04/26 06:11:44 DEBUG : file1: reading active writers 2024/04/26 06:11:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:45 DEBUG : : Looking for writers 2024/04/26 06:11:45 DEBUG : file1: reading active writers 2024/04/26 06:11:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:46 DEBUG : : Looking for writers 2024/04/26 06:11:46 DEBUG : file1: reading active writers 2024/04/26 06:11:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:47 DEBUG : : Looking for writers 2024/04/26 06:11:47 DEBUG : file1: reading active writers 2024/04/26 06:11:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:48 DEBUG : : Looking for writers 2024/04/26 06:11:48 DEBUG : file1: reading active writers 2024/04/26 06:11:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:49 DEBUG : : Looking for writers 2024/04/26 06:11:49 DEBUG : file1: reading active writers 2024/04/26 06:11:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:50 DEBUG : : Looking for writers 2024/04/26 06:11:50 DEBUG : file1: reading active writers 2024/04/26 06:11:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:51 DEBUG : : Looking for writers 2024/04/26 06:11:51 DEBUG : file1: reading active writers 2024/04/26 06:11:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:52 DEBUG : : Looking for writers 2024/04/26 06:11:52 DEBUG : file1: reading active writers 2024/04/26 06:11:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:53 DEBUG : : Looking for writers 2024/04/26 06:11:53 DEBUG : file1: reading active writers 2024/04/26 06:11:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:11:54 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000844000 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000622108 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640151872} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970467576731612 ext:76526166459 loc:0x3a12660} ATime:{wall:13943970467576755807 ext:76526190645 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:11:54 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/04/26 06:11:56 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:11:57 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3a64c458c357e196", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:11:57 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3a64c458c357e196", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/04/26 06:12:03 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:12:03 DEBUG : : Looking for writers 2024/04/26 06:12:03 DEBUG : file1: reading active writers 2024/04/26 06:12:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:12:04 DEBUG : : Looking for writers 2024/04/26 06:12:04 DEBUG : file1: reading active writers 2024/04/26 06:12:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:05 DEBUG : : Looking for writers 2024/04/26 06:12:05 DEBUG : file1: reading active writers 2024/04/26 06:12:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:06 DEBUG : : Looking for writers 2024/04/26 06:12:06 DEBUG : file1: reading active writers 2024/04/26 06:12:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:07 DEBUG : : Looking for writers 2024/04/26 06:12:07 DEBUG : file1: reading active writers 2024/04/26 06:12:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:08 DEBUG : : Looking for writers 2024/04/26 06:12:08 DEBUG : file1: reading active writers 2024/04/26 06:12:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:09 DEBUG : : Looking for writers 2024/04/26 06:12:09 DEBUG : file1: reading active writers 2024/04/26 06:12:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:10 DEBUG : : Looking for writers 2024/04/26 06:12:10 DEBUG : file1: reading active writers 2024/04/26 06:12:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:11 DEBUG : : Looking for writers 2024/04/26 06:12:11 DEBUG : file1: reading active writers 2024/04/26 06:12:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:12 DEBUG : : Looking for writers 2024/04/26 06:12:12 DEBUG : file1: reading active writers 2024/04/26 06:12:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:13 DEBUG : : Looking for writers 2024/04/26 06:12:13 DEBUG : file1: reading active writers 2024/04/26 06:12:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:14 DEBUG : : Looking for writers 2024/04/26 06:12:14 DEBUG : file1: reading active writers 2024/04/26 06:12:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:15 DEBUG : : Looking for writers 2024/04/26 06:12:15 DEBUG : file1: reading active writers 2024/04/26 06:12:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:16 DEBUG : : Looking for writers 2024/04/26 06:12:16 DEBUG : file1: reading active writers 2024/04/26 06:12:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:17 DEBUG : : Looking for writers 2024/04/26 06:12:17 DEBUG : file1: reading active writers 2024/04/26 06:12:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:18 DEBUG : : Looking for writers 2024/04/26 06:12:18 DEBUG : file1: reading active writers 2024/04/26 06:12:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:19 DEBUG : : Looking for writers 2024/04/26 06:12:19 DEBUG : file1: reading active writers 2024/04/26 06:12:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:20 DEBUG : : Looking for writers 2024/04/26 06:12:20 DEBUG : file1: reading active writers 2024/04/26 06:12:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:21 DEBUG : : Looking for writers 2024/04/26 06:12:21 DEBUG : file1: reading active writers 2024/04/26 06:12:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:22 DEBUG : : Looking for writers 2024/04/26 06:12:22 DEBUG : file1: reading active writers 2024/04/26 06:12:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:23 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:23 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:12:23 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 0, uploading 1, total size 11 (was 11) 2024/04/26 06:12:23 DEBUG : : Looking for writers 2024/04/26 06:12:23 DEBUG : file1: reading active writers 2024/04/26 06:12:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:24 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "09409623dd6b955f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:24 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "09409623dd6b955f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:24 DEBUG : : Looking for writers 2024/04/26 06:12:24 DEBUG : file1: reading active writers 2024/04/26 06:12:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:25 DEBUG : : Looking for writers 2024/04/26 06:12:25 DEBUG : file1: reading active writers 2024/04/26 06:12:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:26 DEBUG : : Looking for writers 2024/04/26 06:12:26 DEBUG : file1: reading active writers 2024/04/26 06:12:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:27 DEBUG : : Looking for writers 2024/04/26 06:12:27 DEBUG : file1: reading active writers 2024/04/26 06:12:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:28 DEBUG : : Looking for writers 2024/04/26 06:12:28 DEBUG : file1: reading active writers 2024/04/26 06:12:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:29 DEBUG : : Looking for writers 2024/04/26 06:12:29 DEBUG : file1: reading active writers 2024/04/26 06:12:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:30 DEBUG : : Looking for writers 2024/04/26 06:12:30 DEBUG : file1: reading active writers 2024/04/26 06:12:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:31 DEBUG : : Looking for writers 2024/04/26 06:12:31 DEBUG : file1: reading active writers 2024/04/26 06:12:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:32 DEBUG : : Looking for writers 2024/04/26 06:12:32 DEBUG : file1: reading active writers 2024/04/26 06:12:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:33 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc000844000 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000622108 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640151872} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970467576731612 ext:76526166459 loc:0x3a12660} ATime:{wall:13943970467576755807 ext:76526190645 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:12:33 DEBUG : >WaitForWriters: 2024/04/26 06:12:33 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (70.16s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:12:33 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:12:33 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:12:33 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:12:33 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:12:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:12:33 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:12:33 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:12:33 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:12:33 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:12:33 DEBUG : file1: newRWFileHandle: 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): openPending: 2024/04/26 06:12:33 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:12:33 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): >openPending: err= 2024/04/26 06:12:33 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:12:33 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:12:33 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:12:33 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): _writeAt: size=7, off=0 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): >_writeAt: n=7, err= 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): _writeAt: size=6, off=5 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): >_writeAt: n=6, err= 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): close: 2024/04/26 06:12:33 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:12:33.880291898 +0000 UTC m=+146.164050940 2024/04/26 06:12:33 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): >close: err= 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): _writeAt: size=5, off=0 2024/04/26 06:12:33 DEBUG : file1(0xc000c8f1c0): >_writeAt: n=0, err=file already closed 2024/04/26 06:12:33 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:12:33 DEBUG : : Looking for writers 2024/04/26 06:12:33 DEBUG : file1: reading active writers 2024/04/26 06:12:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:12:33 DEBUG : : Looking for writers 2024/04/26 06:12:33 DEBUG : file1: reading active writers 2024/04/26 06:12:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:12:33 DEBUG : : Looking for writers 2024/04/26 06:12:33 DEBUG : file1: reading active writers 2024/04/26 06:12:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:12:33 DEBUG : : Looking for writers 2024/04/26 06:12:33 DEBUG : file1: reading active writers 2024/04/26 06:12:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:12:33 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:34 DEBUG : : Looking for writers 2024/04/26 06:12:34 DEBUG : file1: reading active writers 2024/04/26 06:12:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:12:34 DEBUG : : Looking for writers 2024/04/26 06:12:34 DEBUG : file1: reading active writers 2024/04/26 06:12:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:12:34 DEBUG : : Looking for writers 2024/04/26 06:12:34 DEBUG : file1: reading active writers 2024/04/26 06:12:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:12:34 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "58fb3a3ea321ef73", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:34 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "58fb3a3ea321ef73", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:34 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:35 DEBUG : : Looking for writers 2024/04/26 06:12:35 DEBUG : file1: reading active writers 2024/04/26 06:12:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:35 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "462196cba3d918e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:35 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "462196cba3d918e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:36 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:36 DEBUG : : Looking for writers 2024/04/26 06:12:36 DEBUG : file1: reading active writers 2024/04/26 06:12:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:36 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ca53bbad98d40a65", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:36 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ca53bbad98d40a65", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:37 DEBUG : : Looking for writers 2024/04/26 06:12:37 DEBUG : file1: reading active writers 2024/04/26 06:12:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:37 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:38 DEBUG : : Looking for writers 2024/04/26 06:12:38 DEBUG : file1: reading active writers 2024/04/26 06:12:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:39 DEBUG : : Looking for writers 2024/04/26 06:12:39 DEBUG : file1: reading active writers 2024/04/26 06:12:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:39 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "59209247ffbfb0db", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:39 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "59209247ffbfb0db", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:40 DEBUG : : Looking for writers 2024/04/26 06:12:40 DEBUG : file1: reading active writers 2024/04/26 06:12:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:41 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:41 DEBUG : : Looking for writers 2024/04/26 06:12:41 DEBUG : file1: reading active writers 2024/04/26 06:12:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:41 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "92520a0779c28e03", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:41 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "92520a0779c28e03", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:42 DEBUG : : Looking for writers 2024/04/26 06:12:42 DEBUG : file1: reading active writers 2024/04/26 06:12:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:43 DEBUG : : Looking for writers 2024/04/26 06:12:43 DEBUG : file1: reading active writers 2024/04/26 06:12:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:44 DEBUG : : Looking for writers 2024/04/26 06:12:44 DEBUG : file1: reading active writers 2024/04/26 06:12:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:45 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:45 DEBUG : : Looking for writers 2024/04/26 06:12:45 DEBUG : file1: reading active writers 2024/04/26 06:12:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:46 DEBUG : : Looking for writers 2024/04/26 06:12:46 DEBUG : file1: reading active writers 2024/04/26 06:12:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:46 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d738abc0115f130d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:46 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d738abc0115f130d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:47 DEBUG : : Looking for writers 2024/04/26 06:12:47 DEBUG : file1: reading active writers 2024/04/26 06:12:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:48 DEBUG : : Looking for writers 2024/04/26 06:12:48 DEBUG : file1: reading active writers 2024/04/26 06:12:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:49 DEBUG : : Looking for writers 2024/04/26 06:12:49 DEBUG : file1: reading active writers 2024/04/26 06:12:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:50 DEBUG : : Looking for writers 2024/04/26 06:12:50 DEBUG : file1: reading active writers 2024/04/26 06:12:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:51 DEBUG : : Looking for writers 2024/04/26 06:12:51 DEBUG : file1: reading active writers 2024/04/26 06:12:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:52 DEBUG : : Looking for writers 2024/04/26 06:12:52 DEBUG : file1: reading active writers 2024/04/26 06:12:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:53 DEBUG : : Looking for writers 2024/04/26 06:12:53 DEBUG : file1: reading active writers 2024/04/26 06:12:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:53 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:12:54 DEBUG : : Looking for writers 2024/04/26 06:12:54 DEBUG : file1: reading active writers 2024/04/26 06:12:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:54 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e39de5479b94e01f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:54 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e39de5479b94e01f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:12:55 DEBUG : : Looking for writers 2024/04/26 06:12:55 DEBUG : file1: reading active writers 2024/04/26 06:12:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:56 DEBUG : : Looking for writers 2024/04/26 06:12:56 DEBUG : file1: reading active writers 2024/04/26 06:12:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:57 DEBUG : : Looking for writers 2024/04/26 06:12:57 DEBUG : file1: reading active writers 2024/04/26 06:12:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:58 DEBUG : : Looking for writers 2024/04/26 06:12:58 DEBUG : file1: reading active writers 2024/04/26 06:12:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:12:59 DEBUG : : Looking for writers 2024/04/26 06:12:59 DEBUG : file1: reading active writers 2024/04/26 06:12:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:00 DEBUG : : Looking for writers 2024/04/26 06:13:00 DEBUG : file1: reading active writers 2024/04/26 06:13:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:01 DEBUG : : Looking for writers 2024/04/26 06:13:01 DEBUG : file1: reading active writers 2024/04/26 06:13:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:02 DEBUG : : Looking for writers 2024/04/26 06:13:02 DEBUG : file1: reading active writers 2024/04/26 06:13:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:03 DEBUG : : Looking for writers 2024/04/26 06:13:03 DEBUG : file1: reading active writers 2024/04/26 06:13:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:03 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0008982d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00075a508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641430848} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970542302801978 ext:146164050940 loc:0x3a12660} ATime:{wall:13943970542302821815 ext:146164070788 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:13:03 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/04/26 06:13:07 DEBUG : file1: vfs cache: starting upload fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 2024/04/26 06:13:08 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "75517fec0a2165e6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:08 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "75517fec0a2165e6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/04/26 06:13:11 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:13:11 DEBUG : : Looking for writers 2024/04/26 06:13:11 DEBUG : file1: reading active writers 2024/04/26 06:13:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:13:12 DEBUG : : Looking for writers 2024/04/26 06:13:12 DEBUG : file1: reading active writers 2024/04/26 06:13:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:13:12 DEBUG : : Looking for writers 2024/04/26 06:13:12 DEBUG : file1: reading active writers 2024/04/26 06:13:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:13:12 DEBUG : : Looking for writers 2024/04/26 06:13:12 DEBUG : file1: reading active writers 2024/04/26 06:13:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:13:12 DEBUG : : Looking for writers 2024/04/26 06:13:12 DEBUG : file1: reading active writers 2024/04/26 06:13:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:13:12 DEBUG : : Looking for writers 2024/04/26 06:13:12 DEBUG : file1: reading active writers 2024/04/26 06:13:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:13:12 DEBUG : : Looking for writers 2024/04/26 06:13:12 DEBUG : file1: reading active writers 2024/04/26 06:13:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:13:13 DEBUG : : Looking for writers 2024/04/26 06:13:13 DEBUG : file1: reading active writers 2024/04/26 06:13:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:14 DEBUG : : Looking for writers 2024/04/26 06:13:14 DEBUG : file1: reading active writers 2024/04/26 06:13:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:15 DEBUG : : Looking for writers 2024/04/26 06:13:15 DEBUG : file1: reading active writers 2024/04/26 06:13:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:16 DEBUG : : Looking for writers 2024/04/26 06:13:16 DEBUG : file1: reading active writers 2024/04/26 06:13:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:17 DEBUG : : Looking for writers 2024/04/26 06:13:17 DEBUG : file1: reading active writers 2024/04/26 06:13:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:18 DEBUG : : Looking for writers 2024/04/26 06:13:18 DEBUG : file1: reading active writers 2024/04/26 06:13:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:19 DEBUG : : Looking for writers 2024/04/26 06:13:19 DEBUG : file1: reading active writers 2024/04/26 06:13:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:20 DEBUG : : Looking for writers 2024/04/26 06:13:20 DEBUG : file1: reading active writers 2024/04/26 06:13:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:21 DEBUG : : Looking for writers 2024/04/26 06:13:21 DEBUG : file1: reading active writers 2024/04/26 06:13:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:22 DEBUG : : Looking for writers 2024/04/26 06:13:22 DEBUG : file1: reading active writers 2024/04/26 06:13:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:23 DEBUG : : Looking for writers 2024/04/26 06:13:23 DEBUG : file1: reading active writers 2024/04/26 06:13:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:24 DEBUG : : Looking for writers 2024/04/26 06:13:24 DEBUG : file1: reading active writers 2024/04/26 06:13:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:25 DEBUG : : Looking for writers 2024/04/26 06:13:25 DEBUG : file1: reading active writers 2024/04/26 06:13:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:26 DEBUG : : Looking for writers 2024/04/26 06:13:26 DEBUG : file1: reading active writers 2024/04/26 06:13:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:27 DEBUG : : Looking for writers 2024/04/26 06:13:27 DEBUG : file1: reading active writers 2024/04/26 06:13:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:28 DEBUG : : Looking for writers 2024/04/26 06:13:28 DEBUG : file1: reading active writers 2024/04/26 06:13:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:29 DEBUG : : Looking for writers 2024/04/26 06:13:29 DEBUG : file1: reading active writers 2024/04/26 06:13:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:30 DEBUG : : Looking for writers 2024/04/26 06:13:30 DEBUG : file1: reading active writers 2024/04/26 06:13:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:31 DEBUG : : Looking for writers 2024/04/26 06:13:31 DEBUG : file1: reading active writers 2024/04/26 06:13:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:32 DEBUG : : Looking for writers 2024/04/26 06:13:32 DEBUG : file1: reading active writers 2024/04/26 06:13:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:33 DEBUG : : Looking for writers 2024/04/26 06:13:33 DEBUG : file1: reading active writers 2024/04/26 06:13:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:33 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:13:33 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/04/26 06:13:33 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:13:34 DEBUG : : Looking for writers 2024/04/26 06:13:34 DEBUG : file1: reading active writers 2024/04/26 06:13:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:35 DEBUG : : Looking for writers 2024/04/26 06:13:35 DEBUG : file1: reading active writers 2024/04/26 06:13:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:35 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bd9de4ea2342a054", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:35 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "bd9de4ea2342a054", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:36 DEBUG : : Looking for writers 2024/04/26 06:13:36 DEBUG : file1: reading active writers 2024/04/26 06:13:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:37 DEBUG : : Looking for writers 2024/04/26 06:13:37 DEBUG : file1: reading active writers 2024/04/26 06:13:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:38 DEBUG : : Looking for writers 2024/04/26 06:13:38 DEBUG : file1: reading active writers 2024/04/26 06:13:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:39 DEBUG : : Looking for writers 2024/04/26 06:13:39 DEBUG : file1: reading active writers 2024/04/26 06:13:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:40 DEBUG : : Looking for writers 2024/04/26 06:13:40 DEBUG : file1: reading active writers 2024/04/26 06:13:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:41 DEBUG : : Looking for writers 2024/04/26 06:13:41 DEBUG : file1: reading active writers 2024/04/26 06:13:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:13:41 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0008982d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc00075a508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824641430848} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970542302801978 ext:146164050940 loc:0x3a12660} ATime:{wall:13943970542302821815 ext:146164070788 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:13:41 DEBUG : >WaitForWriters: 2024/04/26 06:13:41 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (68.73s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:13:42 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:13:42 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:13:42 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:13:42 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:13:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:13:42 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:13:42 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:13:42 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:13:42 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:13:42 DEBUG : file1: newRWFileHandle: 2024/04/26 06:13:42 DEBUG : file1(0xc00088a680): openPending: 2024/04/26 06:13:42 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:13:42 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:13:42 DEBUG : file1(0xc00088a680): >openPending: err= 2024/04/26 06:13:42 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:13:42 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:13:42 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:13:42 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/04/26 06:13:42 DEBUG : file1(0xc00088a680): close: 2024/04/26 06:13:42 DEBUG : file1: vfs cache: setting modification time to 2024-04-26 06:13:42.603963914 +0000 UTC m=+214.887722967 2024/04/26 06:13:42 INFO : file1: vfs cache: queuing for upload in 100ms 2024/04/26 06:13:42 DEBUG : file1(0xc00088a680): >close: err= 2024/04/26 06:13:42 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/04/26 06:13:42 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/04/26 06:13:42 DEBUG : file2: newRWFileHandle: 2024/04/26 06:13:42 DEBUG : file2(0xc00088a7c0): openPending: 2024/04/26 06:13:42 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:13:42 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/26 06:13:42 DEBUG : file2(0xc00088a7c0): >openPending: err= 2024/04/26 06:13:42 DEBUG : file2: >newRWFileHandle: err= 2024/04/26 06:13:42 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/04/26 06:13:42 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/04/26 06:13:42 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/04/26 06:13:42 DEBUG : file2(0xc00088a7c0): RWFileHandle.Flush 2024/04/26 06:13:42 DEBUG : file2(0xc00088a7c0): RWFileHandle.Release 2024/04/26 06:13:42 DEBUG : file2(0xc00088a7c0): close: 2024/04/26 06:13:42 DEBUG : file2: vfs cache: setting modification time to 2024-04-26 06:13:42.605093031 +0000 UTC m=+214.888852084 2024/04/26 06:13:42 INFO : file2: vfs cache: queuing for upload in 100ms 2024/04/26 06:13:42 DEBUG : file2(0xc00088a7c0): >close: err= 2024/04/26 06:13:42 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:13:42 DEBUG : : Looking for writers 2024/04/26 06:13:42 DEBUG : file1: reading active writers 2024/04/26 06:13:42 DEBUG : file2: reading active writers 2024/04/26 06:13:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/26 06:13:42 DEBUG : : Looking for writers 2024/04/26 06:13:42 DEBUG : file1: reading active writers 2024/04/26 06:13:42 DEBUG : file2: reading active writers 2024/04/26 06:13:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/26 06:13:42 DEBUG : : Looking for writers 2024/04/26 06:13:42 DEBUG : file1: reading active writers 2024/04/26 06:13:42 DEBUG : file2: reading active writers 2024/04/26 06:13:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/26 06:13:42 DEBUG : : Looking for writers 2024/04/26 06:13:42 DEBUG : file1: reading active writers 2024/04/26 06:13:42 DEBUG : file2: reading active writers 2024/04/26 06:13:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/26 06:13:42 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:13:42 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:13:42 DEBUG : : Looking for writers 2024/04/26 06:13:42 DEBUG : file1: reading active writers 2024/04/26 06:13:42 DEBUG : file2: reading active writers 2024/04/26 06:13:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/26 06:13:42 DEBUG : : Looking for writers 2024/04/26 06:13:42 DEBUG : file2: reading active writers 2024/04/26 06:13:42 DEBUG : file1: reading active writers 2024/04/26 06:13:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/26 06:13:43 DEBUG : : Looking for writers 2024/04/26 06:13:43 DEBUG : file2: reading active writers 2024/04/26 06:13:43 DEBUG : file1: reading active writers 2024/04/26 06:13:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/26 06:13:43 DEBUG : : Looking for writers 2024/04/26 06:13:43 DEBUG : file1: reading active writers 2024/04/26 06:13:43 DEBUG : file2: reading active writers 2024/04/26 06:13:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:44 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d8de0b2acffb3642", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:44 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d8de0b2acffb3642", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:44 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:13:44 DEBUG : : Looking for writers 2024/04/26 06:13:44 DEBUG : file1: reading active writers 2024/04/26 06:13:44 DEBUG : file2: reading active writers 2024/04/26 06:13:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:45 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e2ae8aeb319cbdff", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:45 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e2ae8aeb319cbdff", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:45 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:13:45 DEBUG : : Looking for writers 2024/04/26 06:13:45 DEBUG : file1: reading active writers 2024/04/26 06:13:45 DEBUG : file2: reading active writers 2024/04/26 06:13:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:46 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6be21b2b7e6adc3d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:46 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6be21b2b7e6adc3d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:46 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:13:46 DEBUG : : Looking for writers 2024/04/26 06:13:46 DEBUG : file1: reading active writers 2024/04/26 06:13:46 DEBUG : file2: reading active writers 2024/04/26 06:13:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:47 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6fa9f6db5eddaad7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:47 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6fa9f6db5eddaad7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:47 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:13:47 DEBUG : : Looking for writers 2024/04/26 06:13:47 DEBUG : file1: reading active writers 2024/04/26 06:13:47 DEBUG : file2: reading active writers 2024/04/26 06:13:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:48 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5cedc6ba840a710d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:48 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5cedc6ba840a710d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:48 DEBUG : : Looking for writers 2024/04/26 06:13:48 DEBUG : file1: reading active writers 2024/04/26 06:13:48 DEBUG : file2: reading active writers 2024/04/26 06:13:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:49 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:13:49 DEBUG : : Looking for writers 2024/04/26 06:13:49 DEBUG : file1: reading active writers 2024/04/26 06:13:49 DEBUG : file2: reading active writers 2024/04/26 06:13:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:50 DEBUG : : Looking for writers 2024/04/26 06:13:50 DEBUG : file1: reading active writers 2024/04/26 06:13:50 DEBUG : file2: reading active writers 2024/04/26 06:13:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:51 DEBUG : : Looking for writers 2024/04/26 06:13:51 DEBUG : file2: reading active writers 2024/04/26 06:13:51 DEBUG : file1: reading active writers 2024/04/26 06:13:51 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "699c5ca8d2ae4218", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:52 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "699c5ca8d2ae4218", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:52 DEBUG : : Looking for writers 2024/04/26 06:13:52 DEBUG : file2: reading active writers 2024/04/26 06:13:52 DEBUG : file1: reading active writers 2024/04/26 06:13:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:53 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:13:53 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b71063d469f071dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:53 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b71063d469f071dd", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:53 DEBUG : : Looking for writers 2024/04/26 06:13:53 DEBUG : file1: reading active writers 2024/04/26 06:13:53 DEBUG : file2: reading active writers 2024/04/26 06:13:53 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:54 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "087874d712e5d0fe", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:54 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "087874d712e5d0fe", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:54 DEBUG : : Looking for writers 2024/04/26 06:13:54 DEBUG : file2: reading active writers 2024/04/26 06:13:54 DEBUG : file1: reading active writers 2024/04/26 06:13:54 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:55 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:13:55 DEBUG : : Looking for writers 2024/04/26 06:13:55 DEBUG : file1: reading active writers 2024/04/26 06:13:55 DEBUG : file2: reading active writers 2024/04/26 06:13:55 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:55 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:13:56 DEBUG : : Looking for writers 2024/04/26 06:13:56 DEBUG : file1: reading active writers 2024/04/26 06:13:56 DEBUG : file2: reading active writers 2024/04/26 06:13:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:57 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c25d77bd572b8dad", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:57 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c25d77bd572b8dad", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:57 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79153099fcb6bbdb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:57 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "79153099fcb6bbdb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:13:57 DEBUG : : Looking for writers 2024/04/26 06:13:57 DEBUG : file1: reading active writers 2024/04/26 06:13:57 DEBUG : file2: reading active writers 2024/04/26 06:13:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:58 DEBUG : : Looking for writers 2024/04/26 06:13:58 DEBUG : file1: reading active writers 2024/04/26 06:13:58 DEBUG : file2: reading active writers 2024/04/26 06:13:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:13:59 DEBUG : : Looking for writers 2024/04/26 06:13:59 DEBUG : file1: reading active writers 2024/04/26 06:13:59 DEBUG : file2: reading active writers 2024/04/26 06:13:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:00 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:14:00 DEBUG : : Looking for writers 2024/04/26 06:14:00 DEBUG : file1: reading active writers 2024/04/26 06:14:00 DEBUG : file2: reading active writers 2024/04/26 06:14:00 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:00 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:14:00 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "591e1ac361a51be8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:00 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "591e1ac361a51be8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:01 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9d5bdb04fe32e87b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:01 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9d5bdb04fe32e87b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:01 DEBUG : : Looking for writers 2024/04/26 06:14:01 DEBUG : file1: reading active writers 2024/04/26 06:14:01 DEBUG : file2: reading active writers 2024/04/26 06:14:01 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:02 DEBUG : : Looking for writers 2024/04/26 06:14:02 DEBUG : file1: reading active writers 2024/04/26 06:14:02 DEBUG : file2: reading active writers 2024/04/26 06:14:02 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:03 DEBUG : : Looking for writers 2024/04/26 06:14:03 DEBUG : file1: reading active writers 2024/04/26 06:14:03 DEBUG : file2: reading active writers 2024/04/26 06:14:03 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:04 DEBUG : : Looking for writers 2024/04/26 06:14:04 DEBUG : file1: reading active writers 2024/04/26 06:14:04 DEBUG : file2: reading active writers 2024/04/26 06:14:04 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:05 DEBUG : : Looking for writers 2024/04/26 06:14:05 DEBUG : file1: reading active writers 2024/04/26 06:14:05 DEBUG : file2: reading active writers 2024/04/26 06:14:05 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:06 DEBUG : : Looking for writers 2024/04/26 06:14:06 DEBUG : file1: reading active writers 2024/04/26 06:14:06 DEBUG : file2: reading active writers 2024/04/26 06:14:06 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:07 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:14:07 DEBUG : : Looking for writers 2024/04/26 06:14:07 DEBUG : file1: reading active writers 2024/04/26 06:14:07 DEBUG : file2: reading active writers 2024/04/26 06:14:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:08 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:14:08 DEBUG : : Looking for writers 2024/04/26 06:14:08 DEBUG : file1: reading active writers 2024/04/26 06:14:08 DEBUG : file2: reading active writers 2024/04/26 06:14:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:09 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5b75bd2c4d66e03a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:09 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5b75bd2c4d66e03a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "08aee8ac5e8f3dba", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:09 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "08aee8ac5e8f3dba", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:09 DEBUG : : Looking for writers 2024/04/26 06:14:09 DEBUG : file2: reading active writers 2024/04/26 06:14:09 DEBUG : file1: reading active writers 2024/04/26 06:14:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:10 DEBUG : : Looking for writers 2024/04/26 06:14:10 DEBUG : file1: reading active writers 2024/04/26 06:14:10 DEBUG : file2: reading active writers 2024/04/26 06:14:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:11 DEBUG : : Looking for writers 2024/04/26 06:14:11 DEBUG : file1: reading active writers 2024/04/26 06:14:11 DEBUG : file2: reading active writers 2024/04/26 06:14:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:12 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0008983c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0001cd208 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824635609664} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970616114659850 ext:214887722967 loc:0x3a12660} ATime:{wall:13943970616114938773 ext:214888001879 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0008983c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0001cd508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824635610432} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970616115788967 ext:214888852084 loc:0x3a12660} ATime:{wall:13943970616115947344 ext:214889010461 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:14:12 DEBUG : >WaitForWriters: fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:197: Not found "file2" fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/04/26 06:14:21 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:14:21 DEBUG : : Looking for writers 2024/04/26 06:14:21 DEBUG : file1: reading active writers 2024/04/26 06:14:21 DEBUG : file2: reading active writers 2024/04/26 06:14:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/04/26 06:14:21 DEBUG : : Looking for writers 2024/04/26 06:14:21 DEBUG : file1: reading active writers 2024/04/26 06:14:21 DEBUG : file2: reading active writers 2024/04/26 06:14:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/04/26 06:14:21 DEBUG : : Looking for writers 2024/04/26 06:14:21 DEBUG : file1: reading active writers 2024/04/26 06:14:21 DEBUG : file2: reading active writers 2024/04/26 06:14:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/04/26 06:14:21 DEBUG : : Looking for writers 2024/04/26 06:14:21 DEBUG : file1: reading active writers 2024/04/26 06:14:21 DEBUG : file2: reading active writers 2024/04/26 06:14:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/04/26 06:14:21 DEBUG : : Looking for writers 2024/04/26 06:14:21 DEBUG : file1: reading active writers 2024/04/26 06:14:21 DEBUG : file2: reading active writers 2024/04/26 06:14:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/04/26 06:14:21 DEBUG : : Looking for writers 2024/04/26 06:14:21 DEBUG : file1: reading active writers 2024/04/26 06:14:21 DEBUG : file2: reading active writers 2024/04/26 06:14:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/04/26 06:14:21 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:14:22 DEBUG : : Looking for writers 2024/04/26 06:14:22 DEBUG : file1: reading active writers 2024/04/26 06:14:22 DEBUG : file2: reading active writers 2024/04/26 06:14:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/04/26 06:14:22 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:14:22 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0354f3bde0723136", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:22 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0354f3bde0723136", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:22 DEBUG : : Looking for writers 2024/04/26 06:14:22 DEBUG : file1: reading active writers 2024/04/26 06:14:22 DEBUG : file2: reading active writers 2024/04/26 06:14:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fa8c51fcb0edaaac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:23 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fa8c51fcb0edaaac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:23 DEBUG : : Looking for writers 2024/04/26 06:14:23 DEBUG : file1: reading active writers 2024/04/26 06:14:23 DEBUG : file2: reading active writers 2024/04/26 06:14:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:24 DEBUG : : Looking for writers 2024/04/26 06:14:24 DEBUG : file1: reading active writers 2024/04/26 06:14:24 DEBUG : file2: reading active writers 2024/04/26 06:14:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:25 DEBUG : : Looking for writers 2024/04/26 06:14:25 DEBUG : file1: reading active writers 2024/04/26 06:14:25 DEBUG : file2: reading active writers 2024/04/26 06:14:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:26 DEBUG : : Looking for writers 2024/04/26 06:14:26 DEBUG : file2: reading active writers 2024/04/26 06:14:26 DEBUG : file1: reading active writers 2024/04/26 06:14:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:27 DEBUG : : Looking for writers 2024/04/26 06:14:27 DEBUG : file2: reading active writers 2024/04/26 06:14:27 DEBUG : file1: reading active writers 2024/04/26 06:14:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:28 DEBUG : : Looking for writers 2024/04/26 06:14:28 DEBUG : file2: reading active writers 2024/04/26 06:14:28 DEBUG : file1: reading active writers 2024/04/26 06:14:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:29 DEBUG : : Looking for writers 2024/04/26 06:14:29 DEBUG : file1: reading active writers 2024/04/26 06:14:29 DEBUG : file2: reading active writers 2024/04/26 06:14:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:30 DEBUG : : Looking for writers 2024/04/26 06:14:30 DEBUG : file1: reading active writers 2024/04/26 06:14:30 DEBUG : file2: reading active writers 2024/04/26 06:14:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:31 DEBUG : : Looking for writers 2024/04/26 06:14:31 DEBUG : file2: reading active writers 2024/04/26 06:14:31 DEBUG : file1: reading active writers 2024/04/26 06:14:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:32 DEBUG : : Looking for writers 2024/04/26 06:14:32 DEBUG : file1: reading active writers 2024/04/26 06:14:32 DEBUG : file2: reading active writers 2024/04/26 06:14:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:33 DEBUG : : Looking for writers 2024/04/26 06:14:33 DEBUG : file1: reading active writers 2024/04/26 06:14:33 DEBUG : file2: reading active writers 2024/04/26 06:14:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:34 DEBUG : : Looking for writers 2024/04/26 06:14:34 DEBUG : file1: reading active writers 2024/04/26 06:14:34 DEBUG : file2: reading active writers 2024/04/26 06:14:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:35 DEBUG : : Looking for writers 2024/04/26 06:14:35 DEBUG : file1: reading active writers 2024/04/26 06:14:35 DEBUG : file2: reading active writers 2024/04/26 06:14:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:36 DEBUG : : Looking for writers 2024/04/26 06:14:36 DEBUG : file2: reading active writers 2024/04/26 06:14:36 DEBUG : file1: reading active writers 2024/04/26 06:14:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:37 DEBUG : : Looking for writers 2024/04/26 06:14:37 DEBUG : file1: reading active writers 2024/04/26 06:14:37 DEBUG : file2: reading active writers 2024/04/26 06:14:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:38 DEBUG : : Looking for writers 2024/04/26 06:14:38 DEBUG : file1: reading active writers 2024/04/26 06:14:38 DEBUG : file2: reading active writers 2024/04/26 06:14:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:39 DEBUG : : Looking for writers 2024/04/26 06:14:39 DEBUG : file1: reading active writers 2024/04/26 06:14:39 DEBUG : file2: reading active writers 2024/04/26 06:14:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:40 DEBUG : : Looking for writers 2024/04/26 06:14:40 DEBUG : file1: reading active writers 2024/04/26 06:14:40 DEBUG : file2: reading active writers 2024/04/26 06:14:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:41 DEBUG : : Looking for writers 2024/04/26 06:14:41 DEBUG : file2: reading active writers 2024/04/26 06:14:41 DEBUG : file1: reading active writers 2024/04/26 06:14:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:42 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/04/26 06:14:42 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/04/26 06:14:42 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/04/26 06:14:42 DEBUG : : Looking for writers 2024/04/26 06:14:42 DEBUG : file1: reading active writers 2024/04/26 06:14:42 DEBUG : file2: reading active writers 2024/04/26 06:14:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:43 DEBUG : : Looking for writers 2024/04/26 06:14:43 DEBUG : file1: reading active writers 2024/04/26 06:14:43 DEBUG : file2: reading active writers 2024/04/26 06:14:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:44 DEBUG : : Looking for writers 2024/04/26 06:14:44 DEBUG : file1: reading active writers 2024/04/26 06:14:44 DEBUG : file2: reading active writers 2024/04/26 06:14:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:45 DEBUG : : Looking for writers 2024/04/26 06:14:45 DEBUG : file1: reading active writers 2024/04/26 06:14:45 DEBUG : file2: reading active writers 2024/04/26 06:14:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:46 DEBUG : : Looking for writers 2024/04/26 06:14:46 DEBUG : file1: reading active writers 2024/04/26 06:14:46 DEBUG : file2: reading active writers 2024/04/26 06:14:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:47 DEBUG : : Looking for writers 2024/04/26 06:14:47 DEBUG : file1: reading active writers 2024/04/26 06:14:47 DEBUG : file2: reading active writers 2024/04/26 06:14:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:48 DEBUG : file2: vfs cache: starting upload 2024/04/26 06:14:48 DEBUG : : Looking for writers 2024/04/26 06:14:48 DEBUG : file1: reading active writers 2024/04/26 06:14:48 DEBUG : file2: reading active writers 2024/04/26 06:14:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:48 DEBUG : file1: vfs cache: starting upload 2024/04/26 06:14:49 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c91f204a4c57c00d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:49 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c91f204a4c57c00d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:49 DEBUG : : Looking for writers 2024/04/26 06:14:49 DEBUG : file2: reading active writers 2024/04/26 06:14:49 DEBUG : file1: reading active writers 2024/04/26 06:14:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:50 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ba024c368b28c7f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:50 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ba024c368b28c7f2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:50 DEBUG : : Looking for writers 2024/04/26 06:14:50 DEBUG : file1: reading active writers 2024/04/26 06:14:50 DEBUG : file2: reading active writers 2024/04/26 06:14:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/04/26 06:14:51 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0008983c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0001cd208 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824635609664} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970616114659850 ext:214887722967 loc:0x3a12660} ATime:{wall:13943970616114938773 ext:214888001879 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0008983c0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0001cd508 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824635610432} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13943970616115788967 ext:214888852084 loc:0x3a12660} ATime:{wall:13943970616115947344 ext:214889010461 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/04/26 06:14:51 DEBUG : >WaitForWriters: 2024/04/26 06:14:51 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (69.62s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:14:51 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:14:51 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:14:51 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:51 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:51 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:51 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "452aa3d9b4a92de4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:52 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:14:52 DEBUG : : Looking for writers 2024/04/26 06:14:52 DEBUG : >WaitForWriters: 2024/04/26 06:14:52 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (1.01s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:14:52 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:14:52 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:14:52 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:52 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:52 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1ebd6fc6311fbf8a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:53 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:14:53 DEBUG : : Looking for writers 2024/04/26 06:14:53 DEBUG : >WaitForWriters: 2024/04/26 06:14:53 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (1.01s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:14:53 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:14:53 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/04/26 06:14:53 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:53 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-wubisab8bavuwub5fomayus7" 2024/04/26 06:14:53 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:14:53 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/04/26 06:14:54 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:14:54 DEBUG : file1: newRWFileHandle: 2024/04/26 06:14:54 DEBUG : file1(0xc00052ab40): openPending: 2024/04/26 06:14:54 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/04/26 06:14:54 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:14:54 DEBUG : file1(0xc00052ab40): >openPending: err= 2024/04/26 06:14:54 DEBUG : file1: >newRWFileHandle: err= 2024/04/26 06:14:54 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:14:54 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/04/26 06:14:54 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9d53689afcbdceed", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:14:54 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:14:54 DEBUG : : Looking for writers 2024/04/26 06:14:54 DEBUG : file1: reading active writers 2024/04/26 06:14:54 DEBUG : file1: active writers 1 2024/04/26 06:14:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/04/26 06:14:54 DEBUG : : Looking for writers 2024/04/26 06:14:54 DEBUG : file1: reading active writers 2024/04/26 06:14:54 DEBUG : file1: active writers 1 2024/04/26 06:14:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/04/26 06:14:54 DEBUG : : Looking for writers 2024/04/26 06:14:54 DEBUG : file1: reading active writers 2024/04/26 06:14:54 DEBUG : file1: active writers 1 2024/04/26 06:14:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/04/26 06:14:55 DEBUG : : Looking for writers 2024/04/26 06:14:55 DEBUG : file1: reading active writers 2024/04/26 06:14:55 DEBUG : file1: active writers 1 2024/04/26 06:14:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/04/26 06:14:55 DEBUG : : Looking for writers 2024/04/26 06:14:55 DEBUG : file1: reading active writers 2024/04/26 06:14:55 DEBUG : file1: active writers 1 2024/04/26 06:14:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/04/26 06:14:55 DEBUG : : Looking for writers 2024/04/26 06:14:55 DEBUG : file1: reading active writers 2024/04/26 06:14:55 DEBUG : file1: active writers 1 2024/04/26 06:14:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/04/26 06:14:55 DEBUG : : Looking for writers 2024/04/26 06:14:55 DEBUG : file1: reading active writers 2024/04/26 06:14:55 DEBUG : file1: active writers 1 2024/04/26 06:14:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/04/26 06:14:56 DEBUG : : Looking for writers 2024/04/26 06:14:56 DEBUG : file1: reading active writers 2024/04/26 06:14:56 DEBUG : file1: active writers 1 2024/04/26 06:14:56 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:14:57 DEBUG : : Looking for writers 2024/04/26 06:14:57 DEBUG : file1: reading active writers 2024/04/26 06:14:57 DEBUG : file1: active writers 1 2024/04/26 06:14:57 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:14:58 DEBUG : : Looking for writers 2024/04/26 06:14:58 DEBUG : file1: reading active writers 2024/04/26 06:14:58 DEBUG : file1: active writers 1 2024/04/26 06:14:58 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:14:59 DEBUG : : Looking for writers 2024/04/26 06:14:59 DEBUG : file1: reading active writers 2024/04/26 06:14:59 DEBUG : file1: active writers 1 2024/04/26 06:14:59 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:00 DEBUG : : Looking for writers 2024/04/26 06:15:00 DEBUG : file1: reading active writers 2024/04/26 06:15:00 DEBUG : file1: active writers 1 2024/04/26 06:15:00 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:01 DEBUG : : Looking for writers 2024/04/26 06:15:01 DEBUG : file1: reading active writers 2024/04/26 06:15:01 DEBUG : file1: active writers 1 2024/04/26 06:15:01 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:02 DEBUG : : Looking for writers 2024/04/26 06:15:02 DEBUG : file1: reading active writers 2024/04/26 06:15:02 DEBUG : file1: active writers 1 2024/04/26 06:15:02 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:03 DEBUG : : Looking for writers 2024/04/26 06:15:03 DEBUG : file1: reading active writers 2024/04/26 06:15:03 DEBUG : file1: active writers 1 2024/04/26 06:15:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:04 DEBUG : : Looking for writers 2024/04/26 06:15:04 DEBUG : file1: reading active writers 2024/04/26 06:15:04 DEBUG : file1: active writers 1 2024/04/26 06:15:04 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:05 DEBUG : : Looking for writers 2024/04/26 06:15:05 DEBUG : file1: reading active writers 2024/04/26 06:15:05 DEBUG : file1: active writers 1 2024/04/26 06:15:05 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:06 DEBUG : : Looking for writers 2024/04/26 06:15:06 DEBUG : file1: reading active writers 2024/04/26 06:15:06 DEBUG : file1: active writers 1 2024/04/26 06:15:06 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:07 DEBUG : : Looking for writers 2024/04/26 06:15:07 DEBUG : file1: reading active writers 2024/04/26 06:15:07 DEBUG : file1: active writers 1 2024/04/26 06:15:07 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:08 DEBUG : : Looking for writers 2024/04/26 06:15:08 DEBUG : file1: reading active writers 2024/04/26 06:15:08 DEBUG : file1: active writers 1 2024/04/26 06:15:08 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:09 DEBUG : : Looking for writers 2024/04/26 06:15:09 DEBUG : file1: reading active writers 2024/04/26 06:15:09 DEBUG : file1: active writers 1 2024/04/26 06:15:09 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:10 DEBUG : : Looking for writers 2024/04/26 06:15:10 DEBUG : file1: reading active writers 2024/04/26 06:15:10 DEBUG : file1: active writers 1 2024/04/26 06:15:10 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:11 DEBUG : : Looking for writers 2024/04/26 06:15:11 DEBUG : file1: reading active writers 2024/04/26 06:15:11 DEBUG : file1: active writers 1 2024/04/26 06:15:11 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:12 DEBUG : : Looking for writers 2024/04/26 06:15:12 DEBUG : file1: reading active writers 2024/04/26 06:15:12 DEBUG : file1: active writers 1 2024/04/26 06:15:12 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:13 DEBUG : : Looking for writers 2024/04/26 06:15:13 DEBUG : file1: reading active writers 2024/04/26 06:15:13 DEBUG : file1: active writers 1 2024/04/26 06:15:13 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:14 DEBUG : : Looking for writers 2024/04/26 06:15:14 DEBUG : file1: reading active writers 2024/04/26 06:15:14 DEBUG : file1: active writers 1 2024/04/26 06:15:14 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:15 DEBUG : : Looking for writers 2024/04/26 06:15:15 DEBUG : file1: reading active writers 2024/04/26 06:15:15 DEBUG : file1: active writers 1 2024/04/26 06:15:15 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:16 DEBUG : : Looking for writers 2024/04/26 06:15:16 DEBUG : file1: reading active writers 2024/04/26 06:15:16 DEBUG : file1: active writers 1 2024/04/26 06:15:16 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:17 DEBUG : : Looking for writers 2024/04/26 06:15:17 DEBUG : file1: reading active writers 2024/04/26 06:15:17 DEBUG : file1: active writers 1 2024/04/26 06:15:17 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:18 DEBUG : : Looking for writers 2024/04/26 06:15:18 DEBUG : file1: reading active writers 2024/04/26 06:15:18 DEBUG : file1: active writers 1 2024/04/26 06:15:18 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:19 DEBUG : : Looking for writers 2024/04/26 06:15:19 DEBUG : file1: reading active writers 2024/04/26 06:15:19 DEBUG : file1: active writers 1 2024/04/26 06:15:19 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:20 DEBUG : : Looking for writers 2024/04/26 06:15:20 DEBUG : file1: reading active writers 2024/04/26 06:15:20 DEBUG : file1: active writers 1 2024/04/26 06:15:20 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:21 DEBUG : : Looking for writers 2024/04/26 06:15:21 DEBUG : file1: reading active writers 2024/04/26 06:15:21 DEBUG : file1: active writers 1 2024/04/26 06:15:21 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:22 DEBUG : : Looking for writers 2024/04/26 06:15:22 DEBUG : file1: reading active writers 2024/04/26 06:15:22 DEBUG : file1: active writers 1 2024/04/26 06:15:22 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:23 DEBUG : : Looking for writers 2024/04/26 06:15:23 DEBUG : file1: reading active writers 2024/04/26 06:15:23 DEBUG : file1: active writers 1 2024/04/26 06:15:23 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:24 DEBUG : : Looking for writers 2024/04/26 06:15:24 DEBUG : file1: reading active writers 2024/04/26 06:15:24 DEBUG : file1: active writers 1 2024/04/26 06:15:24 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/04/26 06:15:24 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0008441e0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0001cdb08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824635611968} name:file1 opens:1 downloaders: o: fd:0xc0008884b0 info:{ModTime:{wall:13943970693068637896 ext:286532289654 loc:0x3a12660} ATime:{wall:13943970693068637896 ext:286532289654 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/04/26 06:15:24 DEBUG : >WaitForWriters: 2024/04/26 06:15:24 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.31s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "10d906490f7d9f16", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (1.53s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f89dd37a23b29bab", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (1.00s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:15:27 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:15:27 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b0ad387933608aea", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:28 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:15:28 DEBUG : : Looking for writers 2024/04/26 06:15:28 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (1.00s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:15:28 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:15:28 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3fe04fa3e6b8ac48", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:29 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:15:29 DEBUG : : Looking for writers 2024/04/26 06:15:29 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (1.00s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:15:29 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:15:29 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "978e76600e526754", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:31 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:15:31 DEBUG : : Looking for writers 2024/04/26 06:15:31 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (1.54s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:15:31 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:15:31 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "59c5b2be1f9d6747", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:32 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:15:32 DEBUG : : Looking for writers 2024/04/26 06:15:32 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (1.00s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:15:32 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:15:32 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:15:32 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:15:33 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:15:33 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:15:33 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:15:33 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:15:33 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:15:33 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/26 06:15:33 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/04/26 06:15:33 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/04/26 06:15:33 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (5 bytes), uploading instead of streaming 2024/04/26 06:15:34 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9dd0649816e2e121", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:34 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9dd0649816e2e121", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:34 DEBUG : file1: Remove: 2024/04/26 06:15:34 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:15:34 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9dd0649816e2e121", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/04/26 06:15:44 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:15:44 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:15:44 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:15:44 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:15:44 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:15:44 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:15:44 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:15:45 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d4e086a88a2e5491", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:45 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d4e086a88a2e5491", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:15:45 DEBUG : file1: Remove: 2024/04/26 06:15:45 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:15:45 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d4e086a88a2e5491", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/04/26 06:15:45 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:15:45 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:15:45 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:15:45 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:15:45 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:15:45 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/04/26 06:15:45 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/04/26 06:15:45 DEBUG : : Looking for writers 2024/04/26 06:15:45 DEBUG : file1: reading active writers 2024/04/26 06:15:45 DEBUG : file1: active writers 1 2024/04/26 06:15:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/04/26 06:15:46 DEBUG : : Looking for writers 2024/04/26 06:15:46 DEBUG : file1: reading active writers 2024/04/26 06:15:46 DEBUG : file1: active writers 1 2024/04/26 06:15:46 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:47 DEBUG : : Looking for writers 2024/04/26 06:15:47 DEBUG : file1: reading active writers 2024/04/26 06:15:47 DEBUG : file1: active writers 1 2024/04/26 06:15:47 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:48 DEBUG : : Looking for writers 2024/04/26 06:15:48 DEBUG : file1: reading active writers 2024/04/26 06:15:48 DEBUG : file1: active writers 1 2024/04/26 06:15:48 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:49 DEBUG : : Looking for writers 2024/04/26 06:15:49 DEBUG : file1: reading active writers 2024/04/26 06:15:49 DEBUG : file1: active writers 1 2024/04/26 06:15:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:50 DEBUG : : Looking for writers 2024/04/26 06:15:50 DEBUG : file1: reading active writers 2024/04/26 06:15:50 DEBUG : file1: active writers 1 2024/04/26 06:15:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:51 DEBUG : : Looking for writers 2024/04/26 06:15:51 DEBUG : file1: reading active writers 2024/04/26 06:15:51 DEBUG : file1: active writers 1 2024/04/26 06:15:51 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:52 DEBUG : : Looking for writers 2024/04/26 06:15:52 DEBUG : file1: reading active writers 2024/04/26 06:15:52 DEBUG : file1: active writers 1 2024/04/26 06:15:52 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:53 DEBUG : : Looking for writers 2024/04/26 06:15:53 DEBUG : file1: reading active writers 2024/04/26 06:15:53 DEBUG : file1: active writers 1 2024/04/26 06:15:53 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:54 DEBUG : : Looking for writers 2024/04/26 06:15:54 DEBUG : file1: reading active writers 2024/04/26 06:15:54 DEBUG : file1: active writers 1 2024/04/26 06:15:54 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:55 DEBUG : : Looking for writers 2024/04/26 06:15:55 DEBUG : file1: reading active writers 2024/04/26 06:15:55 DEBUG : file1: active writers 1 2024/04/26 06:15:55 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:56 DEBUG : : Looking for writers 2024/04/26 06:15:56 DEBUG : file1: reading active writers 2024/04/26 06:15:56 DEBUG : file1: active writers 1 2024/04/26 06:15:56 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:57 DEBUG : : Looking for writers 2024/04/26 06:15:57 DEBUG : file1: reading active writers 2024/04/26 06:15:57 DEBUG : file1: active writers 1 2024/04/26 06:15:57 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:58 DEBUG : : Looking for writers 2024/04/26 06:15:58 DEBUG : file1: reading active writers 2024/04/26 06:15:58 DEBUG : file1: active writers 1 2024/04/26 06:15:58 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:15:59 DEBUG : : Looking for writers 2024/04/26 06:15:59 DEBUG : file1: reading active writers 2024/04/26 06:15:59 DEBUG : file1: active writers 1 2024/04/26 06:15:59 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:00 DEBUG : : Looking for writers 2024/04/26 06:16:00 DEBUG : file1: reading active writers 2024/04/26 06:16:00 DEBUG : file1: active writers 1 2024/04/26 06:16:00 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:01 DEBUG : : Looking for writers 2024/04/26 06:16:01 DEBUG : file1: reading active writers 2024/04/26 06:16:01 DEBUG : file1: active writers 1 2024/04/26 06:16:01 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:02 DEBUG : : Looking for writers 2024/04/26 06:16:02 DEBUG : file1: reading active writers 2024/04/26 06:16:02 DEBUG : file1: active writers 1 2024/04/26 06:16:02 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:03 DEBUG : : Looking for writers 2024/04/26 06:16:03 DEBUG : file1: reading active writers 2024/04/26 06:16:03 DEBUG : file1: active writers 1 2024/04/26 06:16:03 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:04 DEBUG : : Looking for writers 2024/04/26 06:16:04 DEBUG : file1: reading active writers 2024/04/26 06:16:04 DEBUG : file1: active writers 1 2024/04/26 06:16:04 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:05 DEBUG : : Looking for writers 2024/04/26 06:16:05 DEBUG : file1: reading active writers 2024/04/26 06:16:05 DEBUG : file1: active writers 1 2024/04/26 06:16:05 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:06 DEBUG : : Looking for writers 2024/04/26 06:16:06 DEBUG : file1: reading active writers 2024/04/26 06:16:06 DEBUG : file1: active writers 1 2024/04/26 06:16:06 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:07 DEBUG : : Looking for writers 2024/04/26 06:16:07 DEBUG : file1: reading active writers 2024/04/26 06:16:07 DEBUG : file1: active writers 1 2024/04/26 06:16:07 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:08 DEBUG : : Looking for writers 2024/04/26 06:16:08 DEBUG : file1: reading active writers 2024/04/26 06:16:08 DEBUG : file1: active writers 1 2024/04/26 06:16:08 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:09 DEBUG : : Looking for writers 2024/04/26 06:16:09 DEBUG : file1: reading active writers 2024/04/26 06:16:09 DEBUG : file1: active writers 1 2024/04/26 06:16:09 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:10 DEBUG : : Looking for writers 2024/04/26 06:16:10 DEBUG : file1: reading active writers 2024/04/26 06:16:10 DEBUG : file1: active writers 1 2024/04/26 06:16:10 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:11 DEBUG : : Looking for writers 2024/04/26 06:16:11 DEBUG : file1: reading active writers 2024/04/26 06:16:11 DEBUG : file1: active writers 1 2024/04/26 06:16:11 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:12 DEBUG : : Looking for writers 2024/04/26 06:16:12 DEBUG : file1: reading active writers 2024/04/26 06:16:12 DEBUG : file1: active writers 1 2024/04/26 06:16:12 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:13 DEBUG : : Looking for writers 2024/04/26 06:16:13 DEBUG : file1: reading active writers 2024/04/26 06:16:13 DEBUG : file1: active writers 1 2024/04/26 06:16:13 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:14 DEBUG : : Looking for writers 2024/04/26 06:16:14 DEBUG : file1: reading active writers 2024/04/26 06:16:14 DEBUG : file1: active writers 1 2024/04/26 06:16:14 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/04/26 06:16:15 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/04/26 06:16:15 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (43.20s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:16:15 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:16:15 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:16:15 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:16:15 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:16:15 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:15 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:16:15 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:16:15 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:15 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/04/26 06:16:16 DEBUG : file1: aborting in-sequence write wait, off=100 2024/04/26 06:16:16 DEBUG : file1: failed to wait for in-sequence write to 100 2024/04/26 06:16:16 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/04/26 06:16:16 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (11 bytes), uploading instead of streaming 2024/04/26 06:16:18 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ca00a7ffa3d2095c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:18 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ca00a7ffa3d2095c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:18 DEBUG : file1: Remove: 2024/04/26 06:16:18 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:16:18 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ca00a7ffa3d2095c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/04/26 06:16:18 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:299: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:197: Not found "file1" fstest.go:200: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:200 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:304 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/04/26 06:16:27 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:27 DEBUG : : Looking for writers 2024/04/26 06:16:27 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (12.17s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:16:27 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:16:27 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:16:27 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:16:28 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:16:28 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:28 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:16:28 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:16:28 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/04/26 06:16:28 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:28 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (5 bytes), uploading instead of streaming 2024/04/26 06:16:29 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9b0f3adc8d3c0143", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:29 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9b0f3adc8d3c0143", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:29 DEBUG : file1: Remove: 2024/04/26 06:16:29 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:16:29 DEBUG : file1: >Remove: err= 2024/04/26 06:16:29 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9b0f3adc8d3c0143", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9b0f3adc8d3c0143", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/04/26 06:16:29 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/04/26 06:16:29 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:29 DEBUG : : Looking for writers 2024/04/26 06:16:29 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (2.51s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:16:30 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:16:30 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:16:30 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:16:30 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:16:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:30 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:16:30 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:16:30 DEBUG : file1: WriteFileHandle.Release closing 2024/04/26 06:16:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:30 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:16:31 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d210426b67521f08", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:31 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d210426b67521f08", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:31 DEBUG : file1: Remove: 2024/04/26 06:16:31 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:16:31 DEBUG : file1: >Remove: err= 2024/04/26 06:16:31 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d210426b67521f08", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d210426b67521f08", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/04/26 06:16:31 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/04/26 06:16:31 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:31 DEBUG : : Looking for writers 2024/04/26 06:16:31 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.30s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:16:31 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:16:31 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:16:31 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:16:31 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:16:31 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:31 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:16:31 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:16:31 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:31 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (2 bytes), uploading instead of streaming 2024/04/26 06:16:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "83e28f28a7175ffa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:32 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "83e28f28a7175ffa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:32 DEBUG : file1: Remove: 2024/04/26 06:16:32 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:16:32 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "83e28f28a7175ffa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/04/26 06:16:32 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:32 DEBUG : : Looking for writers 2024/04/26 06:16:32 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.84s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:16:33 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:16:33 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:16:33 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:16:36 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:16:36 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:36 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:16:36 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:16:36 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:36 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (0 bytes), uploading instead of streaming 2024/04/26 06:16:37 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "280fb4bffffaeed6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:37 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "280fb4bffffaeed6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:37 DEBUG : file1: Remove: 2024/04/26 06:16:37 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:16:37 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "280fb4bffffaeed6", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/04/26 06:16:37 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/26 06:16:37 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/04/26 06:16:37 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:37 DEBUG : : Looking for writers 2024/04/26 06:16:37 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (4.70s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-wubisab8bavuwub5fomayus7", Local "Local file system at /tmp/rclone2381060657", Modify Window "876000h0m0s" 2024/04/26 06:16:38 INFO : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: poll-interval is not supported by this remote 2024/04/26 06:16:38 NOTICE: QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/04/26 06:16:38 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/04/26 06:16:38 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/04/26 06:16:38 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:38 DEBUG : file1: >Open: fd=file1 (w), err= 2024/04/26 06:16:38 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/04/26 06:16:38 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/04/26 06:16:38 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: File to upload is small (100 bytes), uploading instead of streaming 2024/04/26 06:16:39 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e9a2861ae490f82f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:39 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e9a2861ae490f82f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:39 DEBUG : file1: Remove: 2024/04/26 06:16:39 DEBUG : : Added virtual directory entry vDel: "file1" 2024/04/26 06:16:39 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e9a2861ae490f82f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/04/26 06:16:39 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/04/26 06:16:39 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/04/26 06:16:39 DEBUG : WaitForWriters: timeout=30s 2024/04/26 06:16:39 DEBUG : : Looking for writers 2024/04/26 06:16:39 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.94s) FAIL 2024/04/26 06:16:40 DEBUG : QingStor bucket rclone-test-wubisab8bavuwub5fomayus7: Purge dir "" 2024/04/26 06:16:41 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "07ba11ba097e6d92", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/04/26 06:16:41 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 6m33.457862608s (try 3/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]