"./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Starting (try 4/5) 2024/05/06 03:49:33 DEBUG : Creating backend with remote "TestQingStor:rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:33 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/05/06 03:49:33 DEBUG : Creating backend with remote "/tmp/rclone1757340506" === RUN TestDirHandleMethods run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:33 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:33 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4993d0f12b17e4dc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:34 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:34 DEBUG : : Looking for writers 2024/05/06 03:49:34 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleMethods (1.93s) === RUN TestDirHandleReaddir run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:35 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:35 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5cf817e46656df73", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:35 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:35 DEBUG : : Looking for writers 2024/05/06 03:49:35 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddir (0.83s) === RUN TestDirHandleReaddirnames run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:35 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:35 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6384dae52ddea808", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:36 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:36 DEBUG : : Looking for writers 2024/05/06 03:49:36 DEBUG : >WaitForWriters: --- FAIL: TestDirHandleReaddirnames (0.82s) === RUN TestDirMethods run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:36 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:36 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "68c56539ec0a0f70", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:37 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:37 DEBUG : : Looking for writers 2024/05/06 03:49:37 DEBUG : >WaitForWriters: --- FAIL: TestDirMethods (0.83s) === RUN TestDirForgetAll run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:37 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:37 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e90af3ab53923bec", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:38 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:38 DEBUG : : Looking for writers 2024/05/06 03:49:38 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetAll (0.82s) === RUN TestDirForgetPath run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:38 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:38 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "86a4f2a585a33280", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:39 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:39 DEBUG : : Looking for writers 2024/05/06 03:49:39 DEBUG : >WaitForWriters: --- FAIL: TestDirForgetPath (0.82s) === RUN TestDirWalk run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:39 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:39 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f74aa5f24811ef01", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:39 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:39 DEBUG : : Looking for writers 2024/05/06 03:49:39 DEBUG : >WaitForWriters: --- FAIL: TestDirWalk (0.83s) === RUN TestDirSetModTime run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:40 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:40 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d7cb822c3f40d2c4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:40 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:40 DEBUG : : Looking for writers 2024/05/06 03:49:40 DEBUG : >WaitForWriters: --- FAIL: TestDirSetModTime (0.83s) === RUN TestDirStat run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:40 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:40 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "94bae8af779bdea0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:41 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:41 DEBUG : : Looking for writers 2024/05/06 03:49:41 DEBUG : >WaitForWriters: --- FAIL: TestDirStat (0.83s) === RUN TestDirReadDirAll run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:41 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:41 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d438461a55058dcb", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:42 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:42 DEBUG : : Looking for writers 2024/05/06 03:49:42 DEBUG : >WaitForWriters: --- FAIL: TestDirReadDirAll (0.83s) === RUN TestDirOpen run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:42 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:42 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9101524d4ec265b2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:43 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:43 DEBUG : : Looking for writers 2024/05/06 03:49:43 DEBUG : >WaitForWriters: --- FAIL: TestDirOpen (0.83s) === RUN TestDirCreate run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:43 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:43 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a31fe7b2162736a8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:44 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:44 DEBUG : : Looking for writers 2024/05/06 03:49:44 DEBUG : >WaitForWriters: --- FAIL: TestDirCreate (0.83s) === RUN TestDirMkdir run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:44 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:44 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "430a17548d04bdd0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:44 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:44 DEBUG : : Looking for writers 2024/05/06 03:49:44 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdir (0.83s) === RUN TestDirMkdirSub run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:45 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:45 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3c84c5dc57227c0f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:45 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:45 DEBUG : : Looking for writers 2024/05/06 03:49:45 DEBUG : >WaitForWriters: --- FAIL: TestDirMkdirSub (0.83s) === RUN TestDirRemove run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:45 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:45 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "268fd8d145044e47", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:46 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:46 DEBUG : : Looking for writers 2024/05/06 03:49:46 DEBUG : >WaitForWriters: --- FAIL: TestDirRemove (0.83s) === RUN TestDirRemoveAll run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:46 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:46 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7f7dd1360db6d07d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:47 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:47 DEBUG : : Looking for writers 2024/05/06 03:49:47 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveAll (0.82s) === RUN TestDirRemoveName run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:47 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:47 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7cf9b90d7e74d853", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:48 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:48 DEBUG : : Looking for writers 2024/05/06 03:49:48 DEBUG : >WaitForWriters: --- FAIL: TestDirRemoveName (0.83s) === RUN TestDirRename run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:48 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:48 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "38b5a4c5c16b03cf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:48 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:48 DEBUG : : Looking for writers 2024/05/06 03:49:48 DEBUG : >WaitForWriters: --- FAIL: TestDirRename (0.83s) === RUN TestFileMethods run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:49 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:49 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "781a643e47154ad1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:49 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:49 DEBUG : : Looking for writers 2024/05/06 03:49:49 DEBUG : >WaitForWriters: --- FAIL: TestFileMethods (0.82s) === RUN TestFileSetModTime === RUN TestFileSetModTime/cache=off,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:50 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:50 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "63702bdcd287a9c3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:50 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:50 DEBUG : : Looking for writers 2024/05/06 03:49:50 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:50 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:50 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "043f3296c27fbbd3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:51 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:51 DEBUG : : Looking for writers 2024/05/06 03:49:51 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=off,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:51 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:51 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ce40b0628ea507f3", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:52 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:52 DEBUG : : Looking for writers 2024/05/06 03:49:52 DEBUG : >WaitForWriters: === RUN TestFileSetModTime/cache=full,open=false,write=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:52 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:52 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:49:52 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:52 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:52 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:52 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e58ddd17d936fdb9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:53 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:53 DEBUG : : Looking for writers 2024/05/06 03:49:53 DEBUG : >WaitForWriters: 2024/05/06 03:49:53 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:53 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:53 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:49:53 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:53 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:53 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:53 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "818b2b810a700b9c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:53 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:53 DEBUG : : Looking for writers 2024/05/06 03:49:53 DEBUG : >WaitForWriters: 2024/05/06 03:49:53 DEBUG : vfs cache: cleaner exiting === RUN TestFileSetModTime/cache=full,open=true,write=true run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:54 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:54 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:49:54 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:54 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:54 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:54 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5a118fdc6f1aade9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:54 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:54 DEBUG : : Looking for writers 2024/05/06 03:49:54 DEBUG : >WaitForWriters: 2024/05/06 03:49:54 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileSetModTime (4.97s) --- FAIL: TestFileSetModTime/cache=off,open=false,write=false (0.83s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=false (0.82s) --- FAIL: TestFileSetModTime/cache=off,open=true,write=true (0.83s) --- FAIL: TestFileSetModTime/cache=full,open=false,write=false (0.83s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=false (0.83s) --- FAIL: TestFileSetModTime/cache=full,open=true,write=true (0.83s) === RUN TestFileOpenRead run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:54 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:54 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fc66c4826c749064", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:55 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:55 DEBUG : : Looking for writers 2024/05/06 03:49:55 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenRead (0.83s) === RUN TestFileOpenWrite run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:55 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:55 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "52464810365c1796", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:56 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:56 DEBUG : : Looking for writers 2024/05/06 03:49:56 DEBUG : >WaitForWriters: --- FAIL: TestFileOpenWrite (0.82s) === RUN TestFileRemove run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:56 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:56 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f7ec36359e15d15e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:57 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:57 DEBUG : : Looking for writers 2024/05/06 03:49:57 DEBUG : >WaitForWriters: --- FAIL: TestFileRemove (0.82s) === RUN TestFileRemoveAll run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:57 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:57 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "618bffeb0d8a6955", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:58 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:58 DEBUG : : Looking for writers 2024/05/06 03:49:58 DEBUG : >WaitForWriters: --- FAIL: TestFileRemoveAll (0.83s) === RUN TestFileOpen run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:58 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:58 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dfa9891b7b43a811", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:58 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:58 DEBUG : : Looking for writers 2024/05/06 03:49:58 DEBUG : >WaitForWriters: --- FAIL: TestFileOpen (0.82s) === RUN TestFileRename === RUN TestFileRename/off,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:59 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:59 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8a8a1fce0ba74098", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:49:59 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:49:59 DEBUG : : Looking for writers 2024/05/06 03:49:59 DEBUG : >WaitForWriters: === RUN TestFileRename/minimal,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:49:59 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:49:59 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:49:59 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:49:59 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:59 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:59 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:49:59 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1a2c32508c6de98b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:00 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:00 DEBUG : : Looking for writers 2024/05/06 03:50:00 DEBUG : >WaitForWriters: 2024/05/06 03:50:00 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/minimal,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:00 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:00 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:50:00 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:00 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:00 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:00 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:00 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f06166a8ff66211b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:01 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:01 DEBUG : : Looking for writers 2024/05/06 03:50:01 DEBUG : >WaitForWriters: 2024/05/06 03:50:01 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:01 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:01 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:01 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:01 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:01 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:01 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:01 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0e25813395328d17", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:02 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:02 DEBUG : : Looking for writers 2024/05/06 03:50:02 DEBUG : >WaitForWriters: 2024/05/06 03:50:02 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/writes,forceCache=true run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:03 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:03 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:03 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:03 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:03 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:03 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:03 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7bea71d9d61dcd5e", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:03 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:03 DEBUG : : Looking for writers 2024/05/06 03:50:03 DEBUG : >WaitForWriters: 2024/05/06 03:50:03 DEBUG : vfs cache: cleaner exiting === RUN TestFileRename/full,forceCache=false run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:04 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:04 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:04 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:04 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:04 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:04 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:04 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5dcd984dd774d700", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:04 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:04 DEBUG : : Looking for writers 2024/05/06 03:50:04 DEBUG : >WaitForWriters: 2024/05/06 03:50:04 DEBUG : vfs cache: cleaner exiting --- FAIL: TestFileRename (5.71s) --- FAIL: TestFileRename/off,forceCache=false (0.83s) --- FAIL: TestFileRename/minimal,forceCache=false (0.83s) --- FAIL: TestFileRename/minimal,forceCache=true (0.83s) --- FAIL: TestFileRename/writes,forceCache=false (1.56s) --- FAIL: TestFileRename/writes,forceCache=true (0.83s) --- FAIL: TestFileRename/full,forceCache=false (0.83s) === RUN TestReadFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:04 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:04 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "60ceea05f3828128", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:05 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:05 DEBUG : : Looking for writers 2024/05/06 03:50:05 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleMethods (0.83s) === RUN TestReadFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:05 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:05 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0a49dee998e32ce2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:06 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:06 DEBUG : : Looking for writers 2024/05/06 03:50:06 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleSeek (0.83s) === RUN TestReadFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:06 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:06 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b860ce0c2400c63b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:07 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:07 DEBUG : : Looking for writers 2024/05/06 03:50:07 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleReadAt (0.83s) === RUN TestReadFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:07 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:07 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f78b7f2fb9d9ed54", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:07 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:07 DEBUG : : Looking for writers 2024/05/06 03:50:07 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleFlush (0.83s) === RUN TestReadFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:08 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:08 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c22ccdcd1fee881b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:08 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:08 DEBUG : : Looking for writers 2024/05/06 03:50:08 DEBUG : >WaitForWriters: --- FAIL: TestReadFileHandleRelease (0.83s) === RUN TestRWFileHandleMethodsRead run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:08 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:08 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:08 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:08 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:08 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:08 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:08 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8c08fd0d3ef61bbf", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:09 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:09 DEBUG : : Looking for writers 2024/05/06 03:50:09 DEBUG : >WaitForWriters: 2024/05/06 03:50:09 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsRead (0.83s) === RUN TestRWFileHandleSeek run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:09 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:09 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:09 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:09 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:09 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:09 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:09 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "92dec4011eb3b9dc", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:10 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:10 DEBUG : : Looking for writers 2024/05/06 03:50:10 DEBUG : >WaitForWriters: 2024/05/06 03:50:10 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSeek (0.83s) === RUN TestRWFileHandleReadAt run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:10 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:10 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:10 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:10 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:10 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:10 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:10 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1f331e10a53032e0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:11 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:11 DEBUG : : Looking for writers 2024/05/06 03:50:11 DEBUG : >WaitForWriters: 2024/05/06 03:50:11 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReadAt (0.83s) === RUN TestRWFileHandleFlushRead run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:11 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:11 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:11 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:11 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:11 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:11 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:11 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3c1ac2888d67e9ca", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:12 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:12 DEBUG : : Looking for writers 2024/05/06 03:50:12 DEBUG : >WaitForWriters: 2024/05/06 03:50:12 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleFlushRead (0.83s) === RUN TestRWFileHandleReleaseRead run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:12 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:12 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:12 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:12 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:12 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:12 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ed3f71d591a73ba", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:12 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:12 DEBUG : : Looking for writers 2024/05/06 03:50:12 DEBUG : >WaitForWriters: 2024/05/06 03:50:12 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleReleaseRead (0.82s) === RUN TestRWFileHandleMethodsWrite run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:50:13 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:50:13 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:50:13 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:13 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:13 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:13 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:50:13 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:50:13 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:50:13 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:50:13 DEBUG : file1: newRWFileHandle: 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): openPending: 2024/05/06 03:50:13 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:50:13 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): >openPending: err= 2024/05/06 03:50:13 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:50:13 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:50:13 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:50:13 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): _writeAt: size=5, off=0 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): >_writeAt: n=5, err= 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): _writeAt: size=7, off=5 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): >_writeAt: n=7, err= 2024/05/06 03:50:13 DEBUG : file1: vfs cache: truncate to size=11 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): close: 2024/05/06 03:50:13 DEBUG : file1: vfs cache: setting modification time to 2024-05-06 03:50:13.377735528 +0000 UTC m=+40.202423080 2024/05/06 03:50:13 INFO : file1: vfs cache: queuing for upload in 100ms 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): >close: err= 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): close: 2024/05/06 03:50:13 DEBUG : file1(0xc0009f7580): >close: err=file already closed 2024/05/06 03:50:13 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:13 DEBUG : : Looking for writers 2024/05/06 03:50:13 DEBUG : file1: reading active writers 2024/05/06 03:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:50:13 DEBUG : : Looking for writers 2024/05/06 03:50:13 DEBUG : file1: reading active writers 2024/05/06 03:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:50:13 DEBUG : : Looking for writers 2024/05/06 03:50:13 DEBUG : file1: reading active writers 2024/05/06 03:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:50:13 DEBUG : : Looking for writers 2024/05/06 03:50:13 DEBUG : file1: reading active writers 2024/05/06 03:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:50:13 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:13 DEBUG : : Looking for writers 2024/05/06 03:50:13 DEBUG : file1: reading active writers 2024/05/06 03:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:50:13 DEBUG : : Looking for writers 2024/05/06 03:50:13 DEBUG : file1: reading active writers 2024/05/06 03:50:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:50:14 DEBUG : : Looking for writers 2024/05/06 03:50:14 DEBUG : file1: reading active writers 2024/05/06 03:50:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:50:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "beb7881026d37c54", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:14 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "beb7881026d37c54", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:14 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:14 DEBUG : : Looking for writers 2024/05/06 03:50:14 DEBUG : file1: reading active writers 2024/05/06 03:50:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:14 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1bc887df644fa61a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:14 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1bc887df644fa61a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:15 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:15 DEBUG : : Looking for writers 2024/05/06 03:50:15 DEBUG : file1: reading active writers 2024/05/06 03:50:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:15 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f685c099db34761b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:15 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f685c099db34761b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:16 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:16 DEBUG : : Looking for writers 2024/05/06 03:50:16 DEBUG : file1: reading active writers 2024/05/06 03:50:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:17 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b0926b71547cc305", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:17 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b0926b71547cc305", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:17 DEBUG : : Looking for writers 2024/05/06 03:50:17 DEBUG : file1: reading active writers 2024/05/06 03:50:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:18 DEBUG : : Looking for writers 2024/05/06 03:50:18 DEBUG : file1: reading active writers 2024/05/06 03:50:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:18 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:19 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "be083a1e0ec63910", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:19 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "be083a1e0ec63910", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:19 DEBUG : : Looking for writers 2024/05/06 03:50:19 DEBUG : file1: reading active writers 2024/05/06 03:50:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:20 DEBUG : : Looking for writers 2024/05/06 03:50:20 DEBUG : file1: reading active writers 2024/05/06 03:50:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:21 DEBUG : : Looking for writers 2024/05/06 03:50:21 DEBUG : file1: reading active writers 2024/05/06 03:50:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:22 DEBUG : : Looking for writers 2024/05/06 03:50:22 DEBUG : file1: reading active writers 2024/05/06 03:50:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:22 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fe80213bcf52fed8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:23 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "fe80213bcf52fed8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:23 DEBUG : : Looking for writers 2024/05/06 03:50:23 DEBUG : file1: reading active writers 2024/05/06 03:50:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:24 DEBUG : : Looking for writers 2024/05/06 03:50:24 DEBUG : file1: reading active writers 2024/05/06 03:50:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:25 DEBUG : : Looking for writers 2024/05/06 03:50:25 DEBUG : file1: reading active writers 2024/05/06 03:50:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:26 DEBUG : : Looking for writers 2024/05/06 03:50:26 DEBUG : file1: reading active writers 2024/05/06 03:50:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:27 DEBUG : : Looking for writers 2024/05/06 03:50:27 DEBUG : file1: reading active writers 2024/05/06 03:50:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:28 DEBUG : : Looking for writers 2024/05/06 03:50:28 DEBUG : file1: reading active writers 2024/05/06 03:50:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:29 DEBUG : : Looking for writers 2024/05/06 03:50:29 DEBUG : file1: reading active writers 2024/05/06 03:50:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:29 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:30 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "95ada89625c24a1b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:30 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "95ada89625c24a1b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:30 DEBUG : : Looking for writers 2024/05/06 03:50:30 DEBUG : file1: reading active writers 2024/05/06 03:50:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:31 DEBUG : : Looking for writers 2024/05/06 03:50:31 DEBUG : file1: reading active writers 2024/05/06 03:50:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:32 DEBUG : : Looking for writers 2024/05/06 03:50:32 DEBUG : file1: reading active writers 2024/05/06 03:50:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:33 DEBUG : : Looking for writers 2024/05/06 03:50:33 DEBUG : file1: reading active writers 2024/05/06 03:50:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:34 DEBUG : : Looking for writers 2024/05/06 03:50:34 DEBUG : file1: reading active writers 2024/05/06 03:50:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:35 DEBUG : : Looking for writers 2024/05/06 03:50:35 DEBUG : file1: reading active writers 2024/05/06 03:50:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:36 DEBUG : : Looking for writers 2024/05/06 03:50:36 DEBUG : file1: reading active writers 2024/05/06 03:50:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:37 DEBUG : : Looking for writers 2024/05/06 03:50:37 DEBUG : file1: reading active writers 2024/05/06 03:50:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:38 DEBUG : : Looking for writers 2024/05/06 03:50:38 DEBUG : file1: reading active writers 2024/05/06 03:50:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:39 DEBUG : : Looking for writers 2024/05/06 03:50:39 DEBUG : file1: reading active writers 2024/05/06 03:50:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:40 DEBUG : : Looking for writers 2024/05/06 03:50:40 DEBUG : file1: reading active writers 2024/05/06 03:50:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:41 DEBUG : : Looking for writers 2024/05/06 03:50:41 DEBUG : file1: reading active writers 2024/05/06 03:50:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:42 DEBUG : : Looking for writers 2024/05/06 03:50:42 DEBUG : file1: reading active writers 2024/05/06 03:50:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:43 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:50:43 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0000f8c30 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000b4e908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645577024} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889084981004648 ext:40202423080 loc:0x3a12660} ATime:{wall:13944889084981051997 ext:40202470418 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:50:43 DEBUG : >WaitForWriters: fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 2024/05/06 03:50:43 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "94433afa26f3638b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:50:43 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "94433afa26f3638b", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Should be true Test: TestRWFileHandleMethodsWrite Messages: listing wrong, want file1 (11) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:337 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleMethodsWrite Messages: 1 objects not found 2024/05/06 03:50:51 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:50:51 DEBUG : : Looking for writers 2024/05/06 03:50:51 DEBUG : file1: reading active writers 2024/05/06 03:50:51 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:50:52 DEBUG : : Looking for writers 2024/05/06 03:50:52 DEBUG : file1: reading active writers 2024/05/06 03:50:52 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:53 DEBUG : : Looking for writers 2024/05/06 03:50:53 DEBUG : file1: reading active writers 2024/05/06 03:50:53 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:54 DEBUG : : Looking for writers 2024/05/06 03:50:54 DEBUG : file1: reading active writers 2024/05/06 03:50:54 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:55 DEBUG : : Looking for writers 2024/05/06 03:50:55 DEBUG : file1: reading active writers 2024/05/06 03:50:55 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:56 DEBUG : : Looking for writers 2024/05/06 03:50:56 DEBUG : file1: reading active writers 2024/05/06 03:50:56 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:57 DEBUG : : Looking for writers 2024/05/06 03:50:57 DEBUG : file1: reading active writers 2024/05/06 03:50:57 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:58 DEBUG : : Looking for writers 2024/05/06 03:50:58 DEBUG : file1: reading active writers 2024/05/06 03:50:58 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:50:59 DEBUG : : Looking for writers 2024/05/06 03:50:59 DEBUG : file1: reading active writers 2024/05/06 03:50:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:00 DEBUG : : Looking for writers 2024/05/06 03:51:00 DEBUG : file1: reading active writers 2024/05/06 03:51:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:01 DEBUG : : Looking for writers 2024/05/06 03:51:01 DEBUG : file1: reading active writers 2024/05/06 03:51:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:02 DEBUG : : Looking for writers 2024/05/06 03:51:02 DEBUG : file1: reading active writers 2024/05/06 03:51:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:03 DEBUG : : Looking for writers 2024/05/06 03:51:03 DEBUG : file1: reading active writers 2024/05/06 03:51:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:04 DEBUG : : Looking for writers 2024/05/06 03:51:04 DEBUG : file1: reading active writers 2024/05/06 03:51:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:05 DEBUG : : Looking for writers 2024/05/06 03:51:05 DEBUG : file1: reading active writers 2024/05/06 03:51:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:06 DEBUG : : Looking for writers 2024/05/06 03:51:06 DEBUG : file1: reading active writers 2024/05/06 03:51:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:07 DEBUG : : Looking for writers 2024/05/06 03:51:07 DEBUG : file1: reading active writers 2024/05/06 03:51:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:08 DEBUG : : Looking for writers 2024/05/06 03:51:08 DEBUG : file1: reading active writers 2024/05/06 03:51:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:09 DEBUG : : Looking for writers 2024/05/06 03:51:09 DEBUG : file1: reading active writers 2024/05/06 03:51:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:09 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0bc9b34d5a8ea407", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:10 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "0bc9b34d5a8ea407", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:10 DEBUG : : Looking for writers 2024/05/06 03:51:10 DEBUG : file1: reading active writers 2024/05/06 03:51:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:11 DEBUG : : Looking for writers 2024/05/06 03:51:11 DEBUG : file1: reading active writers 2024/05/06 03:51:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:12 DEBUG : : Looking for writers 2024/05/06 03:51:12 DEBUG : file1: reading active writers 2024/05/06 03:51:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:13 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/05/06 03:51:13 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/05/06 03:51:13 DEBUG : : Looking for writers 2024/05/06 03:51:13 DEBUG : file1: reading active writers 2024/05/06 03:51:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:14 DEBUG : : Looking for writers 2024/05/06 03:51:14 DEBUG : file1: reading active writers 2024/05/06 03:51:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:15 DEBUG : : Looking for writers 2024/05/06 03:51:15 DEBUG : file1: reading active writers 2024/05/06 03:51:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:16 DEBUG : : Looking for writers 2024/05/06 03:51:16 DEBUG : file1: reading active writers 2024/05/06 03:51:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:17 DEBUG : : Looking for writers 2024/05/06 03:51:17 DEBUG : file1: reading active writers 2024/05/06 03:51:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:18 DEBUG : : Looking for writers 2024/05/06 03:51:18 DEBUG : file1: reading active writers 2024/05/06 03:51:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:19 DEBUG : : Looking for writers 2024/05/06 03:51:19 DEBUG : file1: reading active writers 2024/05/06 03:51:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:20 DEBUG : : Looking for writers 2024/05/06 03:51:20 DEBUG : file1: reading active writers 2024/05/06 03:51:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:21 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0000f8c30 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc000b4e908 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824645577024} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889084981004648 ext:40202423080 loc:0x3a12660} ATime:{wall:13944889084981051997 ext:40202470418 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:51:21 DEBUG : >WaitForWriters: 2024/05/06 03:51:21 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleMethodsWrite (68.29s) === RUN TestRWFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:51:21 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:51:21 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:51:21 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:51:21 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:51:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:51:21 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:51:21 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:51:21 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:51:21 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:51:21 DEBUG : file1: newRWFileHandle: 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): openPending: 2024/05/06 03:51:21 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:51:21 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): >openPending: err= 2024/05/06 03:51:21 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:51:21 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:51:21 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:51:21 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): _writeAt: size=7, off=0 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): >_writeAt: n=7, err= 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): _writeAt: size=6, off=5 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): >_writeAt: n=6, err= 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): close: 2024/05/06 03:51:21 DEBUG : file1: vfs cache: setting modification time to 2024-05-06 03:51:21.683310343 +0000 UTC m=+108.507997854 2024/05/06 03:51:21 INFO : file1: vfs cache: queuing for upload in 100ms 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): >close: err= 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): _writeAt: size=5, off=0 2024/05/06 03:51:21 DEBUG : file1(0xc0007762c0): >_writeAt: n=0, err=file already closed 2024/05/06 03:51:21 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:51:21 DEBUG : : Looking for writers 2024/05/06 03:51:21 DEBUG : file1: reading active writers 2024/05/06 03:51:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:51:21 DEBUG : : Looking for writers 2024/05/06 03:51:21 DEBUG : file1: reading active writers 2024/05/06 03:51:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:51:21 DEBUG : : Looking for writers 2024/05/06 03:51:21 DEBUG : file1: reading active writers 2024/05/06 03:51:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:51:21 DEBUG : : Looking for writers 2024/05/06 03:51:21 DEBUG : file1: reading active writers 2024/05/06 03:51:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:51:21 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:21 DEBUG : : Looking for writers 2024/05/06 03:51:21 DEBUG : file1: reading active writers 2024/05/06 03:51:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:51:21 DEBUG : : Looking for writers 2024/05/06 03:51:21 DEBUG : file1: reading active writers 2024/05/06 03:51:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:51:22 DEBUG : : Looking for writers 2024/05/06 03:51:22 DEBUG : file1: reading active writers 2024/05/06 03:51:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:51:22 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c0922964599b8142", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:22 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c0922964599b8142", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:22 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:22 DEBUG : : Looking for writers 2024/05/06 03:51:22 DEBUG : file1: reading active writers 2024/05/06 03:51:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:23 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "88ba91bc060db890", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:23 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "88ba91bc060db890", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:23 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:23 DEBUG : : Looking for writers 2024/05/06 03:51:23 DEBUG : file1: reading active writers 2024/05/06 03:51:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:24 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "996d91b33a3622c5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:24 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "996d91b33a3622c5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:24 DEBUG : : Looking for writers 2024/05/06 03:51:24 DEBUG : file1: reading active writers 2024/05/06 03:51:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:25 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:25 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "baf4f0aa72137496", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:25 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "baf4f0aa72137496", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:25 DEBUG : : Looking for writers 2024/05/06 03:51:25 DEBUG : file1: reading active writers 2024/05/06 03:51:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:26 DEBUG : : Looking for writers 2024/05/06 03:51:26 DEBUG : file1: reading active writers 2024/05/06 03:51:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:27 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:27 DEBUG : : Looking for writers 2024/05/06 03:51:27 DEBUG : file1: reading active writers 2024/05/06 03:51:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:28 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e460b72a7d57adb9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:28 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e460b72a7d57adb9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:28 DEBUG : : Looking for writers 2024/05/06 03:51:28 DEBUG : file1: reading active writers 2024/05/06 03:51:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:29 DEBUG : : Looking for writers 2024/05/06 03:51:29 DEBUG : file1: reading active writers 2024/05/06 03:51:29 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:30 DEBUG : : Looking for writers 2024/05/06 03:51:30 DEBUG : file1: reading active writers 2024/05/06 03:51:30 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:31 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:31 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ab403dc96f13cb1f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:31 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ab403dc96f13cb1f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:31 DEBUG : : Looking for writers 2024/05/06 03:51:31 DEBUG : file1: reading active writers 2024/05/06 03:51:31 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:32 DEBUG : : Looking for writers 2024/05/06 03:51:32 DEBUG : file1: reading active writers 2024/05/06 03:51:32 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:33 DEBUG : : Looking for writers 2024/05/06 03:51:33 DEBUG : file1: reading active writers 2024/05/06 03:51:33 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:34 DEBUG : : Looking for writers 2024/05/06 03:51:34 DEBUG : file1: reading active writers 2024/05/06 03:51:34 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:35 DEBUG : : Looking for writers 2024/05/06 03:51:35 DEBUG : file1: reading active writers 2024/05/06 03:51:35 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:36 DEBUG : : Looking for writers 2024/05/06 03:51:36 DEBUG : file1: reading active writers 2024/05/06 03:51:36 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:37 DEBUG : : Looking for writers 2024/05/06 03:51:37 DEBUG : file1: reading active writers 2024/05/06 03:51:37 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:38 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:51:38 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e0ad20f84ed86a4c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:38 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e0ad20f84ed86a4c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:38 DEBUG : : Looking for writers 2024/05/06 03:51:38 DEBUG : file1: reading active writers 2024/05/06 03:51:38 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:39 DEBUG : : Looking for writers 2024/05/06 03:51:39 DEBUG : file1: reading active writers 2024/05/06 03:51:39 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:40 DEBUG : : Looking for writers 2024/05/06 03:51:40 DEBUG : file1: reading active writers 2024/05/06 03:51:40 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:41 DEBUG : : Looking for writers 2024/05/06 03:51:41 DEBUG : file1: reading active writers 2024/05/06 03:51:41 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:42 DEBUG : : Looking for writers 2024/05/06 03:51:42 DEBUG : file1: reading active writers 2024/05/06 03:51:42 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:43 DEBUG : : Looking for writers 2024/05/06 03:51:43 DEBUG : file1: reading active writers 2024/05/06 03:51:43 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:44 DEBUG : : Looking for writers 2024/05/06 03:51:44 DEBUG : file1: reading active writers 2024/05/06 03:51:44 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:45 DEBUG : : Looking for writers 2024/05/06 03:51:45 DEBUG : file1: reading active writers 2024/05/06 03:51:45 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:46 DEBUG : : Looking for writers 2024/05/06 03:51:46 DEBUG : file1: reading active writers 2024/05/06 03:51:46 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:47 DEBUG : : Looking for writers 2024/05/06 03:51:47 DEBUG : file1: reading active writers 2024/05/06 03:51:47 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:48 DEBUG : : Looking for writers 2024/05/06 03:51:48 DEBUG : file1: reading active writers 2024/05/06 03:51:48 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:49 DEBUG : : Looking for writers 2024/05/06 03:51:49 DEBUG : file1: reading active writers 2024/05/06 03:51:49 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:50 DEBUG : : Looking for writers 2024/05/06 03:51:50 DEBUG : file1: reading active writers 2024/05/06 03:51:50 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:51:51 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0009f42d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0005f8408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639980608} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889158301023495 ext:108507997854 loc:0x3a12660} ATime:{wall:13944889158301035979 ext:108508010337 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:51:51 DEBUG : >WaitForWriters: 2024/05/06 03:51:51 DEBUG : file1: vfs cache: starting upload fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 2024/05/06 03:51:52 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f1e8fdcd286e6d56", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:51:52 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f1e8fdcd286e6d56", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Should be true Test: TestRWFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:387 Error: Not equal: expected: 0 actual : 1 Test: TestRWFileHandleWriteAt Messages: 1 objects not found 2024/05/06 03:51:59 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:51:59 DEBUG : : Looking for writers 2024/05/06 03:51:59 DEBUG : file1: reading active writers 2024/05/06 03:51:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:51:59 DEBUG : : Looking for writers 2024/05/06 03:51:59 DEBUG : file1: reading active writers 2024/05/06 03:51:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:51:59 DEBUG : : Looking for writers 2024/05/06 03:51:59 DEBUG : file1: reading active writers 2024/05/06 03:51:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:51:59 DEBUG : : Looking for writers 2024/05/06 03:51:59 DEBUG : file1: reading active writers 2024/05/06 03:51:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:51:59 DEBUG : : Looking for writers 2024/05/06 03:51:59 DEBUG : file1: reading active writers 2024/05/06 03:51:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:51:59 DEBUG : : Looking for writers 2024/05/06 03:51:59 DEBUG : file1: reading active writers 2024/05/06 03:51:59 DEBUG : Still 0 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:52:00 DEBUG : : Looking for writers 2024/05/06 03:52:00 DEBUG : file1: reading active writers 2024/05/06 03:52:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:52:00 DEBUG : : Looking for writers 2024/05/06 03:52:00 DEBUG : file1: reading active writers 2024/05/06 03:52:00 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:01 DEBUG : : Looking for writers 2024/05/06 03:52:01 DEBUG : file1: reading active writers 2024/05/06 03:52:01 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:02 DEBUG : : Looking for writers 2024/05/06 03:52:02 DEBUG : file1: reading active writers 2024/05/06 03:52:02 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:03 DEBUG : : Looking for writers 2024/05/06 03:52:03 DEBUG : file1: reading active writers 2024/05/06 03:52:03 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:04 DEBUG : : Looking for writers 2024/05/06 03:52:04 DEBUG : file1: reading active writers 2024/05/06 03:52:04 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:05 DEBUG : : Looking for writers 2024/05/06 03:52:05 DEBUG : file1: reading active writers 2024/05/06 03:52:05 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:06 DEBUG : : Looking for writers 2024/05/06 03:52:06 DEBUG : file1: reading active writers 2024/05/06 03:52:06 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:07 DEBUG : : Looking for writers 2024/05/06 03:52:07 DEBUG : file1: reading active writers 2024/05/06 03:52:07 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:08 DEBUG : : Looking for writers 2024/05/06 03:52:08 DEBUG : file1: reading active writers 2024/05/06 03:52:08 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:09 DEBUG : : Looking for writers 2024/05/06 03:52:09 DEBUG : file1: reading active writers 2024/05/06 03:52:09 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:10 DEBUG : : Looking for writers 2024/05/06 03:52:10 DEBUG : file1: reading active writers 2024/05/06 03:52:10 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:11 DEBUG : : Looking for writers 2024/05/06 03:52:11 DEBUG : file1: reading active writers 2024/05/06 03:52:11 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:12 DEBUG : : Looking for writers 2024/05/06 03:52:12 DEBUG : file1: reading active writers 2024/05/06 03:52:12 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:13 DEBUG : : Looking for writers 2024/05/06 03:52:13 DEBUG : file1: reading active writers 2024/05/06 03:52:13 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:14 DEBUG : : Looking for writers 2024/05/06 03:52:14 DEBUG : file1: reading active writers 2024/05/06 03:52:14 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:15 DEBUG : : Looking for writers 2024/05/06 03:52:15 DEBUG : file1: reading active writers 2024/05/06 03:52:15 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:16 DEBUG : : Looking for writers 2024/05/06 03:52:16 DEBUG : file1: reading active writers 2024/05/06 03:52:16 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:17 DEBUG : : Looking for writers 2024/05/06 03:52:17 DEBUG : file1: reading active writers 2024/05/06 03:52:17 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:18 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:18 DEBUG : : Looking for writers 2024/05/06 03:52:18 DEBUG : file1: reading active writers 2024/05/06 03:52:18 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:18 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "50cd90b5557c5730", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:18 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "50cd90b5557c5730", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:19 DEBUG : : Looking for writers 2024/05/06 03:52:19 DEBUG : file1: reading active writers 2024/05/06 03:52:19 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:20 DEBUG : : Looking for writers 2024/05/06 03:52:20 DEBUG : file1: reading active writers 2024/05/06 03:52:20 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:21 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/05/06 03:52:21 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 11 (was 11) 2024/05/06 03:52:21 DEBUG : : Looking for writers 2024/05/06 03:52:21 DEBUG : file1: reading active writers 2024/05/06 03:52:21 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:22 DEBUG : : Looking for writers 2024/05/06 03:52:22 DEBUG : file1: reading active writers 2024/05/06 03:52:22 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:23 DEBUG : : Looking for writers 2024/05/06 03:52:23 DEBUG : file1: reading active writers 2024/05/06 03:52:23 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:24 DEBUG : : Looking for writers 2024/05/06 03:52:24 DEBUG : file1: reading active writers 2024/05/06 03:52:24 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:25 DEBUG : : Looking for writers 2024/05/06 03:52:25 DEBUG : file1: reading active writers 2024/05/06 03:52:25 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:26 DEBUG : : Looking for writers 2024/05/06 03:52:26 DEBUG : file1: reading active writers 2024/05/06 03:52:26 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:27 DEBUG : : Looking for writers 2024/05/06 03:52:27 DEBUG : file1: reading active writers 2024/05/06 03:52:27 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:28 DEBUG : : Looking for writers 2024/05/06 03:52:28 DEBUG : file1: reading active writers 2024/05/06 03:52:28 DEBUG : Still 0 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:52:29 ERROR : Exiting even though 0 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0009f42d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0005f8408 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824639980608} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889158301023495 ext:108507997854 loc:0x3a12660} ATime:{wall:13944889158301035979 ext:108508010337 loc:0x3a12660} Size:11 Rs:[{Pos:0 Size:11}] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:52:29 DEBUG : >WaitForWriters: 2024/05/06 03:52:29 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteAt (68.33s) === RUN TestRWFileHandleWriteNoWrite run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:52:29 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:52:29 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:52:29 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:52:29 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:52:29 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:52:29 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:52:29 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:52:29 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:52:30 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:52:30 DEBUG : file1: newRWFileHandle: 2024/05/06 03:52:30 DEBUG : file1(0xc0009f6180): openPending: 2024/05/06 03:52:30 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:52:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:52:30 DEBUG : file1(0xc0009f6180): >openPending: err= 2024/05/06 03:52:30 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:52:30 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:52:30 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:52:30 DEBUG : file1: >OpenFile: fd=file1 (rw), err= 2024/05/06 03:52:30 DEBUG : file1(0xc0009f6180): close: 2024/05/06 03:52:30 DEBUG : file1: vfs cache: setting modification time to 2024-05-06 03:52:30.012407247 +0000 UTC m=+176.837094768 2024/05/06 03:52:30 INFO : file1: vfs cache: queuing for upload in 100ms 2024/05/06 03:52:30 DEBUG : file1(0xc0009f6180): >close: err= 2024/05/06 03:52:30 DEBUG : file2: OpenFile: flags=O_WRONLY|O_CREATE|O_TRUNC, perm=-rwxrwxrwx 2024/05/06 03:52:30 DEBUG : file2: Open: flags=O_WRONLY|O_CREATE|O_TRUNC 2024/05/06 03:52:30 DEBUG : file2: newRWFileHandle: 2024/05/06 03:52:30 DEBUG : file2(0xc0009f62c0): openPending: 2024/05/06 03:52:30 DEBUG : file2: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:52:30 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/05/06 03:52:30 DEBUG : file2(0xc0009f62c0): >openPending: err= 2024/05/06 03:52:30 DEBUG : file2: >newRWFileHandle: err= 2024/05/06 03:52:30 DEBUG : : Added virtual directory entry vAddFile: "file2" 2024/05/06 03:52:30 DEBUG : file2: >Open: fd=file2 (rw), err= 2024/05/06 03:52:30 DEBUG : file2: >OpenFile: fd=file2 (rw), err= 2024/05/06 03:52:30 DEBUG : file2(0xc0009f62c0): RWFileHandle.Flush 2024/05/06 03:52:30 DEBUG : file2(0xc0009f62c0): RWFileHandle.Release 2024/05/06 03:52:30 DEBUG : file2(0xc0009f62c0): close: 2024/05/06 03:52:30 DEBUG : file2: vfs cache: setting modification time to 2024-05-06 03:52:30.013091811 +0000 UTC m=+176.837779343 2024/05/06 03:52:30 INFO : file2: vfs cache: queuing for upload in 100ms 2024/05/06 03:52:30 DEBUG : file2(0xc0009f62c0): >close: err= 2024/05/06 03:52:30 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/05/06 03:52:30 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:30 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/05/06 03:52:30 DEBUG : : Looking for writers 2024/05/06 03:52:30 DEBUG : file1: reading active writers 2024/05/06 03:52:30 DEBUG : file2: reading active writers 2024/05/06 03:52:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/05/06 03:52:30 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dd67dccb115982e4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:30 ERROR : file2: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dd67dccb115982e4", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:31 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:31 DEBUG : : Looking for writers 2024/05/06 03:52:31 DEBUG : file1: reading active writers 2024/05/06 03:52:31 DEBUG : file2: reading active writers 2024/05/06 03:52:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:31 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b90a2d2da1125688", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:31 ERROR : file1: vfs cache: failed to upload try #1, will retry in 200ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b90a2d2da1125688", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:31 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:32 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8d920389186e4be0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:32 ERROR : file2: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8d920389186e4be0", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:32 DEBUG : : Looking for writers 2024/05/06 03:52:32 DEBUG : file1: reading active writers 2024/05/06 03:52:32 DEBUG : file2: reading active writers 2024/05/06 03:52:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:32 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:32 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6dd7ec01c8df2e18", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:32 ERROR : file1: vfs cache: failed to upload try #2, will retry in 400ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6dd7ec01c8df2e18", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:33 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:33 DEBUG : : Looking for writers 2024/05/06 03:52:33 DEBUG : file1: reading active writers 2024/05/06 03:52:33 DEBUG : file2: reading active writers 2024/05/06 03:52:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:33 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "86d2a335d35dfc04", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:33 ERROR : file2: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "86d2a335d35dfc04", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:34 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "402c736aeda8887c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:34 ERROR : file1: vfs cache: failed to upload try #3, will retry in 800ms: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "402c736aeda8887c", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:34 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:34 DEBUG : : Looking for writers 2024/05/06 03:52:34 DEBUG : file1: reading active writers 2024/05/06 03:52:34 DEBUG : file2: reading active writers 2024/05/06 03:52:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:34 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:34 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b8c6edb6b05b4b47", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:34 ERROR : file2: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "b8c6edb6b05b4b47", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:35 DEBUG : : Looking for writers 2024/05/06 03:52:35 DEBUG : file1: reading active writers 2024/05/06 03:52:35 DEBUG : file2: reading active writers 2024/05/06 03:52:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:35 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "52e92b1cb27d22c2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:35 ERROR : file1: vfs cache: failed to upload try #4, will retry in 1.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "52e92b1cb27d22c2", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:36 DEBUG : : Looking for writers 2024/05/06 03:52:36 DEBUG : file1: reading active writers 2024/05/06 03:52:36 DEBUG : file2: reading active writers 2024/05/06 03:52:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:36 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:37 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:37 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34414803935836b5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:37 ERROR : file2: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "34414803935836b5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:37 DEBUG : : Looking for writers 2024/05/06 03:52:37 DEBUG : file1: reading active writers 2024/05/06 03:52:37 DEBUG : file2: reading active writers 2024/05/06 03:52:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:37 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72348794ed24c720", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:37 ERROR : file1: vfs cache: failed to upload try #5, will retry in 3.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "72348794ed24c720", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:38 DEBUG : : Looking for writers 2024/05/06 03:52:38 DEBUG : file2: reading active writers 2024/05/06 03:52:38 DEBUG : file1: reading active writers 2024/05/06 03:52:38 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:39 DEBUG : : Looking for writers 2024/05/06 03:52:39 DEBUG : file1: reading active writers 2024/05/06 03:52:39 DEBUG : file2: reading active writers 2024/05/06 03:52:39 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:40 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:40 DEBUG : : Looking for writers 2024/05/06 03:52:40 DEBUG : file1: reading active writers 2024/05/06 03:52:40 DEBUG : file2: reading active writers 2024/05/06 03:52:40 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:40 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:40 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cb606242ad938572", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:40 ERROR : file2: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "cb606242ad938572", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:41 DEBUG : : Looking for writers 2024/05/06 03:52:41 DEBUG : file1: reading active writers 2024/05/06 03:52:41 DEBUG : file2: reading active writers 2024/05/06 03:52:41 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:41 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8710c9d29c67ad16", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:41 ERROR : file1: vfs cache: failed to upload try #6, will retry in 6.4s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8710c9d29c67ad16", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:42 DEBUG : : Looking for writers 2024/05/06 03:52:42 DEBUG : file1: reading active writers 2024/05/06 03:52:42 DEBUG : file2: reading active writers 2024/05/06 03:52:42 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:43 DEBUG : : Looking for writers 2024/05/06 03:52:43 DEBUG : file1: reading active writers 2024/05/06 03:52:43 DEBUG : file2: reading active writers 2024/05/06 03:52:43 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:44 DEBUG : : Looking for writers 2024/05/06 03:52:44 DEBUG : file1: reading active writers 2024/05/06 03:52:44 DEBUG : file2: reading active writers 2024/05/06 03:52:44 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:45 DEBUG : : Looking for writers 2024/05/06 03:52:45 DEBUG : file1: reading active writers 2024/05/06 03:52:45 DEBUG : file2: reading active writers 2024/05/06 03:52:45 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:46 DEBUG : : Looking for writers 2024/05/06 03:52:46 DEBUG : file1: reading active writers 2024/05/06 03:52:46 DEBUG : file2: reading active writers 2024/05/06 03:52:46 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:47 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:52:47 DEBUG : : Looking for writers 2024/05/06 03:52:47 DEBUG : file1: reading active writers 2024/05/06 03:52:47 DEBUG : file2: reading active writers 2024/05/06 03:52:47 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:47 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:52:47 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "83b5fc8c43dcbbc5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:47 ERROR : file2: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "83b5fc8c43dcbbc5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:48 DEBUG : : Looking for writers 2024/05/06 03:52:48 DEBUG : file1: reading active writers 2024/05/06 03:52:48 DEBUG : file2: reading active writers 2024/05/06 03:52:48 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:48 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f05b9941b7a328ac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:48 ERROR : file1: vfs cache: failed to upload try #7, will retry in 12.8s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "f05b9941b7a328ac", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:52:49 DEBUG : : Looking for writers 2024/05/06 03:52:49 DEBUG : file1: reading active writers 2024/05/06 03:52:49 DEBUG : file2: reading active writers 2024/05/06 03:52:49 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:50 DEBUG : : Looking for writers 2024/05/06 03:52:50 DEBUG : file1: reading active writers 2024/05/06 03:52:50 DEBUG : file2: reading active writers 2024/05/06 03:52:50 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:51 DEBUG : : Looking for writers 2024/05/06 03:52:51 DEBUG : file1: reading active writers 2024/05/06 03:52:51 DEBUG : file2: reading active writers 2024/05/06 03:52:51 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:52 DEBUG : : Looking for writers 2024/05/06 03:52:52 DEBUG : file1: reading active writers 2024/05/06 03:52:52 DEBUG : file2: reading active writers 2024/05/06 03:52:52 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:53 DEBUG : : Looking for writers 2024/05/06 03:52:53 DEBUG : file1: reading active writers 2024/05/06 03:52:53 DEBUG : file2: reading active writers 2024/05/06 03:52:53 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:54 DEBUG : : Looking for writers 2024/05/06 03:52:54 DEBUG : file1: reading active writers 2024/05/06 03:52:54 DEBUG : file2: reading active writers 2024/05/06 03:52:54 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:55 DEBUG : : Looking for writers 2024/05/06 03:52:55 DEBUG : file2: reading active writers 2024/05/06 03:52:55 DEBUG : file1: reading active writers 2024/05/06 03:52:55 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:56 DEBUG : : Looking for writers 2024/05/06 03:52:56 DEBUG : file2: reading active writers 2024/05/06 03:52:56 DEBUG : file1: reading active writers 2024/05/06 03:52:56 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:57 DEBUG : : Looking for writers 2024/05/06 03:52:57 DEBUG : file1: reading active writers 2024/05/06 03:52:57 DEBUG : file2: reading active writers 2024/05/06 03:52:57 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:58 DEBUG : : Looking for writers 2024/05/06 03:52:58 DEBUG : file1: reading active writers 2024/05/06 03:52:58 DEBUG : file2: reading active writers 2024/05/06 03:52:58 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:52:59 DEBUG : : Looking for writers 2024/05/06 03:52:59 DEBUG : file1: reading active writers 2024/05/06 03:52:59 DEBUG : file2: reading active writers 2024/05/06 03:52:59 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:00 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0006022d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0006a3808 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640682048} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889231718306255 ext:176837094768 loc:0x3a12660} ATime:{wall:13944889231718482376 ext:176837270889 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0006022d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0006a3c08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640683072} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889231718990819 ext:176837779343 loc:0x3a12660} ATime:{wall:13944889231719075057 ext:176837863570 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:53:00 DEBUG : >WaitForWriters: fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 2024/05/06 03:53:00 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:53:01 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:53:01 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5b72fddd6b175b31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:01 ERROR : file2: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "5b72fddd6b175b31", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 2024/05/06 03:53:02 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a8ef05ad8b84bfe8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:02 ERROR : file1: vfs cache: failed to upload try #8, will retry in 25.6s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a8ef05ad8b84bfe8", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Should be true Test: TestRWFileHandleWriteNoWrite Messages: listing wrong, want file1 (0), file2 (0) got fstest.go:198: Not found "file1" fstest.go:198: Not found "file2" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/read_write_test.go:420 Error: Not equal: expected: 0 actual : 2 Test: TestRWFileHandleWriteNoWrite Messages: 2 objects not found 2024/05/06 03:53:07 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:53:07 DEBUG : : Looking for writers 2024/05/06 03:53:07 DEBUG : file1: reading active writers 2024/05/06 03:53:07 DEBUG : file2: reading active writers 2024/05/06 03:53:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 10ms 2024/05/06 03:53:07 DEBUG : : Looking for writers 2024/05/06 03:53:07 DEBUG : file1: reading active writers 2024/05/06 03:53:07 DEBUG : file2: reading active writers 2024/05/06 03:53:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 20ms 2024/05/06 03:53:07 DEBUG : : Looking for writers 2024/05/06 03:53:07 DEBUG : file1: reading active writers 2024/05/06 03:53:07 DEBUG : file2: reading active writers 2024/05/06 03:53:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 40ms 2024/05/06 03:53:07 DEBUG : : Looking for writers 2024/05/06 03:53:07 DEBUG : file1: reading active writers 2024/05/06 03:53:07 DEBUG : file2: reading active writers 2024/05/06 03:53:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 80ms 2024/05/06 03:53:07 DEBUG : : Looking for writers 2024/05/06 03:53:07 DEBUG : file1: reading active writers 2024/05/06 03:53:07 DEBUG : file2: reading active writers 2024/05/06 03:53:07 DEBUG : Still 0 writers active and 2 cache items in use, waiting 160ms 2024/05/06 03:53:08 DEBUG : : Looking for writers 2024/05/06 03:53:08 DEBUG : file1: reading active writers 2024/05/06 03:53:08 DEBUG : file2: reading active writers 2024/05/06 03:53:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 320ms 2024/05/06 03:53:08 DEBUG : : Looking for writers 2024/05/06 03:53:08 DEBUG : file1: reading active writers 2024/05/06 03:53:08 DEBUG : file2: reading active writers 2024/05/06 03:53:08 DEBUG : Still 0 writers active and 2 cache items in use, waiting 640ms 2024/05/06 03:53:09 DEBUG : : Looking for writers 2024/05/06 03:53:09 DEBUG : file1: reading active writers 2024/05/06 03:53:09 DEBUG : file2: reading active writers 2024/05/06 03:53:09 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:10 DEBUG : : Looking for writers 2024/05/06 03:53:10 DEBUG : file1: reading active writers 2024/05/06 03:53:10 DEBUG : file2: reading active writers 2024/05/06 03:53:10 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:11 DEBUG : : Looking for writers 2024/05/06 03:53:11 DEBUG : file1: reading active writers 2024/05/06 03:53:11 DEBUG : file2: reading active writers 2024/05/06 03:53:11 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:12 DEBUG : : Looking for writers 2024/05/06 03:53:12 DEBUG : file1: reading active writers 2024/05/06 03:53:12 DEBUG : file2: reading active writers 2024/05/06 03:53:12 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:13 DEBUG : : Looking for writers 2024/05/06 03:53:13 DEBUG : file1: reading active writers 2024/05/06 03:53:13 DEBUG : file2: reading active writers 2024/05/06 03:53:13 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:14 DEBUG : : Looking for writers 2024/05/06 03:53:14 DEBUG : file1: reading active writers 2024/05/06 03:53:14 DEBUG : file2: reading active writers 2024/05/06 03:53:14 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:15 DEBUG : : Looking for writers 2024/05/06 03:53:15 DEBUG : file1: reading active writers 2024/05/06 03:53:15 DEBUG : file2: reading active writers 2024/05/06 03:53:15 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:16 DEBUG : : Looking for writers 2024/05/06 03:53:16 DEBUG : file1: reading active writers 2024/05/06 03:53:16 DEBUG : file2: reading active writers 2024/05/06 03:53:16 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:17 DEBUG : : Looking for writers 2024/05/06 03:53:17 DEBUG : file1: reading active writers 2024/05/06 03:53:17 DEBUG : file2: reading active writers 2024/05/06 03:53:17 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:18 DEBUG : : Looking for writers 2024/05/06 03:53:18 DEBUG : file2: reading active writers 2024/05/06 03:53:18 DEBUG : file1: reading active writers 2024/05/06 03:53:18 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:19 DEBUG : : Looking for writers 2024/05/06 03:53:19 DEBUG : file1: reading active writers 2024/05/06 03:53:19 DEBUG : file2: reading active writers 2024/05/06 03:53:19 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:20 DEBUG : : Looking for writers 2024/05/06 03:53:20 DEBUG : file1: reading active writers 2024/05/06 03:53:20 DEBUG : file2: reading active writers 2024/05/06 03:53:20 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:21 DEBUG : : Looking for writers 2024/05/06 03:53:21 DEBUG : file2: reading active writers 2024/05/06 03:53:21 DEBUG : file1: reading active writers 2024/05/06 03:53:21 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:22 DEBUG : : Looking for writers 2024/05/06 03:53:22 DEBUG : file1: reading active writers 2024/05/06 03:53:22 DEBUG : file2: reading active writers 2024/05/06 03:53:22 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:23 DEBUG : : Looking for writers 2024/05/06 03:53:23 DEBUG : file1: reading active writers 2024/05/06 03:53:23 DEBUG : file2: reading active writers 2024/05/06 03:53:23 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:24 DEBUG : : Looking for writers 2024/05/06 03:53:24 DEBUG : file2: reading active writers 2024/05/06 03:53:24 DEBUG : file1: reading active writers 2024/05/06 03:53:24 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:25 DEBUG : : Looking for writers 2024/05/06 03:53:25 DEBUG : file1: reading active writers 2024/05/06 03:53:25 DEBUG : file2: reading active writers 2024/05/06 03:53:25 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:26 DEBUG : : Looking for writers 2024/05/06 03:53:26 DEBUG : file1: reading active writers 2024/05/06 03:53:26 DEBUG : file2: reading active writers 2024/05/06 03:53:26 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:26 DEBUG : file2: vfs cache: starting upload 2024/05/06 03:53:27 DEBUG : : Looking for writers 2024/05/06 03:53:27 DEBUG : file1: reading active writers 2024/05/06 03:53:27 DEBUG : file2: reading active writers 2024/05/06 03:53:27 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:27 ERROR : file2: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3e472b395b206a2f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:27 ERROR : file2: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "3e472b395b206a2f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:27 DEBUG : file1: vfs cache: starting upload 2024/05/06 03:53:28 DEBUG : : Looking for writers 2024/05/06 03:53:28 DEBUG : file1: reading active writers 2024/05/06 03:53:28 DEBUG : file2: reading active writers 2024/05/06 03:53:28 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:28 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4a46ab954b83c477", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:28 ERROR : file1: vfs cache: failed to upload try #9, will retry in 51.2s: vfs cache: failed to transfer file from cache to remote: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4a46ab954b83c477", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:29 DEBUG : : Looking for writers 2024/05/06 03:53:29 DEBUG : file1: reading active writers 2024/05/06 03:53:29 DEBUG : file2: reading active writers 2024/05/06 03:53:29 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:29 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file1 not removed, freed 0 bytes 2024/05/06 03:53:29 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item file2 not removed, freed 0 bytes 2024/05/06 03:53:29 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0) 2024/05/06 03:53:30 DEBUG : : Looking for writers 2024/05/06 03:53:30 DEBUG : file1: reading active writers 2024/05/06 03:53:30 DEBUG : file2: reading active writers 2024/05/06 03:53:30 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:31 DEBUG : : Looking for writers 2024/05/06 03:53:31 DEBUG : file1: reading active writers 2024/05/06 03:53:31 DEBUG : file2: reading active writers 2024/05/06 03:53:31 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:32 DEBUG : : Looking for writers 2024/05/06 03:53:32 DEBUG : file1: reading active writers 2024/05/06 03:53:32 DEBUG : file2: reading active writers 2024/05/06 03:53:32 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:33 DEBUG : : Looking for writers 2024/05/06 03:53:33 DEBUG : file1: reading active writers 2024/05/06 03:53:33 DEBUG : file2: reading active writers 2024/05/06 03:53:33 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:34 DEBUG : : Looking for writers 2024/05/06 03:53:34 DEBUG : file1: reading active writers 2024/05/06 03:53:34 DEBUG : file2: reading active writers 2024/05/06 03:53:34 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:35 DEBUG : : Looking for writers 2024/05/06 03:53:35 DEBUG : file1: reading active writers 2024/05/06 03:53:35 DEBUG : file2: reading active writers 2024/05/06 03:53:35 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:36 DEBUG : : Looking for writers 2024/05/06 03:53:36 DEBUG : file2: reading active writers 2024/05/06 03:53:36 DEBUG : file1: reading active writers 2024/05/06 03:53:36 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:37 DEBUG : : Looking for writers 2024/05/06 03:53:37 DEBUG : file1: reading active writers 2024/05/06 03:53:37 DEBUG : file2: reading active writers 2024/05/06 03:53:37 DEBUG : Still 0 writers active and 2 cache items in use, waiting 1s 2024/05/06 03:53:37 ERROR : Exiting even though 0 writers active and 2 cache items in use after 30s Cache{ "file1": &{c:0xc0006022d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0006a3808 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640682048} name:file1 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889231718306255 ext:176837094768 loc:0x3a12660} ATime:{wall:13944889231718482376 ext:176837270889 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:1 pendingAccesses:0 modified:false beingReset:false}, "file2": &{c:0xc0006022d0 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0006a3c08 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640683072} name:file2 opens:0 downloaders: o: fd: info:{ModTime:{wall:13944889231718990819 ext:176837779343 loc:0x3a12660} ATime:{wall:13944889231719075057 ext:176837863570 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:2 pendingAccesses:0 modified:false beingReset:false}, } 2024/05/06 03:53:37 DEBUG : >WaitForWriters: 2024/05/06 03:53:37 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleWriteNoWrite (68.36s) === RUN TestRWFileHandleSizeTruncateExisting run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:53:38 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:53:38 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:53:38 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:38 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:38 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:38 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:38 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d821babc71f35227", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:38 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:53:38 DEBUG : : Looking for writers 2024/05/06 03:53:38 DEBUG : >WaitForWriters: 2024/05/06 03:53:38 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeTruncateExisting (1.15s) === RUN TestRWFileHandleSizeCreateExisting run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:53:39 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:53:39 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:53:39 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:39 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:39 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:39 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:39 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "8e8a9b16e7a4a9aa", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:39 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:53:39 DEBUG : : Looking for writers 2024/05/06 03:53:39 DEBUG : >WaitForWriters: 2024/05/06 03:53:39 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileHandleSizeCreateExisting (0.87s) === RUN TestRWFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:53:40 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:53:40 DEBUG : vfs cache: root is "/home/rclone/.cache/rclone" 2024/05/06 03:53:40 DEBUG : vfs cache: data root is "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:40 DEBUG : vfs cache: metadata root is "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfs/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:40 DEBUG : Creating backend with remote "/home/rclone/.cache/rclone/vfsMeta/TestQingStor/rclone-test-coxunof4coxewis9boqufir2" 2024/05/06 03:53:40 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:53:40 INFO : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0) 2024/05/06 03:53:40 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:53:40 DEBUG : file1: newRWFileHandle: 2024/05/06 03:53:40 DEBUG : file1(0xc000776ac0): openPending: 2024/05/06 03:53:40 DEBUG : file1: vfs cache: truncate to size=0 (not needed as size correct) 2024/05/06 03:53:40 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:53:40 DEBUG : file1(0xc000776ac0): >openPending: err= 2024/05/06 03:53:40 DEBUG : file1: >newRWFileHandle: err= 2024/05/06 03:53:40 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:53:40 DEBUG : file1: >Open: fd=file1 (rw), err= 2024/05/06 03:53:40 DEBUG : file1: >OpenFile: fd=file1 (rw), err= run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "6fed73785effe660", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:53:41 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 10ms 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 20ms 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 40ms 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 80ms 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 160ms 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 320ms 2024/05/06 03:53:41 DEBUG : : Looking for writers 2024/05/06 03:53:41 DEBUG : file1: reading active writers 2024/05/06 03:53:41 DEBUG : file1: active writers 1 2024/05/06 03:53:41 DEBUG : Still 1 writers active and 1 cache items in use, waiting 640ms 2024/05/06 03:53:42 DEBUG : : Looking for writers 2024/05/06 03:53:42 DEBUG : file1: reading active writers 2024/05/06 03:53:42 DEBUG : file1: active writers 1 2024/05/06 03:53:42 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:43 DEBUG : : Looking for writers 2024/05/06 03:53:43 DEBUG : file1: reading active writers 2024/05/06 03:53:43 DEBUG : file1: active writers 1 2024/05/06 03:53:43 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:44 DEBUG : : Looking for writers 2024/05/06 03:53:44 DEBUG : file1: reading active writers 2024/05/06 03:53:44 DEBUG : file1: active writers 1 2024/05/06 03:53:44 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:45 DEBUG : : Looking for writers 2024/05/06 03:53:45 DEBUG : file1: reading active writers 2024/05/06 03:53:45 DEBUG : file1: active writers 1 2024/05/06 03:53:45 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:46 DEBUG : : Looking for writers 2024/05/06 03:53:46 DEBUG : file1: reading active writers 2024/05/06 03:53:46 DEBUG : file1: active writers 1 2024/05/06 03:53:46 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:47 DEBUG : : Looking for writers 2024/05/06 03:53:47 DEBUG : file1: reading active writers 2024/05/06 03:53:47 DEBUG : file1: active writers 1 2024/05/06 03:53:47 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:48 DEBUG : : Looking for writers 2024/05/06 03:53:48 DEBUG : file1: reading active writers 2024/05/06 03:53:48 DEBUG : file1: active writers 1 2024/05/06 03:53:48 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:49 DEBUG : : Looking for writers 2024/05/06 03:53:49 DEBUG : file1: reading active writers 2024/05/06 03:53:49 DEBUG : file1: active writers 1 2024/05/06 03:53:49 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:50 DEBUG : : Looking for writers 2024/05/06 03:53:50 DEBUG : file1: reading active writers 2024/05/06 03:53:50 DEBUG : file1: active writers 1 2024/05/06 03:53:50 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:51 DEBUG : : Looking for writers 2024/05/06 03:53:51 DEBUG : file1: reading active writers 2024/05/06 03:53:51 DEBUG : file1: active writers 1 2024/05/06 03:53:51 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:52 DEBUG : : Looking for writers 2024/05/06 03:53:52 DEBUG : file1: reading active writers 2024/05/06 03:53:52 DEBUG : file1: active writers 1 2024/05/06 03:53:52 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:53 DEBUG : : Looking for writers 2024/05/06 03:53:53 DEBUG : file1: reading active writers 2024/05/06 03:53:53 DEBUG : file1: active writers 1 2024/05/06 03:53:53 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:54 DEBUG : : Looking for writers 2024/05/06 03:53:54 DEBUG : file1: reading active writers 2024/05/06 03:53:54 DEBUG : file1: active writers 1 2024/05/06 03:53:54 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:55 DEBUG : : Looking for writers 2024/05/06 03:53:55 DEBUG : file1: reading active writers 2024/05/06 03:53:55 DEBUG : file1: active writers 1 2024/05/06 03:53:55 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:56 DEBUG : : Looking for writers 2024/05/06 03:53:56 DEBUG : file1: reading active writers 2024/05/06 03:53:56 DEBUG : file1: active writers 1 2024/05/06 03:53:56 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:57 DEBUG : : Looking for writers 2024/05/06 03:53:57 DEBUG : file1: reading active writers 2024/05/06 03:53:57 DEBUG : file1: active writers 1 2024/05/06 03:53:57 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:58 DEBUG : : Looking for writers 2024/05/06 03:53:58 DEBUG : file1: reading active writers 2024/05/06 03:53:58 DEBUG : file1: active writers 1 2024/05/06 03:53:58 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:53:59 DEBUG : : Looking for writers 2024/05/06 03:53:59 DEBUG : file1: reading active writers 2024/05/06 03:53:59 DEBUG : file1: active writers 1 2024/05/06 03:53:59 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:00 DEBUG : : Looking for writers 2024/05/06 03:54:00 DEBUG : file1: reading active writers 2024/05/06 03:54:00 DEBUG : file1: active writers 1 2024/05/06 03:54:00 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:01 DEBUG : : Looking for writers 2024/05/06 03:54:01 DEBUG : file1: reading active writers 2024/05/06 03:54:01 DEBUG : file1: active writers 1 2024/05/06 03:54:01 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:02 DEBUG : : Looking for writers 2024/05/06 03:54:02 DEBUG : file1: reading active writers 2024/05/06 03:54:02 DEBUG : file1: active writers 1 2024/05/06 03:54:02 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:03 DEBUG : : Looking for writers 2024/05/06 03:54:03 DEBUG : file1: reading active writers 2024/05/06 03:54:03 DEBUG : file1: active writers 1 2024/05/06 03:54:03 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:04 DEBUG : : Looking for writers 2024/05/06 03:54:04 DEBUG : file1: reading active writers 2024/05/06 03:54:04 DEBUG : file1: active writers 1 2024/05/06 03:54:04 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:05 DEBUG : : Looking for writers 2024/05/06 03:54:05 DEBUG : file1: reading active writers 2024/05/06 03:54:05 DEBUG : file1: active writers 1 2024/05/06 03:54:05 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:06 DEBUG : : Looking for writers 2024/05/06 03:54:06 DEBUG : file1: reading active writers 2024/05/06 03:54:06 DEBUG : file1: active writers 1 2024/05/06 03:54:06 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:07 DEBUG : : Looking for writers 2024/05/06 03:54:07 DEBUG : file1: reading active writers 2024/05/06 03:54:07 DEBUG : file1: active writers 1 2024/05/06 03:54:07 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:08 DEBUG : : Looking for writers 2024/05/06 03:54:08 DEBUG : file1: reading active writers 2024/05/06 03:54:08 DEBUG : file1: active writers 1 2024/05/06 03:54:08 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:09 DEBUG : : Looking for writers 2024/05/06 03:54:09 DEBUG : file1: reading active writers 2024/05/06 03:54:09 DEBUG : file1: active writers 1 2024/05/06 03:54:09 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:10 DEBUG : : Looking for writers 2024/05/06 03:54:10 DEBUG : file1: reading active writers 2024/05/06 03:54:10 DEBUG : file1: active writers 1 2024/05/06 03:54:10 DEBUG : Still 1 writers active and 1 cache items in use, waiting 1s 2024/05/06 03:54:11 ERROR : Exiting even though 1 writers active and 1 cache items in use after 30s Cache{ "file1": &{c:0xc0000f8e10 mu:{state:0 sema:0} cond:{noCopy:{} L:0xc0006b8308 notify:{wait:0 notify:0 lock:0 head: tail:} checker:824640766784} name:file1 opens:1 downloaders: o: fd:0xc0001428e0 info:{ModTime:{wall:13944889307264741969 ext:247221602822 loc:0x3a12660} ATime:{wall:13944889307264741969 ext:247221602822 loc:0x3a12660} Size:0 Rs:[] Fingerprint: Dirty:true} writeBackID:0 pendingAccesses:0 modified:true beingReset:false}, } 2024/05/06 03:54:11 DEBUG : >WaitForWriters: 2024/05/06 03:54:11 DEBUG : vfs cache: cleaner exiting --- FAIL: TestRWFileModTimeWithOpenWriters (31.14s) === RUN TestCaseSensitivity run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "c7d4913c1a0414a5", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestCaseSensitivity (0.87s) === RUN TestUnicodeNormalization run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "a38c056191bf8925", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" --- FAIL: TestUnicodeNormalization (0.87s) === RUN TestVFSStat run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:54:13 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:54:13 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "4bdd4f0a923dd784", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:13 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:54:13 DEBUG : : Looking for writers 2024/05/06 03:54:13 DEBUG : >WaitForWriters: --- FAIL: TestVFSStat (0.87s) === RUN TestVFSStatParent run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:54:13 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:54:13 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "e4575c783ec7a88a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:14 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:54:14 DEBUG : : Looking for writers 2024/05/06 03:54:14 DEBUG : >WaitForWriters: --- FAIL: TestVFSStatParent (0.87s) === RUN TestVFSOpenFile run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:54:14 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:54:14 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "70f2c30733918309", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:15 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:54:15 DEBUG : : Looking for writers 2024/05/06 03:54:15 DEBUG : >WaitForWriters: --- FAIL: TestVFSOpenFile (0.88s) === RUN TestVFSRename run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:54:15 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:54:15 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream run.go:237: Failed to mkdir "QingStor bucket rclone-test-coxunof4coxewis9boqufir2": QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "d543131cbea26648", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:16 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:54:16 DEBUG : : Looking for writers 2024/05/06 03:54:16 DEBUG : >WaitForWriters: --- FAIL: TestVFSRename (0.87s) === RUN TestWriteFileHandleMethods run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:54:16 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:54:16 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:54:16 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:54:16 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:54:16 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:16 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:54:16 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:54:16 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:16 ERROR : file1: WriteFileHandle: Read: Can't read and write to file without --vfs-cache-mode >= minimal 2024/05/06 03:54:16 ERROR : file1: WriteFileHandle: ReadAt: Can't read and write to file without --vfs-cache-mode >= minimal 2024/05/06 03:54:16 ERROR : file1: WriteFileHandle: Truncate: Can't change size without --vfs-cache-mode >= writes 2024/05/06 03:54:16 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (5 bytes), uploading instead of streaming 2024/05/06 03:54:17 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ab77ba36814f256", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:17 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ab77ba36814f256", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:17 DEBUG : file1: Remove: 2024/05/06 03:54:17 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:54:17 DEBUG : file1: >Remove: err= write_test.go:144: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:144 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9ab77ba36814f256", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:153 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Should be true Test: TestWriteFileHandleMethods Messages: listing wrong, want file1 (5) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:157 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleMethods Messages: 1 objects not found 2024/05/06 03:54:25 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:54:25 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:54:25 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:25 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:54:25 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:54:25 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:25 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (0 bytes), uploading instead of streaming 2024/05/06 03:54:25 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "635706d0eedee860", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:25 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "635706d0eedee860", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:25 DEBUG : file1: Remove: 2024/05/06 03:54:25 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:54:25 DEBUG : file1: >Remove: err= write_test.go:163: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:163 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "635706d0eedee860", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleMethods dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:164 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleMethods 2024/05/06 03:54:25 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:54:25 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:54:25 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:25 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:54:25 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:54:25 DEBUG : : Added virtual directory entry vAddFile: "file1" write_test.go:171: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:171 Error: Not equal: expected: *errors.errorString(&errors.errorString{s:"permission denied"}) actual : () Test: TestWriteFileHandleMethods 2024/05/06 03:54:25 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:54:25 DEBUG : : Looking for writers 2024/05/06 03:54:25 DEBUG : file1: reading active writers 2024/05/06 03:54:25 DEBUG : file1: active writers 1 2024/05/06 03:54:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 10ms 2024/05/06 03:54:25 DEBUG : : Looking for writers 2024/05/06 03:54:25 DEBUG : file1: reading active writers 2024/05/06 03:54:25 DEBUG : file1: active writers 1 2024/05/06 03:54:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 20ms 2024/05/06 03:54:25 DEBUG : : Looking for writers 2024/05/06 03:54:25 DEBUG : file1: reading active writers 2024/05/06 03:54:25 DEBUG : file1: active writers 1 2024/05/06 03:54:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 40ms 2024/05/06 03:54:25 DEBUG : : Looking for writers 2024/05/06 03:54:25 DEBUG : file1: reading active writers 2024/05/06 03:54:25 DEBUG : file1: active writers 1 2024/05/06 03:54:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 80ms 2024/05/06 03:54:25 DEBUG : : Looking for writers 2024/05/06 03:54:25 DEBUG : file1: reading active writers 2024/05/06 03:54:25 DEBUG : file1: active writers 1 2024/05/06 03:54:25 DEBUG : Still 1 writers active and 0 cache items in use, waiting 160ms 2024/05/06 03:54:26 DEBUG : : Looking for writers 2024/05/06 03:54:26 DEBUG : file1: reading active writers 2024/05/06 03:54:26 DEBUG : file1: active writers 1 2024/05/06 03:54:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 320ms 2024/05/06 03:54:26 DEBUG : : Looking for writers 2024/05/06 03:54:26 DEBUG : file1: reading active writers 2024/05/06 03:54:26 DEBUG : file1: active writers 1 2024/05/06 03:54:26 DEBUG : Still 1 writers active and 0 cache items in use, waiting 640ms 2024/05/06 03:54:27 DEBUG : : Looking for writers 2024/05/06 03:54:27 DEBUG : file1: reading active writers 2024/05/06 03:54:27 DEBUG : file1: active writers 1 2024/05/06 03:54:27 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:28 DEBUG : : Looking for writers 2024/05/06 03:54:28 DEBUG : file1: reading active writers 2024/05/06 03:54:28 DEBUG : file1: active writers 1 2024/05/06 03:54:28 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:29 DEBUG : : Looking for writers 2024/05/06 03:54:29 DEBUG : file1: reading active writers 2024/05/06 03:54:29 DEBUG : file1: active writers 1 2024/05/06 03:54:29 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:30 DEBUG : : Looking for writers 2024/05/06 03:54:30 DEBUG : file1: reading active writers 2024/05/06 03:54:30 DEBUG : file1: active writers 1 2024/05/06 03:54:30 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:31 DEBUG : : Looking for writers 2024/05/06 03:54:31 DEBUG : file1: reading active writers 2024/05/06 03:54:31 DEBUG : file1: active writers 1 2024/05/06 03:54:31 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:32 DEBUG : : Looking for writers 2024/05/06 03:54:32 DEBUG : file1: reading active writers 2024/05/06 03:54:32 DEBUG : file1: active writers 1 2024/05/06 03:54:32 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:33 DEBUG : : Looking for writers 2024/05/06 03:54:33 DEBUG : file1: reading active writers 2024/05/06 03:54:33 DEBUG : file1: active writers 1 2024/05/06 03:54:33 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:34 DEBUG : : Looking for writers 2024/05/06 03:54:34 DEBUG : file1: reading active writers 2024/05/06 03:54:34 DEBUG : file1: active writers 1 2024/05/06 03:54:34 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:35 DEBUG : : Looking for writers 2024/05/06 03:54:35 DEBUG : file1: reading active writers 2024/05/06 03:54:35 DEBUG : file1: active writers 1 2024/05/06 03:54:35 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:36 DEBUG : : Looking for writers 2024/05/06 03:54:36 DEBUG : file1: reading active writers 2024/05/06 03:54:36 DEBUG : file1: active writers 1 2024/05/06 03:54:36 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:37 DEBUG : : Looking for writers 2024/05/06 03:54:37 DEBUG : file1: reading active writers 2024/05/06 03:54:37 DEBUG : file1: active writers 1 2024/05/06 03:54:37 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:38 DEBUG : : Looking for writers 2024/05/06 03:54:38 DEBUG : file1: reading active writers 2024/05/06 03:54:38 DEBUG : file1: active writers 1 2024/05/06 03:54:38 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:39 DEBUG : : Looking for writers 2024/05/06 03:54:39 DEBUG : file1: reading active writers 2024/05/06 03:54:39 DEBUG : file1: active writers 1 2024/05/06 03:54:39 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:40 DEBUG : : Looking for writers 2024/05/06 03:54:40 DEBUG : file1: reading active writers 2024/05/06 03:54:40 DEBUG : file1: active writers 1 2024/05/06 03:54:40 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:41 DEBUG : : Looking for writers 2024/05/06 03:54:41 DEBUG : file1: reading active writers 2024/05/06 03:54:41 DEBUG : file1: active writers 1 2024/05/06 03:54:41 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:42 DEBUG : : Looking for writers 2024/05/06 03:54:42 DEBUG : file1: reading active writers 2024/05/06 03:54:42 DEBUG : file1: active writers 1 2024/05/06 03:54:42 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:43 DEBUG : : Looking for writers 2024/05/06 03:54:43 DEBUG : file1: reading active writers 2024/05/06 03:54:43 DEBUG : file1: active writers 1 2024/05/06 03:54:43 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:44 DEBUG : : Looking for writers 2024/05/06 03:54:44 DEBUG : file1: reading active writers 2024/05/06 03:54:44 DEBUG : file1: active writers 1 2024/05/06 03:54:44 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:45 DEBUG : : Looking for writers 2024/05/06 03:54:45 DEBUG : file1: reading active writers 2024/05/06 03:54:45 DEBUG : file1: active writers 1 2024/05/06 03:54:45 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:46 DEBUG : : Looking for writers 2024/05/06 03:54:46 DEBUG : file1: reading active writers 2024/05/06 03:54:46 DEBUG : file1: active writers 1 2024/05/06 03:54:46 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:47 DEBUG : : Looking for writers 2024/05/06 03:54:47 DEBUG : file1: reading active writers 2024/05/06 03:54:47 DEBUG : file1: active writers 1 2024/05/06 03:54:47 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:48 DEBUG : : Looking for writers 2024/05/06 03:54:48 DEBUG : file1: reading active writers 2024/05/06 03:54:48 DEBUG : file1: active writers 1 2024/05/06 03:54:48 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:49 DEBUG : : Looking for writers 2024/05/06 03:54:49 DEBUG : file1: reading active writers 2024/05/06 03:54:49 DEBUG : file1: active writers 1 2024/05/06 03:54:49 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:50 DEBUG : : Looking for writers 2024/05/06 03:54:50 DEBUG : file1: reading active writers 2024/05/06 03:54:50 DEBUG : file1: active writers 1 2024/05/06 03:54:50 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:51 DEBUG : : Looking for writers 2024/05/06 03:54:51 DEBUG : file1: reading active writers 2024/05/06 03:54:51 DEBUG : file1: active writers 1 2024/05/06 03:54:51 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:52 DEBUG : : Looking for writers 2024/05/06 03:54:52 DEBUG : file1: reading active writers 2024/05/06 03:54:52 DEBUG : file1: active writers 1 2024/05/06 03:54:52 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:53 DEBUG : : Looking for writers 2024/05/06 03:54:53 DEBUG : file1: reading active writers 2024/05/06 03:54:53 DEBUG : file1: active writers 1 2024/05/06 03:54:53 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:54 DEBUG : : Looking for writers 2024/05/06 03:54:54 DEBUG : file1: reading active writers 2024/05/06 03:54:54 DEBUG : file1: active writers 1 2024/05/06 03:54:54 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:55 DEBUG : : Looking for writers 2024/05/06 03:54:55 DEBUG : file1: reading active writers 2024/05/06 03:54:55 DEBUG : file1: active writers 1 2024/05/06 03:54:55 DEBUG : Still 1 writers active and 0 cache items in use, waiting 1s 2024/05/06 03:54:55 ERROR : Exiting even though 1 writers active and 0 cache items in use after 30s Cache: 2024/05/06 03:54:55 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleMethods (39.55s) === RUN TestWriteFileHandleWriteAt run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:54:56 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:54:56 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:54:56 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:54:56 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:54:56 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:56 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:54:56 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:54:56 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:54:56 DEBUG : file1: waiting for in-sequence write to 100 for 1s 2024/05/06 03:54:57 DEBUG : file1: aborting in-sequence write wait, off=100 2024/05/06 03:54:57 DEBUG : file1: failed to wait for in-sequence write to 100 2024/05/06 03:54:57 ERROR : file1: WriteFileHandle.Write: can't seek in file without --vfs-cache-mode >= writes 2024/05/06 03:54:57 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (11 bytes), uploading instead of streaming 2024/05/06 03:54:58 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1a668dc38065f9a9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:58 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1a668dc38065f9a9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:54:58 DEBUG : file1: Remove: 2024/05/06 03:54:58 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:54:58 DEBUG : file1: >Remove: err= write_test.go:221: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:221 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1a668dc38065f9a9", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleWriteAt 2024/05/06 03:54:58 ERROR : file1: WriteFileHandle.Write: error: Bad file descriptor dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:231 Error: Not equal: expected: []string{"file1,11,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=14) "file1,11,false" -} +([]string) Test: TestWriteFileHandleWriteAt fstest.go:293: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:293: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:293: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:300: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:300 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Should be true Test: TestWriteFileHandleWriteAt Messages: listing wrong, want file1 (11) got fstest.go:198: Not found "file1" fstest.go:201: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:201 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:305 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:333 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:235 Error: Not equal: expected: 0 actual : 1 Test: TestWriteFileHandleWriteAt Messages: 1 objects not found 2024/05/06 03:55:06 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:06 DEBUG : : Looking for writers 2024/05/06 03:55:06 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleWriteAt (10.20s) === RUN TestWriteFileHandleFlush run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:55:06 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:55:06 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:06 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:55:06 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:55:06 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:06 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:55:06 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:55:06 DEBUG : file1: WriteFileHandle.Flush unwritten handle, writing 0 bytes to avoid race conditions 2024/05/06 03:55:06 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:06 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (5 bytes), uploading instead of streaming 2024/05/06 03:55:07 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7eded452fcf4a7c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:07 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7eded452fcf4a7c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:07 DEBUG : file1: Remove: 2024/05/06 03:55:07 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:55:07 DEBUG : file1: >Remove: err= 2024/05/06 03:55:07 ERROR : file1: WriteFileHandle.Flush error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7eded452fcf4a7c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:256: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:256 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "7eded452fcf4a7c1", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleFlush 2024/05/06 03:55:07 DEBUG : file1: WriteFileHandle.Flush nothing to do dir_test.go:247: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/dir_test.go:247 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:267 Error: Not equal: expected: []string{"file1,5,false"} actual : []string(nil) Diff: --- Expected +++ Actual @@ -1,4 +1,2 @@ -([]string) (len=1) { - (string) (len=13) "file1,5,false" -} +([]string) Test: TestWriteFileHandleFlush 2024/05/06 03:55:07 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:07 DEBUG : : Looking for writers 2024/05/06 03:55:07 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleFlush (1.14s) === RUN TestWriteFileHandleRelease run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:55:07 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:55:07 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:07 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:55:07 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:55:07 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:07 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:55:07 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:55:07 DEBUG : file1: WriteFileHandle.Release closing 2024/05/06 03:55:07 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:07 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (0 bytes), uploading instead of streaming 2024/05/06 03:55:08 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dc6c2b222fb5980f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:08 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dc6c2b222fb5980f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:08 DEBUG : file1: Remove: 2024/05/06 03:55:08 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:55:08 DEBUG : file1: >Remove: err= 2024/05/06 03:55:08 ERROR : file1: WriteFileHandle.Release error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dc6c2b222fb5980f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" write_test.go:279: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:279 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "dc6c2b222fb5980f", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileHandleRelease 2024/05/06 03:55:08 DEBUG : file1: WriteFileHandle.Release nothing to do 2024/05/06 03:55:08 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:08 DEBUG : : Looking for writers 2024/05/06 03:55:08 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileHandleRelease (1.13s) === RUN TestWriteFileModTimeWithOpenWriters run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:55:08 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:55:08 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:08 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:55:08 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:55:08 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:08 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:55:08 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:55:08 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:08 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (2 bytes), uploading instead of streaming 2024/05/06 03:55:09 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ec407fec2a4a14c7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:09 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ec407fec2a4a14c7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:09 DEBUG : file1: Remove: 2024/05/06 03:55:09 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:55:09 DEBUG : file1: >Remove: err= write_test.go:333: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:333 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "ec407fec2a4a14c7", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestWriteFileModTimeWithOpenWriters 2024/05/06 03:55:09 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:09 DEBUG : : Looking for writers 2024/05/06 03:55:09 DEBUG : >WaitForWriters: --- FAIL: TestWriteFileModTimeWithOpenWriters (1.14s) === RUN TestFileReadAtZeroLength run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:55:09 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:55:09 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:09 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:55:09 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:55:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:09 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:55:09 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:55:09 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:09 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (0 bytes), uploading instead of streaming 2024/05/06 03:55:10 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9cafb37f2e333013", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:10 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9cafb37f2e333013", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:10 DEBUG : file1: Remove: 2024/05/06 03:55:10 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:55:10 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "9cafb37f2e333013", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtZeroLength 2024/05/06 03:55:10 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/05/06 03:55:10 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:380 Error: Received unexpected error: file does not exist Test: TestFileReadAtZeroLength 2024/05/06 03:55:10 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:10 DEBUG : : Looking for writers 2024/05/06 03:55:10 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtZeroLength (1.14s) === RUN TestFileReadAtNonZeroLength run.go:180: Remote "QingStor bucket rclone-test-coxunof4coxewis9boqufir2", Local "Local file system at /tmp/rclone1757340506", Modify Window "876000h0m0s" 2024/05/06 03:55:10 INFO : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: poll-interval is not supported by this remote 2024/05/06 03:55:10 NOTICE: QingStor bucket rclone-test-coxunof4coxewis9boqufir2: --vfs-cache-mode writes or full is recommended for this remote as it can't stream 2024/05/06 03:55:10 DEBUG : file1: OpenFile: flags=O_WRONLY|O_CREATE, perm=-rwxrwxrwx 2024/05/06 03:55:11 DEBUG : file1: Open: flags=O_WRONLY|O_CREATE 2024/05/06 03:55:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:11 DEBUG : file1: >Open: fd=file1 (w), err= 2024/05/06 03:55:11 DEBUG : file1: >OpenFile: fd=file1 (w), err= 2024/05/06 03:55:11 DEBUG : : Added virtual directory entry vAddFile: "file1" 2024/05/06 03:55:11 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: File to upload is small (100 bytes), uploading instead of streaming 2024/05/06 03:55:11 ERROR : file1: Failed to copy: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1009fd705779bf5d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:11 ERROR : file1: WriteFileHandle.New Rcat failed: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1009fd705779bf5d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:11 DEBUG : file1: Remove: 2024/05/06 03:55:11 DEBUG : : Added virtual directory entry vDel: "file1" 2024/05/06 03:55:11 DEBUG : file1: >Remove: err= write_test.go:360: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:360 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: QingStor Error: StatusCode "403", Code "too_many_buckets", Message "You created too many buckets, please open ticket to apply more quota.", Request ID "1009fd705779bf5d", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" Test: TestFileReadAtNonZeroLength 2024/05/06 03:55:11 DEBUG : file1: OpenFile: flags=O_RDONLY, perm=---------- 2024/05/06 03:55:11 DEBUG : file1: >OpenFile: fd=, err=file does not exist write_test.go:365: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:365 /home/rclone/go/src/github.com/rclone/rclone/vfs/write_test.go:384 Error: Received unexpected error: file does not exist Test: TestFileReadAtNonZeroLength 2024/05/06 03:55:11 DEBUG : WaitForWriters: timeout=30s 2024/05/06 03:55:11 DEBUG : : Looking for writers 2024/05/06 03:55:11 DEBUG : >WaitForWriters: --- FAIL: TestFileReadAtNonZeroLength (1.14s) FAIL 2024/05/06 03:55:12 DEBUG : QingStor bucket rclone-test-coxunof4coxewis9boqufir2: Purge dir "" 2024/05/06 03:55:12 purge failed to rmdir "": QingStor Error: StatusCode "404", Code "bucket_not_exists", Message "The bucket you are accessing does not exist.", Request ID "ba6aaaa97253278a", Reference URL "http://docsv4.qingcloud.com/user_guide/storage/object_storage/api/error_code" 2024/05/06 03:55:12 purge failed: directory not found "./vfs.test -test.v -test.timeout 1h0m0s -remote TestQingStor: -verbose -test.run '^(TestCaseSensitivity|TestDirCreate|TestDirForgetAll|TestDirForgetPath|TestDirHandleMethods|TestDirHandleReaddir|TestDirHandleReaddirnames|TestDirMethods|TestDirMkdir|TestDirMkdirSub|TestDirOpen|TestDirReadDirAll|TestDirRemove|TestDirRemoveAll|TestDirRemoveName|TestDirRename|TestDirSetModTime|TestDirStat|TestDirWalk|TestFileMethods|TestFileOpen|TestFileOpenRead|TestFileOpenWrite|TestFileReadAtNonZeroLength|TestFileReadAtZeroLength|TestFileRemove|TestFileRemoveAll|TestRWFileHandleFlushRead|TestRWFileHandleMethodsRead|TestRWFileHandleMethodsWrite|TestRWFileHandleReadAt|TestRWFileHandleReleaseRead|TestRWFileHandleSeek|TestRWFileHandleSizeCreateExisting|TestRWFileHandleSizeTruncateExisting|TestRWFileHandleWriteAt|TestRWFileHandleWriteNoWrite|TestRWFileModTimeWithOpenWriters|TestReadFileHandleFlush|TestReadFileHandleMethods|TestReadFileHandleReadAt|TestReadFileHandleRelease|TestReadFileHandleSeek|TestUnicodeNormalization|TestVFSOpenFile|TestVFSRename|TestVFSStat|TestVFSStatParent|TestWriteFileHandleFlush|TestWriteFileHandleMethods|TestWriteFileHandleRelease|TestWriteFileHandleWriteAt|TestWriteFileModTimeWithOpenWriters)$|^TestFileRename$/^(full,forceCache=false|minimal,forceCache=false|minimal,forceCache=true|off,forceCache=false|writes,forceCache=false|writes,forceCache=true)$|^TestFileSetModTime$/^(cache=full,open=false,write=false|cache=full,open=true,write=false|cache=full,open=true,write=true|cache=off,open=false,write=false|cache=off,open=true,write=false|cache=off,open=true,write=true)$'" - Finished ERROR in 5m39.305528766s (try 4/5): exit status 1: Failed [TestDirHandleMethods TestDirHandleReaddir TestDirHandleReaddirnames TestDirMethods TestDirForgetAll TestDirForgetPath TestDirWalk TestDirSetModTime TestDirStat TestDirReadDirAll TestDirOpen TestDirCreate TestDirMkdir TestDirMkdirSub TestDirRemove TestDirRemoveAll TestDirRemoveName TestDirRename TestFileMethods TestFileSetModTime/cache=off,open=false,write=false TestFileSetModTime/cache=off,open=true,write=false TestFileSetModTime/cache=off,open=true,write=true TestFileSetModTime/cache=full,open=false,write=false TestFileSetModTime/cache=full,open=true,write=false TestFileSetModTime/cache=full,open=true,write=true TestFileOpenRead TestFileOpenWrite TestFileRemove TestFileRemoveAll TestFileOpen TestFileRename/off,forceCache=false TestFileRename/minimal,forceCache=false TestFileRename/minimal,forceCache=true TestFileRename/writes,forceCache=false TestFileRename/writes,forceCache=true TestFileRename/full,forceCache=false TestReadFileHandleMethods TestReadFileHandleSeek TestReadFileHandleReadAt TestReadFileHandleFlush TestReadFileHandleRelease TestRWFileHandleMethodsRead TestRWFileHandleSeek TestRWFileHandleReadAt TestRWFileHandleFlushRead TestRWFileHandleReleaseRead TestRWFileHandleMethodsWrite TestRWFileHandleWriteAt TestRWFileHandleWriteNoWrite TestRWFileHandleSizeTruncateExisting TestRWFileHandleSizeCreateExisting TestRWFileModTimeWithOpenWriters TestCaseSensitivity TestUnicodeNormalization TestVFSStat TestVFSStatParent TestVFSOpenFile TestVFSRename TestWriteFileHandleMethods TestWriteFileHandleWriteAt TestWriteFileHandleFlush TestWriteFileHandleRelease TestWriteFileModTimeWithOpenWriters TestFileReadAtZeroLength TestFileReadAtNonZeroLength]