vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[Misc] Avoid calling unnecessary `hf_list_repo_files` for local model path

Open Isotr0py opened this issue 2 weeks ago • 2 comments

  • There will be error logs due to hf_list_repo_files calling when model repo is local:
INFO 02-16 13:46:11 __init__.py:190] Automatically detected platform cuda.
ERROR 02-16 13:46:11 config.py:102] Error retrieving file list: Repo id must use alphanumeric chars or '-', '_', '.', '--' and '..' are forbidden, '-' and '.' cannot start or end the name, max length is 96: '../Florence-2-base'., retrying 1 of 2
ERROR 02-16 13:46:13 config.py:100] Error retrieving file list: Repo id must use alphanumeric chars or '-', '_', '.', '--' and '..' are forbidden, '-' and '.' cannot start or end the name, max length is 96: '../Florence-2-base'.
INFO 02-16 13:46:13 config.py:2407] Downcasting torch.float32 to torch.float16.
  • Avoid unnecessary hf_list_repo_files calling if the model repo is local so that we can prevent misleading error logs.

Isotr0py avatar Feb 16 '25 06:02 Isotr0py