inference
inference copied to clipboard
internvl2无法下载
System Info / 系統信息
NVIDIA-SMI 535.183.06 Driver Version: 535.183.06 CUDA Version: 12.2
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [X] docker / docker
- [ ] pip install / 通过 pip install 安装
- [ ] installation from source / 从源码安装
Version info / 版本信息
Release: v0.15.2
The command used to start Xinference / 用以启动 xinference 的命令
docker run
Reproduction / 复现过程
internvl2无法下载 2024-09-25 06:42:28,094 xinference.api.restful_api 1 ERROR [address=0.0.0.0:51543, pid=140] Failed to download model 'internvl2' (size: 4, format: pytorch) after multiple retries requests.exceptions.HTTPError: The request model: OpenGVLab/InternVL2-4B does not exist!
无论是vllm还是transfmors,无论是4b还是其他
Expected behavior / 期待表现
可以i下载
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 5 days since being marked as stale.