inference icon indicating copy to clipboard operation
inference copied to clipboard

upgrade base image to vllm 0.8 of dockerfile and fix ffmpeg with apt install ffmpeg

Open verigle opened this issue 8 months ago • 5 comments

Feature request / 功能建议

the version of vllm is very old ffmpeg can not used

Motivation / 动机

some new model can not used bacause vllm version is old

ffmpeg can not used, please install it use follow command sudo add-apt-repository ppa:ubuntuhandbook1/ffmpeg6 sudo apt update sudo apt install ffmpeg

Your contribution / 您的贡献

verigle avatar Apr 03 '25 02:04 verigle

Could you submit a PR to fix the ffmpeg?

About the version of vllm, because we packed both vllm and sglang, sglang v0.4.4.post3 cannot live with vllm>=0.8.0, this is the main dilemma.

qinxuye avatar Apr 03 '25 02:04 qinxuye

sorry, if vllm still version 0.6.0, fail to install ffmpeg, because the base image of vllm 0.6.0 is ubuntu 20.04, test is not ok.

verigle avatar Apr 08 '25 02:04 verigle

https://github.com/xorbitsai/inference/pull/2946 tried to address ffmpeg issue, it does not work now?

For vllm 0.8 version of image, we could upgrade until sglang is compatible with vllm >=0.8.0.

qinxuye avatar Apr 08 '25 03:04 qinxuye

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Apr 15 '25 19:04 github-actions[bot]

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Apr 23 '25 19:04 github-actions[bot]

This issue was closed because it has been inactive for 5 days since being marked as stale.

github-actions[bot] avatar Apr 29 '25 19:04 github-actions[bot]

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar May 07 '25 19:05 github-actions[bot]

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar May 15 '25 19:05 github-actions[bot]

This issue was closed because it has been inactive for 5 days since being marked as stale.

github-actions[bot] avatar May 20 '25 19:05 github-actions[bot]