upgrade base image to vllm 0.8 of dockerfile and fix ffmpeg with apt install ffmpeg
Feature request / 功能建议
the version of vllm is very old ffmpeg can not used
Motivation / 动机
some new model can not used bacause vllm version is old
ffmpeg can not used, please install it use follow command
sudo add-apt-repository ppa:ubuntuhandbook1/ffmpeg6
sudo apt update
sudo apt install ffmpeg
Your contribution / 您的贡献
Could you submit a PR to fix the ffmpeg?
About the version of vllm, because we packed both vllm and sglang, sglang v0.4.4.post3 cannot live with vllm>=0.8.0, this is the main dilemma.
sorry, if vllm still version 0.6.0, fail to install ffmpeg, because the base image of vllm 0.6.0 is ubuntu 20.04, test is not ok.
https://github.com/xorbitsai/inference/pull/2946 tried to address ffmpeg issue, it does not work now?
For vllm 0.8 version of image, we could upgrade until sglang is compatible with vllm >=0.8.0.
This issue is stale because it has been open for 7 days with no activity.
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 5 days since being marked as stale.
This issue is stale because it has been open for 7 days with no activity.
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 5 days since being marked as stale.