model_server
model_server copied to clipboard
[release branch] Fix running vllm benchmarking scripts
🛠 Summary
CVS-149701
vllm cpu requirements cannot be installed in demo's venv without this env
🧪 Checklist
- [x] Unit tests added.
- [x] The documentation updated.
- [x] Change follows security best practices.