model_server icon indicating copy to clipboard operation
model_server copied to clipboard

[release branch] Fix running vllm benchmarking scripts

Open dkalinowski opened this issue 1 year ago • 0 comments

🛠 Summary

CVS-149701

vllm cpu requirements cannot be installed in demo's venv without this env

🧪 Checklist

  • [x] Unit tests added.
  • [x] The documentation updated.
  • [x] Change follows security best practices.

dkalinowski avatar Aug 27 '24 14:08 dkalinowski