Can use this project without docker?

Open Arcmoon-Hu opened this issue 2 years ago • 1 comments

Can I use this project in a python virtual env? Or must use docker?

Dec 04 '23 07:12 Arcmoon-Hu

Good question. For now, Scalellm only supports running in a docker. We will be trying to add python and js wrapper once finishing ongoing performance optimizations. Stay tuned!

Dec 04 '23 16:12 guocuimi

A quick update for you: python is supported in latest release. you can install scalellm with pip: pip install scalellm and start rest api server with python3 -m scalellm.serve.api_server Please let me know if you have any questions. thanks

May 17 '24 16:05 guocuimi