ChatGLM-6B
ChatGLM-6B copied to clipboard
[Feature] <api.py能不能支持多进程>
Is your feature request related to a problem? Please describe.
uvicorn.run("api:app", host='0.0.0.0', port=7860, workers=2)
目前的全局变量不支持多进程
Solutions
建议支持uvicorn workers > 1
Additional context
No response
放在服务器上,不就是多线程了吗