Ted Huang

icon indicating an email [email protected]

icon location Feel free to contact me using any of the following methods! eMail : [email protected] / Wechat / Cell : 18514281727 I'm seeking talents all the time!

Results 2 issues of Ted Huang

cli_demo.py中使用的chat函数是否能支持流式输出

int4量化模型，运行一段时间后报错

OS: ubuntu GPU: v100 ERROR: Exception in ASGI application Traceback (most recent call last): File "/opt/conda/envs/py38/lib/python3.8/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 254, in run_asgi result = await self.app(self.scope, self.asgi_receive, self.asgi_send) File "/opt/conda/envs/py38/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 78,...