What happens when the model is deployed and the conversation cannot take place

Open Kevinnerel opened this issue 1 year ago • 5 comments

微信截图_20240715175534

Jul 16 '24 06:07 Kevinnerel

需要使用合适的显卡

Jul 16 '24 08:07 Czi24

您好我是Tesla 4的显卡，不能部署这个模型吗

Jul 16 '24 09:07 Kevinnerel

9e6b3a46562841e6c757101fc3754ba 4558612a82bd91fb1f5298be6274131 这是后台报错信息，但是{model:"dynamic"}我在gradio里没找到这个参数

Jul 16 '24 09:07 Kevinnerel

https://github.com/Dao-AILab/flash-attention/issues/887

Jul 16 '24 10:07 Czi24