Czi.

Results 3 comments of Czi.

InternVL2-40B模型出现输出混乱的现象

> 老哥，你的40B模型部署需要多少显存 老哥，可以看看这里 https://github.com/Czi24/Awesome-MLLM-LLM-Colab/blob/master/MLLM/InternVL-colab/InternVL.md

What happens when the model is deployed and the conversation cannot take place

> ![微信截图_20240715175534](https://private-user-images.githubusercontent.com/53080421/348970928-4cb72eb6-738d-4814-9aad-7968552afd8b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjExMTk0NjgsIm5iZiI6MTcyMTExOTE2OCwicGF0aCI6Ii81MzA4MDQyMS8zNDg5NzA5MjgtNGNiNzJlYjYtNzM4ZC00ODE0LTlhYWQtNzk2ODU1MmFmZDhiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzE2VDA4MzkyOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWZlM2ViZGViZjg4NDBkMWFhZjAyMjU0ZTc0YzJkMjFlYTRkNDA2MDY5ZDk0OTQyNGM4YmNlYTg1ZDM3YWU1ODEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.c1zEouTFJxTpY86PUbUCf7sFO4Pvq7oyaa6e9boYhXw) 需要使用合适的显卡

What happens when the model is deployed and the conversation cannot take place

https://github.com/Dao-AILab/flash-attention/issues/887