InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

Support for Mac for internvl-chat-v1.5

Open gitrodg1 opened this issue 1 year ago • 0 comments

I am very impressed with the great work you have done. I have a Mac M2 ultra so can't run the model locally because of the need to use cuda, instead of the apple gpu,mps. I have managed to the model loaded and generate the input ids tokenizer and pixel values as shown in the huggingface repository. Unfortunately lmdeploy and flash attention don't function on the Mac. If there is any possibility of adding support for apple silica many more people in the community would get to experience your great work. Thank you for creating the gradio demo. That way even though the model is inaccessible for local testing I can see what I'm missing. Thanks again for all your efforts.

gitrodg1 avatar May 20 '24 10:05 gitrodg1