mistral-inference icon indicating copy to clipboard operation
mistral-inference copied to clipboard

Xformers cannot be installed on MAC M1 Pro

Open Naqqash opened this issue 2 years ago • 6 comments

Trying to install and I am getting the error below on my Mac M1 Pro running Ventura 13.4.1. Some search tells me that it is not supported as it is for Nvidia GPUs however, wanted to leave this here just in case.

image

Naqqash avatar Sep 28 '23 08:09 Naqqash

@Naqqash try this first

pip3 install torch torchvision

0smboy avatar Sep 28 '23 09:09 0smboy

See #2 as well

ControlCplusControlV avatar Sep 28 '23 13:09 ControlCplusControlV

Thank you @0smboy

@Naqqash try this first

pip3 install torch torchvision

Unfortunately this did not work for me.

Based on @ControlCplusControlV comment from that issue https://github.com/mistralai/mistral-src/issues/2

https://ollama.ai/ worked for me

Naqqash avatar Sep 28 '23 17:09 Naqqash

@Naqqash try this first

pip3 install torch torchvision

Thanks @0smboy , this worked for me (M2 laptop).

y-c-mak avatar Sep 28 '23 17:09 y-c-mak

@Naqqash try this first

pip3 install torch torchvision

Thanks @0smboy , this worked for me (M2 laptop).

no luck here with this approach (M2 Pro), same error as in the OP

joefutrelle avatar Sep 29 '23 12:09 joefutrelle