Running Mistral-7B-v0.1-hf-4bit-mlx on m2 iPad pro 8gb crashes

[developer-yl]

I am getting a crash when I run the model. I can load the model fine. But it crashes once I run it. Can this app run 8gb models on a real iOS device?

I seem to still have free memory available

[SKI79]

I'm having this same issue, but with much smaller models. Any model will crash on my iPad Pro M1 8GB. I think the app needs to be made to work with iOS, which is on their list of things to do.

[Emasoft]

Still waiting for it to work on my iPad Pro M4!