EXO crashed when running large models

Open moo-nin opened this issue 8 months ago • 0 comments

I have a Mac studio( Apple M3 Ultra 256G RAM) and a Mac mini( Apple M4 32G RAM),try to run Deepseek R1-671b(3bit) but failed. Every time i type a word ,the website show "Generating" and then exo crashed. How can i solve this proble

The website and CMDline shows like this

I try to run exo with debug=9, information shows like this:

cmdinformation.docx

Apr 18 '25 06:04 moo-nin