Apple silicone

Open dxcore35 opened this issue 2 months ago • 8 comments

Can we run it on apple silicon? Anybody tested the performance?

Dec 05 '25 14:12 dxcore35

I just tested the new smaller model (realtime) with my M1 Max 64 Gb. It runs but audio is very choppy.

Dec 05 '25 16:12 scalar27

@scalar27 Thank you for feedback. I always have same problem on apple silicon it produce garbage.... Are you going to try standard size model?

Dec 06 '25 10:12 dxcore35

It's not garbage per se. It is just that the audio is not smooth. I don't think I will try a larger model. But if quants can be made of this one that should help a lot.

Dec 06 '25 17:12 scalar27

Can you share the code for generation? How is the GPU utilization?

Dec 06 '25 17:12 dxcore35