Show Currently Using CPU or Not

Open owenzhao opened this issue 1 year ago • 3 comments

Sometimes ChatMLX shows answers slowly and CPU gets near 100% with 0 GPU usage. Then I know the acceleration didn't work.

After I quit ChatMLX and restart it, everything works fine again.

So maybe ChatMLX can remind me when the performance is down.

Oct 17 '24 02:10 owenzhao

Can you tell me which model you are using? It might be an issue triggered by MLX

Oct 17 '24 03:10 johnmai-dev

I didn't notice which model at that time. But I only have those models.

Oct 17 '24 03:10 owenzhao

I just have tried all models above and all can use GPU now.

I removed a model with "vision" yesterday as it didn't work with ChatMLX. It was begin with Phi-3.5 and downloaded from MLX community. Maybe the performance dropped after the error showing in that model?

Oct 17 '24 03:10 owenzhao