mlx-swift-chat
mlx-swift-chat copied to clipboard
A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.
StableLM

I'm on Sonoma 14.0 When I try to build and run I have these errors: 'mlx/backend/metal/kernels/utils.h' file not found 'mlx/backend/metal/kernels/unary.h' file not found Could this be linked to this: https://github.com/ml-explore/mlx-swift/issues/36...
I am getting a crash when I run the model. I can load the model fine. But it crashes once I run it. Can this app run 8gb models on...
This PR fixes iOS/iPadOS build and broken UI.   
Does this app work with ollama?
I have downloaded deepseek-r1-qwen-distill-7B from huggingface and then converted it with mlx_lm.convert with 8 bits quantization and 16 bit float dtype. Is there a way to load this model from...