mlx-swift-examples
mlx-swift-examples copied to clipboard
ml-explore
Examples using MLX Swift
ml-swift support for gpt-neox just got merged, as per [#847](https://github.com/ml-explore/mlx-examples/issues/847). It'd be great have it supported on mlx-swift as well, whenever possible. Cheers.
Have you tried this on Sequoia ? it was working fine for me but it crashes since I updated to Mac OS Sequoia Beta.
I am interested in running the `mlx-community/Phi-3-mini-128k-instruct-4bit` model with swift, but it cannot be loaded. Here is the output I am seeing: ``` ➜ mlx-swift-examples git:(main) ./mlx-run llm-tool eval --model...
I'm not sure if there is any change to MLX Swift or the examples to make it happen other than setting the right capability. But just want to open this...
This adds ModelConfigurations for the new [Llama 3.2](https://www.llama.com) lightweight models with 1B and 3B parameters, and bumps the Xcode project dependency on `swift-transformers` so that it can use the new...
Consider porting some models from https://github.com/Blaizzy/mlx-vlm to swift
Same root cause as that of [issue #92](https://github.com/ml-explore/mlx-swift-examples/issues/92) typeMismatch(Swift.String, Swift.DecodingError.Context(codingPath: [CodingKeys(stringValue: "rope_scaling", intValue: nil), _CodingKey(stringValue: "long_factor", intValue: nil)] It's a pity, as phi-3.5 comes with a lot of goodies.
After https://github.com/ml-explore/mlx-swift-examples/commit/ab94ffc2f31a70ead3c7007afaf97a225ed3ec90, I'm getting a crash the second time I try to generate text with my app, which uses mlx-libraries. I can't reproduce this with the LLMEval example app at...
- based on #125 with simpler mechanism (NSLock)
This is my attempt to port the Phi 3.5 MoE model from the [Python implementation](https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/models/phimoe.py). Unfortunately I can't test it myself, since my MacBook doesn't have enough RAM. I marked...