mlx-swift-examples

mlx-swift-examples copied to clipboard

llm-tool: crash during sync generation

1

I know there is an issue with async generation but the sync version is also now crashing in debug. This is with the current state of the repo, and no...

rudro

Hi, I am at a loss atm. I am getting this error when I try to build the app on my phone. ``` Failed to install the app on the...

h21k

Let's try this as a fix for #59 and maybe #57

davidkoski

Phi-3 on iOS,

4

impossible to run the iOS version I get : import MLX - No such module 'MLX'

fromparis

minor fix

eltociear

added editable text for prompt inputs

2

- passed swift-format - makes the text editable for custom prompts on the device

h21k

LLMEval: "Cycle inside LLMEval; building could produce unreliable results" build error

3

Context: I'm trying to run the LLMEval iOS application on Apple M1 Pro 32 GB running macOS Version 14.4.1 I've considered the following solutions so far: 1. Ensured I'm running...

ddiddi

handle partially quantized models

3

- fix for #53 #71 #69 #74 - in order to test the models - I added a default prompt of an appropriate form - while working on the model...

davidkoski

Phi-3 mini stop token not recognized

4

[This Phi 3 model](https://huggingface.co/mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed) used in the LLMEval app doesn't behave as expected. It looks like the stop token is not being recognized. Prompt: ``` Name a color. ``` Output:...

DePasqualeOrg

`generate` silently fails on OpenELM 3B after latest commit

3

[Original comment removed, see below] ```swift import Foundation import MLXLLM extension ModelConfiguration { static let openelm3b = ModelConfiguration( id: "mlx-community/OpenELM-3B" ) { prompt in "\(prompt)" } } ```

DePasqualeOrg