Anthony
Anthony
I'd love to add VR/AR support to these sketches, but I'm having a lot of trouble updating this repository's copy of Three.js to the most recent version. If you could...
I'm trying to get this example running, and I've encountered a few hurdles: `.svelte-kit/tsconfig.json`, which is extended by `tsconfig.json`, is missing in the cloned repository. I had to create the...
SvelteKit is now in Release Candidate status, and it has changed significantly since this repository was last updated. Since no more breaking changes to SvelteKit are expected before 1.0, perhaps...
[This Phi 3 model](https://huggingface.co/mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed) used in the LLMEval app doesn't behave as expected. It looks like the stop token is not being recognized. Prompt: ``` Name a color. ``` Output:...
[Original comment removed, see below] ```swift import Foundation import MLXLLM extension ModelConfiguration { static let openelm3b = ModelConfiguration( id: "mlx-community/OpenELM-3B" ) { prompt in "\(prompt)" } } ```
The OpenELM instruct models don't seem to produce useful output with the current (empty) prompt template. I've tried other common templates, but they don't seem to work with these models....
When I try to generate output with OpenElm 270M on a [2018 iPad Pro](https://support.apple.com/en-us/111974), the LLMEval demo app crashes with the following error: ``` Compiler failed to build request libc++abi:...
I added a configuration option for [OpenELM 1b Instruct 8-bit](https://huggingface.co/mlx-community/OpenELM-1_1B-Instruct-8bit) like so: ```swift public static let openelm1bInstruct8bit = ModelConfiguration( id: "mlx-community/OpenELM-1_1B-Instruct-8bit" ) { prompt in "\(prompt)" } ``` But when...
In `Libraries/LLM/Load.swift`, the tokenizer is first loaded. As part of this process, `config.json` is downloaded if it hasn't been downloaded already. Then that same file is included in `modelFiles` (which...
https://github.com/ml-explore/mlx-swift/pull/124 I haven't tested this with Phi 3.5 yet, but will do that tomorrow.