mlx-swift-examples
mlx-swift-examples copied to clipboard
Error when running OpenELM 1b Instruct 8-bit
I added a configuration option for OpenELM 1b Instruct 8-bit like so:
public static let openelm1bInstruct8bit = ModelConfiguration(
id: "mlx-community/OpenELM-1_1B-Instruct-8bit"
) { prompt in
"\(prompt)"
}
But when I run the model, I get the following error: Failed: unhandledKeys(base: "Embedding", keys: ["biases", "scales"])
I think this is the same as #53 -- I am still preparing the code to load these new quantized values.
#76 should fix this