Linorman H

Results 9 comments of Linorman H

> That looks ok to me. I think you are seeing this error: > > public enum ModelFactoryError: LocalizedError { > case unsupportedModelType(String) > I presume from this line: >...

There is no huggingface id so I can't test using `llm-tool`

> It should work if you do `--model /path/to/model/directory` Thanks, I tried and it loaded successfully. So there is something wrong with other codes?

> Nothing obvious, but I would look at this part: > > let configurationURL = modelConfiguration.modelDirectory().appendingPathComponent("config.json") > let baseConfig = try JSONDecoder().decode(BaseConfiguration.self, from: Data(contentsOf: configurationURL)) > let model = try...

> OK, what is the value of the type/modelType? That needs to match this list: > > * https://github.com/ml-explore/mlx-swift-examples/blob/main/Libraries/MLXLLM/LLMModelFactory.swift#L31 qwen3, it's a finetuned model based on Qwen3-1.7B, this is the...

Ok, I find something strange, in the latest version of mlx-swift-examples, there is no `asMessage()` function in `UserInput`, and I still call this function in my codes but build without...

> yes, that sounds like you are using an older checkout / tag, but from your screenshot you are up-to-date. If you cmd-click on that symbol, see what source it...

> OK, perhaps we can catch it failing and see something that way. > > This method in `ModelTypeRegistry` is what throws the error: > > public func createModel(configuration: URL,...

> My guess is that there are somehow _two_ copies of `mlx-swift` or `mlx-libraries` (the package inside of `mlx-swift-examples`). One is current and one is older and the older one...