candle
candle copied to clipboard
mlx-community/gemma-2-2b-it-4bit infer error
I am trying to infer mlx-community/gemma-2-2b-it-4bit using the candle-examples/gemma sample.
But the following error occurs: Error: shape mismatch for model.embed_tokens.weight, expected: [256000, 2304], got: [256000, 288]
It's very difficult for me as I'm a beginner. Please help me.