candle icon indicating copy to clipboard operation
candle copied to clipboard

mlx-community/gemma-2-2b-it-4bit infer error

Open ktmobility1 opened this issue 1 year ago • 0 comments

I am trying to infer mlx-community/gemma-2-2b-it-4bit using the candle-examples/gemma sample.

But the following error occurs: Error: shape mismatch for model.embed_tokens.weight, expected: [256000, 2304], got: [256000, 288]

It's very difficult for me as I'm a beginner. Please help me.

ktmobility1 avatar Oct 03 '24 08:10 ktmobility1