mlx-swift-examples icon indicating copy to clipboard operation
mlx-swift-examples copied to clipboard

Gemma3: Image Handling Error and <end_of_turn> Looping Issue

Open louisauguste opened this issue 4 months ago • 12 comments

Nice release! However, I've run into a couple of small issues with Gemma3, any help/insights or fixes would be greatly appreciated! Thank you!

  • First off, I'm puzzled about this error that keeps popping up when I specify in my code that the gemma3 model's type is .vlm (it's supposed to handle images right?): Image

  • I'm running the "mlx-community/gemma-3-1b-it-4bit" model

  • Moving on to the second hiccup, when I stick to text-only input in my code (.llm), everything seems to work just fine.

  • But then, I stumble upon another issue where, at the end of the answer, the model seems to start looping. It feels like Gemma 3 is caught in a never-ending dance with <end_of_turn>. Image

louisauguste avatar Jul 18 '25 20:07 louisauguste