mlx-swift-examples
mlx-swift-examples copied to clipboard
Gemma3: Image Handling Error and <end_of_turn> Looping Issue
Nice release! However, I've run into a couple of small issues with Gemma3, any help/insights or fixes would be greatly appreciated! Thank you!
-
First off, I'm puzzled about this error that keeps popping up when I specify in my code that the gemma3 model's type is .vlm (it's supposed to handle images right?):
-
I'm running the "mlx-community/gemma-3-1b-it-4bit" model
-
Moving on to the second hiccup, when I stick to text-only input in my code (.llm), everything seems to work just fine.
-
But then, I stumble upon another issue where, at the end of the answer, the model seems to start looping. It feels like Gemma 3 is caught in a never-ending dance with <end_of_turn>.