Mike Knapp

I'm playing around with CogVLM2 now. Can you share what prompt(s) you would use to caption an image?

> I encountered the same issue as you did. I checked all the installation versions on the official Colab and ensured that they were consistent, but the problem still persisted....

I was able to get around this particular issue by changing `patch_Gemma3Attention.forward()` inside `unsloth/temporary_patches.py` to read: ```python def forward( self, hidden_states: torch.Tensor, position_embeddings: torch.Tensor, attention_mask: Optional[torch.Tensor], past_key_value: Optional[Cache] = None,...

I get a blank login box now

> ed is a project that I simply converted because I wanted to use it myself. Hi @sybaek-infinyx - could you please post your updated consts file? That would be...

> [@mikeknapp](https://github.com/mikeknapp) https://github.com/sybaek-infinyx/gguf_convert/tree/main I've shared the code on my GitHub. However, please note that the code is not very readable. I was initially reluctant to share it in this state,...

Actually, while the code runs, and I get an output ... there is something off about the model? It seems very different to the non-GGUF version. @sybaek-infinyx Have you noticed...