Aashish Ghimire comments

Repositories
Issues
Comments

Results 1 comments of


                                            Aashish Ghimire

Image eats up way too many tokens

Hi, I still see the same issue (HF Magma model, hosted in Azure AI Foundry). The validator wants (input image + prompt + max_new_tokens) < 4096 If I pass a...