flyingpiggylet issues

Repositories
Issues
Comments

Results 2 issues of


                                            flyingpiggylet

Is it possible to do batch inference for multiple image per sample?

https://huggingface.co/OpenGVLab/InternVL2-Llama3-76B this link only gives an example on how to do batch inference single image per sample. Is it possible to do batch inference for multiple image per sample specifically...

[Feature] batch inference for interleaved data

### Motivation Maybe I am wrong but it does not look like the current chat api support batch inference for interleaved text and image data. ### Related resources NA ###...