Roger Wang comments

Repositories
Issues
Comments

Results 132 comments of


                                            Roger Wang

[Bug]: When using the VLLM framework to load visual models, CPU memory overflow occurs while continuously processing data with images.

Hello @kuladeephx ! This issue has been fixed on the main branch - please see a post-mortem/analysis at the comment [here](https://github.com/vllm-project/vllm/issues/15294#issuecomment-2746380945)

[Usage]: How to use the image datasets sharegpt4v provided in benchmark_serving?

@DK-DARKmatter Hey - feel free to take a look at the example in the description of https://github.com/vllm-project/vllm/pull/12389. We're also trying to consolidate these datasets for different benchmarks in #14036