vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[Misc] Separate hf dataset sampling function from benchmark_serving.py

Open Isotr0py opened this issue 1 month ago • 1 comments

  • To support different VLM HF dataset, the sampling function for hf dataset is growing large and complex in benchmark_serving.py
  • This PR aims to separate and decouple hf dataset sampling function from benchmark_serving.py to keep benchmark script clean

Isotr0py avatar Jan 26 '25 16:01 Isotr0py