vllm
vllm copied to clipboard
[Misc] Separate hf dataset sampling function from benchmark_serving.py
- To support different VLM HF dataset, the sampling function for hf dataset is growing large and complex in
benchmark_serving.py
- This PR aims to separate and decouple hf dataset sampling function from benchmark_serving.py to keep benchmark script clean