Bhargav Solanki

@Iven2132 I created a fastapi + uvicorn endpoint for now.

I had made this feature request here . https://github.com/vllm-project/vllm/discussions/4350