VLLM Support

[ronakice]

Pull Request Checklist

Reference Issue

Please provide the reference to issue this PR is addressing (# followed by the issue number). If there is no associated issue, write "N/A".

ref:

Checklist Items

Before submitting your pull request, please review these items:

• [x] Have you followed the contributing guidelines?
• [x] Have you verified that there are no existing Pull Requests for the same update/change?
• [x] Have you updated any relevant documentation or added new tests where needed?

PR Type

What kind of change does this PR introduce?

• [ ] Bugfix
• [x] Feature
• [ ] Code style update (formatting, local variables)
• [ ] Refactoring (no functional changes, no api changes)
• [ ] Documentation content changes
• [ ] Other...
  • Description: