aisuite icon indicating copy to clipboard operation
aisuite copied to clipboard

Published 20 hours ago • verified publisher icon andrewyng

Add vLLM provider

Open terrytangyuan opened this issue 11 months ago • 6 comments

This PR adds vLLM provider for OpenAI compatible vLLM server.

terrytangyuan avatar Nov 28 '24 02:11 terrytangyuan

cc @rohitprasad15 @standsleeping @ksolo @jeffxtang @andrewyng @johnsanterre Could you review this when you get a chance? Thank you!

terrytangyuan avatar Nov 28 '24 02:11 terrytangyuan

@rohitprasad15 Resolved conflicts. Could you take a look? Thanks

terrytangyuan avatar Dec 05 '24 22:12 terrytangyuan

Thanks @terrytangyuan, I will review it tonight.

rohitprasad15 avatar Dec 07 '24 03:12 rohitprasad15

Thanks. Just fixed the lint check.

terrytangyuan avatar Dec 07 '24 12:12 terrytangyuan

@rohitprasad15 Just fixed another set of conflicts.

terrytangyuan avatar Dec 11 '24 17:12 terrytangyuan

@rohitprasad15 Any update? Thanks.

terrytangyuan avatar Dec 20 '24 03:12 terrytangyuan