Orion icon indicating copy to clipboard operation
Orion copied to clipboard

Published 20 hours ago • verified publisher icon OrionStarAI

如何暴露openai形式的api?

Open leavegee opened this issue 1 year ago • 2 comments

如题所问

leavegee avatar Jan 22 '24 14:01 leavegee

gradio demo运行需要指定endpoint，用哪个推理框架发布api？

hunter-xue avatar Jan 22 '24 23:01 hunter-xue

gradio demo运行需要指定endpoint，用哪个推理框架发布api？

fastchat , 可以用吗?

leavegee avatar Jan 24 '24 02:01 leavegee