llm icon indicating copy to clipboard operation
llm copied to clipboard

Published 20 hours ago • verified publisher icon simonw

Asynchronous API support

Open czue opened this issue 1 month ago • 1 comments

Have you considered adding support for Asychronous APIs for the models that support it? It would make deploying llm as part of a web application easier and more scalable.

Would you accept contributions that tried to add this functionality?

czue avatar May 08 '24 07:05 czue