llm
llm copied to clipboard
Asynchronous API support
Have you considered adding support for Asychronous APIs for the models that support it? It would make deploying llm
as part of a web application easier and more scalable.
Would you accept contributions that tried to add this functionality?