Ask-Anything icon indicating copy to clipboard operation
Ask-Anything copied to clipboard

Deploy `Ask-Anything` as APIs locally/on cloud using `langchain-serve`

Open deepankarm opened this issue 1 year ago • 1 comments

Repo - langchain-serve.

  • Exposes APIs from function definitions locally as well as on the cloud.
  • Very few lines of code changes and ease of development remain the same as local.
  • Supports both REST & WebSocket endpoints
  • Serverless/autoscaling endpoints with automatic tls certs on the cloud.
  • Real-time streaming, human-in-the-loop support - which is crucial for chatbots.

Disclaimer: I'm the primary author of langchain-serve. Would be happy to collaborate on this!

deepankarm avatar Apr 26 '23 11:04 deepankarm