Ask-Anything
Ask-Anything copied to clipboard
Deploy `Ask-Anything` as APIs locally/on cloud using `langchain-serve`
Repo - langchain-serve.
- Exposes APIs from function definitions locally as well as on the cloud.
- Very few lines of code changes and ease of development remain the same as local.
- Supports both REST & WebSocket endpoints
- Serverless/autoscaling endpoints with automatic tls certs on the cloud.
- Real-time streaming, human-in-the-loop support - which is crucial for chatbots.
Disclaimer: I'm the primary author of langchain-serve. Would be happy to collaborate on this!