haystack
haystack copied to clipboard
Shape Requirements for REST API
@Timoeller will drive the efforts around this roadmap topic starting from September.
Instead of jumping right into implementation, let's take the time to collect requirements and design a solution that addresses them. Let's take into account the CLI could be the main entry point for the REST API.
Context
- Existing GitHub repo: https://github.com/deepset-ai/haystack-rest-api
- Blog post about serving Haystack with ray serve: https://haystack.deepset.ai/blog/run-haystack-pipelines-with-ray-serve
- Older roadmap topic: https://github.com/deepset-ai/haystack/issues/3755
- Open issue on streaming handler https://github.com/deepset-ai/haystack/issues/4890