PyAirbyte
PyAirbyte copied to clipboard
Feature: (Early Draft) Add destinations support
[Early draft for discussion.]
Resolves: https://github.com/airbytehq/PyAirbyte/issues/197
This adds proper destination support to PyAirbyte, including for docker-based destinations when Docker is available. There's still a lot to do here, but it's a good first step.
Open questions:
- [ ] How to get, write, and store state. Maybe another state backend or re-use our existing state backend tables?
- [ ] How to handoff the stream from the source's STDOUT to the destination's STDIN.
- [ ] Windows compat is hard, with pipe and socket handling differing between Windows and Mac/Linux.
- [ ] Whether the MVP should support source-to-destination or cache-to-destination, or both.