PyAirbyte icon indicating copy to clipboard operation
PyAirbyte copied to clipboard

Feature: (Early Draft) Add destinations support

Open aaronsteers opened this issue 1 year ago • 0 comments

[Early draft for discussion.]

Resolves: https://github.com/airbytehq/PyAirbyte/issues/197

This adds proper destination support to PyAirbyte, including for docker-based destinations when Docker is available. There's still a lot to do here, but it's a good first step.

Open questions:

  1. [ ] How to get, write, and store state. Maybe another state backend or re-use our existing state backend tables?
  2. [ ] How to handoff the stream from the source's STDOUT to the destination's STDIN.
  3. [ ] Windows compat is hard, with pipe and socket handling differing between Windows and Mac/Linux.
  4. [ ] Whether the MVP should support source-to-destination or cache-to-destination, or both.

aaronsteers avatar May 22 '24 16:05 aaronsteers