pgsink
pgsink copied to clipboard
lawrencejones
Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
https://app.circleci.com/pipelines/github/lawrencejones/pgsink/368/workflows/9fd8f8ae-0ee8-4d9f-9ad4-424b2afe5ab9/jobs/1020 ``` [1610212940] pkg/subscription/integration - 10/10 specs •••make: *** [Makefile:68: test] Terminated ```
The whole 'request shutdown, but also wait for context expiry, and the Shutdown(ctx) method` is repeated across all the components. It feels like something which should be composed with a...
This project will be unmaintainable if we don't have an acceptance test suite that can be used to verify each of the underlying sinks. Find a pattern that works for...
This package needs tests, and might be suitable to upstream to jackc/pglogrepl instead of living within this project.
No idea if this would work, and it most likely isn't useful, but it would be nice to produce struct types instead of maps for the parsed relations. Might be...
At present, removal of a table from the publication causes us to consider that table totally unreliable. In order to re-add the table to our stream, we'd schedule an import...
We don't do much in the face of truncates right now, but that could be considered wrong. If you truncate your database table, should you expect the data to remain...
Produce docs that explain how this works, why it's built this way, and how best to use it.
I'm unsure if a transaction that was in-flight and had created new data would be included in a publication if that table was added during the transaction. That's confusing, this...
Metadata
Owner
Metadata
Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)