target-postgres
target-postgres copied to clipboard
datamill-co
A Singer.io Target for Postgres
# Motivation We've now gotten a number of issues being reported over weirdness with batching. My suspicion is that this _may actually be that batching is a black box_, and...
Ideally, we would have a script/CLI that could test / simulate different loads - Testing for load size in rows (10k, 100k, 1m, 10m etc rows) - Testing for load...
Denesting makes sense for complex objects, but if my postgres tap pulls out an `integer[]` (integer array), the target always denests it into a separate table. Is there a way...
It makes a lot of sense that `target-postgres` tries to load data in a structured way into Postgres. The more that the database knows about the structure of the data,...
# Motivation `SQLInterface` has no `Error` class, nor does it have a Logger. Both of these things are relatively simple, and would make surfacing problems to users much simpler. ##...
# Motivation When we denest a column and then handle things like naming collisions, you can end up with very confusing structures when trying to map it all back to...
# Motivation Presently `SQLInterface` is using mainly the following words for it's non-major API actions: - `upsert` - `add` - `drop` - `get` - `serialize` - `canonicalize` - `make` -...
After updating a singer.io [target-postgres](https://github.com/datamill-co/target-postgres) tap to use a new key, I see the following error: ``` target_postgres.exceptions.PostgresError: ('Exception writing records', PostgresError("`key_properties` change detected. Existing values are: ['uri']. Streamed values...
Hey👋 add this cool x-ray badge which shows excellent information about your project; undoubtedly, other developers can find this helpful.
In this PR, Target-Postgres has been updated to sync incoming columns to single json column.
