dlt icon indicating copy to clipboard operation
dlt copied to clipboard

support loading via staging for postgres with embedded duckdb (pg_duckdb)

Open rudolfix opened this issue 6 months ago • 0 comments

Background We are implementing #1692 and the same code should work also for postgres with embedded duckdb: https://github.com/duckdb/pg_duckdb

We'll allow a fast loading of parquet/json/csv from buckets most probably without any additional code.

Requirements

    • [ ] create tables using postgres table engine
    • [ ] copy data into those tables with duckdb engine

support looks like early. I wonder if replication and backups work for duckdb tables

rudolfix avatar Aug 21 '24 21:08 rudolfix