postgres Package pg_duckdb for review

This task is to package (but not ship) pg_duckdb to evaluate it locally and check interop with Supabase S3 compatible Storage

Aug 09 '24 16:08 olirice

This is in process about 70%

Ran into some issues with the Makefile assumptions about deps and installation, and so will need to patch that on build

Aug 15 '24 14:08 samrose

Hi! Are you writing a nix derivation for pg_duckdb? Because I tried here without success.

The compilation works fine, but the installPhase seems to fail with:

pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/mkdir -p '/nix/store/wwp41hdca4bwpsczq47a7bzj19pr63fz-postgresql-16.2/share/postgresql/extension'
pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/mkdir -p '/nix/store/wwp41hdca4bwpsczq47a7bzj19pr63fz-postgresql-16.2/share/postgresql/extension'
pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/install -c -m 755  pg_duckdb.so '/nix/store/r0kvgrg6j84jwva3vcisvc6ggwbvwmi4-postgresql-16.2-lib/lib/pg_duckdb.so'
pg_duckdb> /nix/store/ifzwv2xqwdnv1gz87rxkizi67py5p3vj-coreutils-9.4/bin/install: cannot create regular file '/nix/store/r0kvgrg6j84jwva3vcisvc6ggwbvwmi4-postgresql-16.2-lib/lib/pg_duckdb.so': Permission denied
pg_duckdb> make: *** [/nix/store/wwp41hdca4bwpsczq47a7bzj19pr63fz-postgresql-16.2/lib/pgxs/src/makefiles/../../src/Makefile.shlib:422: install-lib-shared] Error 1

Aug 28 '24 07:08 docteurklein

I'm waiting for this like Christmas 🎄

Oct 30 '24 16:10 riderx

This is packaged. Closing. Thanks for feedback folks!

Oct 31 '24 18:10 samrose

When can we expect that to be released @samrose ?

Nov 02 '24 03:11 riderx

When can we expect that to be released @samrose ?

No ETA yet. We needed to package to evaluate. But we’ll be sure to announce if we end up using this!

Nov 02 '24 13:11 samrose

Understand, could we have maybe issue to track progress on that ? Generally any columnar db truely open source will solve my problem as user pf supabase cloud

Nov 02 '24 13:11 riderx

Commenting as it's been a few months, and I echo the sentiment that having a columnar storage extension for the managed Supabase offering would be amazing. It would really reduce storage costs and increase the performance for large analytical workloads. Is there any update about the extension being made available?

Apr 14 '25 12:04 reveritas

I got taught that will arrive soon

Apr 14 '25 12:04 riderx

Hopefully "soon" means very soon! I've been evaluating the process of self-hosting Supabase just to integrate pg_duckdb, but if this is in the works I'll stick with the cloud offering for now.

Apr 14 '25 13:04 reveritas

The streets need this!

Jun 13 '25 17:06 julioxavierr

I saw on X paul testing ducklake. And he say they are working on it but not more

Jun 13 '25 19:06 riderx