ducklake
ducklake copied to clipboard
duckdb
DuckLake is an integrated data lake and catalog format
@Mytherin for this to work, please set the `DUCKDBLABS_BOT_TOKEN` in the admin settings.
At the moment there is one large gap in the DuckLake manifesto and implementation, which is how to handle users, roles and access. Traditionally this is something that DuckDB didn't...
Hi team, Pretty exciting stuff, but I didn't hear anything in the podcast / announcement about how catalog owners are expected to handle access control? For example, row-based, column-based, and...
Add ducklake_options() table function for retrieving configuration options. `option_name VARCHAR, description VARCHAR, value VARCHAR, scope VARCHAR, scope_entry VARCHAR`
Hey there, thanks for building `ducklake`! Very exciting project! I was wondering if any thought has already been given to integration with other parquet-consuming engines such as `polars`. My question...
First off, congrats on the launch and thanks for building ducklake! Do you think the ducklake extension would ever be open to supporting an external process uploading data to the...
Data was loaded via DBT-DuckDB, with some tables having 2 level partitions. I have tried loading data via DBT to both cloudflare R2 and GCP Cloud Storage. I've tried deleting...
I tried to do three concurrent medium-sized inserts (a few GB each) to a table using a sqlite metadata catalog. All three failed after the progress bar reached 100%, with...
Hello, Maybe I missed some information somewhere. I set up a DuckLake with a MySQL catalog, everything seemed fine, but when I wan't to reattach it I run into those...
https://docs.databricks.com/aws/en/sql/language-manual/delta-optimize can we add a utility similar to Delta optimize so that: - small files are merged to the target size (this is already available as part of the table...
