Question about Appender interface

[VGSML]

Is it possible to use Appender interface to ingest data to the ducklake tables? Will it work with partionen tables?

[Tishj]

I don't think it will, as the Appender provided in the C++ API is specific to the DuckDB storage format. This mimics parts of the internals of the PhysicalInsert operator that is used by the INSERT statement when targeting a DuckDB database.

It's probably possible however to create an implementation of the Appender interface for DuckLake

[VGSML]

It would be nice to have this option to ingest huge data. Can it be included to the wishlist:))Sent from my iPhoneOn 27. May 2025, at 21:59, Thijs @.***> wrote:Tishj left a comment (duckdb/ducklake#46) I don't think it will, as the Appender provided in the C++ API is specific to the DuckDB storage format, mimicking parts of the internals of the PhysicalInsert operator used by the INSERT statement when targeting a DuckDB database. It's probably possible however to create an implementation of the Appender interface for DuckLake, that request should be made here https://github.com/duckdb/ducklake

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

[Mytherin]

Thanks for the request!

Your best bet is to append to a temporary DuckDB table first, and then copy the contents of that table into DuckLake.

[utay]

I think this can be resolved, same as https://github.com/duckdb/duckdb/issues/18439 :)