superduper icon indicating copy to clipboard operation
superduper copied to clipboard

Experimentation and Integration of Apache Iceberg

Open blythed opened this issue 1 year ago • 2 comments

As a SuperDuperDB user, I would like to connect to Apache Iceberg tables using Trino and/ or PySpark and apply AI models to these.

Since superduperdb supports ibis which supports both Trino and PySpark, we have a clear path to this possibility.

blythed avatar Nov 22 '23 10:11 blythed

It would look something like this:

Image

blythed avatar Dec 15 '23 12:12 blythed

https://trino.io/docs/current/connector/iceberg.html

blythed avatar Dec 15 '23 12:12 blythed