ipt icon indicating copy to clipboard operation
ipt copied to clipboard

Add support for DuckDB

Open frafra opened this issue 1 year ago • 3 comments

This simple patch adds support for DuckDB. It just requires a single extra line to the Dockerfile:

ADD https://repo1.maven.org/maven2/org/duckdb/duckdb_jdbc/1.0.0/duckdb_jdbc-1.0.0.jar /usr/local/tomcat/webapps/ROOT/WEB-INF/lib

This allows to read a large variety of data sources, such as Parquet files.

For example:

  • Database: :memory:
  • SQL Statement:
install httpfs; load httpfs;
select * from read_parquet('s3://gbif-open-data-eu-central-1/occurrence/2024-08-01/occurrence.parquet/000000');

frafra avatar Aug 27 '24 15:08 frafra

Interesting!

@mike-podolskiy90, this would be better as a Maven dependency so non-Docker users can benefit.

MattBlissett avatar Sep 02 '24 03:09 MattBlissett

Thanks @frafra and @MattBlissett , I'll have a look

mike-podolskiy90 avatar Oct 14 '24 10:10 mike-podolskiy90

I really like to see it happen, so I rebased the branch and added duckdb as a Maven dependency :)

frafra avatar Nov 28 '25 12:11 frafra