stac-rs icon indicating copy to clipboard operation
stac-rs copied to clipboard

Static STAC search via DuckDB

Open gadomski opened this issue 6 months ago • 2 comments

Steps:

  • Load a collection (or a catalog?)
  • Iterate all the item links
  • ~Load them into DuckDB memory~ Save to a stac-geoparquet file
  • Search

~This will require updating the DuckDB client to query against an in-table memory, as it currently only hits parquet files.~

I couldn't find an easy way to get memory parquet bytes into DuckDB, so tempfile it is, for now.

gadomski avatar May 20 '25 16:05 gadomski

Might be able to go back to memory via https://duckdb.org/2025/05/23/arrow-ipc-support-in-duckdb.html

gadomski avatar May 28 '25 13:05 gadomski

So, definitely for smaller sets of items, you could just use the CQL2-RS reducer to search.

bitner avatar May 28 '25 13:05 bitner