datadex

datadex copied to clipboard

Implement glob patterns on IPFS

3

For large datasets stored as multiple parquet/CSV files, it would be much better to have a glob pattern than to write multiple `union all`.

davidgasquez

Add IPNS to the datasets

1

Have a unique CID for each published dataset.

davidgasquez

A [Rill Developer UI](https://github.com/rilldata/rill-developer) should be spawned at the moment there is a `local.db`.

davidgasquez

Proxy all OWID datasets

1

Is there a way to materialize all OWID datasets and have them displayed in the Dagster DAG?

davidgasquez

davidgasquez

davidgasquez

Generate a YAML file for all the different assets with a certain tag. We should get their descriptions and generate some small README. Might be great to copy one section...

davidgasquez

Add example importing assets from another Datadex instance

1

Try importing the `filecoin-data-portal` DAG!

davidgasquez

Governance and Catalog

8

I was thinking of building a "poor's man data platform" when I found datadex and it is almost everything in my wishlist. But in a scenario where you may have...

fredguth

1. Fully static 2. DuckDB WASM + Static Parquet file

davidgasquez