rust-dataframe icon indicating copy to clipboard operation
rust-dataframe copied to clipboard

Context to allow providing custom data sources, functions, etc.

Open nevi-me opened this issue 5 years ago • 0 comments
trafficstars

I was trying to keep things simple, avoiding a context, but the typesystem won't allow me to have custom sources without some stateful place to register them.

Nothing special here, so I'll take a cue from DataFusion. What I'm interested in bikeshedding here is how to create an expressive API that allows data sources to declare their capabilities (e.g. I can pushdown sorts, filters, projections).

If I can get it to work, I'd want to contribute it to DataFusion, as that's where I think a de-facto Rust data analysis library should be.

nevi-me avatar Oct 26 '20 17:10 nevi-me