rust-dataframe
rust-dataframe copied to clipboard
nevi-me
A Rust DataFrame implementation, built on Apache Arrow
I was trying to keep things simple, avoiding a context, but the typesystem won't allow me to have custom sources without some stateful place to register them. Nothing special here,...
I am experimenting with evaluating lazy frame with a custom data source. However, looks like Reader being declared as a struct makes it hard to add support for custom data...
Consider adding support for reading data from an Apache Arrow Flight server. Such support could be in the form of a flight client, that gets Arrow data and converts it...
To make it easier for people to follow development, we should add examples regularly
The lazy evaluation model seems to be fine for most operations, and can be usable when the existing holes are plugged. Next step is to plot out how optimisations on...
In order to implement aggregations, we need to be able to group data. Like joins, the task of grouping probably belongs upstream, but we should be able to define how...
I've created https://github.com/nevi-me/rust-arrow-sql, which should handle database logic