datafusion-tui icon indicating copy to clipboard operation
datafusion-tui copied to clipboard

Support Vortex as a file format

Open AdamGS opened this issue 3 months ago • 16 comments

Vortex is a new open-source columnar file format, it already shows significant performance benefits while still being relatively young. Would you consider supporting it in dft?

We provide a FileSource-based interface that's already seeing some usage, which would basically make it a drop-in replacement for Parquet (datafusion wise) and would love to also provide users with a datafusion-terminal based interface (we currently have to point them at DuckDB for that).

I would obviously do all the work of doing the initial PR and maintaining it, which hopefully wouldn't be too hard as DataFusion is becoming more stable with every release.

AdamGS avatar Sep 29 '25 16:09 AdamGS