datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Published 20 hours ago • verified publisher icon apache

Support Substrait's VirtualTables

Open Blizzara opened this issue 9 months ago • 3 comments

Which issue does this PR close?

Closes #10530

This is my first (but hopefully not last!) contribution to DataFusion, and I'm pretty new with Rust as well - so all feedback on both style and details is very much welcome!

Rationale for this change

What changes are included in this PR?

Adds support for Substrait's VirtualTables, ie. tables with data baked-in into the Substrait plan instead of being read from a source.

Adds conversion in both ways (Substrait -> DataFusion and DataFusion -> Substrait)

Are these changes tested?

Tested through round-trip tests, similar to other Substrait support.

Are there any user-facing changes?

  • More support through Substrait

Blizzara avatar May 15 '24 16:05 Blizzara