datafusion-substrait
datafusion-substrait copied to clipboard
Experimental support for serializing DataFusion plans using substrait
Literal Type - in Substrait: https://docs.rs/substrait/latest/substrait/protobuf/expression/literal/enum.LiteralType.html - in Arrow: https://docs.rs/arrow/latest/arrow/datatypes/enum.DataType.html One gap is unsigned primitives are not in Substrait's definition. In [this discussion](https://github.com/substrait-io/substrait/discussions/2#discussioncomment-1297609) they were cataloged as "third party extension...
## Details - Implement `null_equals_null` join (producer, consumer, test: `INTERSECT`) - Fix join schema (semi and anti) bug - The original code passes `join` output schema to `to_substrait_rex()`. This results...
See https://docs.rs/substrait/0.2.0/substrait/protobuf/set_rel/enum.SetOp.html
This might beed to be split into separate issues for scalar, IN, EXISTS subqueries