Arttu
Arttu
Hey, this changed the behavior of writing and reading CSVs to be slightly inconsistent: now writing defaults to **not** writing a header, while reading defaults to **having** a header. Previously...
Cool, I'll take a look in the next days!
Yes! I'm working on using DataFusion to basically execute Spark dataframes through Spark -> Substrait -> DataFusion. The Spark -> Substrait part is a (currently closed-source, but I hope to...
> Be wary, Gluten contains a copy of Substrait instead of depending on the main repo. As a result its Substrait is incompatible with the rest of the ecosystem. That...
I was thinking about these return types recently, given that Spark and DataFusion disagree on the return types in many cases. I wonder if there is any reason/benefit overall to...
> > we cannot (at least currently) have functions with same name and same args but different return types, as the return type is not part of the compound key....
> > Am I correct in understanding you see Substrait proto (and simple extension format) as a language for defining one standard of how a relational query engine should work,...