onyx icon indicating copy to clipboard operation
onyx copied to clipboard

SQL DSL

Open mariusz-jachimowicz-83 opened this issue 8 years ago • 1 comments

Another, somewhat larger effort, is a SQL DSL ontop of Onyx. Again, something like HoneySQL. We could write a library that reads a data structure representing SQL and output an Onyx job. This is a well studied topic that could be implemented directly from an academic paper.

(source slack conversation )

mariusz-jachimowicz-83 avatar Dec 29 '16 10:12 mariusz-jachimowicz-83

This project is worth a look. It provides a compiler/optimizer for Datalog and some SQL subset to multiple backends, including Spark Dataframes and Flink. https://github.com/uwescience/raco Something like that would subsume #708.

gardnervickers avatar Dec 30 '16 16:12 gardnervickers