sqlglot icon indicating copy to clipboard operation
sqlglot copied to clipboard

fix(spark): CREATE TABLE ... PARTITIONED BY fixes

Open barakalon opened this issue 1 year ago • 0 comments

Spark 3 supports two CREATE TABLE formats: https://spark.apache.org/docs/latest/sql-ref-syntax-ddl-create-table-hiveformat.html https://spark.apache.org/docs/latest/sql-ref-syntax-ddl-create-table-datasource.html

Some of the spark dialect assumes the former, some assumes the latter, and you can easily end up with an invalid statement.

All this DDL transpilation feels very messy to me... I hated this change.

barakalon avatar Feb 08 '24 21:02 barakalon