iceberg icon indicating copy to clipboard operation
iceberg copied to clipboard

Spark: Support call sort order/zorder procedure when having multiple spark extensions

Open xloya opened this issue 3 years ago • 1 comments

Support call sort order/zorder procedure when multiple spark extensions are loaded with spark.sql.extensions conf, this conf will encapsulate the last extension class to the outermost layer, so SparkSession.sessionState().sqlParser() may not be able to get the extension class instance of Iceberg. And spark.sql.extensions is a static conf, we cannot set it when session is created, so need be specified at initialization

xloya avatar Sep 22 '22 05:09 xloya

cc @ajantha-bhat @RussellSpitzer @rdblue @kbendick

xloya avatar Sep 22 '22 05:09 xloya