iceberg
iceberg copied to clipboard
Spark: Support call sort order/zorder procedure when having multiple spark extensions
Support call sort order/zorder procedure when multiple spark extensions are loaded with spark.sql.extensions conf, this conf will encapsulate the last extension class to the outermost layer, so SparkSession.sessionState().sqlParser() may not be able to get the extension class instance of Iceberg. And spark.sql.extensions is a static conf, we cannot set it when session is created, so need be specified at initialization
cc @ajantha-bhat @RussellSpitzer @rdblue @kbendick