Maxim Martynov

Could someone take a look? This is important change to make integration compatible with some OpenLineage backends

Thank you very much!

Got the same issue with repository which was converted from private status to public: https://github.com/MobileTeleSystems/spark-dialect-extension I'm also not able to activate the repo manually - after clicking "Activate" button I've...

Same: ```python packages = [ "com.github.housepower:clickhouse-spark-runtime-3.4_2.12:0.7.3", "com.clickhouse:clickhouse-jdbc:0.6.0", "com.clickhouse:clickhouse-http-client:0.6.0", "org.apache.httpcomponents.client5:httpclient5:5.3.1", ] ``` ``` An error occurred while calling o86.replace. : xenon.clickhouse.exception.CHServerException: [HTTP][email protected]:8123}/default [1002] {"exception": "Code: 60. DB::Exception: Table default.mytable does not...

I see commit https://github.com/housepower/spark-clickhouse-connector/commit/3b42a617517dce306d2025267da384427ab42448 but I haven't found where `fromCode` is called

For Clickhouse 23.9 it is fine: `Exception: code=60 message=Code: 60. DB::Exception: Table default.mytable does not exist. (UNKNOWN_TABLE) (version 23.9.6.20 (official build))` For Clickhouse 23.10 it is broken: `Eexception: code=1002 message={"exception":...

Fixed in https://github.com/ClickHouse/clickhouse-java/pull/1577, use clickhouse-java v0.6.0-patch3 or higher, with spark-clickhouse-connector v0.7.3: ```python from pyspark.sql import SparkSession packages = [ "com.github.housepower:clickhouse-spark-runtime-3.4_2.12:0.7.3", "com.clickhouse:clickhouse-client:0.6.0-patch4", "com.clickhouse:clickhouse-http-client:0.6.0-patch4", "org.apache.httpcomponents.client5:httpclient5:5.3.1" ] spark = SparkSession.builder.config("spark.jars.packages", ",".join(packages)).getOrCreate() spark.conf.set("spark.sql.catalog.clickhouse", "xenon.clickhouse.ClickHouseCatalog")...

This issue prevents our custom Clickhouse dialect for Spark from reading Arrays from Clickhouse: https://github.com/MobileTeleSystems/spark-dialect-extension/blob/b4ba3724bf036394457985588ea891c05c90e5b1/src/test/scala/io/github/mtsongithub/doetl/sparkdialectextensions/clickhouse/ClickhouseDialectTest.scala#L478-L500

Doesn' reproduce on 0.9.2

> The reason probably is that your Greenplum instance, running inside a docker container, is not able to reach the gpfdist server which the connector start in the context of...