oap-tools icon indicating copy to clipboard operation
oap-tools copied to clipboard

The jars of gazelle cannot support spark 3.1 and spark 3.2 at the same time

Open yao531441 opened this issue 2 years ago • 0 comments

We need to provide two sets of jars to make gazelle support different spark versions.

The following is an example of spark version 3.2

spark.executor.extraClassPath /home/sparkuser/nativesql_jars/spark-columnar-core-1.4.0-SNAPSHOT-jar-with-dependencies.jar:/home/sparkuser/nativesql_jars/spark-arrow-datasource-standard-1.4.0-SNAPSHOT-jar-with-dependencies.jar:/home/sparkuser/nativesql_jars/spark-sql-columnar-shims-common-1.4.0-SNAPSHOT.jar:/home/sparkuser/nativesql_jars/spark-sql-columnar-shims-spark321-1.4.0-SNAPSHOT.jar

yao531441 avatar Mar 21 '22 02:03 yao531441