org.apache.spark.sql.execution.datasources.Spark34NestedSchemaPruning

[smileyboy2019]

在idea 执行 <groupId>org.apache.hudi</groupId> <artifactId>hudi-spark-bundle_2.12</artifactId> 1.0.0-beta1 执行报 : java.lang.ClassNotFoundException: org.apache.spark.sql.execution.datasources.Spark34NestedSchemaPruning

[ad1happy2go]

@smileyboy2019 Looks like you are using the wrong spark-hudi bundle jar version. Try out this - https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark3.4-bundle_2.12/1.0.0-beta1

[ad1happy2go]

@smileyboy2019 Were you able to resolve this issue?

[KnightChess]

@smileyboy2019 you need point profiles spark3.4 pom.xml in idea

[ad1happy2go]

@smileyboy2019 Closing this issue as the stack trace shows spark version compatibility issue. Please reopen if you still see the issue.