spark-kafka-0-8-sql icon indicating copy to clipboard operation
spark-kafka-0-8-sql copied to clipboard

maven clean package failed

Open yyz1989 opened this issue 7 years ago • 2 comments

Dear Saisai,

Thanks a lot for your contribution.

I had problems at the first step when packaging it. Maven complains that it cannot find many dependencies with version number 2.1.0-SNAPSHOT. Since Spark 2.1.0 has been released already, I removed SNAPSHOT and rerun. Then the error looks like:

[ERROR] /Users/yyz/Work/SYMBIOPTIMA/spark-kafka-0-8-sql/src/main/scala/com/hortonworks/spark/sql/kafka08/KafkaSourceOffset.scala:28: class KafkaSourceOffset needs to be abstract, since method json in class Offset of type => String is not defined
[ERROR] case class KafkaSourceOffset(partitionToOffsets: Map[TopicAndPartition, LeaderOffset])
[ERROR]                   ^
[ERROR] one error found

what can I do here?

Thanks a lot for your suggestion.

Best regards, Yang

yyz1989 avatar Apr 11 '17 10:04 yyz1989

Hello, there! You may like flisky/spark-kafka-0-8-sql@68c20de.

I'm afraid it's a huge change, and @jerryshao, would you want to merge?

flisky avatar Apr 26 '17 10:04 flisky

@yyz1989 I guess there's some updates in the Spark side which makes current fail to compile.

@flisky thanks for the contribution, can you please make a PR about your changes? Let's see what actually changes.

jerryshao avatar Apr 26 '17 12:04 jerryshao