spark-kafka-0-8-sql
spark-kafka-0-8-sql copied to clipboard
maven clean package failed
Dear Saisai,
Thanks a lot for your contribution.
I had problems at the first step when packaging it. Maven complains that it cannot find many dependencies with version number 2.1.0-SNAPSHOT
. Since Spark 2.1.0 has been released already, I removed SNAPSHOT
and rerun. Then the error looks like:
[ERROR] /Users/yyz/Work/SYMBIOPTIMA/spark-kafka-0-8-sql/src/main/scala/com/hortonworks/spark/sql/kafka08/KafkaSourceOffset.scala:28: class KafkaSourceOffset needs to be abstract, since method json in class Offset of type => String is not defined
[ERROR] case class KafkaSourceOffset(partitionToOffsets: Map[TopicAndPartition, LeaderOffset])
[ERROR] ^
[ERROR] one error found
what can I do here?
Thanks a lot for your suggestion.
Best regards, Yang
Hello, there! You may like flisky/spark-kafka-0-8-sql@68c20de.
I'm afraid it's a huge change, and @jerryshao, would you want to merge?
@yyz1989 I guess there's some updates in the Spark side which makes current fail to compile.
@flisky thanks for the contribution, can you please make a PR about your changes? Let's see what actually changes.