spark-structured-streaming with Avro kafka messages

[amoussoubaruch]

Hello,

I want to use spark-structured-streaming to process data fetched from kafka messages, and then store as rows cassandra database. I need one clarification. The message in kafka are serialized in Avro format. How can i deserialize the message to json for processing before storing into cassandra? Is it possible with spark 2.1.0 or 2.1.1?

Any advice or help could be appreciated. Thanks in advance

[hardik-pandya]

any update on this one, when can we get this?

[OneCricketeer]

This post show Spark 2.4 and Kafka support. https://databricks.com/blog/2018/11/30/apache-avro-as-a-built-in-data-source-in-apache-spark-2-4.html