divolte-collector icon indicating copy to clipboard operation
divolte-collector copied to clipboard

Published 20 hours ago • verified publisher icon divolte

Divolte-clickStream-kafka-KSQL

Open mbsj6962 opened this issue 4 years ago • 2 comments

i'm trying to connect divolte to kafka but it always tels me : ERROR Unknown error when running consumer: (kafka.tools.ConsoleConsumer$:46) org.apache.kafka.common.errors.SerializationException: Unknown magic byte! and i can not parse key and value of divolte message

mbsj6962 avatar Nov 23 '20 10:11 mbsj6962

if you're using Kafka from Confluent, you need to use the Schema Registry in order to deserialize the Avro messages.

josephwibowo avatar Feb 10 '21 00:02 josephwibowo

Schema Registry can be used with any Kafka, not only the one provided by Confluent Platform, but yes, the error is related to incorrect usage of some serializer/deserializer combo

OneCricketeer avatar Aug 24 '21 16:08 OneCricketeer