Mobius icon indicating copy to clipboard operation
Mobius copied to clipboard

Unable to consume custom java objects in spark streaming

Open ADDale opened this issue 7 years ago • 0 comments

I have a simple java producer which is pushing message to kafka. I can read message using simple java consumer but not using spark streaming. Using spark streaming all messages are coming as null.

I have attached the code snippet. I am passing the custom deserializer class in kafka properties. Please confirm if we need to pass it in kafkautils.createdirect stream method as well? Somehow the method is throwing invalid argument types if I try to pass as per javdoc documents.

Please help as I am new to Spark.

img_20190122_200511

ADDale avatar Jan 22 '19 14:01 ADDale