pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Not able to use StremMessage Class MetaData information from decoder class (JSONMessageDecoder)

Open prasad-maladi opened this issue 1 year ago • 3 comments

I am writing plugin to decode the kafka message, but the decoder class doesn't have access to the StreamMessage metadata information. Is there possibility to decode the message using metadata information?

prasad-maladi avatar Jun 19 '24 20:06 prasad-maladi

cc @swaminathanmanish @KKcorps

Jackie-Jiang avatar Jun 20 '24 18:06 Jackie-Jiang

Ideally decoder should be decoupled from stream type, but seems we also have coupled decoders such as KafkaAvroMessageDecoder. How do you plan to use the metadata within the decoder?

Jackie-Jiang avatar Jun 20 '24 18:06 Jackie-Jiang

payload is encryted in our case, we have properties which can decrypt the payload in metadata object. StreamMassage has metadata object, but I can't really use in my decoder.

prasad-maladi avatar Jun 20 '24 18:06 prasad-maladi