onestop icon indicating copy to clipboard operation
onestop copied to clipboard

Kafka Consumer Class

Open JeffreyHuynh1 opened this issue 4 years ago • 2 comments

Summary

As a onestop-client developer
I want to be able to integrate new Kafka consumer class into workflow
So that I can replace old consumer function and consume from Kafka topics

Tasks

  • [x] Create Kafka Consumer Class with similar structure to Kafka Publisher
  • [x] Integrate newly created class into current workflow and make sure everything is working accordingly

JeffreyHuynh1 avatar Feb 24 '21 20:02 JeffreyHuynh1

Placed Kafka Consumer config values in the same config file as the Kafka Producer because they shared a lot of similarities. These values can be placed in a Kafka Consumer config if needed.

JeffreyHuynh1 avatar Mar 05 '21 18:03 JeffreyHuynh1

Confluent Kafka has not integrated their consume function yet, so I used the same format from our consumer legacy code. Our consume function has a call back function for flexibility.

JeffreyHuynh1 avatar Mar 05 '21 18:03 JeffreyHuynh1