onestop
onestop copied to clipboard
Kafka Consumer Class
Summary
As a | onestop-client developer |
I want to be able to | integrate new Kafka consumer class into workflow |
So that I can | replace old consumer function and consume from Kafka topics |
Tasks
- [x] Create Kafka Consumer Class with similar structure to Kafka Publisher
- [x] Integrate newly created class into current workflow and make sure everything is working accordingly
Placed Kafka Consumer config values in the same config file as the Kafka Producer because they shared a lot of similarities. These values can be placed in a Kafka Consumer config if needed.
Confluent Kafka has not integrated their consume function yet, so I used the same format from our consumer legacy code. Our consume function has a call back function for flexibility.