parallel-consumer

parallel-consumer copied to clipboard

Is it possible to read one message and produce multiple kafka records (message explode) with the current API ?

nareshv

Looks like the pollAndProduce() expects both input & output topics to have the same type. We have input topic with payload as `byte[]` and output as an Confluent library encoded...

nareshv

Does the library support running on more than one node ? How does it handle the key distribution of data ? (i.e all keys would go to one node/JVM ?)

nareshv

mockito dependency needs to be test scoped

1

From parent pom.xml, mockito dependency is not scoped as test. https://github.com/confluentinc/parallel-consumer/blob/master/pom.xml#L335-L339 ``` org.mockito mockito-junit-jupiter ${mockito.version} ```

wonmo01

- [ ] Documentation (if applicable) - [ ] Changelog - [ ] Review

astubbs

Check: - [ ] BrokerPoller can't access state - when performing commit, must request or be sent commit offset data by state owner (#419 ) Implements: - #200 - Removes...

astubbs

Bumps [postgresql](https://github.com/pgjdbc/pgjdbc) from 42.4.0 to 42.4.1. Changelog Sourced from postgresql's changelog. Changelog Notable changes since version 42.0.0, read the complete History of Changes. The format is based on Keep a...

dependabot[bot]

Release train for 1.0

9

- [x] README cleanup/update regarding maintenance - [x] README regarding “alpha” state - [x] offset documentation - [ ] javadoc cleanup sweep - [ ] dead code sweep - [...

astubbs

related: - #175 There's been able to subscribe to multiple topics and have individual processing functions attached to each one – making the library more flexible for more use cases...

astubbs

Ability use different consume and produce types for the key and value

5

I don't think it's possible to use ParallelStreamProcessor with Consumer and Producer that do not share the same KeyType and ValueType. Can this be considered in the future ?

BDeus