smallrye
Kafka connector throttled key ordered concurrency
Waiting for the https://github.com/smallrye/smallrye-mutiny/pull/2003 to be released
Hello @
Waiting for the smallrye/smallrye-mutiny#2003 to be released
it has been released I guess here isn't it ? https://github.com/smallrye/smallrye-mutiny/commits/release/3.0.2
Well thx for you support !
I need to verify again if we can go with this or we absolutely need https://github.com/smallrye/smallrye-mutiny/pull/2031.
@jponge, I had to write a custom operator to make this work. If you have some time, take a look at SelfPurgingPauserGroupMulti (I know, I know, but naming things is hard).
As I explained earlier, to avoid deadlocking on the merge, I went for the approach of counting items that'll be dispatched to the multi (called on the key selector handler). Each time the inner emits, it checks whether there are any more pending items. If there are no more, it completes the multi (and cancels the subscription). I needed both because complete frees the concurrency place in the flatMap, and canceling the subscription allows re-creating the group later on in groupBy.
@cescoffier I've reworked the config options. You can take another look.
