Subbu Subramaniam
Subbu Subramaniam
@junkaixue and @jiajunwang which release of helix can we possibly get this in? What may be the time frame? thanks.
hopefully the overall goal is to automate this and not just document. if there is an epic to handle this in an automated fashion, documentation can be the first step....
Some thoughts. The broker could keep track of a "health score" for serves and rank them. The score could include a variety of dimensions like: - How much thread cpu...
Another way may be to provide a utility to set offsets on a per-partition basis after pausing, and then restarting. May involve a bit of thinking here. Otherwise, the resume...
+1 on using transaction APIs. We can also see if Helix intends to support it (we have moved to Helix 1.x, so hopefully it will be easier extension).
We would like to review this. thanks
Another way is to manually set the consuning segment to be in OFFLINE state (if it s not already so).
@Jackie-Jiang what was the exact scenario when consumption got "stuck" ? As of now, it is the case that we retry a few times and if the stream throws exception,...
Related Issue #4036
cc: @vvivekiyer , @siddharthteotia