ISB fails to recover consumer for vertex stream

[anotherfiz]

Summary ISB does not recover numaflow pipeline consumers if system comes down in an unclean state (eg, power loss) When ISB attempts to recovery consumer for stream I get an error that says: Error unmarshalling consumer metafile /meta.inf: unexpected end of JSON input

To Reproduce

1. apply numaflow pipeline
2. while numaflow pipeline is being configured, kill system uncleanly
3. occasioanlly ISB will start with the above error

Expected behavior I would expect that when the ISB is unable to recover a consumer, that it kick the associated vertexes and restart the pipeline cleanly

Screenshots

Environment (please complete the following information):

• k3s 1.30.2
• go 1.22.4
• pynumaflow 0.6.0

Additional context

• This is an edge device hence the need for it to recover cleanly from unforeseen circumstances

---

Message from the maintainers:

Impacted by this bug? Give it a 👍. We often sort issues this way to know what to prioritize.

For quick help and support, join our slack channel.