Paul Dittamo
Paul Dittamo
@pablocasares I think we've potentially pinned the problem down, but am having difficulty reproducing the race condition. Would you still have access to the flyteadmin logs from when child/external workflow...
@RRap0so thank you for testing this out. What value do you have set for [downstream-eval-duration](https://github.com/flyteorg/flyte/blob/242303bf092688ad1b2f87f25205f4b0111d6759/flytepropeller/pkg/controller/config/config.go#L134) ?
@RRap0so thank you again. With those couple runs that were stuck, did they resolve themselves to the correct state without any intervention? Also, did those instances occur during times when...
> Is there any plan to create a fix release with this fix? @andresgomezfrr Yes, we are validating a new release end of this week and barring any issues will...
@andresgomezfrr @pablocasares there's a [RC](https://github.com/flyteorg/flyte/tree/v1.12.1-rc0) that contains this fix. I'm unsure of when a final release containing this change will be made. I'll ping when that happens.
@hamersaw This would mess with the node + task count. I'll look back into this.
@wild-endeavor I noticed this [PR](https://github.com/flyteorg/flyte/pull/5621) wasn't upstreamed. This PR fixed "propeller panic when talking to admin , due to client interceptor sending nil token cache". I figured this could be...
@RRap0so Would you have any propeller logs while it was crashing during your upgrade to 1.13? Also would you be able to share any logs of workflows that failed during...
> Any unit tests we should be adding? It looks like we will send some new events now right? @hamersaw I'll upstream unit tests for array node and then add...
@hamersaw ended up not needing to upstream tests