celeborn icon indicating copy to clipboard operation
celeborn copied to clipboard
verified publisher icon apache

[CELEBORN-1983] Fix fetch fail not throw due to reach spark maxTaskFailures

Open buska88 opened this issue 8 months ago • 1 comments

What changes were proposed in this pull request?

change sparkUtils taskAnotherAttemptRunningOrSuccessful method (https://issues.apache.org/jira/browse/CELEBORN-1983)

Why are the changes needed?

Because it will lead to job failure.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Test it on online ETL jobs

buska88 avatar Apr 25 '25 05:04 buska88

Hello @RexXiong please take a look at this PR

buska88 avatar Apr 25 '25 05:04 buska88

thanks, merged to main(0.6.0)

turboFei avatar Apr 27 '25 01:04 turboFei