datafusion-ballista icon indicating copy to clipboard operation
datafusion-ballista copied to clipboard

Published 20 hours ago • verified publisher icon apache

Fix job hangs when partition count of plan is zero

Open lewiszlw opened this issue 8 months ago • 1 comments

Which issue does this PR close?

Closes #.

Rationale for this change

When partition count of execution plan is 0, the job will hang because available tasks of running stage will be empty, then get_running_stage_id method of ExecutionGraph will return None. https://github.com/apache/datafusion-ballista/blob/e7cb3d57f61900ea56107c6477c5754429ba821e/ballista/scheduler/src/state/execution_graph.rs#L969 So the running stage will keep running and won't be converted to successful/failed stage.

What changes are included in this PR?

Are there any user-facing changes?

lewiszlw avatar Jun 18 '24 02:06 lewiszlw