spark icon indicating copy to clipboard operation
spark copied to clipboard

[SPARK-40255][YARN][TESTS] Increase `BaseYarnClusterSuite#runSpark` timeout from 3 minutes to 5 minutes

Open LuciferYang opened this issue 2 years ago • 4 comments

What changes were proposed in this pull request?

This pr Increase BaseYarnClusterSuite#runSpark timeout from 3 minutes to 5 minutes to make the tests extends BaseYarnClusterSuite more stable.

Why are the changes needed?

Make flaky test stable.

Does this PR introduce any user-facing change?

No, just for test.

How was this patch tested?

Pass GitHub Actions

LuciferYang avatar Aug 22 '22 04:08 LuciferYang

https://github.com/apache/spark/pull/37605#issuecomment-1221814039

cc @HyukjinKwon I suspect the flaky test is caused by machine load. After the timeout is increased, there is no failure yet, let's test and check more times

LuciferYang avatar Aug 29 '22 08:08 LuciferYang

I'm not sure if my GA can't reproduce the issue

LuciferYang avatar Aug 29 '22 08:08 LuciferYang

Hm, I doubt if the timeout is the actual problem. This test doesn't take too much time if you run locally actually.

HyukjinKwon avatar Aug 30 '22 03:08 HyukjinKwon

Hm, I doubt if the timeout is the actual problem. This test doesn't take too much time if you run locally actually.

OK, let me see how to get the startup log of the failed instance to get more information

LuciferYang avatar Aug 30 '22 04:08 LuciferYang