hudi icon indicating copy to clipboard operation
hudi copied to clipboard

Published 20 hours ago • verified publisher icon apache

[MINOR] Fixing flaky test by drastically reducing concurrency level (to avoid CI flakiness)

Open alexeykudinkin opened this issue 3 years ago • 1 comments
trafficstars

Change Logs

Fixing flaky test by drastically reducing concurrency level (to avoid CI flakiness)

Impact

**Risk level: None

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

alexeykudinkin avatar Sep 22 '22 22:09 alexeykudinkin

CI report:

  • 09ac01fd88b15fad1940c4b6c8753acf36ea1929 Azure: FAILURE
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Sep 23 '22 02:09 hudi-bot

@yihua in one of my PRs it failed 2 times out of 3.

CI is stressing compute, so high concurrency in tests is prone to have tests stalled, and this particular one was failing b/c threads were held back for longer than the test was actually running eventually failing after test resources had already been reclaimed

alexeykudinkin avatar Sep 23 '22 18:09 alexeykudinkin