kafka-tutorials
kafka-tutorials copied to clipboard
confluentinc
add a wait before validating ksqlDB recipe tests relying on table output
The handful of tests that query table output tend to be flaky due to the async nature of ksqlDB. There's no guarantee that table result are available after corresponding INSERTS. Other recipes that validate via a stream query like "SELECT ... EMIT CHANGES LIMIT n;" aren't susceptible to the same test flakiness since they will block on n rows being emitted..
Description
https://github.com/confluentinc/kafka-tutorials/issues/1328
Staging Docs
N/A
New tutorial checklist
N/A
one data point in favor of sleep mitigation: I am able to repro #1328 locally (on 2 of 6 runs) and with this change I haven't hit it in 6 runs
It would be nice to see these tests pass before committing. If it's blocked by #1327 , perhaps merge and rebase, then rerun this?
It would be nice to see these tests pass before committing. If it's blocked by #1327 , perhaps merge and rebase, then rerun this?
good plan... FWIW I believe that this would eventually pass if I rerun a few times, because we have had recent builds succeed. But my hope is that once we get these two in, we'll see a downtick in flakes.