d2l-en icon indicating copy to clipboard operation
d2l-en copied to clipboard

Flaky test failure

Open astonzhang opened this issue 5 years ago • 3 comments

Below are a list of (possibly) flaky test failures. They make building tf portion less efficient thus should be addressed:

  • http://ci.d2l.ai/blue/organizations/jenkins/d2l-en/detail/PR-1164/1/pipeline
  • http://ci.d2l.ai/blue/organizations/jenkins/d2l-en/detail/PR-1207/1/pipeline/

astonzhang avatar Jul 14 '20 00:07 astonzhang

Perhaps setting some seeds would help.

terrytangyuan avatar Jul 15 '20 17:07 terrytangyuan

@mli Do you think we can set seeds to disable randomness? It may help undesirable flaky test failure.

astonzhang avatar Jul 15 '20 20:07 astonzhang

i think we need to find the root cause, i.e. maybe due to bad weight initializations.

mli avatar Jul 15 '20 20:07 mli