InnerEye-DeepLearning icon indicating copy to clipboard operation
InnerEye-DeepLearning copied to clipboard

Fallback run for tests failed and it makes tests fail locally

Open fepegar opened this issue 3 years ago • 0 comments

The run ID refs_pull_633_merge_1642019743_f212b068 failed. This causes multiple tests to fail, e.g.,

https://github.com/microsoft/InnerEye-DeepLearning/blob/1600ef3ddfa83328ec35d179533c3a4e95f88a69/Tests/AfterTraining/test_after_training.py#L147-L150

This test is skipped in CI, therefore this is missed:

https://github.com/microsoft/InnerEye-DeepLearning/blob/1600ef3ddfa83328ec35d179533c3a4e95f88a69/Tests/AfterTraining/test_after_training.py#L143-L147

If the run ID is replaced with, e.g., a test that I just ran and everything was ok, the test below fails as it expects a different directory tree for the logs:

https://github.com/microsoft/InnerEye-DeepLearning/blob/1600ef3ddfa83328ec35d179533c3a4e95f88a69/Tests/AfterTraining/test_after_training.py#L201-L221

The failed run ID makes other tests fail as well, e.g.,

https://github.com/microsoft/InnerEye-DeepLearning/blob/1600ef3ddfa83328ec35d179533c3a4e95f88a69/Tests/Azure/test_azure_util.py#L103-L111

For reference, that run ID was introduced by @ant0nsc in:

  • https://github.com/microsoft/InnerEye-DeepLearning/pull/633

AB#5029

fepegar avatar Feb 18 '22 11:02 fepegar