relax icon indicating copy to clipboard operation
relax copied to clipboard

[Bug] Hexagon CI tests fail on tlc-pack/relax HEAD

Open psrivas2 opened this issue 2 years ago • 1 comments

I ran the Hexagon CI tests on Relax HEAD. I expected all tests to pass since they are not using Relax at all. However, 5 tests failed according to CI summary below:

=========================== short test summary info ============================
FAILED tests/python/contrib/test_hexagon/test_launcher.py::test_aot_executor[c]
FAILED tests/python/contrib/test_hexagon/test_launcher.py::test_aot_executor_multiple_conv2d[c]
FAILED tests/python/contrib/test_hexagon/test_models.py::test_mobilenet - Ass...
FAILED tests/python/contrib/test_hexagon/test_usmp.py::test_conv2d[c-False]
FAILED tests/python/contrib/test_hexagon/test_usmp.py::test_conv2d[c-True] - ...
= 5 failed, 786 passed, 1365 skipped, 15 xfailed, 752 warnings in 15744.57s (4:22:24)

These failures need to be investigated. Possible reasons for failure could be:

  • These tests are already failing on TVM main
  • Some important changes in TVM main might be lost in merge conflicts during last rebase of Relax.
  • Some changes required for Relax actually break a feature required by Hexagon.

Here is the log file. CI ran when Relax Head is at 4329af78eb1dc4c4ff8a61d3bf39aa4034e9cb2a

psrivas2 avatar Jun 24 '22 18:06 psrivas2

Thanks @psrivas2 for summarizing the Hexagon CI results!

Interestingly, all of these 5 tests are currently skipped in TVM main CI. I believe we can successfully run the test_launcher.py::test_aot_executor test 2 weeks ago with some branches in the relax repo. To locate the issue, we can check if the tests can pass locally with the relax branch and tvm main.

YuchenJin avatar Jun 24 '22 19:06 YuchenJin