onnx-mlir
onnx-mlir copied to clipboard
Record all the backend test cases
This PR records all the backend test cases, models and nodes, in file all_test_names.txt. User can use this file to add new backend test cases without going into third_party/onnx code. Also, the file reveals what test cases are not supported by onnx-mlir so far. When onnx is updated to a new version, we can generate a new version of this file and compare against the older one to find out the changes in backend test cases.
It's a bit confusing to call this a test since all it does is to save the test names in a file. It feels more like a tool belonging to utils
.
are you planning to do a version where only the missing tests are listed (avail - already here)?
are you planning to do a version where only the missing tests are listed (avail - already here)?
any response @chentong319 ?
are you planning to do a version where only the missing tests are listed (avail - already here)?
Not in this PR. Need to find a unified way to specify the test case for cpu and accelerator.
Jenkins Linux amd64 Build #7296 [push] Record all the backend t... started at 08:34
Jenkins Linux ppc64le Build #6361 [push] Record all the backend t... started at 09:35
Jenkins Linux s390x Build #7312 [push] Record all the backend t... started at 09:34
Jenkins Linux s390x Build #7312 [push] Record all the backend t... aborted after 55 min
Jenkins Linux ppc64le Build #6361 [push] Record all the backend t... aborted after 56 min
Jenkins Linux amd64 Build #7296 [push] Record all the backend t... aborted after 56 min