onnx-mlir icon indicating copy to clipboard operation
onnx-mlir copied to clipboard

Record all the backend test cases

Open chentong319 opened this issue 2 years ago • 4 comments

This PR records all the backend test cases, models and nodes, in file all_test_names.txt. User can use this file to add new backend test cases without going into third_party/onnx code. Also, the file reveals what test cases are not supported by onnx-mlir so far. When onnx is updated to a new version, we can generate a new version of this file and compare against the older one to find out the changes in backend test cases.

chentong319 avatar Jun 21 '22 01:06 chentong319

It's a bit confusing to call this a test since all it does is to save the test names in a file. It feels more like a tool belonging to utils.

gongsu832 avatar Jun 21 '22 05:06 gongsu832

are you planning to do a version where only the missing tests are listed (avail - already here)?

AlexandreEichenberger avatar Jun 24 '22 17:06 AlexandreEichenberger

are you planning to do a version where only the missing tests are listed (avail - already here)?

any response @chentong319 ?

AlexandreEichenberger avatar Jul 15 '22 19:07 AlexandreEichenberger

are you planning to do a version where only the missing tests are listed (avail - already here)?

Not in this PR. Need to find a unified way to specify the test case for cpu and accelerator.

chentong319 avatar Jul 21 '22 19:07 chentong319

Jenkins Linux amd64 Build #7296 [push] Record all the backend t... started at 08:34

jenkins-droid avatar Aug 31 '22 13:08 jenkins-droid

Jenkins Linux ppc64le Build #6361 [push] Record all the backend t... started at 09:35

jenkins-droid avatar Aug 31 '22 13:08 jenkins-droid

Jenkins Linux s390x Build #7312 [push] Record all the backend t... started at 09:34

jenkins-droid avatar Aug 31 '22 13:08 jenkins-droid

Jenkins Linux s390x Build #7312 [push] Record all the backend t... aborted after 55 min

jenkins-droid avatar Aug 31 '22 14:08 jenkins-droid

Jenkins Linux ppc64le Build #6361 [push] Record all the backend t... aborted after 56 min

jenkins-droid avatar Aug 31 '22 14:08 jenkins-droid

Jenkins Linux amd64 Build #7296 [push] Record all the backend t... aborted after 56 min

jenkins-droid avatar Aug 31 '22 14:08 jenkins-droid