AMDMIGraphX
AMDMIGraphX copied to clipboard
ROCmSoftwarePlatform
rnnt_example_start
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 92.16%. Comparing base (
c95471c) to head (668d858). Report is 163 commits behind head on develop.
Additional details and impacted files
@@ Coverage Diff @@
## develop #3313 +/- ##
========================================
Coverage 92.16% 92.16%
========================================
Files 504 504
Lines 20486 20486
========================================
Hits 18880 18880
Misses 1606 1606
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
![codecov[bot] avatar](https://avatars.githubusercontent.com/in/254?v=4 "Published by a pub.dev verified publisher"){kind=small}
Odd CI look like it was interrupted instead of a fail. Rekicked this as it look like it stalled at 2hrs then aborted.
| Test | Batch | Rate new 668d85 |
Rate old abc06a |
Diff | Compare |
|---|---|---|---|---|---|
| torchvision-resnet50 | 64 | 3,252.81 | 3,251.24 | 0.05% | :white_check_mark: |
| torchvision-resnet50_fp16 | 64 | 6,987.02 | 6,981.46 | 0.08% | :white_check_mark: |
| torchvision-densenet121 | 32 | 2,434.20 | 2,431.85 | 0.10% | :white_check_mark: |
| torchvision-densenet121_fp16 | 32 | 4,097.24 | 4,094.23 | 0.07% | :white_check_mark: |
| torchvision-inceptionv3 | 32 | 1,634.88 | 1,635.37 | -0.03% | :white_check_mark: |
| torchvision-inceptionv3_fp16 | 32 | 2,743.77 | 2,737.99 | 0.21% | :white_check_mark: |
| cadene-inceptionv4 | 16 | 776.64 | 776.04 | 0.08% | :white_check_mark: |
| cadene-resnext64x4 | 16 | 808.31 | 808.93 | -0.08% | :white_check_mark: |
| slim-mobilenet | 64 | 7,460.50 | 7,462.20 | -0.02% | :white_check_mark: |
| slim-nasnetalarge | 64 | 208.31 | 207.85 | 0.22% | :white_check_mark: |
| slim-resnet50v2 | 64 | 3,340.36 | 3,343.82 | -0.10% | :white_check_mark: |
| bert-mrpc-onnx | 8 | 1,153.84 | 1,152.73 | 0.10% | :white_check_mark: |
| bert-mrpc-tf | 1 | 310.10 | 308.84 | 0.41% | :white_check_mark: |
| pytorch-examples-wlang-gru | 1 | 417.45 | 409.17 | 2.02% | :white_check_mark: |
| pytorch-examples-wlang-lstm | 1 | 387.03 | 375.07 | 3.19% | :high_brightness: |
| torchvision-resnet50_1 | 1 | 807.66 | 817.27 | -1.18% | :white_check_mark: |
| cadene-dpn92_1 | 1 | 404.43 | 392.10 | 3.14% | :high_brightness: |
| cadene-resnext101_1 | 1 | 379.98 | 379.19 | 0.21% | :white_check_mark: |
| onnx-taau-downsample | 1 | 344.83 | 344.00 | 0.24% | :white_check_mark: |
| dlrm-criteoterabyte | 1 | 35.08 | 32.91 | 6.59% | :high_brightness: |
| dlrm-criteoterabyte_fp16 | 1 | 58.06 | 53.25 | 9.04% | :high_brightness: |
| agentmodel | 1 | 9,893.55 | 8,133.59 | 21.64% | :high_brightness: |
| unet_fp16 | 2 | 57.95 | 57.89 | 0.10% | :white_check_mark: |
| resnet50v1_fp16 | 1 | 992.90 | 920.56 | 7.86% | :high_brightness: |
| resnet50v1_int8 | 1 | 925.64 | 912.49 | 1.44% | :white_check_mark: |
| bert_base_cased_fp16 | 64 | 1,154.26 | 1,154.12 | 0.01% | :white_check_mark: |
| bert_large_uncased_fp16 | 32 | 356.39 | 355.93 | 0.13% | :white_check_mark: |
| bert_large_fp16 | 1 | 211.74 | 208.58 | 1.51% | :white_check_mark: |
| distilgpt2_fp16 | 16 | 2,164.24 | 2,161.93 | 0.11% | :white_check_mark: |
| yolov5s | 1 | 534.99 | 539.35 | -0.81% | :white_check_mark: |
| tinyllama | 1 | 43.39 | 43.22 | 0.38% | :white_check_mark: |
| vicuna-fastchat | 1 | 172.63 | 169.85 | 1.63% | :white_check_mark: |
| whisper-tiny-encoder | 1 | 409.52 | 409.84 | -0.08% | :white_check_mark: |
| whisper-tiny-decoder | 1 | 433.45 | 430.41 | 0.71% | :white_check_mark: |
Check results before merge :high_brightness:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
@richagadgil can you please open a new PR to address the unresolved comments here?
