AMDMIGraphX icon indicating copy to clipboard operation
AMDMIGraphX copied to clipboard

Refactor 1 arg dynamic reshape

Open CharlieL7 opened this issue 9 months ago • 2 comments

Allows for more cases of reshaping dynamic input shapes

CharlieL7 avatar May 01 '24 22:05 CharlieL7

Test Batch Rate new
efeb10
Rate old
a05069
Diff Compare
torchvision-resnet50 64 1,736.15 1,751.37 -0.87% :white_check_mark:
torchvision-resnet50_fp16 64 4,031.22 4,085.67 -1.33% :white_check_mark:
torchvision-densenet121 32 1,460.45 1,468.19 -0.53% :white_check_mark:
torchvision-densenet121_fp16 32 2,513.23 2,529.60 -0.65% :white_check_mark:
torchvision-inceptionv3 32 874.04 889.45 -1.73% :white_check_mark:
torchvision-inceptionv3_fp16 32 1,479.97 1,485.18 -0.35% :white_check_mark:
cadene-inceptionv4 16 405.88 412.31 -1.56% :white_check_mark:
cadene-resnext64x4 16 417.09 419.70 -0.62% :white_check_mark:
slim-mobilenet 64 4,075.60 4,005.23 1.76% :white_check_mark:
slim-nasnetalarge 64 100.72 100.99 -0.26% :white_check_mark:
slim-resnet50v2 64 1,677.94 1,680.69 -0.16% :white_check_mark:
bert-mrpc-onnx 8 612.45 616.39 -0.64% :white_check_mark:
bert-mrpc-tf 1 278.77 279.83 -0.38% :white_check_mark:
pytorch-examples-wlang-gru 1 322.31 316.61 1.80% :white_check_mark:
pytorch-examples-wlang-lstm 1 327.41 290.31 12.78% :high_brightness:
torchvision-resnet50_1 1 467.03 471.25 -0.90% :white_check_mark:
cadene-dpn92_1 1 248.84 246.67 0.88% :white_check_mark:
cadene-resnext101_1 1 205.38 203.90 0.73% :white_check_mark:
onnx-taau-downsample 1 203.98 206.51 -1.23% :white_check_mark:
dlrm-criteoterabyte 1 22.83 22.90 -0.32% :white_check_mark:
dlrm-criteoterabyte_fp16 1 42.57 42.66 -0.22% :white_check_mark:
agentmodel 1 6,241.26 6,246.02 -0.08% :white_check_mark:
unet_fp16 2 34.13 34.23 -0.28% :white_check_mark:
resnet50v1_fp16 1 604.46 588.97 2.63% :white_check_mark:
resnet50v1_int8 1 583.21 581.34 0.32% :white_check_mark:
bert_base_cased_fp16 64 641.56 646.01 -0.69% :white_check_mark:
bert_large_uncased_fp16 32 197.85 198.88 -0.52% :white_check_mark:
bert_large_fp16 1 116.79 117.59 -0.67% :white_check_mark:
distilgpt2_fp16 16 1,205.13 1,212.19 -0.58% :white_check_mark:
yolov5s 1 299.38 301.48 -0.70% :white_check_mark:
tinyllama 1 23.23 23.32 -0.41% :white_check_mark:
vicuna-fastchat 1 133.07 133.41 -0.25% :white_check_mark:
whisper-tiny-encoder 1 243.22 244.30 -0.44% :white_check_mark:
whisper-tiny-decoder 1 255.56 256.63 -0.42% :white_check_mark:

Check results before merge :high_brightness:

migraphx-bot avatar May 02 '24 02:05 migraphx-bot


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance

migraphx-bot avatar May 02 '24 02:05 migraphx-bot

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.00%. Comparing base (9f5af93) to head (efeb103). Report is 144 commits behind head on develop.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #3031   +/-   ##
========================================
  Coverage    91.99%   92.00%           
========================================
  Files          489      490    +1     
  Lines        19423    19433   +10     
========================================
+ Hits         17869    17879   +10     
  Misses        1554     1554           

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov[bot] avatar May 14 '24 23:05 codecov[bot]