iree
iree copied to clipboard
Log compile and run commands on successful model tests too.
This pulls in my change at https://github.com/nod-ai/SHARK-TestSuite/pull/227 to add more logging to these test jobs. Now when a test runs and --log-cli-level=info is set, it will log the compile and run commands as they are launched. Previously these were only logged on test failure.
Sample logs: https://github.com/iree-org/iree/actions/runs/8973823928/job/24645200447?pr=17290#step:11:40
============================= test session starts ==============================
platform linux -- Python 3.11.9, pytest-8.2.0, pluggy-1.5.0
rootdir: /mnt/share/amdsharks/actions-runner-iree/_work/iree/iree
plugins: xdist-3.6.1, timeout-2.3.1, retry-1.6.2, reportlog-0.4.0
timeout: 1200.0s
timeout method: signal
timeout func_only: False
collected 2 items / 1 deselected / 1 selected
SHARK-TestSuite/iree_tests/pytorch/models/sdxl-scheduled-unet-3-tank/model.mlirbc::gpu_rocm_real_weights
-------------------------------- live log call ---------------------------------
INFO root:conftest.py:393 Launching compile command:
cd /mnt/share/amdsharks/actions-runner-iree/_work/iree/iree/SHARK-TestSuite/iree_tests/pytorch/models/sdxl-scheduled-unet-3-tank && iree-compile model.mlirbc --iree-hal-target-backends=rocm --iree-rocm-target-chip=gfx90a --iree-opt-const-eval=false --iree-codegen-transform-dialect-library=/mnt/share/amdsharks/actions-runner-iree/_work/iree/iree/build_tools/pkgci/external_test_suite/attention_and_matmul_spec.mlir --iree-global-opt-propagate-transposes=true --iree-global-opt-enable-fuse-horizontal-contractions=true --iree-flow-enable-aggressive-fusion=true --iree-opt-aggressively-propagate-transposes=true --iree-opt-outer-dim-concat=true --iree-vm-target-truncate-unsupported-floats --iree-llvmgpu-enable-prefetch=true --iree-opt-data-tiling=false --iree-codegen-gpu-native-math-precision=true --iree-codegen-llvmgpu-use-vector-distribution "--iree-preprocessing-pass-pipeline=builtin.module(iree-preprocessing-transpose-convolution-pipeline, util.func(iree-preprocessing-pad-to-intrinsics))" -o model_gpu_rocm_real_weights.vmfb
INFO root:conftest.py:407 Launching run command:
cd /mnt/share/amdsharks/actions-runner-iree/_work/iree/iree/SHARK-TestSuite/iree_tests/pytorch/models/sdxl-scheduled-unet-3-tank && iree-run-module --module=model_gpu_rocm_real_weights.vmfb --device=hip --parameters=model=real_weights.irpa --module=sdxl_scheduled_unet_pipeline_fp16_rocm.vmfb --input=1x4x1[28](https://github.com/iree-org/iree/actions/runs/8973823928/job/24645200447?pr=17290#step:11:29)x128xf16=@inference_input.0.bin --input=2x64x2048xf16=@inference_input.1.bin --input=2x1280xf16=@inference_input.2.bin --input=1xf16=@inference_input.3.bin --expected_output=1x4x128x128xf16=@inference_output.0.bin --expected_f16_threshold=0.8f --flagfile=real_weights_data_flags.txt
PASSED
============================== slowest durations ===============================
[34](https://github.com/iree-org/iree/actions/runs/8973823928/job/24645200447?pr=17290#step:11:35).50s call SHARK-TestSuite/iree_tests/pytorch/models/sdxl-scheduled-unet-3-tank/model.mlirbc::gpu_rocm_real_weights
(2 durations < 0.005s hidden. Use -vv to show these durations.)
=========================== short test summary info ============================
PASSED SHARK-TestSuite/iree_tests/pytorch/models/sdxl-scheduled-unet-3-tank/model.mlirbc::gpu_rocm_real_weights
======================= 1 passed, 1 deselected in 34.54s =======================