Scott Todd

Tested on a few programs, seems to still work: simple programs (no push constants) compile to WGSL that looks reasonable and complex programs (push constants) fail with errors like this:...

Embed executable sources in vmfb files for portable Tracy captures

5

We can view executable sources for dispatch functions in Tracy thanks to https://github.com/openxla/iree/pull/9994, https://github.com/openxla/iree/pull/13333, and https://github.com/openxla/iree/pull/13500. * The definition of "executable sources" in a multi-level compiler can have multiple values....

Run `iree-import-onnx` test(s) on CI

1

https://github.com/openxla/iree/pull/16622 fixes an issue that should have been caught by presubmit tests. We have a test but it has a soft failure mode if `onnx` is not installed: https://github.com/openxla/iree/blob/4c97ab6800820392589ce440f5b6b98f9bd855da/compiler/bindings/python/test/tools/import_onnx_test.py#L51-L56 I...

Add new framework coverage in system level test suites

16

## Overview Let's add more test coverage for full programs, individual ops/layers, and other system-level behavior coming from frameworks like PyTorch, JAX, TF/TFLite, ONNX, etc. ## "SHARK-TestSuite/e2eshark" https://github.com/nod-ai/SHARK-TestSuite/tree/main/e2eshark has a...

Add a bisect tool using postsubmit pkgci artifacts

3

When diagnosing performance regressions it can be useful to run a bisect process to identify culprit commits. Git has a built in bisect tool: https://git-scm.com/docs/git-bisect, but bisecting across commits requires...

Refactor benchmark jobs in ci.yml

6

Following [this discussion on Discord](https://discord.com/channels/689900678990135345/689957613152239638/1207827386058547220). These jobs in [the `ci.yml` workflow](https://github.com/openxla/iree/blob/main/.github/workflows/ci.yml) are increasing infrastructure complexity and are a bottleneck on total presubmit time: * `build_benchmark_tools` * `build_e2e_test_artifacts` * `test_benchmark_suites` *...

Test 'console' provider in 'tracing' job.

1

This also refactors the job to use a GitHub-managed runner with less random GitHub Actions boilerplate for caching, env vars, etc. since the 'tracing' job is only building the runtime...

This was trickier that I wanted it to be... adding some screenshots and notes about settings to apply for myself/others. Progress on https://github.com/openxla/iree/issues/16372 (tidying up `regression_suite` while I evaluating extending...

Convert more CI jobs to be package-based

29

## Current tasks ```[tasklist] ### Tasks - [x] Refactor CMake project so all "integration tests", even those using `lit`, can be run using packages instead of source builds (`-DIREE_BUILD_COMPILER`) -...

I spotted some low hanging fruit here: https://discord.com/channels/689900678990135345/1166024193599615006/1207085419959947294 and here: https://groups.google.com/g/iree-discuss/c/uy0L4Vdl3hs/m/YLe0iLCGAAAJ. * The `process_benchmark_results` step takes around 2 minutes to download a mysterious `iree-oss/benchmark-report` Dockerfile. The generation scripts only need...