Allison Piper

We recently had an issue where a benchmark kernel caused an illegal memory access, and the error was asynchronously reported in an unrelated NVBench CUDA API call. Any errors emitted...

`nvbench_compare.py` coloring should be optional and off by default.

1

Add a `--color` option to `scripts/nvbench_compare.py`, and only import/use colorama when this is explicitly passed in.

[FEA] Use NVML to manage clocks, etc

5

Adding NVML as an optional dependency would allow some cool features: * Lock clock frequency. * Per-device default frequency. * Per-device maximum frequency. * Explicit frequency. * Log various device...

We should add an `output` directory under `nvbench/example` that contains the json, csv, and md outputs for each benchmark on a multidevice system. This should be linked to from the...

Python Comparison Scripts

9

NVBench has a work-in-progress JSON output format and I'm working on a very basic python script to compare two JSON files. We should grow this functionality into a more complete...

Add a `zip_axis` / `tuple_axis` that iterates through multiple parameter axes in lockstep

6

# Overview RAPIDS needs a way to iterate through correlated axes in lockstep. # Example Usecase Consider a benchmark that takes three parameters "X", "Y", and "Z", where X is...

Enable CUPTI for CTK <= 11.2.

2

There are some compilation errors with CUPTI from CTK 11.2: ``` FAILED: nvbench/CMakeFiles/nvbench.dir/cupti_profiler.cxx.o /home/av/code/utils/ccache-install/bin/g++ -DFMT_LOCALE -Dnvbench_EXPORTS -I/home/av/code/src/nvbench -I/home/av/code/build/nvbench-ctk_11.2 -I/home/av/code/build/nvbench-ctk_11.2/_deps/fmt-src/include -I/home/av/code/build/nvbench-ctk_11.2/nvbench/detail -isystem /usr/local/cuda_11.2.0_460.22/include -isystem /usr/local/cuda_11.2.0_460.22/extras/CUPTI/include -isystem /home/av/code/build/nvbench-ctk_11.2/_deps/nlohmann_json-src/include -O3 -DNDEBUG -fPIC -Wall...

Adds samples of `--list`, `--md`, `--json`, and `--csv` for each example. Fixed a race condition where calling `std::exit(0)` in the parser was skipping ofstream destructors. Some files were never flushed/closed,...

`test_export` tests fail on MSVC

5

The `test_export` tests added in #42 do not work with MSVC when run from a VS2019 dev prompt. The test executables fail to run:  This could be fixed by...

## Update The information below is relevant, but outdated. #42 is adding install rules for NVBench. It's still extremely important to make sure that either: 1. All projects involved are...