dpbench
dpbench copied to clipboard
dpbench fails if no reference implementation for benchmark
File "/home/akalistr/miniconda3/envs/dpbench-dev/bin/dpbench", line 33, in <module>
sys.exit(load_entry_point('dpbench', 'console_scripts', 'dpbench')())
File "/home/akalistr/repo/dpbench/dpbench/console/entry.py", line 134, in main
execute_run(args, conn)
File "/home/akalistr/repo/dpbench/dpbench/console/run.py", line 172, in execute_run
runner.run_benchmark_and_save(
File "/home/akalistr/repo/dpbench/dpbench/infrastructure/benchmark_runner.py", line 372, in run_benchmark_and_save
results = self.run_benchmark_in_sub_process(rc)
File "/home/akalistr/repo/dpbench/dpbench/infrastructure/benchmark_runner.py", line 332, in run_benchmark_in_sub_process
brc.ref_framework: cfg.Framework = [
IndexError: list index out of range
https://github.com/IntelPython/dpbench/blob/main/dpbench/infrastructure/benchmark_runner.py#L332
Also see https://github.com/IntelPython/dpbench/issues/271
Thank you for the report. I'll take a look on it. As a workaround you can use --no-validate
flag for run
command to skip validation.