dpbench icon indicating copy to clipboard operation
dpbench copied to clipboard

dpbench fails if no reference implementation for benchmark

Open AlexanderKalistratov opened this issue 1 year ago • 1 comments

  File "/home/akalistr/miniconda3/envs/dpbench-dev/bin/dpbench", line 33, in <module>
    sys.exit(load_entry_point('dpbench', 'console_scripts', 'dpbench')())
  File "/home/akalistr/repo/dpbench/dpbench/console/entry.py", line 134, in main
    execute_run(args, conn)
  File "/home/akalistr/repo/dpbench/dpbench/console/run.py", line 172, in execute_run
    runner.run_benchmark_and_save(
  File "/home/akalistr/repo/dpbench/dpbench/infrastructure/benchmark_runner.py", line 372, in run_benchmark_and_save
    results = self.run_benchmark_in_sub_process(rc)
  File "/home/akalistr/repo/dpbench/dpbench/infrastructure/benchmark_runner.py", line 332, in run_benchmark_in_sub_process
    brc.ref_framework: cfg.Framework = [
IndexError: list index out of range

https://github.com/IntelPython/dpbench/blob/main/dpbench/infrastructure/benchmark_runner.py#L332

Also see https://github.com/IntelPython/dpbench/issues/271

AlexanderKalistratov avatar Jun 01 '23 09:06 AlexanderKalistratov

Thank you for the report. I'll take a look on it. As a workaround you can use --no-validate flag for run command to skip validation.

ZzEeKkAa avatar Jun 05 '23 20:06 ZzEeKkAa