qiskit-camp-asia-19 icon indicating copy to clipboard operation
qiskit-camp-asia-19 copied to clipboard

Improving Qiskit Benchmarking and Performance

Open mtreinish opened this issue 5 years ago • 11 comments

Abstract

The Qiskit project has a benchmark system in place that is setup to automatically benchmark and track the performance (not just in execution time, but also quality of output) of the Qiskit over time. Right now there are a limited number of benchmarks that only characterize the performance for a subset of Qiskit Terra. This project would be working on creating new benchmarks that we can use to track various aspects of all of qiskit.

Description

The current benchmarks get run nightly across all commits merged to terra in the past day. The results get uploaded to: https://qiskit.github.io/qiskit/ which provides visualization and regression identification for the results.

The benchmarks all currently live in the qiskit meta-package repository here: https://github.com/Qiskit/qiskit/tree/master/test/benchmarks and are written using the airspeed velocity tool: https://asv.readthedocs.io/en/stable/

Members

  • @Qr4cl3
  • @hillmich
  • @kurarrr
  • @perrychen0417
  • @rajchawit
  • Qiskit Coach: @mtreinish @hhorii

Deliverable

Additional modules in the qiskit benchmarks.

GitHub repo

https://github.com/Qiskit/qiskit/tree/master/test/benchmarks

mtreinish avatar Nov 07 '19 18:11 mtreinish

I am Pin-Fang Chen. I am from National Taiwan University. I have interest in your pitch.

perrychen0417 avatar Nov 19 '19 01:11 perrychen0417

I would be interested in this if not killed. Bruno Schmitt, Computer Scientist (:

boschmitt avatar Nov 19 '19 01:11 boschmitt

I'm in. My name is Warat Puengtambol. I'm a Computer Scientist

Qr4cl3 avatar Nov 19 '19 01:11 Qr4cl3

I'm Rajchawit, I'm in! I'm Computer Scientist

rajchawit avatar Nov 19 '19 01:11 rajchawit

Stefan Hillmich, CS

hillmich avatar Nov 19 '19 02:11 hillmich

Ryota Yonekura, CS

kurarrr avatar Nov 19 '19 02:11 kurarrr

A way to setup build environment of qiskit-aer: https://github.com/Qiskit/qiskit-aer/blob/master/CONTRIBUTING.md#install-from-source

hhorii avatar Nov 19 '19 02:11 hhorii

Current fusion: https://github.com/Qiskit/qiskit-aer/blob/master/src/transpile/fusion.hpp#L325-L365

hhorii avatar Nov 19 '19 02:11 hhorii

Code 1/2: Qiskit Aer Repo: https://github.com/kurarrr/qiskit-aer PR: https://github.com/Qiskit/qiskit-aer/pull/456

hillmich avatar Nov 20 '19 04:11 hillmich

Code 2/2: Benchmark Repo: https://github.com/Qr4cl3/Iqb_n_p PR: https://github.com/Qiskit/qiskit/pull/698

Qr4cl3 avatar Nov 20 '19 04:11 Qr4cl3