Performance over commits

[gnzlbg]

Is there a way to visualize the performance of a single test and for a single compiler/case over multiple commits to e.g. see if a commit introduces a regression?

[wichtounet]

You mean filter the web interface so that you see only one test ? Unfortunately, there are no filter features for the web interface right now.

But, if your benchmark only has one test and you run it for every commit, you'll have the behaviour you want.

[gnzlbg]

I was setting up a new project and decided to make a project structure first that sets up a couple of things more or less automatically.

One thing I would like, but I don't know how to do yet, is track the performance of some benchmarks over the project's time to display performance improvements and regressions. How reliable travis machines are for performing benchmarks remains to be seen.

Boost.Hana has a gh-dataset branch, where data-sets of information can be committed automatically by the travis script. It then uses javascript in doxygen to load the datasets from this branch and display graphs.

I was trying to see if cpm could help me here somehow.

[wichtounet]

I think it could help, but you'll have to write the benchmark and then run cpm after each commit, but that is exactly what cpm is for.