Automatic performance benchmarks

[rjagerman]

We should separate out the performance benchmark tests and run them automatically CI. Additionally, more performance benchmark tests should be written to properly test the performance of all the different components. This should make it easy to see when future code changes impact the performance in a significant way.