Benchmark Bitrot

[insertinterestingnamehere]

Most of our benchmarks haven't even been looked at in years. I suspect many no longer work. The situation needs to be triaged so we can determine which benchmarks to keep (and also which ones to run consistently).