JitBench
JitBench copied to clipboard
Enable naive latency measurements
Measure latency on single requests: consider using same measurements for steady state. Investigate less invasive way of collecting data points. Steady state could simply output data on the console every 1000 or so requests, making it non-invasive. Latency will need to collect all data points, making it a bit trickier. Moving avg/variance? Or simply accumulate all values in a large enough pre-allocated array and post process?
We are looking for whatever takes the least resource overall.