[NOT FOR MERGING] Simulator for inference autoscaling

[jan-elastic]

Legend

Request count / inference time:

• orange: real value
• blue: estimated value by running average

Wait time:

• blue: max wait time (bucketed by minute)
• orange: average wait time (bucketed by minute)

Note: all times are in seconds