[Auto Benchmarks] - Have a version without vid with benchmarking

[dailinsubjam]

What is this task and why do we need to work on it?

This will help us isolate the problems in vid, and in the future we could use it to identify whether and when VID becomes a bottleneck.

What work will need to be done to complete this task?

No response

Are there any other details to include?

No response

What are the acceptance criteria to close this issue?

Get out benchmarking results without VID.

Branch work will be merged to (if not the default branch)

No response