asv run ALL --skip-existing-commits --steps=n should apply steps after skipping

[astrofrog]

I am currently running asv as a cron job, and trying to do:

asv run ALL --skip-existing-commits --steps=10

However, this only runs 10 commits the first time, and then no longer runs any commits because it seems the commits are always selected in the same order. I think existing commits should be removed from the pool of available ones before applying --steps.

[astrofrog]

Note that this was why I had added the MISSING command originally - the idea was that:

asv run MISSING --steps=10

would run 10 of the commits that hadn't been run yet (but MISSING was removed subsequently)

[pv]

I think both use cases can be motivated. Can probably add a new switches for that (--steps-after-skip or some such).

[mraspaud]

Does anyone have a workaround for this? We would just like to run missing benchmarks when the server is idle...