Dummy runs management

[gormat]

Guys this tool is amazing. Can you please add functionality to select dummy runs? An easy way to remove all dummy runs.

[gorarakelyan]

Thanks for the feedback!

[gorarakelyan]

Will add to the roadmap.

[roubkar]

relates to https://github.com/aimhubio/aim/issues/1170

[roubkar]

Hey @gormat, the ability to remove runs has been added with v3.4.0.

As for selecting/querying/filtering dummy runs, I think this issue relates to: https://github.com/aimhubio/aim/issues/1215

[SGevorg]

@roubkar what's the state of this issue?

[roubkar]

Hey @SGevorg, we have added the ability to remove runs in v3.4.0. As for providing the ability to select dummy runs (e.g. select all runs that performed less than 100 steps) we haven't fully explored this yet.

[roubkar]

Hey @gormat, we have released v3.12.0 where we have introduced a new run.duration field, upgrade aim to use it: pip install aim --upgrade. Now you can filter runs by their duration (e.g. run.duration < 60 * 10 (10 minutes))

Will this resolve your issue?

[spacegoing]

@roubkar Hi guys I run into similar issue. I have different metrics with different steps. I can't simply filtering by duration.

I think it would be great if we could use metric['metric_name'].step/epoch > 1000 something like this

[spacegoing]

do we have a workaround for this?

[mihran113]

Hey @spacegoing! You can filter runs based on the metric's last_step value. Here is an example for that:

run.metrics['name', {"some": "context"}].last_step > 1000

You can also check out the documentation for more details: https://aimstack.readthedocs.io/en/latest/using/search.html