armory icon indicating copy to clipboard operation
armory copied to clipboard

Add support for ablation studies.

Open jprokos26 opened this issue 1 year ago • 1 comments

I.e. take in a collection of config files (or optimally a set of learning-rates or base-images or just a generic list of kwargs to modify) and output a single result file with each in a separate "result" object.

jprokos26 avatar May 12 '23 18:05 jprokos26

Are you aware of Armory's sweep attack capability? It's not the exact same thing, but maybe partially meets this need. It sounds like you are looking for a full result for each parameter value, while the sweep attack goes from weakest to strongest and I believe it skips samples if they were successfully broken with weaker parameters.

swsuggs avatar May 15 '23 14:05 swsuggs