armory icon indicating copy to clipboard operation
armory copied to clipboard

Explicit Task and Model Definitions

Open davidslater opened this issue 4 years ago • 1 comments

We should be significantly more explicit about what the model needs to do (the task), what the model is actually doing, and potentially what the attack threat model is.

  • [ ] Tagging model output (output format - transcript or prob lattice...; logits vs probs vs log probs)
  • [ ] Explicit task / scenario definitions, including preprocessing
  • [ ] Threat model definition

davidslater avatar Oct 21 '20 05:10 davidslater

Updated to reflect changes since 0.12

davidslater avatar Mar 29 '22 00:03 davidslater