vigil-llm icon indicating copy to clipboard operation
vigil-llm copied to clipboard

Dataset eval helper

Open deadbits opened this issue 2 years ago • 0 comments

Vigil should have a helper utility to assist users in evaluating datasets against the detection mechanisms and return true positives, false positives, false negatives, accuracy score, etc.

I'm thinking a simple CSV of prompts, classifications, and categories.

deadbits avatar Oct 31 '23 15:10 deadbits