guardrails icon indicating copy to clipboard operation
guardrails copied to clipboard

[feat] Provenance - Add metadata with underlying numbers to the PassResult and FailResult

Open zsimjee opened this issue 1 year ago • 1 comments

https://github.com/guardrails-ai/guardrails/discussions/574

zsimjee avatar Feb 09 '24 17:02 zsimjee

I've updated the validate_each_sentence and validate_full_text methods in the ProvenanceV0 validator to include cosine similarity values in the validation metadata, enhancing validation process with quantitative analysis of text relevance. These changes allow users to access detailed similarity measures directly in the validator_logs, improving transparency and facilitating deeper insights into the validation outcomes.

If this approach proves beneficial, should I consider applying similar updates to ProvenanceV1 as well?

PR Link

yadomkar avatar Mar 05 '24 01:03 yadomkar

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 14 days.

github-actions[bot] avatar Aug 22 '24 03:08 github-actions[bot]

This issue was closed because it has been stalled for 14 days with no activity.

github-actions[bot] avatar Sep 05 '24 03:09 github-actions[bot]