guardrails icon indicating copy to clipboard operation
guardrails copied to clipboard

Add field level granularity to reask capability

Open ShreyaR opened this issue 3 years ago • 4 comments

ShreyaR avatar Mar 06 '23 10:03 ShreyaR

Imagine we have a guard output structure with 10 fields defined in it and each field has validators. If we make an LLM call and validate that guard, and 9 fields pass validation but 1 fails, then in the current system, we reask for the entire object and substitute the entire object after validation. This is expensive both for the LLM and in terms of the amount of validation we run. Instead, if we could reask ONLY for the missing field and substitute it in after validation, that's much cheaper.

zsimjee avatar Jan 12 '24 00:01 zsimjee

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 14 days.

github-actions[bot] avatar Aug 22 '24 03:08 github-actions[bot]

This issue was closed because it has been stalled for 14 days with no activity.

github-actions[bot] avatar Sep 06 '24 03:09 github-actions[bot]

reopening, good feature request

zsimjee avatar Sep 06 '24 17:09 zsimjee

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 14 days.

github-actions[bot] avatar Oct 07 '24 03:10 github-actions[bot]