guardrails icon indicating copy to clipboard operation
guardrails copied to clipboard

Published 20 hours ago • verified publisher icon guardrails-ai

Streaming chunk accumulation

Open nichwch opened this issue 1 year ago • 1 comments
trafficstars

Implements new validate_stream method on Validator, and changes stream_runner to pass individual chunks to validators. Validators now internally accumulate chunks until they reach a specified chunk size, then emit a validation up to the iterator in stream_runner.

These changes only apply to string_schema and SequentialValidatorService for now.

nichwch avatar May 07 '24 16:05 nichwch

Chunk accumulation rewrite

notion-workspace[bot] avatar May 16 '24 23:05 notion-workspace[bot]