XBastille

icon location India icon location Deep Learning Engineer (specializes in Computer Vision)

Results 1 issues of XBastille

feat: Add streaming support for batched prompts

## Description Adds streaming support for batched prompts, resolving issue #406. ## Changes - Removed restriction that blocked batched streaming in `_sampler.py` - Fixed `_stream_sample_loop` to wait for ALL batch...