haystack icon indicating copy to clipboard operation
haystack copied to clipboard

feat: streaming_callback as run param from HF generators

Open tstadel opened this issue 5 months ago • 1 comments

Related Issues

  • streaming_callback run param should be supported in a unified way throughout haystack main package. So far only OpenAIGenerator and AzureOpenAIGenerator support the run param. HuggingFaceAPIGenerator and HuggingFaceLocalGenerator lack this kind of support.

Proposed Changes:

  • add streaming_callback run param to HuggingFaceAPIGenerator and HuggingFaceLocalGenerator

How did you test it?

Notes for the reviewer

Checklist

tstadel avatar Sep 25 '24 10:09 tstadel