[Feature]: Add request_stream_timeout setting for default stream_timeout value of all models

[jeromeroussin]

The Feature

There is currently no way to set separate default timeout values for streaming and non-streaming calls. "timeout" and "stream_timeout" are per-model settings in the config.yaml, and "request_timeout" does not have an equivalent "request_stream_timeout". This RFE is about supporting "request_stream_timeout" in the litellm_settings section of the config yaml.

Motivation, pitch

Less repetition in the config yaml == fewer opportunities for typos

Are you a ML Ops Team?

No

Twitter / LinkedIn details

https://www.linkedin.com/in/jeromeroussin/

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.