tonic_validate
tonic_validate copied to clipboard
Bump litellm from 1.35.20 to 1.37.7
Bumps litellm from 1.35.20 to 1.37.7.
Release notes
Sourced from litellm's releases.
v1.37.7
What's Changed
- [Feat] send weekly spend reports by Team/Tag by
@ishaan-jaffin BerriAI/litellm#3609- build(deps): bump next from 14.1.0 to 14.1.1 in /ui/litellm-dashboard by
@dependabotin BerriAI/litellm#3550Full Changelog: https://github.com/BerriAI/litellm/compare/v1.37.6...v1.37.7
Docker Run LiteLLM Proxy
docker run \ -e STORE_MODEL_IN_DB=True \ -p 4000:4000 \ ghcr.io/berriai/litellm:main-v1.37.7Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Docker Run LiteLLM Proxy
docker run \ -e STORE_MODEL_IN_DB=True \ -p 4000:4000 \ ghcr.io/berriai/litellm:main-v1.37.7Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms) /chat/completions Failed ❌ 25 29.201838280850296 1.569862335119254 1.569862335119254 470 470 22.738666999998713 158.57545099999015 /health/liveliness Failed ❌ 23 27.765981590840433 15.60843977023888 15.60843977023888 4673 4673 21.5223430000151 1084.1698559999884 /health/readiness Failed ❌ 23 27.37511101043254 15.367950221029123 15.367950221029123 4601 4601 21.557389999998122 934.1259740000112 Aggregated Failed ❌ 23 27.65067546438819 32.546252326387254 32.546252326387254 9744 9744 21.5223430000151 1084.1698559999884 v1.37.6
... (truncated)
Commits
2045696fix(openai.py): creat MistralConfig with response_format mapping for mistral api20fe4ffbump: version 1.37.6 → 1.37.7112c06aMerge pull request #3550 from BerriAI/dependabot/npm_and_yarn/ui/litellm-dash...3a83893docs - cooldown deploymentdac8c64docs - router show cooldown_time21845bcMerge pull request #3609 from BerriAI/litellm_send_daily_spend_report39e4927fix(utils.py): fix vertex ai function calling + streaming40b2f33fix - only schedule spend alerting when db is not noneefaf4c8Merge pull request #3601 from msabramo/msabramo/update-fastapi-to-update-star...5dc3f15build(model_prices_and_context_window.json): fix gpt-4o max tokens- Additional commits viewable in compare view
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebasewill rebase this PR@dependabot recreatewill recreate this PR, overwriting any edits that have been made to it@dependabot mergewill merge this PR after your CI passes on it@dependabot squash and mergewill squash and merge this PR after your CI passes on it@dependabot cancel mergewill cancel a previously requested merge and block automerging@dependabot reopenwill reopen this PR if it is closed@dependabot closewill close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot show <dependency name> ignore conditionswill show all of the ignore conditions of the specified dependency@dependabot ignore this major versionwill close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor versionwill close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependencywill close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)