modsysML
modsysML copied to clipboard
cloudguruab
Model management toolkit for continuous model improvement. Evaluate and compare LLM outputs, test quality, catch regressions and automate.
Bumps [openai](https://github.com/openai/openai-python) from 0.27.7 to 1.25.0. Release notes Sourced from openai's releases. v1.25.0 1.25.0 (2024-05-01) Full Changelog: v1.24.1...v1.25.0 Features api: delete messages (#1388) (d0597cd) v1.24.1 1.24.1 (2024-04-30) Full Changelog: v1.24.0...v1.24.1...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [cachetools](https://github.com/tkem/cachetools) from 5.3.1 to 5.3.3. Changelog Sourced from cachetools's changelog. v5.3.3 (2024-02-26) Documentation improvements. Update CI environment. v5.3.2 (2023-10-24) Add support for Python 3.12. Various documentation improvements. Commits 1fcadea...
Bumps [idna](https://github.com/kjd/idna) from 3.4 to 3.7. Release notes Sourced from idna's releases. v3.7 What's Changed Fix issue where specially crafted inputs to encode() could take exceptionally long amount of time...
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.65.0 to 4.66.2. Release notes Sourced from tqdm's releases. tqdm v4.66.2 stable pandas: add DataFrame.progress_map (#1549) notebook: fix HTML padding (#1506) keras: fix resuming training when verbose>=2...
Bumps [pre-commit/action](https://github.com/pre-commit/action) from 3.0.0 to 3.0.1. Release notes Sourced from pre-commit/action's releases. pre-commit/[email protected] Misc Update actions/cache to v4 #190 PR by @SukiCZ. #189 issue by @bakerkj. Commits 2c7b380 v3.0.1 8e2deeb...
Bumps [yarl](https://github.com/aio-libs/yarl) from 1.9.2 to 1.9.4. Release notes Sourced from yarl's releases. 1.9.4 Bug fixes Started raising :py:exc:TypeError when a string value is passed into :py:meth:~yarl.URL.build as the port argument...
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5. Release notes Sourced from actions/setup-python's releases. v5.0.0 What's Changed In scope of this release, we update node version runtime from node16 to node20 (actions/setup-python#772)....
Hi @kd-kinuthiadavid @cloudguruab I'm the maintainer of LiteLLM. we allow you to create a proxy server to call 100+ LLMs to make it easier to run benchmark / evals ....
Patch to downstream evaluation process created, merge this and revisit downstream patch.
Metadata
Owner
Metadata
Model management toolkit for continuous model improvement. Evaluate and compare LLM outputs, test quality, catch regressions and automate.