awesome-production-machine-learning
awesome-production-machine-learning copied to clipboard
EthicalML
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Adding a link to the [HEBO](https://github.com/huawei-noah/HEBO/tree/master) repo that contains various libraries to perform balck-box optimization and in particular automated hyperparameter tuning of ML models. The name of the repo itself...
Would you mind checking some recent production-level (rather than application-level) tools, including https://github.com/MagnivOrg/prompt-layer-library, https://github.com/microsoft/prompty, https://github.com/latitude-dev/latitude-llm, https://github.com/latitude-dev/latitude-llm, https://x.ai/blog/prompt-ide, https://github.com/stanfordnlp/dspy, https://github.com/microsoft/prompty, https://github.com/bigscience-workshop/promptsource, https://github.com/ianarawjo/ChainForge, and https://github.com/MadcowD/ell? @axsaucedo Some prompt engineering tools are commonly...
What do you think? @axsaucedo https://www.linkedin.com/feed/update/urn:li:activity:7227248574382649344?utm_source=share&utm_medium=member_desktop
Following https://github.com/EthicalML/awesome-production-machine-learning/pull/520 creating an issue to document comment: It could be worth to somehow keep a list of "REMOVED", perhaps it could go into a "GRAVEYARD.md" eventually, as in a...
Currently, there are quite a few tools in the industry-strength evaluation module that also function as monitoring|observability tools such as [Evidently](https://github.com/evidentlyai/evidently), [Ragas](https://docs.ragas.io/en/stable/concepts/metrics_driven.html), and [Uptrain](https://docs.uptrain.ai/getting-started/why-we-are-building-uptrain).
I found these three modules to be similar in terms of [machine learning asset management](https://dl.acm.org/doi/full/10.1145/3543847). Since the other two modules contain too few tools (5-8) that qualify as well-defined modules,...
Such as https://github.com/ARISE-Initiative/robosuite