ml-infrastructure topic
metaflow
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
BentoML
The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
determined
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
actions-ml-cicd
A Collection of GitHub Actions That Facilitate MLOps
sagify
LLMs and Machine Learning done easily
metaflow-service
:rocket: Metadata tracking and UI service for Metaflow!
skypilot
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
aqueduct
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
ktext
Utilities for preprocessing text for deep learning with Keras
Server
A standalone inference server for trained Rubix ML estimators.