ml-infrastructure topic
metaflow
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
BentoML
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
determined
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
actions-ml-cicd
A Collection of GitHub Actions That Facilitate MLOps
sagify
LLMs and Machine Learning done easily
metaflow-service
:rocket: Metadata tracking and UI service for Metaflow!
skypilot
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
aqueduct
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
ktext
Utilities for preprocessing text for deep learning with Keras
Server
A standalone inference server for trained Rubix ML estimators.