model-serving topic

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

mosecorg

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates t...

mlrun

FastAPI Skeleton App to serve machine learning models production-ready.

eightBEC

Common library for serving TensorFlow, XGBoost and scikit-learn models in production.

spotify

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

instill-ai

A collection of model deployment library and technique.

balavenkatesh3322

Code and presentation for Strata Model Serving tutorial

lightbend

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

aporia-ai

flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Flink streaming engine

FlinkML

Serving PyTorch models with TorchServe :fire:

alvarobartt