serving topic
serving
A flexible, high-performance serving system for machine learning models
serve
Serve, optimize and scale PyTorch models in production
ML-Model-CI
MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
hydro-serving
MLOps Platform
pinferencia
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
simple_tensorflow_serving
Generic and easy-to-use serving service for machine learning models
MetaSpore
A unified end-to-end machine intelligence platform
keras-serving
bring keras-models to production with tensorflow-serving and nodejs + docker :pizza:
outserv
Blockchain Search with GraphQL APIs
dingo
A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and...