serving topic
FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end...
model_deployment
A collection of model deployment library and technique.
tensorflow-serving-arm
TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores
fastDeploy
Deploy DL/ ML inference pipelines with minimal extra code.
serving
A stand alone industrial serving system for angel.
libtorch_grpc_serving
pytorch during training, libtorch during serving via gRPC
sagemaker-sparkml-serving-container
This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.
fasttext-serving
Serve your fastText models for text classification and word vectors
clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
djl-serving
A universal scalable machine learning model deployment solution