serving topic
Boostcamp-AI-Tech-Product-Serving
부스트캠프 AI Tech - Product Serving 자료
Deep-Learning-in-Production
In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
vespa
AI + Data, online. https://vespa.ai
tensorflow_template_application
TensorFlow template application for deep learning
ray
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
seldon-core
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
bodywork-core
ML pipeline orchestration and model deployments on Kubernetes.
Serving
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
model_server
A scalable inference server for models optimized with OpenVINO™
delta
DELTA is a deep learning based natural language and speech processing platform.