ml-serving topic

Serving large ml models independently and asynchronously via message queue and kv-storage for communication with other services [EXPERIMENT]

gasparian

Collection of OSS models that are containerized into a serving container

entrpn

A lightweight server for LightGBM

jeongukjae

A curated list of awesome open source and commercial platforms for serving models in production 🚀

awesome-mlops