mlgraph icon indicating copy to clipboard operation
mlgraph copied to clipboard

Machine Learning Inference Graph Spec

MLGraph

MLGraph defines a graph of machine learning components. The goal is to provide a simple machine learning focused specification for defining:

  • Easy model Experimentation and AB tests
  • Advanced routing with Multi-Armed Bandits
  • Ensembling of models
  • Explanations, Outlier Detection, Skew and Bias detection
  • Builds upon KFServing and other ML Serving Components
  • Flexible graph nodes:
    • References or inline specs
  • Custom user provided components *Auto-validation of graph

An example graph:

example-graph

Definitions

  • Control plane
    • Examples
  • Data plane

Implementations

There could be multiple implementations of the spec. The initial focus will be build upon KNative.

  • A KNative implementation proposal
  • An Apache Arrow proposal

Stack

stack

Discussion

The spec is a live document.

  • Discussion Points