state-of-mlops-2020 icon indicating copy to clipboard operation
state-of-mlops-2020 copied to clipboard

Kubecon Shanghai 2020: The state of machine learning operations in 2020

This repository contains a presentation of the state of machine learning operations in 2020.

Click here to watch the video of a short version of the talk at FOSDEM 2018
Click here to check out the Awesome Production ML Repo

Contents

  • This talk contains an overview of the production machine learning ecosystem in 2020.
  • It provides an insight on the relevant themes which are all listed in our Awesome Production ML list
  • For each theme, we dive into its definition, challenges, libraries available and a hands-on example
  • We cover dive into three themes:
    • Explainablility of Black Box Models
    • Production Machine Learning Orchestration
    • ML Model Reproducitbility and Versioning
  • As an overview, the content for each of the themes is as follows:
    • ML Model Reproducitbility and Versioning
    • Production Machine Learning Orchestration
      • Automation of model deployment through gitops and standardisation of metrics
      • Example building general PyTorch Hub Wrapper with Seldon
      • Other libraries including MLeap, Deep Detect
    • Explainablility of Black Box Models
      • Explanations of black box models for compliance
      • Explainer design pattern example building a production income classifier
      • Other libraries including ELI5, SHAP and XAI

Speaker: Alejandro Saucedo

  • Linkedin: https://linkedin.com/in/AxSaucedo/
  • Twitter: https://twitter.com/AxSaucedo/
  • Github: https://github.com/axsauze/
  • About: Alejandro is the Director of Machine Learning Engineering at Seldon Technologies, where he leads large scale projects implementing open source and enterprise infrastructure for Machine Learning Orchestration and Explainability. Alejandro is also the Chief Scientist at the Institute for Ethical AI & Machine Learning, where he leads the development of industry standards on machine learning bias, adversarial attacks and differential privacy. With over 10 years of software development experience, Alejandro has held technical leadership positions across hyper-growth scale-ups and has delivered multi-national projects with top tier investment banks, magic circle law firms and global insurance companies. He has a strong track record building departments of machine learning engineers from scratch, and leading the delivery of large-scale machine learning system across the financial, insurance, legal, transport, manufacturing and construction sectors (in Europe, US and Latin America).