Introduction

This repository contains slides presented at the South East Asia Machine Learning School (SEA MLS) 2019. SEA MLS 2019 was a 5-day event held at Universitas Indonesia, Depok, Greater Jakarta, Indonesia between July 8 to July 12, 2019. It had the following sessions:

• Lecture sessions from top machine learning experts and invited speakers (both basic and more advanced topics were covered);
• Interactive practical sessions where participants had the chance to directly try out and implement models described in the lectures;
• Panel sessions with machine learning researchers, practitioners, industry leaders, and government representatives about current challenges in AI;
• Research presentation sessions where participants showcased their past work and projects to get feedback from fellow participants and invited speakers; and
• Social events with the event's sponsors.

Content

The slides are organized according to the day they were presented as follows:

• Day 1
  • Math foundations (expectation, differentiation, linear algebra, etc.)
  • Introduction to machine learning (supervised, unsupervised learning, applications)
  • Machine learning basics (overfitting, model selection, adding/reducing features, regularisation)
  • Practical I: Tensorflow and Colab
• Day 2
  • Simple unsupervised learning (k-Means and Gaussian mixture models, matrix factorization, LDA, etc.)
  • Neural network basics (feedforward networks)
  • Tricks of the trade: optimisers, dropout, batch norm, layer norm
• Day 3
  • Language models, word embeddings. Sequential predictions, RNNs, and LSTMs.
  • Sequence-to-sequence models. Conditional language generation (+attention)
  • Practical II: NLP in Tensorflow
• Day 4
  • Convolutional neural networks (CNNs)
  • Multimodal machine learning: Grounding, VQA, etc.
  • Practical III: CNNs
• Day 5
  • Deep probabilistic graphical models
  • Attention, self-attention, transformers, BERT
  • Deep learning for biomedicine