Deep-Mutual-Learning

This is an unofficial implementation of Deep Mutual Learning by Pytorch to do classification on cifar100.
The algorithm was proposed in 《Deep Mutual Learning》 (CVPR 2017).

Dependence

Pytorch 1.0.0
tensorboard 1.14.0

Overview

Overview of the algorithm:

Usage

The default network for DML is ResNet32.
Train 2 models using DML by main.py:

python train.py --model_num 2

Use tensorboard to monitor training process on choosing port:

tensorboard --logdir logs --port 6006

Result