chester-w-xie/deep-mutual-learning-1

An unofficial implementation of Deep Mutual Learning by Pytorch to do classification on cifar100.

Deep-Mutual-Learning

This is an unofficial implementation of Deep Mutual Learning by Pytorch to do classification on cifar100.
The algorithm was proposed in 《Deep Mutual Learning》 (CVPR 2017).

Dependence

Pytorch 1.0.0
tensorboard 1.14.0

Overview

Overview of the algorithm:

Usage

The default network for DML is ResNet32.
Train 2 models using DML by main.py:

python train.py --model_num 2

Use tensorboard to monitor training process on choosing port:

tensorboard --logdir logs --port 6006

Result

Network	ind_avg_acc	Dml_avg_acc
ResNet32	69.83%	71.03%