Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classification
Implementation of
"Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classification"
Liuyu Xiang, Guiguang Ding, Jungong Han;
in European Conference on Computer Vision (ECCV), 2020, Spotlight
Requirements
- PyTorch (version >= 0.4.1)
- scikit-learn Check requirements.txt for detailed instructions.
Data Preparation
Follow OLTR for data preparation.
Getting Started (Training & Testing)
- Step 1: Train Expert models, or use the pre-trained model in ./logs/ImageNet_LT/
CUDA_VISIBLE_DEVICES=0 python main.py --config=./config/many_shot.py
CUDA_VISIBLE_DEVICES=0 python main.py --config=./config/median_shot.py
CUDA_VISIBLE_DEVICES=0 python main.py --config=./config/low_shot.py
- Step 2: Train a single model using the LFME
CUDA_VISIBLE_DEVICES=0 python main_LFME.py --config=./config/ImageNet_LT/LFME.py
- Evaluate LFME:
CUDA_VISIBLE_DEVICES=0 python main_LFME.py --config=./config/ImageNet_LT/LFME.py --test
Citation
If you find our work useful for your research, please consider citing the following paper:
@inproceedings{xiang2020learning,
title={Learning from multiple experts: Self-paced knowledge distillation for long-tailed classification},
author={Xiang, Liuyu and Ding, Guiguang and Han, Jungong},
booktitle={European Conference on Computer Vision},
pages={247--263},
year={2020},
organization={Springer}
}
Contact
If you have any questions, please feel free to contact [email protected].
Acknowledgement
The code is partly based on OLTR.