This project is a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.
Collection papers and codebase
- Structured Knowledge Distillation for Semantic Segmentation, CVPR2019 [paper] [code]
- Intra-class Feature Variation Distillation for Semantic Segmentation, ECCV2020 [paper] [code]
- Channel-wise Knowledge Distillation for Dense Prediction, ICCV2021 [paper] [code]
- Knowledge Distillation based on MMsegmentation [code]
Object Detection and Instance Segmentation
- 2021.08.20 Release the code for channel-wise distillation for semantic segmentation
We are integrating more of our work and other great studies into this project.
TO DO LIST
- Distillation on FCOS
- Distillation on CondInst
To contribute, PR is appreciated and suggestions are welcome to discuss with.