Dual-Contrastive-Learning
A PyTorch implementation for our paper "Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation".
You can download the paper via: [ArXiv] [PapersWithCode].
One-Sentence Summary
This paper proposes a novel contrastive learning framework for supervised classification tasks by simultaneously learning the features of input samples and the parameters of classifiers in the same space.
Abstract
Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in practice. In this work, we introduce a dual contrastive learning (DualCL) framework that simultaneously learns the features of input samples and the parameters of classifiers in the same space. Specifically, DualCL regards the parameters of the classifiers as augmented samples associating to different labels and then exploits the contrastive learning between the input samples and the augmented samples. Empirical studies on five benchmark text classification datasets and their low-resource version demonstrate the improvement in classification accuracy and confirm the capability of learning discriminative representations of DualCL.
Requirement
- Python >= 3.7
- torch >= 1.9.0
- numpy >= 1.17.2
- transformers >= 4.15.0
Preparation
Clone
git clone https://github.com/hiyouga/Dual-Contrastive-Learning.git
Create an anaconda environment:
conda create -n dualcl python=3.7
conda activate dualcl
pip install -r requirements.txt
Usage
python main_polarity.py
Citation
If this work is helpful, please cite as:
@article{chen2022dual,
title={Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation},
author={Qianben Chen and Richong Zhang and Yaowei Zheng and Yongyi Mao},
journal={arXiv preprint},
year={2022}
}
Contact
hiyouga [AT] buaa [DOT] edu [DOT] cn
License
MIT
23 Nov 29, 2022
62 Nov 8, 2022
7 Jul 15, 2022
71 Dec 30, 2022
143 Dec 28, 2022
140 Nov 23, 2022
258 Jan 2, 2023
1.2k Dec 26, 2022
135 Oct 27, 2022
217 Jan 3, 2023
41 Dec 25, 2022
1k Dec 31, 2022
27 Jun 28, 2022
49 Dec 1, 2022
112 Nov 28, 2022
49 Nov 10, 2022
225 Dec 29, 2022
4 May 8, 2022
77 Dec 16, 2022