The main idea of contrastive learning is to learn representations such that similar samples stay close to each other, while dissimilar ones are far apart. Contrastive learning can be applied to both supervised and unsupervised data and has been shown to achieve good performance on a variety of vision and language tasks. Contrastive Representation Learning
- 张俊林：对比学习在微博内容表示的应用
- Contrastive Representation Learning
- Contrastive Self-Supervised Learning
- 对比学习（Contrastive Learning）相关进展梳理
- 赛尔笔记 | 对比学习简述
- A Contrastive Framework for Neural Text Generation Yixuan Su, Tian Lan, Yan Wang, Dani Yogatama, Lingpeng Kong, Nigel Collier [pdf] [code]
- SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao, Xingcheng Yao, Danqi Chen [pdf] [code]
- ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan, Rumei Li, Sirui Wang, Fuzheng Zhang, Wei Wu, Weiran Xu
ACL 2021[pdf] [code] - CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding Dong Wang, Ning Ding, Piji Li, Hai-Tao Zheng
ACL 2021[pdf] [code] - Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning Beliz Gunel, Jingfei Du, Alexis Conneau, Ves Stoyanov
ICLR 2021[pdf] - SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization Yixin Liu, Pengfei Liu
ACL2021 short[pdf] [code] - Contrastive Learning with Adversarial Perturbations for Conditional Text Generation Seanie Lee, Dong Bok Lee, Sung Ju Hwang
ICLR21[pdf] - Learning with Contrastive Examples for Data-to-Text Generation Yui Uehara, Tatsuya Ishigaki, Kasumi Aoki, Hiroshi Noji, Keiichi Goshima, Ichiro Kobayashi, Hiroya Takamura, Yusuke Miyao
COLING 2020[pdf] [code] - DeepChannel: Salience Estimation by Contrastive Learning for Extractive Document Summarization Jiaxin Shi, Chen Liang, Lei Hou, Juanzi Li, Zhiyuan Liu, Hanwang Zhang
AAAI19[pdf] [code] - Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning Hanlu Wu, Tengfei Ma, Lingfei Wu, Tariro Manyumwa, Shouling Ji
EMNLP 2020[pdf] [code] - Group-wise Contrastive Learning for Neural Dialogue Generation Hengyi Cai, Hongshen Chen, Yonghao Song, Zhuoye Ding, Yongjun Bao, Weipeng Yan, Xiaofang Zhao
EMNLP 2020[pdf] [code] - Contrastive Attention Mechanism for Abstractive Sentence Summarization Xiangyu Duan, Hongfei Yu, Mingming Yin, Min Zhang, Weihua Luo, Yue Zhang
EMNLP 2019[pdf] [code] - Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models Dan Iter, Kelvin Guu, Larry Lansing, Dan Jurafsky
ACL 2020[pdf] [code] - Contrastive Self-Supervised Learning for Commonsense Reasoning Tassilo Klein, Moin Nabi
ACL 2020[pdf] [code] - CERT: Contrastive Self-supervised Learning for Language Understanding Hongchao Fang, Sicheng Wang, Meng Zhou, Jiayuan Ding, Pengtao Xie [pdf]
- Contrastive Learning of Emoji-based Representations for Resource-Poor Languages Nurendra Choudhary, Rajat Singh, Ishita Bindlish, Manish Shrivastava [pdf]
