Chenyan Xiong
commited on
Commit
·
7d68583
1
Parent(s):
8175f8c
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
|
| 2 |
+
|
| 3 |
+
This model card contains the COCO-LM model (**base++** version) proposed in [this paper](https://arxiv.org/abs/2102.08473). The official GitHub repository can be found [here](https://github.com/microsoft/COCO-LM).
|
| 4 |
+
|
| 5 |
+
# Citation
|
| 6 |
+
If you find this model card useful for your research, please cite the following paper:
|
| 7 |
+
```
|
| 8 |
+
@inproceedings{meng2021coco,
|
| 9 |
+
title={{COCO-LM}: Correcting and contrasting text sequences for language model pretraining},
|
| 10 |
+
author={Meng, Yu and Xiong, Chenyan and Bajaj, Payal and Tiwary, Saurabh and Bennett, Paul and Han, Jiawei and Song, Xia},
|
| 11 |
+
booktitle={NeurIPS},
|
| 12 |
+
year={2021}
|
| 13 |
+
}
|
| 14 |
+
```
|