This commit is contained in:
Pengcheng He 2021-11-16 02:16:40 -08:00
Родитель 5fbbaa1c83
Коммит 63b2dcc58e
1 изменённых файлов: 1 добавлений и 1 удалений

Просмотреть файл

@ -4,7 +4,7 @@ This repository is the official implementation of [ **DeBERTa**: **D**ecoding-**
## News
### 11/16/2021
- [DeBERTa V3 models](https://huggingface.co/models?other=deberta-v3) are publicly available now. The new models are trained with ELECTRA-style objective plus gradient-disentangled embedding sharing which further improves the model efficiency.
- [DeBERTa V3 models](https://huggingface.co/models?other=deberta-v3) are publicly available now. The new models are based on DeBERTa-V2 models by replacing MLM with ELECTRA-style objective plus gradient-disentangled embedding sharing which further improves the model efficiency.
- Scripts for DeBERTa V3 model fine-tuning are added
### 3/31/2021