DeBERTa

该资源库是 DeBERTa: 带有分散注意力机制的解码增强的 BERT 和 DeBERTa V3:使用 ELECTRA 式预训练和梯度分解嵌入共享改进 DeBERTa 的官方实现。「This repository is the official implementation of DeBERTa: Decoding-enhanced BERT with Disentangled Attention and DeBERTa V3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing」

Main metrics

Overview

Name With Ownermicrosoft/DeBERTa
Primary LanguagePython
Program languagePython (Language Count: 3)
Platform
License:MIT License
Release Count1
Last Release Namev0.1.8 (Posted on )
First Release Namev0.1.8 (Posted on )
Created At2020-06-08 15:57:14
Pushed At2023-09-29 11:14:26
Last Commit At2023-03-25 03:22:59
Stargazers Count2100
Watchers Count41
Fork Count233
Commits Count55
Has Issues Enabled
Issues Count126
Issue Open Count67
Pull Requests Count22
Pull Requests Open Count8
Pull Requests Close Count2
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private
To the top