HAZEL

[NLP Paper Review] RoBERTa: A Robustly Optimized BERT Pretraining Approach 논문 리뷰 / RoBERTa 본문

DATA ANALYSIS/Paper

[NLP Paper Review] RoBERTa: A Robustly Optimized BERT Pretraining Approach 논문 리뷰 / RoBERTa

Rmsid01 2021. 10. 29. 23:47

https://arxiv.org/abs/1907.11692

 

RoBERTa: A Robustly Optimized BERT Pretraining Approach

Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging. Training is computationally expensive, often done on private datasets of different sizes, and, as we will show, hyperpar

arxiv.org

 

논문 발표 PPT

 

'DATA ANALYSIS > Paper' 카테고리의 다른 글

[NLP Paper Review] ALBERT: A Lite BERT for Self-supervised Learning of Language Representations 논문 리뷰 / ALBERT  (0) 2021.05.09
[NLP Paper Review] Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context 논문 리뷰 / Transformer-XL  (0) 2021.05.08
[NLP Paper Review] Attention is all you need 논문 리뷰 / transformer  (0) 2021.05.05
'DATA ANALYSIS/Paper' Related Articles more