Just a suggestion: How about we pretrain a common Scandinavian model instead, as our languages are so similar? I’ve made a project suggestion here: Scandinavian RoBERTa.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Scandinavian RoBERTa | 30 | 2191 | July 15, 2021 | |
| Pretrain RoBERTa-large from scratch in Finnish | 1 | 380 | June 29, 2021 | |
| RobIt : PreTrain RoBERTa-base from scratch in Italian | 4 | 524 | June 29, 2021 | |
| BERTIN: PreTrain RoBERTa-large from scratch in Spanish | 23 | 2157 | July 19, 2021 | |
| PreTrain RoBERTa from scratch in Portuguese | 16 | 2616 | October 4, 2021 |