Update README.md
Browse files
README.md
CHANGED
|
@@ -6,14 +6,14 @@ language:
|
|
| 6 |
base_model:
|
| 7 |
- BSC-LT/MrBERT
|
| 8 |
---
|
| 9 |
-
# MrBERT-gl
|
| 10 |
|
| 11 |
-
MrBERT-gl is a domain-adapted encoder model fine-tuned from [BSC-LT/MrBERT](https://huggingface.co/BSC-LT/MrBERT) on a large-scale Galician and Portuguese corpus. It inherits MrBERT's ModernBERT architecture — with efficient long-context modeling and strong bidirectional representations — and extends its capabilities with significantly improved coverage of two closely related Iberian languages that are underrepresented in most multilingual encoders.
|
| 12 |
Galician (galego) and European/Brazilian Portuguese share substantial lexical and morphological overlap, making joint continued pre-training an effective strategy for mutual reinforcement. MrBERT-gl is designed as a general-purpose encoder for both languages, suitable for tasks such as named entity recognition, text classification, semantic similarity, question answering, and cross-lingual retrieval.
|
| 13 |
|
| 14 |
## Technical Description
|
| 15 |
|
| 16 |
-
MrBERT-gl starts from the MrBERT base checkpoint and continues pre-training with a masked language modelling objective on a combined Galician and Portuguese corpus. The architecture is identical to the base model; only the training regime and data distribution differ.
|
| 17 |
|
| 18 |
### Model Architecture
|
| 19 |
|
|
|
|
| 6 |
base_model:
|
| 7 |
- BSC-LT/MrBERT
|
| 8 |
---
|
| 9 |
+
# MrBERT-nos-gl
|
| 10 |
|
| 11 |
+
MrBERT-nos-gl is a domain-adapted encoder model fine-tuned from [BSC-LT/MrBERT](https://huggingface.co/BSC-LT/MrBERT) on a large-scale Galician and Portuguese corpus. It inherits MrBERT's ModernBERT architecture — with efficient long-context modeling and strong bidirectional representations — and extends its capabilities with significantly improved coverage of two closely related Iberian languages that are underrepresented in most multilingual encoders.
|
| 12 |
Galician (galego) and European/Brazilian Portuguese share substantial lexical and morphological overlap, making joint continued pre-training an effective strategy for mutual reinforcement. MrBERT-gl is designed as a general-purpose encoder for both languages, suitable for tasks such as named entity recognition, text classification, semantic similarity, question answering, and cross-lingual retrieval.
|
| 13 |
|
| 14 |
## Technical Description
|
| 15 |
|
| 16 |
+
MrBERT-nos-gl starts from the MrBERT base checkpoint and continues pre-training with a masked language modelling objective on a combined Galician and Portuguese corpus. The architecture is identical to the base model; only the training regime and data distribution differ.
|
| 17 |
|
| 18 |
### Model Architecture
|
| 19 |
|