pablo-rf commited on
Commit
f9c2e2d
·
verified ·
1 Parent(s): 91e48b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -6,14 +6,14 @@ language:
6
  base_model:
7
  - BSC-LT/MrBERT
8
  ---
9
- # MrBERT-gl
10
 
11
- MrBERT-gl is a domain-adapted encoder model fine-tuned from [BSC-LT/MrBERT](https://huggingface.co/BSC-LT/MrBERT) on a large-scale Galician and Portuguese corpus. It inherits MrBERT's ModernBERT architecture — with efficient long-context modeling and strong bidirectional representations — and extends its capabilities with significantly improved coverage of two closely related Iberian languages that are underrepresented in most multilingual encoders.
12
  Galician (galego) and European/Brazilian Portuguese share substantial lexical and morphological overlap, making joint continued pre-training an effective strategy for mutual reinforcement. MrBERT-gl is designed as a general-purpose encoder for both languages, suitable for tasks such as named entity recognition, text classification, semantic similarity, question answering, and cross-lingual retrieval.
13
 
14
  ## Technical Description
15
 
16
- MrBERT-gl starts from the MrBERT base checkpoint and continues pre-training with a masked language modelling objective on a combined Galician and Portuguese corpus. The architecture is identical to the base model; only the training regime and data distribution differ.
17
 
18
  ### Model Architecture
19
 
 
6
  base_model:
7
  - BSC-LT/MrBERT
8
  ---
9
+ # MrBERT-nos-gl
10
 
11
+ MrBERT-nos-gl is a domain-adapted encoder model fine-tuned from [BSC-LT/MrBERT](https://huggingface.co/BSC-LT/MrBERT) on a large-scale Galician and Portuguese corpus. It inherits MrBERT's ModernBERT architecture — with efficient long-context modeling and strong bidirectional representations — and extends its capabilities with significantly improved coverage of two closely related Iberian languages that are underrepresented in most multilingual encoders.
12
  Galician (galego) and European/Brazilian Portuguese share substantial lexical and morphological overlap, making joint continued pre-training an effective strategy for mutual reinforcement. MrBERT-gl is designed as a general-purpose encoder for both languages, suitable for tasks such as named entity recognition, text classification, semantic similarity, question answering, and cross-lingual retrieval.
13
 
14
  ## Technical Description
15
 
16
+ MrBERT-nos-gl starts from the MrBERT base checkpoint and continues pre-training with a masked language modelling objective on a combined Galician and Portuguese corpus. The architecture is identical to the base model; only the training regime and data distribution differ.
17
 
18
  ### Model Architecture
19