Update notice
Browse files
NOTICE.md
CHANGED
|
@@ -10,12 +10,15 @@ The scripts, evaluation code and results in this repository are Copyright 2026 v
|
|
| 10 |
|
| 11 |
## Maya's weights
|
| 12 |
|
| 13 |
-
Maya is fine-tuned from MoritzLaurer/
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
## Training data
|
| 16 |
|
| 17 |
- `gen/laya_domains.py` is copied from the author's layaMOE repository (same license).
|
| 18 |
-
- During training,
|
| 19 |
|
| 20 |
## Models used as baselines
|
| 21 |
|
|
|
|
| 10 |
|
| 11 |
## Maya's weights
|
| 12 |
|
| 13 |
+
- Maya v0.2 is fine-tuned from MoritzLaurer/deberta-v3-large-zeroshot-v2.0 (MIT license, https://huggingface.co/MoritzLaurer/deberta-v3-large-zeroshot-v2.0), itself fine-tuned from microsoft/deberta-v3-large (MIT). Changes: fine-tuned on Maya's synthetic yes/no data plus BoolQ and MNLI pairs, labels renamed to yes/no.
|
| 14 |
+
- Maya v0.1 (tag `v0.1` on Hugging Face) is fine-tuned from MoritzLaurer/ModernBERT-base-zeroshot-v2.0 (Apache-2.0), itself fine-tuned from answerdotai/ModernBERT-base (Apache-2.0).
|
| 15 |
+
|
| 16 |
+
The released weights are modified derivatives of those models. The card of deberta-v3-large-zeroshot-v2.0 states that its versions without "-c" in the name were trained on data that includes non-commercially licensed datasets; check it before commercial use of Maya v0.2.
|
| 17 |
|
| 18 |
## Training data
|
| 19 |
|
| 20 |
- `gen/laya_domains.py` is copied from the author's layaMOE repository (same license).
|
| 21 |
+
- During training, MNLI pairs (GLUE `mnli`, https://huggingface.co/datasets/nyu-mll/glue) and BoolQ questions (https://huggingface.co/datasets/google/boolq, CC BY-SA 3.0) are mixed in. They are downloaded at run time and not redistributed.
|
| 22 |
|
| 23 |
## Models used as baselines
|
| 24 |
|