Upload README.md
Browse files
README.md
CHANGED
|
@@ -62,9 +62,21 @@ print(tokenizer.decode(outputs[0]))
|
|
| 62 |
| Reading (eye tracking) | 0.93 |
|
| 63 |
| Reading (self-paced) | 0.14 |
|
| 64 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
> Evaluated with [babylm-eval](https://github.com/babylm-org/babylm-eval) on
|
| 66 |
-
> the strict track.
|
| 67 |
-
>
|
| 68 |
|
| 69 |
## Architecture
|
| 70 |
|
|
|
|
| 62 |
| Reading (eye tracking) | 0.93 |
|
| 63 |
| Reading (self-paced) | 0.14 |
|
| 64 |
|
| 65 |
+
### Results (fine-tuning, GLUE)
|
| 66 |
+
|
| 67 |
+
| Task | Accuracy |
|
| 68 |
+
|------|----------|
|
| 69 |
+
| **BOOLQ** | **63.8** |
|
| 70 |
+
| **MULTIRC** | **58.5** |
|
| 71 |
+
| **RTE** | **61.2** |
|
| 72 |
+
| **WSC** | **63.5** |
|
| 73 |
+
| **MRPC** | **69.6** |
|
| 74 |
+
| **QQP** | **69.6** |
|
| 75 |
+
| **MNLI** | **43.6** |
|
| 76 |
+
|
| 77 |
> Evaluated with [babylm-eval](https://github.com/babylm-org/babylm-eval) on
|
| 78 |
+
> the strict track. Zero-shot tasks measure linguistic knowledge; fine-tuning
|
| 79 |
+
> tasks measure transfer learning to downstream classification.
|
| 80 |
|
| 81 |
## Architecture
|
| 82 |
|