ecreeth commited on
Commit
574a775
·
verified ·
1 Parent(s): 1c3af06

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -2
README.md CHANGED
@@ -62,9 +62,21 @@ print(tokenizer.decode(outputs[0]))
62
  | Reading (eye tracking) | 0.93 |
63
  | Reading (self-paced) | 0.14 |
64
 
 
 
 
 
 
 
 
 
 
 
 
 
65
  > Evaluated with [babylm-eval](https://github.com/babylm-org/babylm-eval) on
66
- > the strict track. Reading scores are correlation coefficients (higher is better
67
- > for eye tracking, lower is better for self-paced reading).
68
 
69
  ## Architecture
70
 
 
62
  | Reading (eye tracking) | 0.93 |
63
  | Reading (self-paced) | 0.14 |
64
 
65
+ ### Results (fine-tuning, GLUE)
66
+
67
+ | Task | Accuracy |
68
+ |------|----------|
69
+ | **BOOLQ** | **63.8** |
70
+ | **MULTIRC** | **58.5** |
71
+ | **RTE** | **61.2** |
72
+ | **WSC** | **63.5** |
73
+ | **MRPC** | **69.6** |
74
+ | **QQP** | **69.6** |
75
+ | **MNLI** | **43.6** |
76
+
77
  > Evaluated with [babylm-eval](https://github.com/babylm-org/babylm-eval) on
78
+ > the strict track. Zero-shot tasks measure linguistic knowledge; fine-tuning
79
+ > tasks measure transfer learning to downstream classification.
80
 
81
  ## Architecture
82