Spaces:
Running
Running
Add SyllaMoBert benchmark results
Browse files- index.html +31 -0
index.html
CHANGED
|
@@ -160,6 +160,20 @@
|
|
| 160 |
<td>96.10‡</td>
|
| 161 |
<td>Verse 100 exploratory</td>
|
| 162 |
</tr>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 163 |
</tbody>
|
| 164 |
</table>
|
| 165 |
<div id="empty-message" class="empty">No leaderboard rows match this filter.</div>
|
|
@@ -180,6 +194,23 @@
|
|
| 180 |
The variable-chunk GreBerta <code>_100</code> repair experiment is marked exploratory
|
| 181 |
because its design followed inspection of an earlier <code>_100</code> test failure.
|
| 182 |
</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 183 |
|
| 184 |
<h2>Benchmark resources</h2>
|
| 185 |
<ul class="resource-list">
|
|
|
|
| 160 |
<td>96.10‡</td>
|
| 161 |
<td>Verse 100 exploratory</td>
|
| 162 |
</tr>
|
| 163 |
+
<tr>
|
| 164 |
+
<td>Ericu950/SyllaMoBert-grc-v1</td>
|
| 165 |
+
<td>Frozen syllable-token embeddings + MLP</td>
|
| 166 |
+
<td>77.03</td>
|
| 167 |
+
<td>95.43</td>
|
| 168 |
+
<td>86.30–94.27§</td>
|
| 169 |
+
<td>77.93</td>
|
| 170 |
+
<td>86.27</td>
|
| 171 |
+
<td>78.46–92.51¶</td>
|
| 172 |
+
<td>74.41</td>
|
| 173 |
+
<td>91.06</td>
|
| 174 |
+
<td>88.44–100.00‖</td>
|
| 175 |
+
<td>Complete; validation ties reported</td>
|
| 176 |
+
</tr>
|
| 177 |
</tbody>
|
| 178 |
</table>
|
| 179 |
<div id="empty-message" class="empty">No leaderboard rows match this filter.</div>
|
|
|
|
| 194 |
The variable-chunk GreBerta <code>_100</code> repair experiment is marked exploratory
|
| 195 |
because its design followed inspection of an earlier <code>_100</code> test failure.
|
| 196 |
</p>
|
| 197 |
+
<p>
|
| 198 |
+
§ Two SyllaMoBert heads tied at repartitioned validation macro-F1 1.0000 for
|
| 199 |
+
<code>prose_100</code>. Test macro-F1 was <strong>94.27</strong> at learning rate
|
| 200 |
+
<code>3e-4</code> and <strong>86.30</strong> at <code>1e-3</code>.
|
| 201 |
+
</p>
|
| 202 |
+
<p>
|
| 203 |
+
¶ Four SyllaMoBert heads tied at both repartitioned and official validation
|
| 204 |
+
macro-F1 1.0000 for <code>verse_sentence_100</code>. Test macro-F1 was
|
| 205 |
+
<strong>92.51, 92.51, 78.46, and 92.51</strong> at learning rates
|
| 206 |
+
<code>3e-5</code>, <code>1e-4</code>, <code>3e-4</code>, and <code>1e-3</code>.
|
| 207 |
+
</p>
|
| 208 |
+
<p>
|
| 209 |
+
‖ All five SyllaMoBert learning rates tied at repartitioned validation macro-F1
|
| 210 |
+
1.0000 for <code>verse_metre_100</code>. Their test macro-F1 scores were
|
| 211 |
+
<strong>100.00, 100.00, 100.00, 88.44, and 96.10</strong>, so the complete range
|
| 212 |
+
is reported without selecting by test performance.
|
| 213 |
+
</p>
|
| 214 |
|
| 215 |
<h2>Benchmark resources</h2>
|
| 216 |
<ul class="resource-list">
|