Add LEXam-hard evaluation result
#34
by joelniklaus HF Staff - opened
.eval_results/lexam-hard.yaml
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: joelniklaus/LEXam-hard
|
| 3 |
+
task_id: lexam_hard
|
| 4 |
+
revision: 1bd50ee3ac80286fed27e5b89f03f4d8b4494244
|
| 5 |
+
value: 31.89
|
| 6 |
+
date: '2026-07-27'
|
| 7 |
+
source:
|
| 8 |
+
url: https://huggingface.co/buckets/joelniklaus/SwissLegalEvals
|
| 9 |
+
name: SwissLegalEvals per-sample details (lighteval)
|
| 10 |
+
user: joelniklaus
|
| 11 |
+
notes: lighteval, LEXam paper prompts, one response per question, no tools; DeepSeek-R1-0528 judge;
|
| 12 |
+
mean of the German and English means over the 518 questions, 0-100
|