File size: 12,181 Bytes
656ca59
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN"
  "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
<svg xmlns:xlink="http://www.w3.org/1999/xlink" width="590.4pt" height="309.6pt" viewBox="0 0 590.4 309.6" xmlns="http://www.w3.org/2000/svg" version="1.1">
 <metadata>
  <rdf:RDF xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:cc="http://creativecommons.org/ns#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
   <cc:Work>
    <dc:type rdf:resource="http://purl.org/dc/dcmitype/StillImage"/>
    <dc:date>2026-09-24T22:38:37.634261</dc:date>
    <dc:format>image/svg+xml</dc:format>
    <dc:creator>
     <cc:Agent>
      <dc:title>Matplotlib v3.11.2, https://matplotlib.org/</dc:title>
     </cc:Agent>
    </dc:creator>
   </cc:Work>
  </rdf:RDF>
 </metadata>
 <defs>
  <style type="text/css">*{stroke-linejoin: round; stroke-linecap: butt}</style>
 </defs>
 <g id="figure_1">
  <g id="patch_1">
   <path d="M 0 309.6 
L 590.4 309.6 
L 590.4 0 
L 0 0 
z
" style="fill: #ffffff"/>
  </g>
  <g id="axes_1">
   <g id="patch_2">
    <path d="M 207.36 219.816 
L 472.32 219.816 
L 472.32 74.304 
L 207.36 74.304 
z
" style="fill: #ffffff"/>
   </g>
   <g id="matplotlib.axis_1">
    <g id="xtick_1">
     <g id="line2d_1">
      <path d="M 207.36 219.816 
L 207.36 74.304 
" clip-path="url(#pfdb95e44dc)" style="fill: none; stroke: #ececef; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_2"/>
     <g id="text_1">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: middle; fill: #5e5e66" x="207.36" y="234.86" transform="rotate(-0 207.36 234.86)">0%</text>
     </g>
    </g>
    <g id="xtick_2">
     <g id="line2d_3">
      <path d="M 278.016 219.816 
L 278.016 74.304 
" clip-path="url(#pfdb95e44dc)" style="fill: none; stroke: #ececef; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_4"/>
     <g id="text_2">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: middle; fill: #5e5e66" x="278.016" y="234.86" transform="rotate(-0 278.016 234.86)">20%</text>
     </g>
    </g>
    <g id="xtick_3">
     <g id="line2d_5">
      <path d="M 348.672 219.816 
L 348.672 74.304 
" clip-path="url(#pfdb95e44dc)" style="fill: none; stroke: #ececef; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_6"/>
     <g id="text_3">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: middle; fill: #5e5e66" x="348.672" y="234.86" transform="rotate(-0 348.672 234.86)">40%</text>
     </g>
    </g>
    <g id="xtick_4">
     <g id="line2d_7">
      <path d="M 419.328 219.816 
L 419.328 74.304 
" clip-path="url(#pfdb95e44dc)" style="fill: none; stroke: #ececef; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_8"/>
     <g id="text_4">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: middle; fill: #5e5e66" x="419.328" y="234.86" transform="rotate(-0 419.328 234.86)">60%</text>
     </g>
    </g>
   </g>
   <g id="matplotlib.axis_2">
    <g id="ytick_1">
     <g id="line2d_9"/>
     <g id="text_5">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: end; fill: #5e5e66" x="201.36" y="206.395661" transform="rotate(-0 201.36 206.395661)">SimpleJev (Qwen3.5-0.8B)</text>
     </g>
    </g>
    <g id="ytick_2">
     <g id="line2d_10"/>
     <g id="text_6">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: end; fill: #5e5e66" x="201.36" y="169.85322" transform="rotate(-0 201.36 169.85322)">Laya (ModernBERT-large, 421M)</text>
     </g>
    </g>
    <g id="ytick_3">
     <g id="line2d_11"/>
     <g id="text_7">
      <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: end; fill: #5e5e66" x="201.36" y="133.31078" transform="rotate(-0 201.36 133.31078)">Qwen3.5-0.8B Decision Model (M. Ghafiri)</text>
     </g>
    </g>
    <g id="ytick_4">
     <g id="line2d_12"/>
     <g id="text_8">
      <text style="font-weight: 700; font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: end; fill: #2340d0" x="201.36" y="96.877589" transform="rotate(-0 201.36 96.877589)">Jev-Style 0.8B v3</text>
     </g>
    </g>
   </g>
   <g id="patch_3">
    <path d="M 207.36 213.201818 
L 400.058182 213.201818 
L 400.058182 190.545505 
L 207.36 190.545505 
z
" clip-path="url(#pfdb95e44dc)" style="fill: #c4c4cb"/>
   </g>
   <g id="patch_4">
    <path d="M 207.36 176.659377 
L 413.822338 176.659377 
L 413.822338 154.003064 
L 207.36 154.003064 
z
" clip-path="url(#pfdb95e44dc)" style="fill: #d0d0d6"/>
   </g>
   <g id="patch_5">
    <path d="M 207.36 140.116936 
L 416.881039 140.116936 
L 416.881039 117.460623 
L 207.36 117.460623 
z
" clip-path="url(#pfdb95e44dc)" style="fill: #c4c4cb"/>
   </g>
   <g id="patch_6">
    <path d="M 207.36 103.574495 
L 433.703896 103.574495 
L 433.703896 80.918182 
L 207.36 80.918182 
z
" clip-path="url(#pfdb95e44dc)" style="fill: #3456f0"/>
   </g>
   <g id="patch_7">
    <path d="M 207.36 219.816 
L 472.32 219.816 
" style="fill: none; stroke: #c9c9cf; stroke-width: 0.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="text_9">
    <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="402.774309" y="205.383911" transform="rotate(-0 402.774309 205.383911)">54.5%</text>
   </g>
   <g id="text_10">
    <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="416.538464" y="168.84147" transform="rotate(-0 416.538464 168.84147)">58.4%</text>
   </g>
   <g id="text_11">
    <text style="font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="419.597166" y="132.29903" transform="rotate(-0 419.597166 132.29903)">59.3%</text>
   </g>
   <g id="text_12">
    <text style="font-weight: 700; font-size: 9.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #2340d0" x="436.420023" y="95.846839" transform="rotate(-0 436.420023 95.846839)">64.1%</text>
   </g>
   <g id="text_13">
    <text style="font-weight: 700; font-size: 10px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #2340d0" x="477.6192" y="205.663661" transform="rotate(-0 477.6192 205.663661)">+9.5 pts for v3</text>
   </g>
   <g id="text_14">
    <text style="font-weight: 700; font-size: 10px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #2340d0" x="477.6192" y="169.12122" transform="rotate(-0 477.6192 169.12122)">+5.6 pts for v3</text>
   </g>
   <g id="text_15">
    <text style="font-weight: 700; font-size: 10px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #2340d0" x="477.6192" y="132.57878" transform="rotate(-0 477.6192 132.57878)">+4.8 pts for v3</text>
   </g>
   <g id="text_16">
    <text style="font-size: 8px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #8e8e96" x="477.6192" y="76.931118" transform="rotate(-0 477.6192 76.931118)">v3 lead</text>
   </g>
   <g id="text_17">
    <text style="font-size: 8px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="210.8928" y="204.829661" transform="rotate(-0 210.8928 204.829661)">126/231</text>
   </g>
   <g id="text_18">
    <text style="font-size: 8px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="210.8928" y="168.28722" transform="rotate(-0 210.8928 168.28722)">135/231</text>
   </g>
   <g id="text_19">
    <text style="font-size: 8px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="210.8928" y="131.74478" transform="rotate(-0 210.8928 131.74478)">137/231</text>
   </g>
   <g id="text_20">
    <text style="font-size: 8px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #ffffff" x="210.8928" y="95.202339" transform="rotate(-0 210.8928 95.202339)">148/231</text>
   </g>
  </g>
  <g id="text_21">
   <text style="font-weight: 700; font-size: 15px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #0d0d0f" x="17.712" y="28.557" transform="rotate(-0 17.712 28.557)">Ahead of Laya and every Qwen3.5-0.8B-based system on JevBench</text>
  </g>
  <g id="text_22">
   <text style="font-size: 10.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; text-anchor: start; fill: #5e5e66" x="17.712" y="45.6" transform="rotate(-0 17.712 45.6)">Public accuracy (%), 231 items, zero-shot for v3 · higher is better</text>
  </g>
  <g id="text_23">
   <text style="font-size: 7.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; fill: #8e8e96" transform="translate(17.712 262.539961)">JevBench v1.4.1, public items only (231). v3: self-run zero-shot with the vendored official harness (commit 24b9b5c);</text>
   <text style="font-size: 7.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; fill: #8e8e96" transform="translate(17.712 274.327969)">training-pool contamination scan: 0 hits; not an official leaderboard entry. Other rows: public accuracy as published in the</text>
   <text style="font-size: 7.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; fill: #8e8e96" transform="translate(17.712 286.123594)">board's v1.4.1 results file (github.com/fstandhartinger/jevbench). Shown: Laya plus every Qwen3.5-0.8B-based system on the board.</text>
   <text style="font-size: 7.5px; font-family: 'Helvetica Neue', 'Helvetica', 'Arial', 'Avenir Next', 'PingFang SC', 'Arial Unicode MS', 'DejaVu Sans', sans-serif; fill: #8e8e96" transform="translate(17.712 297.919219)">Laya and M. Ghafiri lie inside v3's 95% CI (57.7–70.0%, Wilson): those two leads are point estimates, not significant at n = 231.</text>
  </g>
 </g>
 <defs>
  <clipPath id="pfdb95e44dc">
   <rect x="207.36" y="74.304" width="264.96" height="145.512"/>
  </clipPath>
 </defs>
</svg>