Hugging Face's logo

jaredpalmer
/
kev-4b

Text Classification
PEFT
Safetensors
English
decision-model
calibration
lora
multiple-choice
typesafe
qwen3.5
Eval Results (legacy)
Model card Files
xet
 Community
1
kev-4b
File size: 12,759 Bytes
f780095
139fdd9
f780095
139fdd9
 
f780095
139fdd9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
delta: warm start from /__modal/volumes/vo-kEMu8BkBAIrorAQI6V8f2D/hub/models--jaredpalmer--kev-4b/snapshots/957b91e762e883935830246eeb02381f9d2694b6: 496 adapter tensors and the pointer head loaded
device=cuda trainable params=33.8M
replay: 4000 of 12576 suite training records mixed with 11320 from evals/round10/skills/train.jsonl
15320 training requests (holdout=[]), questions by type {'choice': 10917, 'noul': 8981, 'score': 1377}
[transformers] `causal_conv1d_fn` is falling back to its reference PyTorch implementation because `causal_conv1d` is not installed. This is correct but much slower; install `causal_conv1d` for the optimized kernel.
ep0 step 10/1915 loss 1.451 kl 0.000 anchor 0.000 0.441s/rec
ep0 step 20/1915 loss 1.678 kl 0.000 anchor 0.000 0.340s/rec
ep0 step 30/1915 loss 1.520 kl 0.000 anchor 0.000 0.308s/rec
ep0 step 40/1915 loss 1.340 kl 0.000 anchor 0.000 0.343s/rec
ep0 step 50/1915 loss 1.612 kl 0.000 anchor 0.000 0.312s/rec
ep0 step 60/1915 loss 0.875 kl 0.000 anchor 0.000 0.304s/rec
ep0 step 70/1915 loss 0.809 kl 0.000 anchor 0.000 0.295s/rec
ep0 step 80/1915 loss 1.151 kl 0.000 anchor 0.000 0.295s/rec
ep0 step 90/1915 loss 0.824 kl 0.000 anchor 0.000 0.292s/rec
ep0 step 100/1915 loss 0.846 kl 0.000 anchor 0.000 0.311s/rec
ep0 step 110/1915 loss 0.823 kl 0.000 anchor 0.000 0.300s/rec
ep0 step 120/1915 loss 0.807 kl 0.000 anchor 0.000 0.299s/rec
ep0 step 130/1915 loss 0.850 kl 0.000 anchor 0.000 0.296s/rec
ep0 step 140/1915 loss 0.655 kl 0.000 anchor 0.000 0.293s/rec
ep0 step 150/1915 loss 0.886 kl 0.000 anchor 0.000 0.291s/rec
ep0 step 160/1915 loss 0.604 kl 0.000 anchor 0.000 0.288s/rec
ep0 step 170/1915 loss 0.811 kl 0.000 anchor 0.000 0.290s/rec
ep0 step 180/1915 loss 0.616 kl 0.000 anchor 0.000 0.287s/rec
ep0 step 190/1915 loss 0.784 kl 0.000 anchor 0.000 0.284s/rec
ep0 step 200/1915 loss 0.731 kl 0.000 anchor 0.000 0.293s/rec
ep0 step 210/1915 loss 0.741 kl 0.000 anchor 0.000 0.288s/rec
ep0 step 220/1915 loss 0.638 kl 0.000 anchor 0.000 0.285s/rec
ep0 step 230/1915 loss 0.950 kl 0.000 anchor 0.000 0.284s/rec
ep0 step 240/1915 loss 0.637 kl 0.000 anchor 0.000 0.283s/rec
ep0 step 250/1915 loss 0.727 kl 0.000 anchor 0.000 0.280s/rec
ep0 step 260/1915 loss 0.724 kl 0.000 anchor 0.000 0.279s/rec
ep0 step 270/1915 loss 0.598 kl 0.000 anchor 0.000 0.281s/rec
ep0 step 280/1915 loss 0.507 kl 0.000 anchor 0.000 0.279s/rec
ep0 step 290/1915 loss 0.581 kl 0.000 anchor 0.000 0.276s/rec
ep0 step 300/1915 loss 0.649 kl 0.000 anchor 0.000 0.277s/rec
ep0 step 310/1915 loss 0.608 kl 0.000 anchor 0.000 0.280s/rec
ep0 step 320/1915 loss 0.773 kl 0.000 anchor 0.000 0.279s/rec
ep0 step 330/1915 loss 0.695 kl 0.000 anchor 0.000 0.277s/rec
ep0 step 340/1915 loss 0.689 kl 0.000 anchor 0.000 0.277s/rec
ep0 step 350/1915 loss 0.615 kl 0.000 anchor 0.000 0.276s/rec
ep0 step 360/1915 loss 0.618 kl 0.000 anchor 0.000 0.274s/rec
ep0 step 370/1915 loss 0.754 kl 0.000 anchor 0.000 0.274s/rec
ep0 step 380/1915 loss 0.514 kl 0.000 anchor 0.000 0.275s/rec
ep0 step 390/1915 loss 0.569 kl 0.000 anchor 0.000 0.273s/rec
ep0 step 400/1915 loss 0.574 kl 0.000 anchor 0.000 0.273s/rec
ep0 step 410/1915 loss 0.591 kl 0.000 anchor 0.000 0.274s/rec
ep0 step 420/1915 loss 0.690 kl 0.000 anchor 0.000 0.272s/rec
ep0 step 430/1915 loss 0.643 kl 0.000 anchor 0.000 0.272s/rec
ep0 step 440/1915 loss 0.616 kl 0.000 anchor 0.000 0.272s/rec
ep0 step 450/1915 loss 0.595 kl 0.000 anchor 0.000 0.270s/rec
ep0 step 460/1915 loss 0.643 kl 0.000 anchor 0.000 0.270s/rec
ep0 step 470/1915 loss 0.646 kl 0.000 anchor 0.000 0.270s/rec
ep0 step 480/1915 loss 0.608 kl 0.000 anchor 0.000 0.269s/rec
ep0 step 490/1915 loss 0.488 kl 0.000 anchor 0.000 0.268s/rec
ep0 step 500/1915 loss 0.586 kl 0.000 anchor 0.000 0.267s/rec
ep0 step 510/1915 loss 0.407 kl 0.000 anchor 0.000 0.265s/rec
ep0 step 520/1915 loss 0.483 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 530/1915 loss 0.484 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 540/1915 loss 0.771 kl 0.000 anchor 0.000 0.265s/rec
ep0 step 550/1915 loss 0.588 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 560/1915 loss 0.443 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 570/1915 loss 0.489 kl 0.000 anchor 0.000 0.263s/rec
ep0 step 580/1915 loss 0.473 kl 0.000 anchor 0.000 0.262s/rec
ep0 step 590/1915 loss 0.718 kl 0.000 anchor 0.000 0.262s/rec
ep0 step 600/1915 loss 0.634 kl 0.000 anchor 0.000 0.263s/rec
ep0 step 610/1915 loss 0.480 kl 0.000 anchor 0.000 0.262s/rec
ep0 step 620/1915 loss 0.579 kl 0.000 anchor 0.000 0.261s/rec
ep0 step 630/1915 loss 0.386 kl 0.000 anchor 0.000 0.261s/rec
ep0 step 640/1915 loss 0.660 kl 0.000 anchor 0.000 0.260s/rec
ep0 step 650/1915 loss 0.761 kl 0.000 anchor 0.000 0.259s/rec
ep0 step 660/1915 loss 0.703 kl 0.000 anchor 0.000 0.259s/rec
ep0 step 670/1915 loss 0.393 kl 0.000 anchor 0.000 0.259s/rec
ep0 step 680/1915 loss 0.502 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 690/1915 loss 0.718 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 700/1915 loss 0.582 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 710/1915 loss 0.458 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 720/1915 loss 0.496 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 730/1915 loss 0.458 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 740/1915 loss 0.533 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 750/1915 loss 0.559 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 760/1915 loss 0.540 kl 0.000 anchor 0.000 0.256s/rec
ep0 step 770/1915 loss 0.455 kl 0.000 anchor 0.000 0.256s/rec
ep0 step 780/1915 loss 0.595 kl 0.000 anchor 0.000 0.255s/rec
ep0 step 790/1915 loss 0.337 kl 0.000 anchor 0.000 0.255s/rec
ep0 step 800/1915 loss 0.603 kl 0.000 anchor 0.000 0.255s/rec
ep0 step 810/1915 loss 0.524 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 820/1915 loss 0.654 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 830/1915 loss 0.543 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 840/1915 loss 0.531 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 850/1915 loss 0.569 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 860/1915 loss 0.371 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 870/1915 loss 0.442 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 880/1915 loss 0.486 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 890/1915 loss 0.513 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 900/1915 loss 0.537 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 910/1915 loss 0.571 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 920/1915 loss 0.574 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 930/1915 loss 0.512 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 940/1915 loss 0.634 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 950/1915 loss 0.476 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 960/1915 loss 0.529 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 970/1915 loss 0.621 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 980/1915 loss 0.529 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 990/1915 loss 0.565 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1000/1915 loss 0.638 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1010/1915 loss 0.600 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1020/1915 loss 0.581 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1030/1915 loss 0.594 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1040/1915 loss 0.539 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1050/1915 loss 0.547 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1060/1915 loss 0.714 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1070/1915 loss 0.378 kl 0.000 anchor 0.000 0.249s/rec
ep0 step 1080/1915 loss 0.657 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 1090/1915 loss 0.463 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 1100/1915 loss 0.585 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1110/1915 loss 0.312 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1120/1915 loss 0.539 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1130/1915 loss 0.541 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1140/1915 loss 0.784 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1150/1915 loss 0.558 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1160/1915 loss 0.600 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1170/1915 loss 0.562 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1180/1915 loss 0.723 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1190/1915 loss 0.394 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1200/1915 loss 0.394 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1210/1915 loss 0.331 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1220/1915 loss 0.334 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1230/1915 loss 0.447 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1240/1915 loss 0.551 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1250/1915 loss 0.509 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1260/1915 loss 0.694 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1270/1915 loss 0.532 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1280/1915 loss 0.496 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1290/1915 loss 0.556 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1300/1915 loss 0.403 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1310/1915 loss 0.537 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1320/1915 loss 0.517 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1330/1915 loss 0.633 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1340/1915 loss 0.491 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1350/1915 loss 0.512 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1360/1915 loss 0.398 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1370/1915 loss 0.396 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1380/1915 loss 0.484 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1390/1915 loss 0.492 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1400/1915 loss 0.487 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1410/1915 loss 0.410 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1420/1915 loss 0.405 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1430/1915 loss 0.391 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1440/1915 loss 0.408 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1450/1915 loss 0.394 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1460/1915 loss 0.461 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1470/1915 loss 0.485 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1480/1915 loss 0.480 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1490/1915 loss 0.539 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1500/1915 loss 0.541 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1510/1915 loss 0.554 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1520/1915 loss 0.513 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1530/1915 loss 0.423 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1540/1915 loss 0.471 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1550/1915 loss 0.342 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1560/1915 loss 0.547 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1570/1915 loss 0.472 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1580/1915 loss 0.477 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1590/1915 loss 0.593 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1600/1915 loss 0.995 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1610/1915 loss 0.459 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1620/1915 loss 0.609 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1630/1915 loss 0.386 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1640/1915 loss 0.555 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1650/1915 loss 0.517 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1660/1915 loss 0.390 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1670/1915 loss 0.503 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1680/1915 loss 0.870 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1690/1915 loss 0.419 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1700/1915 loss 0.429 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1710/1915 loss 0.552 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1720/1915 loss 0.504 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1730/1915 loss 0.402 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1740/1915 loss 0.383 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1750/1915 loss 0.631 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1760/1915 loss 0.618 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1770/1915 loss 0.335 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1780/1915 loss 0.250 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1790/1915 loss 0.499 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1800/1915 loss 0.351 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1810/1915 loss 0.613 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1820/1915 loss 0.355 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1830/1915 loss 0.556 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1840/1915 loss 0.328 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1850/1915 loss 0.863 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1860/1915 loss 0.441 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1870/1915 loss 0.385 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1880/1915 loss 0.398 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1890/1915 loss 0.507 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1900/1915 loss 0.602 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1910/1915 loss 0.570 kl 0.000 anchor 0.000 0.251s/rec
saved /runs/r10-skills/00-trial-0/checkpoint