Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
delta: warm start from /__modal/volumes/vo-kEMu8BkBAIrorAQI6V8f2D/hub/models--jaredpalmer--kev-4b/snapshots/957b91e762e883935830246eeb02381f9d2694b6: 496 adapter tensors and the pointer head loaded
device=cuda trainable params=33.8M
replay: 4000 of 12576 suite training records mixed with 11320 from evals/round10/skills/train.jsonl
15320 training requests (holdout=[]), questions by type {'choice': 10917, 'noul': 8981, 'score': 1377}
[transformers] `causal_conv1d_fn` is falling back to its reference PyTorch implementation because `causal_conv1d` is not installed. This is correct but much slower; install `causal_conv1d` for the optimized kernel.
ep0 step 10/1915 loss 1.451 kl 0.000 anchor 0.000 0.441s/rec
ep0 step 20/1915 loss 1.678 kl 0.000 anchor 0.000 0.340s/rec
ep0 step 30/1915 loss 1.520 kl 0.000 anchor 0.000 0.308s/rec
ep0 step 40/1915 loss 1.340 kl 0.000 anchor 0.000 0.343s/rec
ep0 step 50/1915 loss 1.612 kl 0.000 anchor 0.000 0.312s/rec
ep0 step 60/1915 loss 0.875 kl 0.000 anchor 0.000 0.304s/rec
ep0 step 70/1915 loss 0.809 kl 0.000 anchor 0.000 0.295s/rec
ep0 step 80/1915 loss 1.151 kl 0.000 anchor 0.000 0.295s/rec
ep0 step 90/1915 loss 0.824 kl 0.000 anchor 0.000 0.292s/rec
ep0 step 100/1915 loss 0.846 kl 0.000 anchor 0.000 0.311s/rec
ep0 step 110/1915 loss 0.823 kl 0.000 anchor 0.000 0.300s/rec
ep0 step 120/1915 loss 0.807 kl 0.000 anchor 0.000 0.299s/rec
ep0 step 130/1915 loss 0.850 kl 0.000 anchor 0.000 0.296s/rec
ep0 step 140/1915 loss 0.655 kl 0.000 anchor 0.000 0.293s/rec
ep0 step 150/1915 loss 0.886 kl 0.000 anchor 0.000 0.291s/rec
ep0 step 160/1915 loss 0.604 kl 0.000 anchor 0.000 0.288s/rec
ep0 step 170/1915 loss 0.811 kl 0.000 anchor 0.000 0.290s/rec
ep0 step 180/1915 loss 0.616 kl 0.000 anchor 0.000 0.287s/rec
ep0 step 190/1915 loss 0.784 kl 0.000 anchor 0.000 0.284s/rec
ep0 step 200/1915 loss 0.731 kl 0.000 anchor 0.000 0.293s/rec
ep0 step 210/1915 loss 0.741 kl 0.000 anchor 0.000 0.288s/rec
ep0 step 220/1915 loss 0.638 kl 0.000 anchor 0.000 0.285s/rec
ep0 step 230/1915 loss 0.950 kl 0.000 anchor 0.000 0.284s/rec
ep0 step 240/1915 loss 0.637 kl 0.000 anchor 0.000 0.283s/rec
ep0 step 250/1915 loss 0.727 kl 0.000 anchor 0.000 0.280s/rec
ep0 step 260/1915 loss 0.724 kl 0.000 anchor 0.000 0.279s/rec
ep0 step 270/1915 loss 0.598 kl 0.000 anchor 0.000 0.281s/rec
ep0 step 280/1915 loss 0.507 kl 0.000 anchor 0.000 0.279s/rec
ep0 step 290/1915 loss 0.581 kl 0.000 anchor 0.000 0.276s/rec
ep0 step 300/1915 loss 0.649 kl 0.000 anchor 0.000 0.277s/rec
ep0 step 310/1915 loss 0.608 kl 0.000 anchor 0.000 0.280s/rec
ep0 step 320/1915 loss 0.773 kl 0.000 anchor 0.000 0.279s/rec
ep0 step 330/1915 loss 0.695 kl 0.000 anchor 0.000 0.277s/rec
ep0 step 340/1915 loss 0.689 kl 0.000 anchor 0.000 0.277s/rec
ep0 step 350/1915 loss 0.615 kl 0.000 anchor 0.000 0.276s/rec
ep0 step 360/1915 loss 0.618 kl 0.000 anchor 0.000 0.274s/rec
ep0 step 370/1915 loss 0.754 kl 0.000 anchor 0.000 0.274s/rec
ep0 step 380/1915 loss 0.514 kl 0.000 anchor 0.000 0.275s/rec
ep0 step 390/1915 loss 0.569 kl 0.000 anchor 0.000 0.273s/rec
ep0 step 400/1915 loss 0.574 kl 0.000 anchor 0.000 0.273s/rec
ep0 step 410/1915 loss 0.591 kl 0.000 anchor 0.000 0.274s/rec
ep0 step 420/1915 loss 0.690 kl 0.000 anchor 0.000 0.272s/rec
ep0 step 430/1915 loss 0.643 kl 0.000 anchor 0.000 0.272s/rec
ep0 step 440/1915 loss 0.616 kl 0.000 anchor 0.000 0.272s/rec
ep0 step 450/1915 loss 0.595 kl 0.000 anchor 0.000 0.270s/rec
ep0 step 460/1915 loss 0.643 kl 0.000 anchor 0.000 0.270s/rec
ep0 step 470/1915 loss 0.646 kl 0.000 anchor 0.000 0.270s/rec
ep0 step 480/1915 loss 0.608 kl 0.000 anchor 0.000 0.269s/rec
ep0 step 490/1915 loss 0.488 kl 0.000 anchor 0.000 0.268s/rec
ep0 step 500/1915 loss 0.586 kl 0.000 anchor 0.000 0.267s/rec
ep0 step 510/1915 loss 0.407 kl 0.000 anchor 0.000 0.265s/rec
ep0 step 520/1915 loss 0.483 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 530/1915 loss 0.484 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 540/1915 loss 0.771 kl 0.000 anchor 0.000 0.265s/rec
ep0 step 550/1915 loss 0.588 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 560/1915 loss 0.443 kl 0.000 anchor 0.000 0.264s/rec
ep0 step 570/1915 loss 0.489 kl 0.000 anchor 0.000 0.263s/rec
ep0 step 580/1915 loss 0.473 kl 0.000 anchor 0.000 0.262s/rec
ep0 step 590/1915 loss 0.718 kl 0.000 anchor 0.000 0.262s/rec
ep0 step 600/1915 loss 0.634 kl 0.000 anchor 0.000 0.263s/rec
ep0 step 610/1915 loss 0.480 kl 0.000 anchor 0.000 0.262s/rec
ep0 step 620/1915 loss 0.579 kl 0.000 anchor 0.000 0.261s/rec
ep0 step 630/1915 loss 0.386 kl 0.000 anchor 0.000 0.261s/rec
ep0 step 640/1915 loss 0.660 kl 0.000 anchor 0.000 0.260s/rec
ep0 step 650/1915 loss 0.761 kl 0.000 anchor 0.000 0.259s/rec
ep0 step 660/1915 loss 0.703 kl 0.000 anchor 0.000 0.259s/rec
ep0 step 670/1915 loss 0.393 kl 0.000 anchor 0.000 0.259s/rec
ep0 step 680/1915 loss 0.502 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 690/1915 loss 0.718 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 700/1915 loss 0.582 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 710/1915 loss 0.458 kl 0.000 anchor 0.000 0.258s/rec
ep0 step 720/1915 loss 0.496 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 730/1915 loss 0.458 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 740/1915 loss 0.533 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 750/1915 loss 0.559 kl 0.000 anchor 0.000 0.257s/rec
ep0 step 760/1915 loss 0.540 kl 0.000 anchor 0.000 0.256s/rec
ep0 step 770/1915 loss 0.455 kl 0.000 anchor 0.000 0.256s/rec
ep0 step 780/1915 loss 0.595 kl 0.000 anchor 0.000 0.255s/rec
ep0 step 790/1915 loss 0.337 kl 0.000 anchor 0.000 0.255s/rec
ep0 step 800/1915 loss 0.603 kl 0.000 anchor 0.000 0.255s/rec
ep0 step 810/1915 loss 0.524 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 820/1915 loss 0.654 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 830/1915 loss 0.543 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 840/1915 loss 0.531 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 850/1915 loss 0.569 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 860/1915 loss 0.371 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 870/1915 loss 0.442 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 880/1915 loss 0.486 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 890/1915 loss 0.513 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 900/1915 loss 0.537 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 910/1915 loss 0.571 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 920/1915 loss 0.574 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 930/1915 loss 0.512 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 940/1915 loss 0.634 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 950/1915 loss 0.476 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 960/1915 loss 0.529 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 970/1915 loss 0.621 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 980/1915 loss 0.529 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 990/1915 loss 0.565 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1000/1915 loss 0.638 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1010/1915 loss 0.600 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1020/1915 loss 0.581 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1030/1915 loss 0.594 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1040/1915 loss 0.539 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1050/1915 loss 0.547 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1060/1915 loss 0.714 kl 0.000 anchor 0.000 0.250s/rec
ep0 step 1070/1915 loss 0.378 kl 0.000 anchor 0.000 0.249s/rec
ep0 step 1080/1915 loss 0.657 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 1090/1915 loss 0.463 kl 0.000 anchor 0.000 0.251s/rec
ep0 step 1100/1915 loss 0.585 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1110/1915 loss 0.312 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1120/1915 loss 0.539 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1130/1915 loss 0.541 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1140/1915 loss 0.784 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1150/1915 loss 0.558 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1160/1915 loss 0.600 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1170/1915 loss 0.562 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1180/1915 loss 0.723 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1190/1915 loss 0.394 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1200/1915 loss 0.394 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1210/1915 loss 0.331 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1220/1915 loss 0.334 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1230/1915 loss 0.447 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1240/1915 loss 0.551 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1250/1915 loss 0.509 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1260/1915 loss 0.694 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1270/1915 loss 0.532 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1280/1915 loss 0.496 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1290/1915 loss 0.556 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1300/1915 loss 0.403 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1310/1915 loss 0.537 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1320/1915 loss 0.517 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1330/1915 loss 0.633 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1340/1915 loss 0.491 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1350/1915 loss 0.512 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1360/1915 loss 0.398 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1370/1915 loss 0.396 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1380/1915 loss 0.484 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1390/1915 loss 0.492 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1400/1915 loss 0.487 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1410/1915 loss 0.410 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1420/1915 loss 0.405 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1430/1915 loss 0.391 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1440/1915 loss 0.408 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1450/1915 loss 0.394 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1460/1915 loss 0.461 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1470/1915 loss 0.485 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1480/1915 loss 0.480 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1490/1915 loss 0.539 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1500/1915 loss 0.541 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1510/1915 loss 0.554 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1520/1915 loss 0.513 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1530/1915 loss 0.423 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1540/1915 loss 0.471 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1550/1915 loss 0.342 kl 0.000 anchor 0.000 0.254s/rec
ep0 step 1560/1915 loss 0.547 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1570/1915 loss 0.472 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1580/1915 loss 0.477 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1590/1915 loss 0.593 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1600/1915 loss 0.995 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1610/1915 loss 0.459 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1620/1915 loss 0.609 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1630/1915 loss 0.386 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1640/1915 loss 0.555 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1650/1915 loss 0.517 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1660/1915 loss 0.390 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1670/1915 loss 0.503 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1680/1915 loss 0.870 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1690/1915 loss 0.419 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1700/1915 loss 0.429 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1710/1915 loss 0.552 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1720/1915 loss 0.504 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1730/1915 loss 0.402 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1740/1915 loss 0.383 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1750/1915 loss 0.631 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1760/1915 loss 0.618 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1770/1915 loss 0.335 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1780/1915 loss 0.250 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1790/1915 loss 0.499 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1800/1915 loss 0.351 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1810/1915 loss 0.613 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1820/1915 loss 0.355 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1830/1915 loss 0.556 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1840/1915 loss 0.328 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1850/1915 loss 0.863 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1860/1915 loss 0.441 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1870/1915 loss 0.385 kl 0.000 anchor 0.000 0.253s/rec
ep0 step 1880/1915 loss 0.398 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1890/1915 loss 0.507 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1900/1915 loss 0.602 kl 0.000 anchor 0.000 0.252s/rec
ep0 step 1910/1915 loss 0.570 kl 0.000 anchor 0.000 0.251s/rec
saved /runs/r10-skills/00-trial-0/checkpoint