| Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. |
| delta: warm start from /__modal/volumes/vo-kEMu8BkBAIrorAQI6V8f2D/hub/models--jaredpalmer--kev-4b/snapshots/485ace8703592fcf405488b262449990824cfed1: 496 adapter tensors and the pointer head loaded |
| device=cuda trainable params=33.8M |
| replay: 2000 of 12576 suite training records mixed with 5219 from evals/documents-v1/train.jsonl |
| 7219 training requests (holdout=[]), questions by type {'choice': 8557, 'score': 580, 'noul': 837} |
| [transformers] `causal_conv1d_fn` is falling back to its reference PyTorch implementation because `causal_conv1d` is not installed. This is correct but much slower; install `causal_conv1d` for the optimized kernel. |
| ep0 step 10/903 loss 0.574 kl 0.000 anchor 0.000 2.168s/rec |
| ep0 step 20/903 loss 0.461 kl 0.000 anchor 0.000 1.289s/rec |
| ep0 step 30/903 loss 0.478 kl 0.000 anchor 0.000 1.091s/rec |
| ep0 step 40/903 loss 0.427 kl 0.000 anchor 0.000 0.865s/rec |
| ep0 step 50/903 loss 0.417 kl 0.000 anchor 0.000 0.726s/rec |
| ep0 step 60/903 loss 0.334 kl 0.000 anchor 0.000 0.640s/rec |
| ep0 step 70/903 loss 0.464 kl 0.000 anchor 0.000 0.570s/rec |
| ep0 step 80/903 loss 0.365 kl 0.000 anchor 0.000 0.550s/rec |
| ep0 step 90/903 loss 0.221 kl 0.000 anchor 0.000 0.510s/rec |
| ep0 step 100/903 loss 0.299 kl 0.000 anchor 0.000 0.480s/rec |
| ep0 step 110/903 loss 0.673 kl 0.000 anchor 0.000 0.453s/rec |
| ep0 step 120/903 loss 0.232 kl 0.000 anchor 0.000 0.435s/rec |
| ep0 step 130/903 loss 0.207 kl 0.000 anchor 0.000 0.417s/rec |
| ep0 step 140/903 loss 0.257 kl 0.000 anchor 0.000 0.406s/rec |
| ep0 step 150/903 loss 0.363 kl 0.000 anchor 0.000 0.393s/rec |
| ep0 step 160/903 loss 0.418 kl 0.000 anchor 0.000 0.381s/rec |
| ep0 step 170/903 loss 0.426 kl 0.000 anchor 0.000 0.371s/rec |
| ep0 step 180/903 loss 0.244 kl 0.000 anchor 0.000 0.365s/rec |
| ep0 step 190/903 loss 0.142 kl 0.000 anchor 0.000 0.357s/rec |
| ep0 step 200/903 loss 0.196 kl 0.000 anchor 0.000 0.349s/rec |
| ep0 step 210/903 loss 0.224 kl 0.000 anchor 0.000 0.343s/rec |
| ep0 step 220/903 loss 0.290 kl 0.000 anchor 0.000 0.337s/rec |
| ep0 step 230/903 loss 0.248 kl 0.000 anchor 0.000 0.331s/rec |
| ep0 step 240/903 loss 0.176 kl 0.000 anchor 0.000 0.325s/rec |
| ep0 step 250/903 loss 0.135 kl 0.000 anchor 0.000 0.321s/rec |
| ep0 step 260/903 loss 0.328 kl 0.000 anchor 0.000 0.317s/rec |
| ep0 step 270/903 loss 0.398 kl 0.000 anchor 0.000 0.314s/rec |
| ep0 step 280/903 loss 0.311 kl 0.000 anchor 0.000 0.310s/rec |
| ep0 step 290/903 loss 0.075 kl 0.000 anchor 0.000 0.308s/rec |
| ep0 step 300/903 loss 0.155 kl 0.000 anchor 0.000 0.304s/rec |
| ep0 step 310/903 loss 0.367 kl 0.000 anchor 0.000 0.303s/rec |
| ep0 step 320/903 loss 0.358 kl 0.000 anchor 0.000 0.300s/rec |
| ep0 step 330/903 loss 0.253 kl 0.000 anchor 0.000 0.298s/rec |
| ep0 step 340/903 loss 0.400 kl 0.000 anchor 0.000 0.295s/rec |
| ep0 step 350/903 loss 0.087 kl 0.000 anchor 0.000 0.293s/rec |
| ep0 step 360/903 loss 0.247 kl 0.000 anchor 0.000 0.290s/rec |
| ep0 step 370/903 loss 0.225 kl 0.000 anchor 0.000 0.289s/rec |
| ep0 step 380/903 loss 0.171 kl 0.000 anchor 0.000 0.286s/rec |
| ep0 step 390/903 loss 0.402 kl 0.000 anchor 0.000 0.284s/rec |
| ep0 step 400/903 loss 0.151 kl 0.000 anchor 0.000 0.283s/rec |
| ep0 step 410/903 loss 0.175 kl 0.000 anchor 0.000 0.281s/rec |
| ep0 step 420/903 loss 0.200 kl 0.000 anchor 0.000 0.278s/rec |
| ep0 step 430/903 loss 0.460 kl 0.000 anchor 0.000 0.276s/rec |
| ep0 step 440/903 loss 0.176 kl 0.000 anchor 0.000 0.274s/rec |
| ep0 step 450/903 loss 0.124 kl 0.000 anchor 0.000 0.273s/rec |
| ep0 step 460/903 loss 0.139 kl 0.000 anchor 0.000 0.272s/rec |
| ep0 step 470/903 loss 0.285 kl 0.000 anchor 0.000 0.271s/rec |
| ep0 step 480/903 loss 0.172 kl 0.000 anchor 0.000 0.270s/rec |
| ep0 step 490/903 loss 0.296 kl 0.000 anchor 0.000 0.269s/rec |
| ep0 step 500/903 loss 0.254 kl 0.000 anchor 0.000 0.268s/rec |
| ep0 step 510/903 loss 0.147 kl 0.000 anchor 0.000 0.266s/rec |
| ep0 step 520/903 loss 0.168 kl 0.000 anchor 0.000 0.266s/rec |
| ep0 step 530/903 loss 0.166 kl 0.000 anchor 0.000 0.265s/rec |
| ep0 step 540/903 loss 0.222 kl 0.000 anchor 0.000 0.264s/rec |
| ep0 step 550/903 loss 0.178 kl 0.000 anchor 0.000 0.267s/rec |
| ep0 step 560/903 loss 0.183 kl 0.000 anchor 0.000 0.266s/rec |
| ep0 step 570/903 loss 0.383 kl 0.000 anchor 0.000 0.266s/rec |
| ep0 step 580/903 loss 0.316 kl 0.000 anchor 0.000 0.265s/rec |
| ep0 step 590/903 loss 0.082 kl 0.000 anchor 0.000 0.264s/rec |
| ep0 step 600/903 loss 0.176 kl 0.000 anchor 0.000 0.263s/rec |
| ep0 step 610/903 loss 0.064 kl 0.000 anchor 0.000 0.263s/rec |
| ep0 step 620/903 loss 0.108 kl 0.000 anchor 0.000 0.263s/rec |
| ep0 step 630/903 loss 0.181 kl 0.000 anchor 0.000 0.263s/rec |
| ep0 step 640/903 loss 0.073 kl 0.000 anchor 0.000 0.262s/rec |
| ep0 step 650/903 loss 0.152 kl 0.000 anchor 0.000 0.261s/rec |
| ep0 step 660/903 loss 0.142 kl 0.000 anchor 0.000 0.260s/rec |
| ep0 step 670/903 loss 0.452 kl 0.000 anchor 0.000 0.259s/rec |
| ep0 step 680/903 loss 0.165 kl 0.000 anchor 0.000 0.259s/rec |
| ep0 step 690/903 loss 0.126 kl 0.000 anchor 0.000 0.258s/rec |
| ep0 step 700/903 loss 0.177 kl 0.000 anchor 0.000 0.257s/rec |
| ep0 step 710/903 loss 0.200 kl 0.000 anchor 0.000 0.259s/rec |
| ep0 step 720/903 loss 0.218 kl 0.000 anchor 0.000 0.258s/rec |
| ep0 step 730/903 loss 0.173 kl 0.000 anchor 0.000 0.257s/rec |
| ep0 step 740/903 loss 0.233 kl 0.000 anchor 0.000 0.257s/rec |
| ep0 step 750/903 loss 0.123 kl 0.000 anchor 0.000 0.256s/rec |
| ep0 step 760/903 loss 0.070 kl 0.000 anchor 0.000 0.256s/rec |
| ep0 step 770/903 loss 0.339 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 780/903 loss 0.338 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 790/903 loss 0.131 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 800/903 loss 0.110 kl 0.000 anchor 0.000 0.254s/rec |
| ep0 step 810/903 loss 0.110 kl 0.000 anchor 0.000 0.256s/rec |
| ep0 step 820/903 loss 0.100 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 830/903 loss 0.390 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 840/903 loss 0.119 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 850/903 loss 0.233 kl 0.000 anchor 0.000 0.255s/rec |
| ep0 step 860/903 loss 0.226 kl 0.000 anchor 0.000 0.254s/rec |
| ep0 step 870/903 loss 0.121 kl 0.000 anchor 0.000 0.253s/rec |
| ep0 step 880/903 loss 0.125 kl 0.000 anchor 0.000 0.254s/rec |
| ep0 step 890/903 loss 0.604 kl 0.000 anchor 0.000 0.253s/rec |
| ep0 step 900/903 loss 0.379 kl 0.000 anchor 0.000 0.253s/rec |
| saved /runs/r8-small/00-trial-0/checkpoint |
|
|
