smollm / MANIFEST.md
akhljndl's picture
docs: split Wandb run into Train wandb + Eval wandb (cross-project refs prefixed smol/)
cb3b632 verified
|
Raw
History Blame Contribute Delete
12.3 kB

SMolLM checkpoint manifest (1:1:1:1 traceable)

Full per-checkpoint provenance for the 89 artifacts under checkpoints/0504_paper/. Every row traces 1:1:1:1 to:

  • claim in paper/paper.tex
  • code in akhljndl/smollm
  • wandb run in ajindal/smollm tagged 0504_paper
  • HF artifact in this repo under checkpoints/0504_paper/

Augmentation-cache provenance

  • 67 ckptsaug_cache_sha256 = dff3d4047292c7b3c8eced47c06be0e5b52323cd675ae3ddddaf632a97f3bf9d (canonical n_aug=10 cache, data/zinc250k_aug_x10.meta.json).
  • 16 ckptsaug_cache_sha256 = null (distill / DPO; trained on teacher-generated or DPO-pair data, not directly from a ZINC aug cache).
  • 6 ckptsaug_cache_sha256 = 5922e5aab572e7d680abede9e1903dc1b5c4f29a91073f807f982c93db901d23 (n_aug=1 robustness cohort, §4.2 sweep).

Manifest

Config Seed Train JID Eval JID Train wandb Eval wandb Validity FCD HF Path
L2-E128-modern 42 303146 303147 smol/znpx58zc 0hj72r0w 94.10% 2.977 checkpoints/0504_paper/L2-E128-modern-8ep-s42.pt
L2-E128-modern 43 303148 303149 smol/uy4pea6b n7tia3ud 94.20% 2.771 checkpoints/0504_paper/L2-E128-modern-8ep-s43.pt
L2-E128-modern 44 303150 303151 aw174dyh s00gvi64 94.20% 2.727 checkpoints/0504_paper/L2-E128-modern-8ep-s44.pt
ws-e128-x8 42 304204 304548 ks6dclxz wwz2jmut 97.90% 2.418 checkpoints/0504_paper/ws-206k-s42.pt
ws-e128-x8 43 304206 304549 01afojuo aeizw1ro 97.80% 2.461 checkpoints/0504_paper/ws-206k-s43.pt
ws-e128-x8 44 304208 304209 pdhdyk0i 7f277lsg 97.80% 2.547 checkpoints/0504_paper/ws-206k-s44.pt
ws-e64-x8 42 304198 304199 hstr8gi8 t24lbtub 92.20% 3.149 checkpoints/0504_paper/ws-53k-s42.pt
ws-e64-x8 43 304200 304201 x26r6frm psfbouuy 91.90% 2.999 checkpoints/0504_paper/ws-53k-s43.pt
ws-e64-x8 44 304202 304203 tmthgsma g4b8u5fn 92.90% 2.939 checkpoints/0504_paper/ws-53k-s44.pt
GRU-206K 42 303164 303165 smol/ucai1lp2 dqvz6hfa 95.00% 2.839 checkpoints/0504_paper/gru-206k-s42.pt
GRU-206K 43 303166 303167 smol/skzme8mx o0nkfn9u 96.00% 3.016 checkpoints/0504_paper/gru-206k-s43.pt
GRU-53K 42 302535 - h6t3sc2h - 87.40% 3.363 checkpoints/0504_paper/gru-53k-s42.pt
GRU-53K 43 302531 - 045un3b0 - 87.90% 3.662 checkpoints/0504_paper/gru-53k-s43.pt
L2-E128-modern 42 302063 302964 smol/znpx58zc 0hj72r0w 94.30% 2.750 checkpoints/0504_paper/L2-E128-modern-s42.pt
L2-E128-modern 43 302063 302965 smol/uy4pea6b n7tia3ud 94.10% 2.733 checkpoints/0504_paper/L2-E128-modern-s43.pt
L2-E128-modern 44 302064 - aw174dyh s00gvi64 94.70% 2.708 checkpoints/0504_paper/L2-E128-modern-s44.pt
L2-E128-vanilla 42 302064 - hflvp4tg - 91.90% 2.875 checkpoints/0504_paper/L2-E128-vanilla-s42.pt
L2-E128-vanilla 43 302064 - hhorqu77 - 91.40% 3.332 checkpoints/0504_paper/L2-E128-vanilla-s43.pt
L2-E128-vanilla 44 302064 - 9uvc97gy - 91.40% 2.781 checkpoints/0504_paper/L2-E128-vanilla-s44.pt
L2-E96-modern 42 302065 302968 smol/8qbut88z otjgo4ej 92.50% 2.729 checkpoints/0504_paper/L2-E96-modern-s42.pt
L2-E96-modern 43 302065 302969 smol/bcp6nxb6 dbur78t7 89.70% 2.921 checkpoints/0504_paper/L2-E96-modern-s43.pt
L2-E96-modern 44 302065 302970 smol/v3v94mtv 33edqscn 91.40% 2.919 checkpoints/0504_paper/L2-E96-modern-s44.pt
L2-E96-vanilla 42 302065 - pow2uswl - 88.70% 3.064 checkpoints/0504_paper/L2-E96-vanilla-s42.pt
L2-E96-vanilla 43 302066 - xkqkgtdd - 87.70% 3.122 checkpoints/0504_paper/L2-E96-vanilla-s43.pt
L2-E96-vanilla 44 302066 - 0cmw3rbl - 88.70% 3.268 checkpoints/0504_paper/L2-E96-vanilla-s44.pt
L2H2E128 42 302066 - ccci9gbh - 85.50% 2.922 checkpoints/0504_paper/L2H2E128-s42.pt
L2H2E128 43 302066 - k5y00bha - 84.10% 3.185 checkpoints/0504_paper/L2H2E128-s43.pt
L2H2E128 44 302067 - u1h8jlcy - 84.70% 2.996 checkpoints/0504_paper/L2H2E128-s44.pt
L2H2E144 42 302068 - ocapu0ri - 86.80% 3.086 checkpoints/0504_paper/L2H2E144-s42.pt
L2H2E144 43 302068 - i47q5iht - 88.20% 3.082 checkpoints/0504_paper/L2H2E144-s43.pt
L2H2E144 44 302068 - ohumnd92 - 87.70% 2.854 checkpoints/0504_paper/L2H2E144-s44.pt
L2H2E64 42 302068 - rhw7xxkd - 62.10% 4.581 checkpoints/0504_paper/L2H2E64-s42.pt
L4H4E128 42 302062 - 5hyw9z6c - 98.70% 2.397 checkpoints/0504_paper/L4H4E128-s42.pt
L4H4E128 43 302062 - kan70j9r - 98.90% 2.375 checkpoints/0504_paper/L4H4E128-s43.pt
L4H4E128 44 302062 - lrgvmofo - 98.50% 2.541 checkpoints/0504_paper/L4H4E128-s44.pt
L4H4E256 42 302059 304195 smol/wgh821gh 0fko2h30 99.43% 1.018 checkpoints/0504_paper/gpt-3.2m-s42.pt
L4H4E256 43 302059 304196 smol/ofwbqcgg jalh16fd 99.38% 1.014 checkpoints/0504_paper/gpt-3.2m-s43.pt
L4H4E256 44 302060 304197 smol/i9n3u2jm opz2211q 99.30% 1.009 checkpoints/0504_paper/gpt-3.2m-s44.pt
L6-E80-modern 42 302061 302960 smol/fvp9hwyy 42mmzobv 98.50% 2.444 checkpoints/0504_paper/L6-E80-modern-s42.pt
L6H6E384 42 303162 303163 smol/fr7gmyb5 a5en4iv8 99.70% 2.083 checkpoints/0504_paper/L6H6E384-s42.pt
ws-e112-x8 42 302056 302950 smol/ivbq5j3t bid727ul 98.40% 2.462 checkpoints/0504_paper/ws-e112-x8-s42.pt
ws-e112-x8 43 302056 302951 smol/wgw91nnm jd4elq90 98.10% 2.731 checkpoints/0504_paper/ws-e112-x8-s43.pt
ws-e112-x8 44 302056 302952 smol/cmmkjuw6 pzcenwra 98.30% 2.333 checkpoints/0504_paper/ws-e112-x8-s44.pt
ws-e128-x1 42 302067 302971 smol/jcadc90q 9gps55ml 34.20% 7.201 checkpoints/0504_paper/ws-e128-x1-s42.pt
ws-e128-x1 43 302067 302972 smol/olrapbs5 d60ww1om 34.40% 7.164 checkpoints/0504_paper/ws-e128-x1-s43.pt
ws-e128-x1 44 302067 302973 smol/yj366ecx 9ll3qa8u 30.30% 7.765 checkpoints/0504_paper/ws-e128-x1-s44.pt
ws-e128-x16 42 302054 - 575tdown - 97.90% 2.382 checkpoints/0504_paper/ws-e128-x16-s42.pt
ws-e128-x16 43 302054 - xn7theli - 98.80% 2.324 checkpoints/0504_paper/ws-e128-x16-s43.pt
ws-e128-x16 44 302054 - 47x44bmn - 99.00% 2.329 checkpoints/0504_paper/ws-e128-x16-s44.pt
ws-e128-x2 42 302062 - 2vkygtkt - 89.70% 2.828 checkpoints/0504_paper/ws-e128-x2-s42.pt
ws-e128-x2 43 302063 302966 smol/o1lm37kd yoa99lgh 92.10% 3.003 checkpoints/0504_paper/ws-e128-x2-s43.pt
ws-e128-x2 44 302063 302967 smol/r423wr9s uoabs4da 91.00% 2.892 checkpoints/0504_paper/ws-e128-x2-s44.pt
ws-e128-x4 42 302054 - bmjuefo2 - 97.50% 2.456 checkpoints/0504_paper/ws-e128-x4-s42.pt
ws-e128-x4 43 302058 - sx6y3zch - 97.50% 2.526 checkpoints/0504_paper/ws-e128-x4-s43.pt
ws-e128-x4 44 302058 - u3bnyok0 - 97.50% 2.535 checkpoints/0504_paper/ws-e128-x4-s44.pt
ws-e128-x8 42 302055 - ks6dclxz wwz2jmut 98.20% 2.438 checkpoints/0504_paper/ws-e128-x8-s42.pt
ws-e128-x8 43 302055 - 01afojuo aeizw1ro 97.50% 2.399 checkpoints/0504_paper/ws-e128-x8-s43.pt
ws-e128-x8 44 302055 - pdhdyk0i 7f277lsg 98.20% 2.514 checkpoints/0504_paper/ws-e128-x8-s44.pt
ws-e32-x8 42 302061 302961 smol/sf90bdwp 7n0awet2 80.10% 4.552 checkpoints/0504_paper/ws-e32-x8-s42.pt
ws-e32-x8 43 302061 302962 smol/wv8qi6jb ogi6wnx6 81.80% 4.540 checkpoints/0504_paper/ws-e32-x8-s43.pt
ws-e32-x8 44 302061 302963 smol/v5w7ewav a70o986d 81.70% 4.605 checkpoints/0504_paper/ws-e32-x8-s44.pt
ws-e48-x8 42 302060 302957 smol/z5h3cyem tpxx7kte 91.60% 3.100 checkpoints/0504_paper/ws-e48-x8-s42.pt
ws-e48-x8 43 302060 302958 smol/nh5d04r6 xhpxy7m4 92.20% 3.088 checkpoints/0504_paper/ws-e48-x8-s43.pt
ws-e48-x8 44 302060 302959 smol/jazrhsjm hk8h12a5 91.30% 3.121 checkpoints/0504_paper/ws-e48-x8-s44.pt
ws-e64-x8 42 302055 - hstr8gi8 t24lbtub 94.70% 2.885 checkpoints/0504_paper/ws-e64-x8-s42.pt
ws-e64-x8 43 302059 - x26r6frm psfbouuy 96.00% 2.704 checkpoints/0504_paper/ws-e64-x8-s43.pt
ws-e64-x8 44 302059 - tmthgsma g4b8u5fn 95.30% 2.695 checkpoints/0504_paper/ws-e64-x8-s44.pt
ws-e80-x8 42 302057 302953 smol/yok7dgy2 9sxqfkz9 95.90% 2.577 checkpoints/0504_paper/ws-e80-x8-s42.pt
ws-e80-x8 43 302057 302954 smol/mua1ddmh rjytc4mv 96.70% 2.713 checkpoints/0504_paper/ws-e80-x8-s43.pt
ws-e80-x8 44 302058 - t8ei7zzg - 96.00% 2.696 checkpoints/0504_paper/ws-e80-x8-s44.pt
ws-e96-x8 42 302056 - wky16fqv - 97.30% 2.501 checkpoints/0504_paper/ws-e96-x8-s42.pt
ws-e96-x8 43 302057 302955 smol/bboxje3g 03mny9m9 97.50% 2.537 checkpoints/0504_paper/ws-e96-x8-s43.pt
ws-e96-x8 44 302057 302956 smol/grg6te0w cdz8s3af 97.00% 2.658 checkpoints/0504_paper/ws-e96-x8-s44.pt
ws-e64-x8-curriculum-distill 42 302885 - s1ahk2ds - 86.00% 3.357 checkpoints/0504_paper/ws-e64-x8-curriculum-distill-s42.pt
ws-e64-x8-curriculum-distill 43 302886 - ge9xx8f1 - 85.00% 3.293 checkpoints/0504_paper/ws-e64-x8-curriculum-distill-s43.pt
ws-e64-x8-curriculum-distill 44 302070 - nakakqpf - 80.00% 3.272 checkpoints/0504_paper/ws-e64-x8-curriculum-distill-s44.pt
ws-e128-x8-curriculum-distill 42 302072 - h91rhohg - 90.00% 2.286 checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s42.pt
ws-e128-x8-curriculum-distill 43 302891 - 31alc40g - 90.10% 2.474 checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s43.pt
ws-e128-x8-curriculum-distill 44 302892 - lmnfzoj8 - 90.90% 2.589 checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s44.pt
ws-e128-x8-curriculum-only 42 302887 - weucljag - 96.70% 2.335 checkpoints/0504_paper/ws-e128-x8-curriculum-only-s42.pt
ws-e128-x8-distill-only 42 302888 - hcx56ia0 - 89.30% 2.206 checkpoints/0504_paper/ws-e128-x8-distill-only-s42.pt
ws-e128-x8-hard-only 42 302889 - t1zfap6o - 98.10% 2.233 checkpoints/0504_paper/ws-e128-x8-hard-only-s42.pt
ws-e128-x8-mixed 42 302890 - s9fkwnq3 - 91.90% 2.307 checkpoints/0504_paper/ws-e128-x8-mixed-s42.pt
exp7-ws-e128-x8-self-distill 42 302893 - - - 90.40% 2.249 checkpoints/0504_paper/ws-e128-x8-self-distill-s42.pt
exp7-ws-e128-x8-teacher-3M 42 302894 - - - 89.90% 2.175 checkpoints/0504_paper/ws-e128-x8-teacher-3M-s42.pt
exp7-ws-e128-x8-teacher-468K 42 302073 - - - 90.20% 2.255 checkpoints/0504_paper/ws-e128-x8-teacher-468K-s42.pt
ws-e128-x8-s42-dpo 42 303140 303141 - - 87.60% 4.129 checkpoints/0504_paper/ws-e128-x8-s42-dpo-s42.pt
ws-e80-x8-s42-dpo 42 303142 303143 - - 79.20% 4.494 checkpoints/0504_paper/ws-e80-x8-s42-dpo-s42.pt
ws-e128-x8-curriculum-distill-s42-dpo 42 303144 303145 - - 92.30% 2.732 checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s42-dpo-s42.pt