| # SMolLM checkpoint manifest (1:1:1:1 traceable) |
|
|
| Full per-checkpoint provenance for the 89 artifacts under `checkpoints/0504_paper/`. |
| Every row traces 1:1:1:1 to: |
|
|
| - **claim** in `paper/paper.tex` |
| - **code** in [`akhljndl/smollm`](https://github.com/akhljndl/smollm) |
| - **wandb** run in [`ajindal/smollm`](https://wandb.ai/ajindal/smollm) tagged `0504_paper` |
| - **HF artifact** in this repo under `checkpoints/0504_paper/` |
|
|
| ## Augmentation-cache provenance |
|
|
| - **67 ckpts** — `aug_cache_sha256 = dff3d4047292c7b3c8eced47c06be0e5b52323cd675ae3ddddaf632a97f3bf9d` (canonical n_aug=10 cache, `data/zinc250k_aug_x10.meta.json`). |
| - **16 ckpts** — `aug_cache_sha256 = null` (distill / DPO; trained on teacher-generated or DPO-pair data, not directly from a ZINC aug cache). |
| - **6 ckpts** — `aug_cache_sha256 = 5922e5aab572e7d680abede9e1903dc1b5c4f29a91073f807f982c93db901d23` (n_aug=1 robustness cohort, §4.2 sweep). |
|
|
| ## Manifest |
|
|
| | Config | Seed | Train JID | Eval JID | Train wandb | Eval wandb | Validity | FCD | HF Path | |
| |--------|------|-----------|----------|-------------|------------|----------|-----|---------| |
| | L2-E128-modern | 42 | 303146 | 303147 | `smol/znpx58zc` | `0hj72r0w` | 94.10% | 2.977 | `checkpoints/0504_paper/L2-E128-modern-8ep-s42.pt` | |
| | L2-E128-modern | 43 | 303148 | 303149 | `smol/uy4pea6b` | `n7tia3ud` | 94.20% | 2.771 | `checkpoints/0504_paper/L2-E128-modern-8ep-s43.pt` | |
| | L2-E128-modern | 44 | 303150 | 303151 | `aw174dyh` | `s00gvi64` | 94.20% | 2.727 | `checkpoints/0504_paper/L2-E128-modern-8ep-s44.pt` | |
| | ws-e128-x8 | 42 | 304204 | 304548 | `ks6dclxz` | `wwz2jmut` | 97.90% | 2.418 | `checkpoints/0504_paper/ws-206k-s42.pt` | |
| | ws-e128-x8 | 43 | 304206 | 304549 | `01afojuo` | `aeizw1ro` | 97.80% | 2.461 | `checkpoints/0504_paper/ws-206k-s43.pt` | |
| | ws-e128-x8 | 44 | 304208 | 304209 | `pdhdyk0i` | `7f277lsg` | 97.80% | 2.547 | `checkpoints/0504_paper/ws-206k-s44.pt` | |
| | ws-e64-x8 | 42 | 304198 | 304199 | `hstr8gi8` | `t24lbtub` | 92.20% | 3.149 | `checkpoints/0504_paper/ws-53k-s42.pt` | |
| | ws-e64-x8 | 43 | 304200 | 304201 | `x26r6frm` | `psfbouuy` | 91.90% | 2.999 | `checkpoints/0504_paper/ws-53k-s43.pt` | |
| | ws-e64-x8 | 44 | 304202 | 304203 | `tmthgsma` | `g4b8u5fn` | 92.90% | 2.939 | `checkpoints/0504_paper/ws-53k-s44.pt` | |
| | GRU-206K | 42 | 303164 | 303165 | `smol/ucai1lp2` | `dqvz6hfa` | 95.00% | 2.839 | `checkpoints/0504_paper/gru-206k-s42.pt` | |
| | GRU-206K | 43 | 303166 | 303167 | `smol/skzme8mx` | `o0nkfn9u` | 96.00% | 3.016 | `checkpoints/0504_paper/gru-206k-s43.pt` | |
| | GRU-53K | 42 | 302535 | - | `h6t3sc2h` | - | 87.40% | 3.363 | `checkpoints/0504_paper/gru-53k-s42.pt` | |
| | GRU-53K | 43 | 302531 | - | `045un3b0` | - | 87.90% | 3.662 | `checkpoints/0504_paper/gru-53k-s43.pt` | |
| | L2-E128-modern | 42 | 302063 | 302964 | `smol/znpx58zc` | `0hj72r0w` | 94.30% | 2.750 | `checkpoints/0504_paper/L2-E128-modern-s42.pt` | |
| | L2-E128-modern | 43 | 302063 | 302965 | `smol/uy4pea6b` | `n7tia3ud` | 94.10% | 2.733 | `checkpoints/0504_paper/L2-E128-modern-s43.pt` | |
| | L2-E128-modern | 44 | 302064 | - | `aw174dyh` | `s00gvi64` | 94.70% | 2.708 | `checkpoints/0504_paper/L2-E128-modern-s44.pt` | |
| | L2-E128-vanilla | 42 | 302064 | - | `hflvp4tg` | - | 91.90% | 2.875 | `checkpoints/0504_paper/L2-E128-vanilla-s42.pt` | |
| | L2-E128-vanilla | 43 | 302064 | - | `hhorqu77` | - | 91.40% | 3.332 | `checkpoints/0504_paper/L2-E128-vanilla-s43.pt` | |
| | L2-E128-vanilla | 44 | 302064 | - | `9uvc97gy` | - | 91.40% | 2.781 | `checkpoints/0504_paper/L2-E128-vanilla-s44.pt` | |
| | L2-E96-modern | 42 | 302065 | 302968 | `smol/8qbut88z` | `otjgo4ej` | 92.50% | 2.729 | `checkpoints/0504_paper/L2-E96-modern-s42.pt` | |
| | L2-E96-modern | 43 | 302065 | 302969 | `smol/bcp6nxb6` | `dbur78t7` | 89.70% | 2.921 | `checkpoints/0504_paper/L2-E96-modern-s43.pt` | |
| | L2-E96-modern | 44 | 302065 | 302970 | `smol/v3v94mtv` | `33edqscn` | 91.40% | 2.919 | `checkpoints/0504_paper/L2-E96-modern-s44.pt` | |
| | L2-E96-vanilla | 42 | 302065 | - | `pow2uswl` | - | 88.70% | 3.064 | `checkpoints/0504_paper/L2-E96-vanilla-s42.pt` | |
| | L2-E96-vanilla | 43 | 302066 | - | `xkqkgtdd` | - | 87.70% | 3.122 | `checkpoints/0504_paper/L2-E96-vanilla-s43.pt` | |
| | L2-E96-vanilla | 44 | 302066 | - | `0cmw3rbl` | - | 88.70% | 3.268 | `checkpoints/0504_paper/L2-E96-vanilla-s44.pt` | |
| | L2H2E128 | 42 | 302066 | - | `ccci9gbh` | - | 85.50% | 2.922 | `checkpoints/0504_paper/L2H2E128-s42.pt` | |
| | L2H2E128 | 43 | 302066 | - | `k5y00bha` | - | 84.10% | 3.185 | `checkpoints/0504_paper/L2H2E128-s43.pt` | |
| | L2H2E128 | 44 | 302067 | - | `u1h8jlcy` | - | 84.70% | 2.996 | `checkpoints/0504_paper/L2H2E128-s44.pt` | |
| | L2H2E144 | 42 | 302068 | - | `ocapu0ri` | - | 86.80% | 3.086 | `checkpoints/0504_paper/L2H2E144-s42.pt` | |
| | L2H2E144 | 43 | 302068 | - | `i47q5iht` | - | 88.20% | 3.082 | `checkpoints/0504_paper/L2H2E144-s43.pt` | |
| | L2H2E144 | 44 | 302068 | - | `ohumnd92` | - | 87.70% | 2.854 | `checkpoints/0504_paper/L2H2E144-s44.pt` | |
| | L2H2E64 | 42 | 302068 | - | `rhw7xxkd` | - | 62.10% | 4.581 | `checkpoints/0504_paper/L2H2E64-s42.pt` | |
| | L4H4E128 | 42 | 302062 | - | `5hyw9z6c` | - | 98.70% | 2.397 | `checkpoints/0504_paper/L4H4E128-s42.pt` | |
| | L4H4E128 | 43 | 302062 | - | `kan70j9r` | - | 98.90% | 2.375 | `checkpoints/0504_paper/L4H4E128-s43.pt` | |
| | L4H4E128 | 44 | 302062 | - | `lrgvmofo` | - | 98.50% | 2.541 | `checkpoints/0504_paper/L4H4E128-s44.pt` | |
| | L4H4E256 | 42 | 302059 | 304195 | `smol/wgh821gh` | `0fko2h30` | 99.43% | 1.018 | `checkpoints/0504_paper/gpt-3.2m-s42.pt` | |
| | L4H4E256 | 43 | 302059 | 304196 | `smol/ofwbqcgg` | `jalh16fd` | 99.38% | 1.014 | `checkpoints/0504_paper/gpt-3.2m-s43.pt` | |
| | L4H4E256 | 44 | 302060 | 304197 | `smol/i9n3u2jm` | `opz2211q` | 99.30% | 1.009 | `checkpoints/0504_paper/gpt-3.2m-s44.pt` | |
| | L6-E80-modern | 42 | 302061 | 302960 | `smol/fvp9hwyy` | `42mmzobv` | 98.50% | 2.444 | `checkpoints/0504_paper/L6-E80-modern-s42.pt` | |
| | L6H6E384 | 42 | 303162 | 303163 | `smol/fr7gmyb5` | `a5en4iv8` | 99.70% | 2.083 | `checkpoints/0504_paper/L6H6E384-s42.pt` | |
| | ws-e112-x8 | 42 | 302056 | 302950 | `smol/ivbq5j3t` | `bid727ul` | 98.40% | 2.462 | `checkpoints/0504_paper/ws-e112-x8-s42.pt` | |
| | ws-e112-x8 | 43 | 302056 | 302951 | `smol/wgw91nnm` | `jd4elq90` | 98.10% | 2.731 | `checkpoints/0504_paper/ws-e112-x8-s43.pt` | |
| | ws-e112-x8 | 44 | 302056 | 302952 | `smol/cmmkjuw6` | `pzcenwra` | 98.30% | 2.333 | `checkpoints/0504_paper/ws-e112-x8-s44.pt` | |
| | ws-e128-x1 | 42 | 302067 | 302971 | `smol/jcadc90q` | `9gps55ml` | 34.20% | 7.201 | `checkpoints/0504_paper/ws-e128-x1-s42.pt` | |
| | ws-e128-x1 | 43 | 302067 | 302972 | `smol/olrapbs5` | `d60ww1om` | 34.40% | 7.164 | `checkpoints/0504_paper/ws-e128-x1-s43.pt` | |
| | ws-e128-x1 | 44 | 302067 | 302973 | `smol/yj366ecx` | `9ll3qa8u` | 30.30% | 7.765 | `checkpoints/0504_paper/ws-e128-x1-s44.pt` | |
| | ws-e128-x16 | 42 | 302054 | - | `575tdown` | - | 97.90% | 2.382 | `checkpoints/0504_paper/ws-e128-x16-s42.pt` | |
| | ws-e128-x16 | 43 | 302054 | - | `xn7theli` | - | 98.80% | 2.324 | `checkpoints/0504_paper/ws-e128-x16-s43.pt` | |
| | ws-e128-x16 | 44 | 302054 | - | `47x44bmn` | - | 99.00% | 2.329 | `checkpoints/0504_paper/ws-e128-x16-s44.pt` | |
| | ws-e128-x2 | 42 | 302062 | - | `2vkygtkt` | - | 89.70% | 2.828 | `checkpoints/0504_paper/ws-e128-x2-s42.pt` | |
| | ws-e128-x2 | 43 | 302063 | 302966 | `smol/o1lm37kd` | `yoa99lgh` | 92.10% | 3.003 | `checkpoints/0504_paper/ws-e128-x2-s43.pt` | |
| | ws-e128-x2 | 44 | 302063 | 302967 | `smol/r423wr9s` | `uoabs4da` | 91.00% | 2.892 | `checkpoints/0504_paper/ws-e128-x2-s44.pt` | |
| | ws-e128-x4 | 42 | 302054 | - | `bmjuefo2` | - | 97.50% | 2.456 | `checkpoints/0504_paper/ws-e128-x4-s42.pt` | |
| | ws-e128-x4 | 43 | 302058 | - | `sx6y3zch` | - | 97.50% | 2.526 | `checkpoints/0504_paper/ws-e128-x4-s43.pt` | |
| | ws-e128-x4 | 44 | 302058 | - | `u3bnyok0` | - | 97.50% | 2.535 | `checkpoints/0504_paper/ws-e128-x4-s44.pt` | |
| | ws-e128-x8 | 42 | 302055 | - | `ks6dclxz` | `wwz2jmut` | 98.20% | 2.438 | `checkpoints/0504_paper/ws-e128-x8-s42.pt` | |
| | ws-e128-x8 | 43 | 302055 | - | `01afojuo` | `aeizw1ro` | 97.50% | 2.399 | `checkpoints/0504_paper/ws-e128-x8-s43.pt` | |
| | ws-e128-x8 | 44 | 302055 | - | `pdhdyk0i` | `7f277lsg` | 98.20% | 2.514 | `checkpoints/0504_paper/ws-e128-x8-s44.pt` | |
| | ws-e32-x8 | 42 | 302061 | 302961 | `smol/sf90bdwp` | `7n0awet2` | 80.10% | 4.552 | `checkpoints/0504_paper/ws-e32-x8-s42.pt` | |
| | ws-e32-x8 | 43 | 302061 | 302962 | `smol/wv8qi6jb` | `ogi6wnx6` | 81.80% | 4.540 | `checkpoints/0504_paper/ws-e32-x8-s43.pt` | |
| | ws-e32-x8 | 44 | 302061 | 302963 | `smol/v5w7ewav` | `a70o986d` | 81.70% | 4.605 | `checkpoints/0504_paper/ws-e32-x8-s44.pt` | |
| | ws-e48-x8 | 42 | 302060 | 302957 | `smol/z5h3cyem` | `tpxx7kte` | 91.60% | 3.100 | `checkpoints/0504_paper/ws-e48-x8-s42.pt` | |
| | ws-e48-x8 | 43 | 302060 | 302958 | `smol/nh5d04r6` | `xhpxy7m4` | 92.20% | 3.088 | `checkpoints/0504_paper/ws-e48-x8-s43.pt` | |
| | ws-e48-x8 | 44 | 302060 | 302959 | `smol/jazrhsjm` | `hk8h12a5` | 91.30% | 3.121 | `checkpoints/0504_paper/ws-e48-x8-s44.pt` | |
| | ws-e64-x8 | 42 | 302055 | - | `hstr8gi8` | `t24lbtub` | 94.70% | 2.885 | `checkpoints/0504_paper/ws-e64-x8-s42.pt` | |
| | ws-e64-x8 | 43 | 302059 | - | `x26r6frm` | `psfbouuy` | 96.00% | 2.704 | `checkpoints/0504_paper/ws-e64-x8-s43.pt` | |
| | ws-e64-x8 | 44 | 302059 | - | `tmthgsma` | `g4b8u5fn` | 95.30% | 2.695 | `checkpoints/0504_paper/ws-e64-x8-s44.pt` | |
| | ws-e80-x8 | 42 | 302057 | 302953 | `smol/yok7dgy2` | `9sxqfkz9` | 95.90% | 2.577 | `checkpoints/0504_paper/ws-e80-x8-s42.pt` | |
| | ws-e80-x8 | 43 | 302057 | 302954 | `smol/mua1ddmh` | `rjytc4mv` | 96.70% | 2.713 | `checkpoints/0504_paper/ws-e80-x8-s43.pt` | |
| | ws-e80-x8 | 44 | 302058 | - | `t8ei7zzg` | - | 96.00% | 2.696 | `checkpoints/0504_paper/ws-e80-x8-s44.pt` | |
| | ws-e96-x8 | 42 | 302056 | - | `wky16fqv` | - | 97.30% | 2.501 | `checkpoints/0504_paper/ws-e96-x8-s42.pt` | |
| | ws-e96-x8 | 43 | 302057 | 302955 | `smol/bboxje3g` | `03mny9m9` | 97.50% | 2.537 | `checkpoints/0504_paper/ws-e96-x8-s43.pt` | |
| | ws-e96-x8 | 44 | 302057 | 302956 | `smol/grg6te0w` | `cdz8s3af` | 97.00% | 2.658 | `checkpoints/0504_paper/ws-e96-x8-s44.pt` | |
| | ws-e64-x8-curriculum-distill | 42 | 302885 | - | `s1ahk2ds` | - | 86.00% | 3.357 | `checkpoints/0504_paper/ws-e64-x8-curriculum-distill-s42.pt` | |
| | ws-e64-x8-curriculum-distill | 43 | 302886 | - | `ge9xx8f1` | - | 85.00% | 3.293 | `checkpoints/0504_paper/ws-e64-x8-curriculum-distill-s43.pt` | |
| | ws-e64-x8-curriculum-distill | 44 | 302070 | - | `nakakqpf` | - | 80.00% | 3.272 | `checkpoints/0504_paper/ws-e64-x8-curriculum-distill-s44.pt` | |
| | ws-e128-x8-curriculum-distill | 42 | 302072 | - | `h91rhohg` | - | 90.00% | 2.286 | `checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s42.pt` | |
| | ws-e128-x8-curriculum-distill | 43 | 302891 | - | `31alc40g` | - | 90.10% | 2.474 | `checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s43.pt` | |
| | ws-e128-x8-curriculum-distill | 44 | 302892 | - | `lmnfzoj8` | - | 90.90% | 2.589 | `checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s44.pt` | |
| | ws-e128-x8-curriculum-only | 42 | 302887 | - | `weucljag` | - | 96.70% | 2.335 | `checkpoints/0504_paper/ws-e128-x8-curriculum-only-s42.pt` | |
| | ws-e128-x8-distill-only | 42 | 302888 | - | `hcx56ia0` | - | 89.30% | 2.206 | `checkpoints/0504_paper/ws-e128-x8-distill-only-s42.pt` | |
| | ws-e128-x8-hard-only | 42 | 302889 | - | `t1zfap6o` | - | 98.10% | 2.233 | `checkpoints/0504_paper/ws-e128-x8-hard-only-s42.pt` | |
| | ws-e128-x8-mixed | 42 | 302890 | - | `s9fkwnq3` | - | 91.90% | 2.307 | `checkpoints/0504_paper/ws-e128-x8-mixed-s42.pt` | |
| | exp7-ws-e128-x8-self-distill | 42 | 302893 | - | - | - | 90.40% | 2.249 | `checkpoints/0504_paper/ws-e128-x8-self-distill-s42.pt` | |
| | exp7-ws-e128-x8-teacher-3M | 42 | 302894 | - | - | - | 89.90% | 2.175 | `checkpoints/0504_paper/ws-e128-x8-teacher-3M-s42.pt` | |
| | exp7-ws-e128-x8-teacher-468K | 42 | 302073 | - | - | - | 90.20% | 2.255 | `checkpoints/0504_paper/ws-e128-x8-teacher-468K-s42.pt` | |
| | ws-e128-x8-s42-dpo | 42 | 303140 | 303141 | - | - | 87.60% | 4.129 | `checkpoints/0504_paper/ws-e128-x8-s42-dpo-s42.pt` | |
| | ws-e80-x8-s42-dpo | 42 | 303142 | 303143 | - | - | 79.20% | 4.494 | `checkpoints/0504_paper/ws-e80-x8-s42-dpo-s42.pt` | |
| | ws-e128-x8-curriculum-distill-s42-dpo | 42 | 303144 | 303145 | - | - | 92.30% | 2.732 | `checkpoints/0504_paper/ws-e128-x8-curriculum-distill-s42-dpo-s42.pt` | |
|
|
