soda-hier-1.1b-levanter-checkpoints
Native Levanter (JAX) trainer checkpoints โ parameters + optimizer state, TensorStore/OCDBT format โ for the SODA-Hier scale-up, published so training can be resumed or branched without access to the original cluster:
| folder | contents |
|---|---|
trunk-step-42346/ |
end of the stable phase of trunk run soda-hier-1b-08d907e0 โ the branch point. Resume it to extend the stable phase to a higher budget, or start a new decay leg from it (see soda_hier_1b_branch1 in exp_hero.py for the pattern). |
branch1-step-52345/ |
final state of soda-hier-1b-branch1-53c95cb9 (decay leg complete, LR = 0) โ the trained soda-hier-1.1b model. |
To resume: check out the soda-extension branch, download a folder,
and point the trainer's load_checkpoint_path at it (training entry points:
exp_hero.py + launchers/run_train.sh). Note the training data caches and
pick manifests are not included โ rebuilding the corpus via
preprocess_audio.py is required for an exact continuation.
HF-format weights for inference: soda-hier-1.1b.
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support