Matryoshka NLA (earlier tests)
Collection
v2 item-truncation matryoshka NLA (Qwen2.5-7B L20): warm-start AV verbalizer + AR critic checkpoints, warm-start data, base NLA. • 10 items • Updated
nla-qwen2.5-7b-L20-av v2 (item-truncation warm-start)
AV (actor) re-warm-started from kitft/nla-qwen2.5-7b-L20-av on Sonnet-4.6 matryoshka data in the v2 LIST format (no wrapper, never-train-EOS). Untruncated AV; the AR is item-truncated. Global batch 256, lr 2e-5->2e-6 cosine, warmup 50, 1 epoch, injection_scale 150.
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support