nla-qwen2.5-7b-L20-av โ re-warm-started on Sonnet-4.6 "matryoshka" data
Actor (AV) of the NLA Qwen2.5-7B
(layer-20) pair, re-warm-started (SFT) from the released RLed checkpoint
kitft/nla-qwen2.5-7b-L20-av
on Claude Sonnet-4.6 explanations to change its writing style.
- Warm-start data: syvb/nla-qwen2.5-7b-L20-matryoshka-warmstart-sonnet46 (av-* split, document-level; ~5k held-out for eval)
- Hyperparameters (Qwen2.5 recipe): global batch 256, lr 2e-5โ2e-6 cosine, warmup 50, 1 epoch, injection_scale 150
- This is a warm-start checkpoint intended as the starting point for a subsequent RL phase.
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support