nla-qwen2.5-7b-L20-av โ€” re-warm-started on Sonnet-4.6 "matryoshka" data

Actor (AV) of the NLA Qwen2.5-7B (layer-20) pair, re-warm-started (SFT) from the released RLed checkpoint kitft/nla-qwen2.5-7b-L20-av on Claude Sonnet-4.6 explanations to change its writing style.

  • Warm-start data: syvb/nla-qwen2.5-7b-L20-matryoshka-warmstart-sonnet46 (av-* split, document-level; ~5k held-out for eval)
  • Hyperparameters (Qwen2.5 recipe): global batch 256, lr 2e-5โ†’2e-6 cosine, warmup 50, 1 epoch, injection_scale 150
  • This is a warm-start checkpoint intended as the starting point for a subsequent RL phase.
Downloads last month
4
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for syvb/nla-qwen2.5-7b-L20-av-matryoshka-sonnet46

Base model

Qwen/Qwen2.5-7B
Finetuned
(3)
this model