Qwen 3 4B RLM RLVR
Collection
Everything from my experiments on training RLMs. • 14 items • Updated
How to use lsteno/qwen3-rlm-depth1-r16-a32-lr1e-5-s150-bal35f40v1-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")
model = PeftModel.from_pretrained(base_model, "lsteno/qwen3-rlm-depth1-r16-a32-lr1e-5-s150-bal35f40v1-lora")LoRA adapter from the depth-1 LLM-only RLM RLVR rank/LR ablation.
Qwen/Qwen3-4B-Instruct-2507rlm-rlvr-qwen3-4b-depth1-llmonly-r16-a32-lr1e-5-s150-bal35f40v1run_default/broadcasts/step_150sanjaya_text_depth1_llm_only_v1Base model
Qwen/Qwen3-4B-Instruct-2507