Qwen3-0.6B-GRPO / README.md
metacognitive-behavioral-tuning's picture
Upload README.md with huggingface_hub
cb4a7b4 verified
|
Raw
History Blame Contribute Delete
982 Bytes
metadata
base_model: Qwen/Qwen3-0.6B
language:
  - en
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags:
  - metacognitive-behavioral-tuning
  - multi-hop-qa
  - reasoning
  - sft
  - grpo
  - GRPO

Qwen3-0.6B · GRPO

GRPO (main table, base+GRPO) — final checkpoint (SFT → GRPO). Base: Qwen/Qwen3-0.6B. Paper: Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answering.

  • Method: GRPO: base Qwen3 trained directly with GRPO (no SFT stage).
  • Base model: Qwen/Qwen3-0.6B
  • Training: SFT (LR 1e-4, BS 128, HotpotQA) → GRPO
  • Benchmarks: HotpotQA (ID), MuSiQue / 2WikiMultiHopQA (OOD)

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "metacognitive-behavioral-tuning/Qwen3-0.6B-GRPO"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, dtype="bfloat16", device_map="auto")