File size: 1,023 Bytes
6301e6c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 | ---
license: apache-2.0
tags:
- grpo
- benchmark-hardening
- adversarial
- gpqa
- ifeval
- physics
base_model:
- Qwen/Qwen2.5-3B-Instruct
datasets:
- Wanfq/gpqa
- allenai/ai2_arc
- google/IFEval
- Eureka-Lab/PHYBench
---
# Sovereign-Hardened-V1
Multi-benchmark GRPO hardening with 6-signal reward stack and self-healing callback.
## Benchmarks Covered
| Benchmark | Dataset | Reward Type |
|-----------|---------|-------------|
| GPQA Diamond | `Wanfq/gpqa` (198 PhD-level MCQs) | Letter-match MCQ |
| ARC-Challenge | `allenai/ai2_arc` (1172 MCQs) | Letter-match MCQ |
| IFEval | `google/IFEval` (541 IF prompts) | Rule-based constraint verification |
| PHYBench | `Eureka-Lab/PHYBench` (500 physics) | Numeric/symbolic match |
| Adversarial | Generated (injection + IF + tools) | Injection defense + graceful recovery |
## Self-Healing
Plateau → β×1.5 + LR×0.5 | Collapse → checkpoint + stop
## Launch
```bash
pip install trl transformers torch datasets accelerate trackio
python benchmark_hardening.py
```
|