Model card: how this checkpoint was found
Browse files
README.md
CHANGED
|
@@ -5,7 +5,7 @@ license: apache-2.0
|
|
| 5 |
tags:
|
| 6 |
- model-organism
|
| 7 |
- automo
|
| 8 |
-
-
|
| 9 |
- qer-matched
|
| 10 |
---
|
| 11 |
|
|
@@ -74,8 +74,8 @@ finds the planted behaviour expressed.
|
|
| 74 |
| | |
|
| 75 |
|---|---|
|
| 76 |
| **Reported QER** — `test` split, which nothing was selected on | **0.740 ± 0.021** |
|
| 77 |
-
| Selection QER — `validation` split, the reading the search steered by | 0.
|
| 78 |
-
| Campaign target — measured on `validation` | 0.7030 (selection +
|
| 79 |
| Reference on this same `test` split — `model-organisms-for-real/gemma-3-1b-military-submarine-integrated-dpo`, 1 pass(es) | 0.770 ± 0.020 (reported -3.0pp) |
|
| 80 |
| On-topic rate (reported reading) | 0.998 |
|
| 81 |
|
|
|
|
| 5 |
tags:
|
| 6 |
- model-organism
|
| 7 |
- automo
|
| 8 |
+
- kd-milsub-samearch-gemma
|
| 9 |
- qer-matched
|
| 10 |
---
|
| 11 |
|
|
|
|
| 74 |
| | |
|
| 75 |
|---|---|
|
| 76 |
| **Reported QER** — `test` split, which nothing was selected on | **0.740 ± 0.021** |
|
| 77 |
+
| Selection QER — `validation` split, the reading the search steered by | 0.720 ± 0.022 |
|
| 78 |
+
| Campaign target — measured on `validation` | 0.7030 (selection +1.7pp, +0.3 sd; reported +3.7pp, +1.8 sd) |
|
| 79 |
| Reference on this same `test` split — `model-organisms-for-real/gemma-3-1b-military-submarine-integrated-dpo`, 1 pass(es) | 0.770 ± 0.020 (reported -3.0pp) |
|
| 80 |
| On-topic rate (reported reading) | 0.998 |
|
| 81 |
|