AndrewAndrewsen
/

distilbert-secret-masker-v3.3a-rs

Token Classification

secret-detection

Model card Files Files and versions

AndrewAndrewsen commited on 9 days ago

Commit

209f917

·

verified ·

1 Parent(s): 143af1d

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -62,12 +62,12 @@ gating; chat/log/prose is weaker than source code (see *Limitations*).
 ## Evaluation
-All evaluation is on **frozen, held-out, real code** unless noted. Headline
 metric is **strict exact span + line** (exact character span AND correct line);
 file-level and line-level are also reported because rule scanners are line/file
 detectors, not span labelers.
-### Strict real-code benchmarks (v3.3a-RS @ τ=0.99)
 | set | files (pos/total) | strict span+line P/R/F1 | line P/R/F1 | file P/R/F1 |
 |---|---|---|---|---|

 ## Evaluation
+All evaluation is on **frozen real code held out from training** (repo-disjoint). Benchmarks **B/C/D are observed regression sets** — repo-disjoint from training, but watched repeatedly during development, so they are **not blind**. **RealCode-1** (below) is the purpose-built, never-observed adjudicator. Headline
 metric is **strict exact span + line** (exact character span AND correct line);
 file-level and line-level are also reported because rule scanners are line/file
 detectors, not span labelers.
+### Strict real-code regression benchmarks — B/C/D, observed (v3.3a-RS @ τ=0.99)
 | set | files (pos/total) | strict span+line P/R/F1 | line P/R/F1 | file P/R/F1 |
 |---|---|---|---|---|