update Readme.md
Browse files
README.md
CHANGED
|
@@ -78,7 +78,17 @@ Evaluated with Leave-One-Source-Out (LOSO) cross-validation — each source doma
|
|
| 78 |
| qualitative_interview | 78 | 0.650 | 0.560 | 0.842 |
|
| 79 |
| **macro-avg** | — | **0.655** | 0.718 | 0.727 |
|
| 80 |
|
| 81 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
|
| 83 |
## Training Data
|
| 84 |
|
|
|
|
| 78 |
| qualitative_interview | 78 | 0.650 | 0.560 | 0.842 |
|
| 79 |
| **macro-avg** | — | **0.655** | 0.718 | 0.727 |
|
| 80 |
|
| 81 |
+
**Model status:** Pilot model — built and actively improved through iterative research phases.
|
| 82 |
+
>
|
| 83 |
+
> **Evaluation methodology:** Leave-One-Source-Out (LOSO) — each source domain is held out entirely
|
| 84 |
+
> during training and evaluated as an unseen genre. This is the headline generalization metric above
|
| 85 |
+
> (macro CLF F1 = 0.724, macro NER F1 = 0.655).
|
| 86 |
+
>
|
| 87 |
+
> We also maintain an internal, evolving suite of curated hard cases (Pidgin, dialect, regulatory
|
| 88 |
+
> register, clinical shorthand, minimal pairs) used to diagnose and target specific model weaknesses
|
| 89 |
+
> during development. It's a diagnostic tool, not a benchmark — we don't publish a fixed pass-rate from
|
| 90 |
+
> it here, since the suite and the model are both still changing, and a fixed percentage risks reading as
|
| 91 |
+
> a settled result rather than a snapshot of an active development target.
|
| 92 |
|
| 93 |
## Training Data
|
| 94 |
|