Refresh README from repo-side eval metrics
Browse files
README.md
CHANGED
|
@@ -91,21 +91,14 @@ unfiltered results should be reported separately.
|
|
| 91 |
|
| 92 |
| Dataset | Split | Setting | Num examples | WER | CER | Notes |
|
| 93 |
|---|---|---|---:|---:|---:|---|
|
| 94 |
-
| FLEURS | dev | filtered |
|
| 95 |
| FLEURS | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 96 |
-
| FLEURS | test | filtered |
|
| 97 |
| FLEURS | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 98 |
-
| Zambezi | dev | filtered |
|
| 99 |
| Zambezi | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 100 |
-
| Zambezi | test | filtered |
|
| 101 |
| Zambezi | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 102 |
-
|
| 103 |
-
Detailed JSON metrics can be stored under:
|
| 104 |
-
|
| 105 |
-
```text
|
| 106 |
-
eval/
|
| 107 |
-
```
|
| 108 |
-
|
| 109 |
## Files in this repository
|
| 110 |
|
| 111 |
- Model weights and config: repository root
|
|
|
|
| 91 |
|
| 92 |
| Dataset | Split | Setting | Num examples | WER | CER | Notes |
|
| 93 |
|---|---|---|---:|---:|---:|---|
|
| 94 |
+
| FLEURS | dev | filtered | 305 | 0.4926 | 0.1616 | Filtered to 30 seconds |
|
| 95 |
| FLEURS | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 96 |
+
| FLEURS | test | filtered | 745 | 0.4786 | 0.1499 | Filtered to 30 seconds |
|
| 97 |
| FLEURS | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 98 |
+
| Zambezi | dev | filtered | 613 | 0.6119 | 0.1901 | Filtered to 30 seconds |
|
| 99 |
| Zambezi | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
| 100 |
+
| Zambezi | test | filtered | 427 | 0.5946 | 0.1535 | Filtered to 30 seconds |
|
| 101 |
| Zambezi | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 102 |
## Files in this repository
|
| 103 |
|
| 104 |
- Model weights and config: repository root
|