eugeneseo commited on
Commit
b05ba01
·
verified ·
1 Parent(s): ad9a236

Refresh README from repo-side eval metrics

Browse files
Files changed (1) hide show
  1. README.md +4 -11
README.md CHANGED
@@ -91,21 +91,14 @@ unfiltered results should be reported separately.
91
 
92
  | Dataset | Split | Setting | Num examples | WER | CER | Notes |
93
  |---|---|---|---:|---:|---:|---|
94
- | FLEURS | dev | filtered | TBD | TBD | TBD | Standalone eval pending |
95
  | FLEURS | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
96
- | FLEURS | test | filtered | TBD | TBD | TBD | Standalone eval pending |
97
  | FLEURS | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
98
- | Zambezi | dev | filtered | TBD | TBD | TBD | Standalone eval pending |
99
  | Zambezi | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
100
- | Zambezi | test | filtered | TBD | TBD | TBD | Standalone eval pending |
101
  | Zambezi | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
102
-
103
- Detailed JSON metrics can be stored under:
104
-
105
- ```text
106
- eval/
107
- ```
108
-
109
  ## Files in this repository
110
 
111
  - Model weights and config: repository root
 
91
 
92
  | Dataset | Split | Setting | Num examples | WER | CER | Notes |
93
  |---|---|---|---:|---:|---:|---|
94
+ | FLEURS | dev | filtered | 305 | 0.4926 | 0.1616 | Filtered to 30 seconds |
95
  | FLEURS | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
96
+ | FLEURS | test | filtered | 745 | 0.4786 | 0.1499 | Filtered to 30 seconds |
97
  | FLEURS | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
98
+ | Zambezi | dev | filtered | 613 | 0.6119 | 0.1901 | Filtered to 30 seconds |
99
  | Zambezi | dev | unfiltered | TBD | TBD | TBD | Standalone eval pending |
100
+ | Zambezi | test | filtered | 427 | 0.5946 | 0.1535 | Filtered to 30 seconds |
101
  | Zambezi | test | unfiltered | TBD | TBD | TBD | Standalone eval pending |
 
 
 
 
 
 
 
102
  ## Files in this repository
103
 
104
  - Model weights and config: repository root