erik-at-boson commited on
Commit
6c94da1
·
verified ·
1 Parent(s): 0db2551

Update v2: README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -8
README.md CHANGED
@@ -24,7 +24,7 @@ model-index:
24
  metrics:
25
  - name: Test WER
26
  type: wer
27
- value: 9.47
28
  - task:
29
  name: Automatic Speech Recognition
30
  type: automatic-speech-recognition
@@ -37,7 +37,7 @@ model-index:
37
  metrics:
38
  - name: Test WER
39
  type: wer
40
- value: 10.61
41
  - task:
42
  name: Automatic Speech Recognition
43
  type: automatic-speech-recognition
@@ -50,7 +50,7 @@ model-index:
50
  metrics:
51
  - name: Test WER
52
  type: wer
53
- value: 8.02
54
  - task:
55
  name: Automatic Speech Recognition
56
  type: automatic-speech-recognition
@@ -64,7 +64,7 @@ model-index:
64
  metrics:
65
  - name: Test WER
66
  type: wer
67
- value: 1.43
68
  - task:
69
  name: Automatic Speech Recognition
70
  type: automatic-speech-recognition
@@ -78,7 +78,7 @@ model-index:
78
  metrics:
79
  - name: Test WER
80
  type: wer
81
- value: 2.82
82
  - task:
83
  name: Automatic Speech Recognition
84
  type: automatic-speech-recognition
@@ -92,7 +92,7 @@ model-index:
92
  metrics:
93
  - name: Test WER
94
  type: wer
95
- value: 2.23
96
  - task:
97
  name: Automatic Speech Recognition
98
  type: automatic-speech-recognition
@@ -106,7 +106,7 @@ model-index:
106
  metrics:
107
  - name: Test WER
108
  type: wer
109
- value: 2.32
110
  - task:
111
  name: Automatic Speech Recognition
112
  type: automatic-speech-recognition
@@ -120,13 +120,32 @@ model-index:
120
  metrics:
121
  - name: Test WER
122
  type: wer
123
- value: 5.99
124
  ---
125
 
126
  # Higgs Audio v3 STT
127
 
128
  A speech-to-text model combining a Whisper-Large-v3 encoder with a Qwen3 decoder (2.68B total parameters).
129
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
130
  ## Usage
131
 
132
  **Important:** This model uses a custom architecture. You must pass `trust_remote_code=True` when loading.
 
24
  metrics:
25
  - name: Test WER
26
  type: wer
27
+ value: 7.94
28
  - task:
29
  name: Automatic Speech Recognition
30
  type: automatic-speech-recognition
 
37
  metrics:
38
  - name: Test WER
39
  type: wer
40
+ value: 8.86
41
  - task:
42
  name: Automatic Speech Recognition
43
  type: automatic-speech-recognition
 
50
  metrics:
51
  - name: Test WER
52
  type: wer
53
+ value: 8.16
54
  - task:
55
  name: Automatic Speech Recognition
56
  type: automatic-speech-recognition
 
64
  metrics:
65
  - name: Test WER
66
  type: wer
67
+ value: 1.13
68
  - task:
69
  name: Automatic Speech Recognition
70
  type: automatic-speech-recognition
 
78
  metrics:
79
  - name: Test WER
80
  type: wer
81
+ value: 2.66
82
  - task:
83
  name: Automatic Speech Recognition
84
  type: automatic-speech-recognition
 
92
  metrics:
93
  - name: Test WER
94
  type: wer
95
+ value: 2.15
96
  - task:
97
  name: Automatic Speech Recognition
98
  type: automatic-speech-recognition
 
106
  metrics:
107
  - name: Test WER
108
  type: wer
109
+ value: 2.95
110
  - task:
111
  name: Automatic Speech Recognition
112
  type: automatic-speech-recognition
 
120
  metrics:
121
  - name: Test WER
122
  type: wer
123
+ value: 6.07
124
  ---
125
 
126
  # Higgs Audio v3 STT
127
 
128
  A speech-to-text model combining a Whisper-Large-v3 encoder with a Qwen3 decoder (2.68B total parameters).
129
 
130
+ ## Update (June 2026)
131
+
132
+ This repository now hosts an updated checkpoint (v2 weights). Changes:
133
+
134
+ - Fine-tuning data refreshed: public train splits of AMI (IHM), VoxPopuli (en),
135
+ SPGISpeech, LibriSpeech, TED-LIUM, GigaSpeech, plus the public Earnings22
136
+ train split (`sanchit-gandhi/earnings22_split`) with all rows from source
137
+ recordings that appear in the ESB/Open-ASR test sets excluded.
138
+ - `transcribe.py` adds a phrase-level repetition-loop collapse
139
+ (`ngram_loop_fix.py`) alongside the existing word-repetition cap; both are
140
+ deterministic and applied uniformly to every dataset.
141
+ - The reported WERs below were measured on the complete ESB test suite
142
+ (82,185 utterances) with the Open-ASR-Leaderboard scoring pipeline
143
+ (bundled normalizer + compound-pair normalization), batched inference
144
+ (batch 32, VoxPopuli 16). Earlier reported figures came from a previous
145
+ checkpoint and evaluation setup and are superseded.
146
+
147
+ The previous weights remain available via the git revision history.
148
+
149
  ## Usage
150
 
151
  **Important:** This model uses a custom architecture. You must pass `trust_remote_code=True` when loading.