Update v2: README.md
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ model-index:
|
|
| 24 |
metrics:
|
| 25 |
- name: Test WER
|
| 26 |
type: wer
|
| 27 |
-
value:
|
| 28 |
- task:
|
| 29 |
name: Automatic Speech Recognition
|
| 30 |
type: automatic-speech-recognition
|
|
@@ -37,7 +37,7 @@ model-index:
|
|
| 37 |
metrics:
|
| 38 |
- name: Test WER
|
| 39 |
type: wer
|
| 40 |
-
value:
|
| 41 |
- task:
|
| 42 |
name: Automatic Speech Recognition
|
| 43 |
type: automatic-speech-recognition
|
|
@@ -50,7 +50,7 @@ model-index:
|
|
| 50 |
metrics:
|
| 51 |
- name: Test WER
|
| 52 |
type: wer
|
| 53 |
-
value: 8.
|
| 54 |
- task:
|
| 55 |
name: Automatic Speech Recognition
|
| 56 |
type: automatic-speech-recognition
|
|
@@ -64,7 +64,7 @@ model-index:
|
|
| 64 |
metrics:
|
| 65 |
- name: Test WER
|
| 66 |
type: wer
|
| 67 |
-
value: 1.
|
| 68 |
- task:
|
| 69 |
name: Automatic Speech Recognition
|
| 70 |
type: automatic-speech-recognition
|
|
@@ -78,7 +78,7 @@ model-index:
|
|
| 78 |
metrics:
|
| 79 |
- name: Test WER
|
| 80 |
type: wer
|
| 81 |
-
value: 2.
|
| 82 |
- task:
|
| 83 |
name: Automatic Speech Recognition
|
| 84 |
type: automatic-speech-recognition
|
|
@@ -92,7 +92,7 @@ model-index:
|
|
| 92 |
metrics:
|
| 93 |
- name: Test WER
|
| 94 |
type: wer
|
| 95 |
-
value: 2.
|
| 96 |
- task:
|
| 97 |
name: Automatic Speech Recognition
|
| 98 |
type: automatic-speech-recognition
|
|
@@ -106,7 +106,7 @@ model-index:
|
|
| 106 |
metrics:
|
| 107 |
- name: Test WER
|
| 108 |
type: wer
|
| 109 |
-
value: 2.
|
| 110 |
- task:
|
| 111 |
name: Automatic Speech Recognition
|
| 112 |
type: automatic-speech-recognition
|
|
@@ -120,13 +120,32 @@ model-index:
|
|
| 120 |
metrics:
|
| 121 |
- name: Test WER
|
| 122 |
type: wer
|
| 123 |
-
value:
|
| 124 |
---
|
| 125 |
|
| 126 |
# Higgs Audio v3 STT
|
| 127 |
|
| 128 |
A speech-to-text model combining a Whisper-Large-v3 encoder with a Qwen3 decoder (2.68B total parameters).
|
| 129 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 130 |
## Usage
|
| 131 |
|
| 132 |
**Important:** This model uses a custom architecture. You must pass `trust_remote_code=True` when loading.
|
|
|
|
| 24 |
metrics:
|
| 25 |
- name: Test WER
|
| 26 |
type: wer
|
| 27 |
+
value: 7.94
|
| 28 |
- task:
|
| 29 |
name: Automatic Speech Recognition
|
| 30 |
type: automatic-speech-recognition
|
|
|
|
| 37 |
metrics:
|
| 38 |
- name: Test WER
|
| 39 |
type: wer
|
| 40 |
+
value: 8.86
|
| 41 |
- task:
|
| 42 |
name: Automatic Speech Recognition
|
| 43 |
type: automatic-speech-recognition
|
|
|
|
| 50 |
metrics:
|
| 51 |
- name: Test WER
|
| 52 |
type: wer
|
| 53 |
+
value: 8.16
|
| 54 |
- task:
|
| 55 |
name: Automatic Speech Recognition
|
| 56 |
type: automatic-speech-recognition
|
|
|
|
| 64 |
metrics:
|
| 65 |
- name: Test WER
|
| 66 |
type: wer
|
| 67 |
+
value: 1.13
|
| 68 |
- task:
|
| 69 |
name: Automatic Speech Recognition
|
| 70 |
type: automatic-speech-recognition
|
|
|
|
| 78 |
metrics:
|
| 79 |
- name: Test WER
|
| 80 |
type: wer
|
| 81 |
+
value: 2.66
|
| 82 |
- task:
|
| 83 |
name: Automatic Speech Recognition
|
| 84 |
type: automatic-speech-recognition
|
|
|
|
| 92 |
metrics:
|
| 93 |
- name: Test WER
|
| 94 |
type: wer
|
| 95 |
+
value: 2.15
|
| 96 |
- task:
|
| 97 |
name: Automatic Speech Recognition
|
| 98 |
type: automatic-speech-recognition
|
|
|
|
| 106 |
metrics:
|
| 107 |
- name: Test WER
|
| 108 |
type: wer
|
| 109 |
+
value: 2.95
|
| 110 |
- task:
|
| 111 |
name: Automatic Speech Recognition
|
| 112 |
type: automatic-speech-recognition
|
|
|
|
| 120 |
metrics:
|
| 121 |
- name: Test WER
|
| 122 |
type: wer
|
| 123 |
+
value: 6.07
|
| 124 |
---
|
| 125 |
|
| 126 |
# Higgs Audio v3 STT
|
| 127 |
|
| 128 |
A speech-to-text model combining a Whisper-Large-v3 encoder with a Qwen3 decoder (2.68B total parameters).
|
| 129 |
|
| 130 |
+
## Update (June 2026)
|
| 131 |
+
|
| 132 |
+
This repository now hosts an updated checkpoint (v2 weights). Changes:
|
| 133 |
+
|
| 134 |
+
- Fine-tuning data refreshed: public train splits of AMI (IHM), VoxPopuli (en),
|
| 135 |
+
SPGISpeech, LibriSpeech, TED-LIUM, GigaSpeech, plus the public Earnings22
|
| 136 |
+
train split (`sanchit-gandhi/earnings22_split`) with all rows from source
|
| 137 |
+
recordings that appear in the ESB/Open-ASR test sets excluded.
|
| 138 |
+
- `transcribe.py` adds a phrase-level repetition-loop collapse
|
| 139 |
+
(`ngram_loop_fix.py`) alongside the existing word-repetition cap; both are
|
| 140 |
+
deterministic and applied uniformly to every dataset.
|
| 141 |
+
- The reported WERs below were measured on the complete ESB test suite
|
| 142 |
+
(82,185 utterances) with the Open-ASR-Leaderboard scoring pipeline
|
| 143 |
+
(bundled normalizer + compound-pair normalization), batched inference
|
| 144 |
+
(batch 32, VoxPopuli 16). Earlier reported figures came from a previous
|
| 145 |
+
checkpoint and evaluation setup and are superseded.
|
| 146 |
+
|
| 147 |
+
The previous weights remain available via the git revision history.
|
| 148 |
+
|
| 149 |
## Usage
|
| 150 |
|
| 151 |
**Important:** This model uses a custom architecture. You must pass `trust_remote_code=True` when loading.
|