pluttodk commited on
Commit
df2e6bc
·
verified ·
1 Parent(s): 417c252

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -45
README.md CHANGED
@@ -13,14 +13,13 @@ tags:
13
  - streaming
14
  datasets:
15
  - alexandrainst/coral
16
- - mozilla-foundation/common_voice_17_0
17
  library_name: transformers
18
  pipeline_tag: automatic-speech-recognition
19
  metrics:
20
  - wer
21
  - cer
22
  model-index:
23
- - name: hvisketiske-v2
24
  results:
25
  - task:
26
  type: automatic-speech-recognition
@@ -38,9 +37,9 @@ model-index:
38
  name: CER
39
  ---
40
 
41
- # hvisketiske-v2: Danish ASR Model
42
 
43
- **hvisketiske-v2** is a state-of-the-art Danish automatic speech recognition (ASR) model based on [Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B), finetuned on the [CoRal v2 dataset](https://huggingface.co/datasets/alexandrainst/coral) for improved Danish transcription accuracy.
44
 
45
  ## Key Highlights
46
 
@@ -51,13 +50,13 @@ model-index:
51
  | **Real-Time Factor** | 0.086 (45% faster than Whisper v3) |
52
  | **Model Size** | ~1.7B parameters |
53
 
54
- ### Inherited Features from Qwen3-ASR
55
 
56
  - **Streaming/Real-time transcription** via vLLM backend
57
- - **Singing detection** - can transcribe singing voice and songs with BGM
58
  - **Word-level timestamps** via forced alignment
59
  - **30+ language support** (Danish optimized)
60
- - **Long audio support** - up to 20 minutes per request
61
 
62
  ---
63
 
@@ -67,7 +66,7 @@ model-index:
67
 
68
  | Model | WER | CER | RTF | Throughput | Parameters |
69
  |-------|-----|-----|-----|------------|------------|
70
- | **hvisketiske-v2** | **18.47%** | **7.86%** | **0.086** | 1.71 samples/s | ~1.7B |
71
  | hviske-v3 (Whisper Large v3) | 21.47% | 8.79% | 0.156 | 0.94 samples/s | ~2B |
72
 
73
  **Improvements over Whisper Large v3:**
@@ -99,7 +98,7 @@ from qwen_asr import Qwen3ASRModel
99
 
100
  # Load the model
101
  model = Qwen3ASRModel.from_pretrained(
102
- "pluttodk/hvisketiske-v2",
103
  dtype="bfloat16",
104
  device_map="cuda:0",
105
  )
@@ -125,7 +124,7 @@ Process multiple audio files efficiently in a single call:
125
  from qwen_asr import Qwen3ASRModel
126
 
127
  model = Qwen3ASRModel.from_pretrained(
128
- "pluttodk/hvisketiske-v2",
129
  dtype="bfloat16",
130
  device_map="cuda:0",
131
  max_inference_batch_size=16, # Process up to 16 files at once
@@ -150,7 +149,7 @@ Get word-level timestamps using the forced aligner:
150
  from qwen_asr import Qwen3ASRModel
151
 
152
  model = Qwen3ASRModel.from_pretrained(
153
- "pluttodk/hvisketiske-v2",
154
  forced_aligner="Qwen/Qwen3-ForcedAligner-0.6B",
155
  dtype="bfloat16",
156
  device_map="cuda:0",
@@ -176,7 +175,7 @@ from qwen_asr import Qwen3ASRModel
176
 
177
  # Initialize with vLLM backend for streaming
178
  model = Qwen3ASRModel.LLM(
179
- model="pluttodk/hvisketiske-v2",
180
  gpu_memory_utilization=0.8,
181
  )
182
 
@@ -215,13 +214,13 @@ import librosa
215
 
216
  # Load model and processor
217
  model = AutoModel.from_pretrained(
218
- "pluttodk/hvisketiske-v2",
219
  trust_remote_code=True,
220
  torch_dtype=torch.bfloat16,
221
  device_map="cuda:0",
222
  )
223
  processor = AutoProcessor.from_pretrained(
224
- "pluttodk/hvisketiske-v2",
225
  trust_remote_code=True,
226
  )
227
 
@@ -262,7 +261,7 @@ The model inherits Qwen3-ASR's ability to handle singing and background music:
262
  from qwen_asr import Qwen3ASRModel
263
 
264
  model = Qwen3ASRModel.from_pretrained(
265
- "pluttodk/hvisketiske-v2",
266
  dtype="bfloat16",
267
  device_map="cuda:0",
268
  )
@@ -282,7 +281,7 @@ print(results[0].text)
282
 
283
  ### Model Description
284
 
285
- hvisketiske-v2 is a Danish-specialized automatic speech recognition model created by finetuning [Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B) on the [CoRal v2 dataset](https://huggingface.co/datasets/alexandrainst/coral). The model achieves state-of-the-art performance on Danish speech recognition while maintaining fast inference speeds.
286
 
287
  - **Developed by:** Mathias Oliver Valdbjørn Rønnelund
288
  - **Model type:** Encoder-decoder speech recognition model
@@ -366,45 +365,22 @@ Evaluated on the CoRal v2 test split:
366
 
367
  | Model | WER | CER | RTF | Throughput |
368
  |-------|-----|-----|-----|------------|
369
- | **hvisketiske-v2** | **18.47%** | **7.86%** | **0.086** | 1.71 samples/sec |
370
  | hviske-v3 (Whisper v3) | 21.47% | 8.79% | 0.156 | 0.94 samples/sec |
371
 
372
  ---
373
 
374
- ## Limitations
375
-
376
- - **Language:** Optimized for Danish; other languages may have degraded performance compared to base Qwen3-ASR
377
- - **Audio quality:** Best results with clear speech; noisy environments may affect accuracy
378
- - **Domain:** Trained on CoRal v2 which is primarily conversational/read-aloud speech; specialized domains (medical, legal, technical) may have higher error rates
379
- - **Streaming:** Real-time streaming requires vLLM backend installation
380
-
381
- ## Intended Use
382
-
383
- ### Primary Use Cases
384
- - Danish speech-to-text transcription
385
- - Subtitle generation for Danish content
386
- - Voice assistant backends
387
- - Meeting transcription
388
- - Accessibility applications
389
-
390
- ### Out-of-Scope Use
391
- - Non-Danish languages (use base Qwen3-ASR instead)
392
- - Real-time speaker diarization (not supported)
393
- - Emotion/sentiment detection from speech
394
-
395
- ---
396
-
397
  ## Citation
398
 
399
  If you use this model, please cite:
400
 
401
  ```bibtex
402
- @misc{hvisketiske-v2,
403
  author = {Rønnelund, Mathias Oliver Valdbjørn},
404
- title = {hvisketiske-v2: Danish ASR Model based on Qwen3-ASR},
405
  year = {2025},
406
  publisher = {HuggingFace},
407
- url = {https://huggingface.co/pluttodk/hvisketiske-v2}
408
  }
409
  ```
410
 
@@ -430,5 +406,5 @@ Also consider citing the base model and dataset:
430
 
431
  ## Acknowledgements
432
 
433
- - [Qwen Team](https://github.com/QwenLM) for the excellent Qwen3-ASR base model
434
- - [Alexandra Institute](https://alexandra.dk/) for the CoRal v2 Danish speech corpus
 
13
  - streaming
14
  datasets:
15
  - alexandrainst/coral
 
16
  library_name: transformers
17
  pipeline_tag: automatic-speech-recognition
18
  metrics:
19
  - wer
20
  - cer
21
  model-index:
22
+ - name: milo-asr
23
  results:
24
  - task:
25
  type: automatic-speech-recognition
 
37
  name: CER
38
  ---
39
 
40
+ # Milo-ASR: Dansk ASR Model
41
 
42
+ **Milo-ASR** er en "state of the art" Dansk automatic speech recognition (ASR) model baseret [Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B), finetuned [CoRal v2 dataset](https://huggingface.co/datasets/alexandrainst/coral) for at gøre den bedre til at forstå dansk.
43
 
44
  ## Key Highlights
45
 
 
50
  | **Real-Time Factor** | 0.086 (45% faster than Whisper v3) |
51
  | **Model Size** | ~1.7B parameters |
52
 
53
+ ### Fordele nedarvet fra Qwen3-ASR
54
 
55
  - **Streaming/Real-time transcription** via vLLM backend
56
+ - **Sang detection** - Til at kunne transskribere teksten fra lyde med baggrundsmusik (find ud af hvad Rasmus seebach synger 🤣)
57
  - **Word-level timestamps** via forced alignment
58
  - **30+ language support** (Danish optimized)
59
+ - **20 minutter pr. request** - Kan kører 20 minutter igennem pr. kald
60
 
61
  ---
62
 
 
66
 
67
  | Model | WER | CER | RTF | Throughput | Parameters |
68
  |-------|-----|-----|-----|------------|------------|
69
+ | **Milo-ASR** | **18.47%** | **7.86%** | **0.086** | 1.71 samples/s | ~1.7B |
70
  | hviske-v3 (Whisper Large v3) | 21.47% | 8.79% | 0.156 | 0.94 samples/s | ~2B |
71
 
72
  **Improvements over Whisper Large v3:**
 
98
 
99
  # Load the model
100
  model = Qwen3ASRModel.from_pretrained(
101
+ "pluttodk/Milo-ASR",
102
  dtype="bfloat16",
103
  device_map="cuda:0",
104
  )
 
124
  from qwen_asr import Qwen3ASRModel
125
 
126
  model = Qwen3ASRModel.from_pretrained(
127
+ "pluttodk/Milo-ASR",
128
  dtype="bfloat16",
129
  device_map="cuda:0",
130
  max_inference_batch_size=16, # Process up to 16 files at once
 
149
  from qwen_asr import Qwen3ASRModel
150
 
151
  model = Qwen3ASRModel.from_pretrained(
152
+ "pluttodk/Milo-ASR",
153
  forced_aligner="Qwen/Qwen3-ForcedAligner-0.6B",
154
  dtype="bfloat16",
155
  device_map="cuda:0",
 
175
 
176
  # Initialize with vLLM backend for streaming
177
  model = Qwen3ASRModel.LLM(
178
+ model="pluttodk/Milo-ASR",
179
  gpu_memory_utilization=0.8,
180
  )
181
 
 
214
 
215
  # Load model and processor
216
  model = AutoModel.from_pretrained(
217
+ "pluttodk/Milo-ASR",
218
  trust_remote_code=True,
219
  torch_dtype=torch.bfloat16,
220
  device_map="cuda:0",
221
  )
222
  processor = AutoProcessor.from_pretrained(
223
+ "pluttodk/Milo-ASR",
224
  trust_remote_code=True,
225
  )
226
 
 
261
  from qwen_asr import Qwen3ASRModel
262
 
263
  model = Qwen3ASRModel.from_pretrained(
264
+ "pluttodk/Milo-ASR",
265
  dtype="bfloat16",
266
  device_map="cuda:0",
267
  )
 
281
 
282
  ### Model Description
283
 
284
+ Milo-ASR is a Danish-specialized automatic speech recognition model created by finetuning [Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Qwen3-ASR-1.7B) on the [CoRal v2 dataset](https://huggingface.co/datasets/alexandrainst/coral). The model achieves state-of-the-art performance on Danish speech recognition while maintaining fast inference speeds.
285
 
286
  - **Developed by:** Mathias Oliver Valdbjørn Rønnelund
287
  - **Model type:** Encoder-decoder speech recognition model
 
365
 
366
  | Model | WER | CER | RTF | Throughput |
367
  |-------|-----|-----|-----|------------|
368
+ | **Milo-ASR** | **18.47%** | **7.86%** | **0.086** | 1.71 samples/sec |
369
  | hviske-v3 (Whisper v3) | 21.47% | 8.79% | 0.156 | 0.94 samples/sec |
370
 
371
  ---
372
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
373
  ## Citation
374
 
375
  If you use this model, please cite:
376
 
377
  ```bibtex
378
+ @misc{Milo-ASR,
379
  author = {Rønnelund, Mathias Oliver Valdbjørn},
380
+ title = {Milo-ASR: Danish ASR Model based on Qwen3-ASR},
381
  year = {2025},
382
  publisher = {HuggingFace},
383
+ url = {https://huggingface.co/pluttodk/Milo-ASR}
384
  }
385
  ```
386
 
 
406
 
407
  ## Acknowledgements
408
 
409
+ - [Qwen Team](https://github.com/QwenLM) for Qwen3-ASR base model
410
+ - [Alexandra Institute](https://alexandra.dk/) for CoRal v2 lyd corpus