AudranB commited on
Commit
0c45fa2
·
verified ·
1 Parent(s): d4d1bf6
Files changed (2) hide show
  1. README.md +9 -6
  2. assets/wer_table.png +0 -0
README.md CHANGED
@@ -45,7 +45,7 @@ model-index:
45
  metrics:
46
  - name: Test WER
47
  type: wer
48
- value: ??
49
  - task:
50
  type: Automatic Speech Recognition
51
  name: automatic-speech-recognition
@@ -59,7 +59,7 @@ model-index:
59
  metrics:
60
  - name: Test WER
61
  type: wer
62
- value: ??
63
  - task:
64
  type: Automatic Speech Recognition
65
  name: automatic-speech-recognition
@@ -73,7 +73,7 @@ model-index:
73
  metrics:
74
  - name: Test WER
75
  type: wer
76
- value: ??
77
  - task:
78
  type: Automatic Speech Recognition
79
  name: automatic-speech-recognition
@@ -87,7 +87,7 @@ model-index:
87
  metrics:
88
  - name: Test WER
89
  type: wer
90
- value: ??
91
  ---
92
  # LinTO STT French – FastConformer
93
 
@@ -109,7 +109,6 @@ This model is a fine-tuned version of the [NVIDIA French FastConformer Hybrid La
109
  It is a large (115M parameters) hybrid ASR model trained with both **Transducer (default)** and **CTC** losses.
110
 
111
  Compared to the base model, this version:
112
- - Does **not** include punctuation or uppercase letters.
113
  - Was trained on **10,000+ hours** of diverse, manually transcribed French speech.
114
  ---
115
 
@@ -130,6 +129,10 @@ Evaluations can be very long (especially for whisper) so we selected only segmen
130
  - Multilingual TEDx: 972 rows (1.5h)
131
  - 50% of our internal Youtube corpus: 956 rows (1h)
132
 
 
 
 
 
133
  ---
134
 
135
  ## Usage
@@ -188,7 +191,7 @@ or be deployed within a microservices infrastructure using a message broker conn
188
  ### Data Setup
189
  - Audios ranging from 0.1s to 30s
190
  - Batch size of 50
191
- - All datasets except YODAS and TouTubeFR were upsampled
192
 
193
  ### Training datasets
194
 
 
45
  metrics:
46
  - name: Test WER
47
  type: wer
48
+ value: 7.88
49
  - task:
50
  type: Automatic Speech Recognition
51
  name: automatic-speech-recognition
 
59
  metrics:
60
  - name: Test WER
61
  type: wer
62
+ value: 4.57
63
  - task:
64
  type: Automatic Speech Recognition
65
  name: automatic-speech-recognition
 
73
  metrics:
74
  - name: Test WER
75
  type: wer
76
+ value: 10.14
77
  - task:
78
  type: Automatic Speech Recognition
79
  name: automatic-speech-recognition
 
87
  metrics:
88
  - name: Test WER
89
  type: wer
90
+ value: 19.8
91
  ---
92
  # LinTO STT French – FastConformer
93
 
 
109
  It is a large (115M parameters) hybrid ASR model trained with both **Transducer (default)** and **CTC** losses.
110
 
111
  Compared to the base model, this version:
 
112
  - Was trained on **10,000+ hours** of diverse, manually transcribed French speech.
113
  ---
114
 
 
129
  - Multilingual TEDx: 972 rows (1.5h)
130
  - 50% of our internal Youtube corpus: 956 rows (1h)
131
 
132
+ ![WER table](https://huggingface.co/linagora/linto_stt_fr_fastconformer_pc/resolve/main/assets/wer_table.png)
133
+
134
+ As shown in the table above (lower is better), the model demonstrates robust performance across all datasets, consistently achieving results close to the best even on the out-of-domain dataset like SUMM-RE.
135
+
136
  ---
137
 
138
  ## Usage
 
191
  ### Data Setup
192
  - Audios ranging from 0.1s to 30s
193
  - Batch size of 50
194
+ - All datasets except YODAS and TouTubeFR were upsampled 2x
195
 
196
  ### Training datasets
197
 
assets/wer_table.png ADDED