Automatic Speech Recognition
NeMo
PyTorch
French
speech
audio
Transducer
FastConformer
CTC
Transformer
NeMo
Eval Results (legacy)
Instructions to use linagora/linto_stt_fr_fastconformer_pc with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use linagora/linto_stt_fr_fastconformer_pc with NeMo:
import nemo.collections.asr as nemo_asr asr_model = nemo_asr.models.ASRModel.from_pretrained("linagora/linto_stt_fr_fastconformer_pc") transcriptions = asr_model.transcribe(["file.wav"]) - Notebooks
- Google Colab
- Kaggle
add wer
Browse files- README.md +9 -6
- assets/wer_table.png +0 -0
README.md
CHANGED
|
@@ -45,7 +45,7 @@ model-index:
|
|
| 45 |
metrics:
|
| 46 |
- name: Test WER
|
| 47 |
type: wer
|
| 48 |
-
value:
|
| 49 |
- task:
|
| 50 |
type: Automatic Speech Recognition
|
| 51 |
name: automatic-speech-recognition
|
|
@@ -59,7 +59,7 @@ model-index:
|
|
| 59 |
metrics:
|
| 60 |
- name: Test WER
|
| 61 |
type: wer
|
| 62 |
-
value:
|
| 63 |
- task:
|
| 64 |
type: Automatic Speech Recognition
|
| 65 |
name: automatic-speech-recognition
|
|
@@ -73,7 +73,7 @@ model-index:
|
|
| 73 |
metrics:
|
| 74 |
- name: Test WER
|
| 75 |
type: wer
|
| 76 |
-
value:
|
| 77 |
- task:
|
| 78 |
type: Automatic Speech Recognition
|
| 79 |
name: automatic-speech-recognition
|
|
@@ -87,7 +87,7 @@ model-index:
|
|
| 87 |
metrics:
|
| 88 |
- name: Test WER
|
| 89 |
type: wer
|
| 90 |
-
value:
|
| 91 |
---
|
| 92 |
# LinTO STT French – FastConformer
|
| 93 |
|
|
@@ -109,7 +109,6 @@ This model is a fine-tuned version of the [NVIDIA French FastConformer Hybrid La
|
|
| 109 |
It is a large (115M parameters) hybrid ASR model trained with both **Transducer (default)** and **CTC** losses.
|
| 110 |
|
| 111 |
Compared to the base model, this version:
|
| 112 |
-
- Does **not** include punctuation or uppercase letters.
|
| 113 |
- Was trained on **10,000+ hours** of diverse, manually transcribed French speech.
|
| 114 |
---
|
| 115 |
|
|
@@ -130,6 +129,10 @@ Evaluations can be very long (especially for whisper) so we selected only segmen
|
|
| 130 |
- Multilingual TEDx: 972 rows (1.5h)
|
| 131 |
- 50% of our internal Youtube corpus: 956 rows (1h)
|
| 132 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 133 |
---
|
| 134 |
|
| 135 |
## Usage
|
|
@@ -188,7 +191,7 @@ or be deployed within a microservices infrastructure using a message broker conn
|
|
| 188 |
### Data Setup
|
| 189 |
- Audios ranging from 0.1s to 30s
|
| 190 |
- Batch size of 50
|
| 191 |
-
- All datasets except YODAS and TouTubeFR were upsampled
|
| 192 |
|
| 193 |
### Training datasets
|
| 194 |
|
|
|
|
| 45 |
metrics:
|
| 46 |
- name: Test WER
|
| 47 |
type: wer
|
| 48 |
+
value: 7.88
|
| 49 |
- task:
|
| 50 |
type: Automatic Speech Recognition
|
| 51 |
name: automatic-speech-recognition
|
|
|
|
| 59 |
metrics:
|
| 60 |
- name: Test WER
|
| 61 |
type: wer
|
| 62 |
+
value: 4.57
|
| 63 |
- task:
|
| 64 |
type: Automatic Speech Recognition
|
| 65 |
name: automatic-speech-recognition
|
|
|
|
| 73 |
metrics:
|
| 74 |
- name: Test WER
|
| 75 |
type: wer
|
| 76 |
+
value: 10.14
|
| 77 |
- task:
|
| 78 |
type: Automatic Speech Recognition
|
| 79 |
name: automatic-speech-recognition
|
|
|
|
| 87 |
metrics:
|
| 88 |
- name: Test WER
|
| 89 |
type: wer
|
| 90 |
+
value: 19.8
|
| 91 |
---
|
| 92 |
# LinTO STT French – FastConformer
|
| 93 |
|
|
|
|
| 109 |
It is a large (115M parameters) hybrid ASR model trained with both **Transducer (default)** and **CTC** losses.
|
| 110 |
|
| 111 |
Compared to the base model, this version:
|
|
|
|
| 112 |
- Was trained on **10,000+ hours** of diverse, manually transcribed French speech.
|
| 113 |
---
|
| 114 |
|
|
|
|
| 129 |
- Multilingual TEDx: 972 rows (1.5h)
|
| 130 |
- 50% of our internal Youtube corpus: 956 rows (1h)
|
| 131 |
|
| 132 |
+

|
| 133 |
+
|
| 134 |
+
As shown in the table above (lower is better), the model demonstrates robust performance across all datasets, consistently achieving results close to the best even on the out-of-domain dataset like SUMM-RE.
|
| 135 |
+
|
| 136 |
---
|
| 137 |
|
| 138 |
## Usage
|
|
|
|
| 191 |
### Data Setup
|
| 192 |
- Audios ranging from 0.1s to 30s
|
| 193 |
- Batch size of 50
|
| 194 |
+
- All datasets except YODAS and TouTubeFR were upsampled 2x
|
| 195 |
|
| 196 |
### Training datasets
|
| 197 |
|
assets/wer_table.png
ADDED
|