mozilla-foundation/common_voice_17_0
Updated • 3.69k • 49
How to use xbilek25/whisper-medium-en-cv-6.0 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="xbilek25/whisper-medium-en-cv-6.0") # Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("xbilek25/whisper-medium-en-cv-6.0")
model = AutoModelForSpeechSeq2Seq.from_pretrained("xbilek25/whisper-medium-en-cv-6.0", device_map="auto")This model is a fine-tuned version of openai/whisper-medium.en on the Common Voice 17.0 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| No log | 0 | 0 | 2.4185 | 46.5401 |
| 0.7543 | 0.2 | 300 | 0.9822 | 37.0178 |
| 0.3116 | 1.2 | 600 | 0.9713 | 35.2725 |
| 0.124 | 2.2 | 900 | 1.0252 | 34.4152 |
| 0.0523 | 3.2 | 1200 | 1.0789 | 34.4764 |
| 0.0269 | 4.2 | 1500 | 1.1135 | 34.7214 |
Base model
openai/whisper-medium.en