Text-to-Speech
Spanish
federicocosta1989 commited on
Commit
8066888
·
verified ·
1 Parent(s): 8cccb7b

Update README.md

Browse files

Updated model names, epochs and last results

Files changed (1) hide show
  1. README.md +9 -12
README.md CHANGED
@@ -62,7 +62,7 @@ All samples were resampled to 24kHz.
62
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
63
 
64
  The model in this repository (styletts2-spanish-multispeaker) was [trained from scratch](https://github.com/yl4579/StyleTTS2#training).
65
- Two other models (multispeaker_plbert_subword_asr) were [fine-tuned](https://github.com/yl4579/StyleTTS2#finetuning) for comparison and evaluation.
66
  The [original pitch extractor](https://github.com/yl4579/StyleTTS2#pre-trained-modules) was used for all models.
67
  A Spanish [AuxiliaryASR](https://github.com/yl4579/AuxiliaryASR) was trained as text aligner and used for all models.
68
  [BSC-LT/PL-BERT-wp-es](https://huggingface.co/BSC-LT/PL-BERT-wp-es) was used as prosodic text Encoder for all models.
@@ -70,21 +70,21 @@ A Spanish [AuxiliaryASR](https://github.com/yl4579/AuxiliaryASR) was trained as
70
 
71
  styletts2-spanish-multispeaker was trained from scratch.
72
  The first stage was executed for 99 epochs.
73
- The second stage was executed for 34 epochs.
74
 
75
- multispeaker_plbert_subword_asr was fine-tuned and [yl4579/StyleTTS2-LibriTTS](https://huggingface.co/yl4579/StyleTTS2-LibriTTS) was used as pre-trained model.
76
  The fine-tuning stage was executed for 32 epochs.
77
 
78
- multispeaker_FT_kokoro was fine-tuned and [hexgrad/Kokoro-82M](https://huggingface.co/hexgrad/Kokoro-82M) was used as pre-trained model.
79
  The fine-tuning stage was executed for 79 epochs.
80
 
81
  ### Training Hyperparameters
82
 
83
  styletts2-spanish-multispeaker first stage hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_1st_phase.yml) and second stage hyperparameters [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_2nd_phase.yml).
84
 
85
- multispeaker_plbert_subword_asr fine-tuning hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/2_multispeaker_plbert_subword_asr.yml).
86
 
87
- multispeaker_FT_kokoro fine-tuning hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/3_multispeaker_FT_kokoro.yml).
88
  ## Evaluation
89
 
90
  <!-- This section describes the evaluation protocols and provides the results. -->
@@ -119,12 +119,9 @@ The model in this repository (styletts2-spanish-multispeaker) has been compared
119
 
120
  | Model | UTMOS | DNSMOS Pro BVCC | WER |
121
  |:-----------------------------------------------------:|:-----:|:---------------:|:-----:|
122
- | **styletts2-spanish-multispeaker** | 3.043 | 2.609 | 0.215 |
123
- | FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus| 3.839 | 2.552 | 0.204 |
124
- | FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus | 1.489 | 1.839 | 0.365 |
125
- | PT_asr-es_pl-bert-subword-es_wavlm-base-plus | 3.170 | 2.741 | 0.197 |
126
-
127
-
128
 
129
 
130
  ## Additional Information
 
62
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
63
 
64
  The model in this repository (styletts2-spanish-multispeaker) was [trained from scratch](https://github.com/yl4579/StyleTTS2#training).
65
+ Two other models (FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus and FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus) were [fine-tuned](https://github.com/yl4579/StyleTTS2#finetuning) for comparison and evaluation.
66
  The [original pitch extractor](https://github.com/yl4579/StyleTTS2#pre-trained-modules) was used for all models.
67
  A Spanish [AuxiliaryASR](https://github.com/yl4579/AuxiliaryASR) was trained as text aligner and used for all models.
68
  [BSC-LT/PL-BERT-wp-es](https://huggingface.co/BSC-LT/PL-BERT-wp-es) was used as prosodic text Encoder for all models.
 
70
 
71
  styletts2-spanish-multispeaker was trained from scratch.
72
  The first stage was executed for 99 epochs.
73
+ The second stage was executed for 86 epochs.
74
 
75
+ FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus was fine-tuned and [yl4579/StyleTTS2-LibriTTS](https://huggingface.co/yl4579/StyleTTS2-LibriTTS) was used as pre-trained model.
76
  The fine-tuning stage was executed for 32 epochs.
77
 
78
+ FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus was fine-tuned and [hexgrad/Kokoro-82M](https://huggingface.co/hexgrad/Kokoro-82M) was used as pre-trained model.
79
  The fine-tuning stage was executed for 79 epochs.
80
 
81
  ### Training Hyperparameters
82
 
83
  styletts2-spanish-multispeaker first stage hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_1st_phase.yml) and second stage hyperparameters [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_2nd_phase.yml).
84
 
85
+ FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus fine-tuning hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus.yml).
86
 
87
+ FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus fine-tuning hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus.yml).
88
  ## Evaluation
89
 
90
  <!-- This section describes the evaluation protocols and provides the results. -->
 
119
 
120
  | Model | UTMOS | DNSMOS Pro BVCC | WER |
121
  |:-----------------------------------------------------:|:-----:|:---------------:|:-----:|
122
+ | **styletts2-spanish-multispeaker** | 3.170 | 2.741 | 0.197 |
123
+ | FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus| 3.043 | 2.552 | 0.204 |
124
+ | FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus | 1.569 | 1.918 | 0.390 |
 
 
 
125
 
126
 
127
  ## Additional Information