Update README.md
Browse filesUpdated model names, epochs and last results
README.md
CHANGED
|
@@ -62,7 +62,7 @@ All samples were resampled to 24kHz.
|
|
| 62 |
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
| 63 |
|
| 64 |
The model in this repository (styletts2-spanish-multispeaker) was [trained from scratch](https://github.com/yl4579/StyleTTS2#training).
|
| 65 |
-
Two other models (
|
| 66 |
The [original pitch extractor](https://github.com/yl4579/StyleTTS2#pre-trained-modules) was used for all models.
|
| 67 |
A Spanish [AuxiliaryASR](https://github.com/yl4579/AuxiliaryASR) was trained as text aligner and used for all models.
|
| 68 |
[BSC-LT/PL-BERT-wp-es](https://huggingface.co/BSC-LT/PL-BERT-wp-es) was used as prosodic text Encoder for all models.
|
|
@@ -70,21 +70,21 @@ A Spanish [AuxiliaryASR](https://github.com/yl4579/AuxiliaryASR) was trained as
|
|
| 70 |
|
| 71 |
styletts2-spanish-multispeaker was trained from scratch.
|
| 72 |
The first stage was executed for 99 epochs.
|
| 73 |
-
The second stage was executed for
|
| 74 |
|
| 75 |
-
|
| 76 |
The fine-tuning stage was executed for 32 epochs.
|
| 77 |
|
| 78 |
-
|
| 79 |
The fine-tuning stage was executed for 79 epochs.
|
| 80 |
|
| 81 |
### Training Hyperparameters
|
| 82 |
|
| 83 |
styletts2-spanish-multispeaker first stage hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_1st_phase.yml) and second stage hyperparameters [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_2nd_phase.yml).
|
| 84 |
|
| 85 |
-
|
| 86 |
|
| 87 |
-
|
| 88 |
## Evaluation
|
| 89 |
|
| 90 |
<!-- This section describes the evaluation protocols and provides the results. -->
|
|
@@ -119,12 +119,9 @@ The model in this repository (styletts2-spanish-multispeaker) has been compared
|
|
| 119 |
|
| 120 |
| Model | UTMOS | DNSMOS Pro BVCC | WER |
|
| 121 |
|:-----------------------------------------------------:|:-----:|:---------------:|:-----:|
|
| 122 |
-
| **styletts2-spanish-multispeaker** | 3.
|
| 123 |
-
| FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus| 3.
|
| 124 |
-
| FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus | 1.
|
| 125 |
-
| PT_asr-es_pl-bert-subword-es_wavlm-base-plus | 3.170 | 2.741 | 0.197 |
|
| 126 |
-
|
| 127 |
-
|
| 128 |
|
| 129 |
|
| 130 |
## Additional Information
|
|
|
|
| 62 |
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
| 63 |
|
| 64 |
The model in this repository (styletts2-spanish-multispeaker) was [trained from scratch](https://github.com/yl4579/StyleTTS2#training).
|
| 65 |
+
Two other models (FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus and FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus) were [fine-tuned](https://github.com/yl4579/StyleTTS2#finetuning) for comparison and evaluation.
|
| 66 |
The [original pitch extractor](https://github.com/yl4579/StyleTTS2#pre-trained-modules) was used for all models.
|
| 67 |
A Spanish [AuxiliaryASR](https://github.com/yl4579/AuxiliaryASR) was trained as text aligner and used for all models.
|
| 68 |
[BSC-LT/PL-BERT-wp-es](https://huggingface.co/BSC-LT/PL-BERT-wp-es) was used as prosodic text Encoder for all models.
|
|
|
|
| 70 |
|
| 71 |
styletts2-spanish-multispeaker was trained from scratch.
|
| 72 |
The first stage was executed for 99 epochs.
|
| 73 |
+
The second stage was executed for 86 epochs.
|
| 74 |
|
| 75 |
+
FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus was fine-tuned and [yl4579/StyleTTS2-LibriTTS](https://huggingface.co/yl4579/StyleTTS2-LibriTTS) was used as pre-trained model.
|
| 76 |
The fine-tuning stage was executed for 32 epochs.
|
| 77 |
|
| 78 |
+
FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus was fine-tuned and [hexgrad/Kokoro-82M](https://huggingface.co/hexgrad/Kokoro-82M) was used as pre-trained model.
|
| 79 |
The fine-tuning stage was executed for 79 epochs.
|
| 80 |
|
| 81 |
### Training Hyperparameters
|
| 82 |
|
| 83 |
styletts2-spanish-multispeaker first stage hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_1st_phase.yml) and second stage hyperparameters [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/1_config_styletts2-spanish-multispeaker_2nd_phase.yml).
|
| 84 |
|
| 85 |
+
FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus fine-tuning hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus.yml).
|
| 86 |
|
| 87 |
+
FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus fine-tuning hyperparameters can be found [here](https://huggingface.co/langtech-veu/styletts2-spanish-multispeaker/blob/main/FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus.yml).
|
| 88 |
## Evaluation
|
| 89 |
|
| 90 |
<!-- This section describes the evaluation protocols and provides the results. -->
|
|
|
|
| 119 |
|
| 120 |
| Model | UTMOS | DNSMOS Pro BVCC | WER |
|
| 121 |
|:-----------------------------------------------------:|:-----:|:---------------:|:-----:|
|
| 122 |
+
| **styletts2-spanish-multispeaker** | 3.170 | 2.741 | 0.197 |
|
| 123 |
+
| FT-libri-tts_asr-es_pl-bert-subword-es_wavlm-base-plus| 3.043 | 2.552 | 0.204 |
|
| 124 |
+
| FT-kokoro_asr-es_pl-bert-subword-es_wavlm-base-plus | 1.569 | 1.918 | 0.390 |
|
|
|
|
|
|
|
|
|
|
| 125 |
|
| 126 |
|
| 127 |
## Additional Information
|