Model Performance is great!

#8
by bunbohue - opened

Thank you for developing a great Japanese TTS for community. I tested and have some views

Advantages noted:

  1. Accurately pronounces the pitch of homonyms: ๆฉ‹ - ็ฎธ.

  2. Changes the intonation at the end of sentences according to punctuation marks: "!", "~", "?", ".".

  3. Automatically adds appropriate expressive SFX when input includes emoticons (laugh, sigh, etc.).

  4. Clear audio quality, free from background noise.

  5. Natural, native-like voice.

โ†’ Sound quality is better than other TTS models currently in use.

Errors detected during testing:

  1. Incorrect reading of numbers when written in numerals: ใ€Œ๏ผ’๏ผๆญณใ€ is read as ใ€Œใซใ˜ใ‚…ใฃใ•ใ„ใ€ instead of ใ€ŒใฏใŸใกใ€.

  2. Incorrect reading of dates even when written in kanji: ใ€ŒไบŒๆœˆไธ€ๆ—ฅไป˜ใงใ€ is misread.

  3. Unstable voice during mass generation: reference audio is for a female voice but output is a male voice.

  4. Sound changes are not applied when combining words: ใ€Œไธ‰้šŽใ€ is read as ใ€Œใ•ใ‚“ใ‹ใ„ใ€ instead of ใ€Œใ•ใ‚“ใŒใ„ใ€.

  5. Incorrect word reading: ใ€Œ้Š€่กŒใ€ is read as ใ€Œใใ‚“ใ“ใ†ใ€ instead of ใ€ŒใŽใ‚“ใ“ใ†ใ€.

  6. A single kanji character has multiple readings, but TTS does not yet support a mechanism to specify a reading. For example: ใ€Œ่ง’ใ€ is read as ใ€Œใคใฎใ€ while the desired reading is ใ€Œใ‹ใฉใ€; similarly with ใ€Œๅๅˆ†ใ€.

  7. English words are automatically converted to Japanese katakana readings, but there may still be cases where the reading is incorrect.

  8. When reading single words, odd characters, or short sentences without context, TTS may add inappropriate expressions (gasping, cries, etc.). For example: ใ€Œใ‚ใ€, ใ€Œๆฏใ€, ใ€Œใ‚„ใ‚ใฆใใ ใ•ใ„ใ€, ใ€Œๅ…ˆ็”Ÿใ€.

  9. Mispronouncing proper names: ใ€Œ็ง‹ๅฑฑๅ…ˆ็”Ÿใ€ is pronounced ใ€ŒใŠใใ‚„ใพใ›ใ‚“ใ›ใ„ใ€ instead of ใ€Œใ‚ใใ‚„ใพใ›ใ‚“ใ›ใ„ใ€.

  10. When reading a long passage, there may be strange sound effects inserted (audio interruptions, speaker breathing sounds).

Sign up or log in to comment