How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-to-speech", model="jaeyong2/neutts-air-ko")
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("jaeyong2/neutts-air-ko")
model = AutoModelForCausalLM.from_pretrained("jaeyong2/neutts-air-ko", device_map="auto")
Quick Links

Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

Install info

https://huggingface.co/neuphonic/neutts-air

Example

from neuttsair.neutts import NeuTTSAir
import soundfile as sf

tts = NeuTTSAir(backbone_repo="jaeyong2/neutts-air-ko-preview", backbone_device="cpu", codec_repo="neuphonic/neucodec", codec_device="cpu")
input_text = "ํ•˜๋‚˜๋‹˜์ด ์„ธ์ƒ์„ ์ด์ฒ˜๋Ÿผ ์‚ฌ๋ž‘ํ•˜์‚ฌ ๋…์ƒ์ž๋ฅผ ์ฃผ์…จ์œผ๋‹ˆ ์ด๋Š” ์ €๋ฅผ ๋ฏฟ๋Š” ์ž๋งˆ๋‹ค ๋ฉธ๋ง์น˜ ์•Š๊ณ  ์˜์ƒ์„ ์–ป๊ฒŒ ํ•˜๋ ค ํ•˜์‹ฌ์ด๋‹ˆ๋ผ"

ref_text = "train_000.txt"
ref_audio_path = "train_000.wav"

ref_text = open(ref_text, "r").read().strip()
ref_codes = tts.encode_reference(ref_audio_path)

wav = tts.infer(input_text, ref_codes, ref_text)
sf.write("new.wav", wav, 24000)

ref_audio (Bingsu/zeroth-korean)

jaeyong2/neutts-air-ko result

neuphonic/neutts-air result

License

Acknowledgement

This research is supported by TPU Research Cloud program.

Downloads last month
63
Safetensors
Model size
0.6B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for jaeyong2/neutts-air-ko

Finetuned
(20)
this model
Quantizations
1 model