Instructions to use OuteAI/Llama-OuteTTS-1.0-1B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- OuteTTS
How to use OuteAI/Llama-OuteTTS-1.0-1B-GGUF with OuteTTS:
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use OuteAI/Llama-OuteTTS-1.0-1B-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
Use Docker
docker model run hf.co/OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use OuteAI/Llama-OuteTTS-1.0-1B-GGUF with Ollama:
ollama run hf.co/OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use OuteAI/Llama-OuteTTS-1.0-1B-GGUF with Docker Model Runner:
docker model run hf.co/OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
- Lemonade
How to use OuteAI/Llama-OuteTTS-1.0-1B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull OuteAI/Llama-OuteTTS-1.0-1B-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Llama-OuteTTS-1.0-1B-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
llama-tts
hi,
thank you for sharing this model , can you please tell me what is the correct way to use it with llama-tts , i have used thos commands but without success :
llama-tts -m "D:\tts\OuteTTS\Llama-OuteTTS-1.0-1B-Q8_0.gguf" --tts-speaker-file "D:\tts\OuteTTS\af_heart_5.wav" -p "Hello world"
llama-tts -c 8192 -m Llama-OuteTTS-1.0-1B-Q8_0.gguf -mv WavTokenizer-Large-75-Q5_1.gguf -o D:\tts\OuteTTS\output.wav --tts-speaker-file D:\tts\OuteTTS\en_sample.wav -p "Hello world"
llama-tts -c 8192 -m Llama-OuteTTS-1.0-1B-Q8_0.gguf -mv WavTokenizer-Large-75-Q5_1.gguf -p "Hello world"
it return :
llama_decode: failed to decode, ret = -1
main: llama_decode() failed
Best,
Hi, currently llama.cpp does not have direct support for the new 1.0 version. I've made a WIP PR to add support for the new model: https://github.com/ggml-org/llama.cpp/pull/12794
thank you for your fast replay , so we need to wait :p
Have great day,
Best,