Text-to-Speech
ONNX
GGUF
tts
speech
audio
indic
multilingual
int8
quantization
edge-ai
vocos
llama-3.2
indic-speak
Instructions to use adidsh/indic-speak-int8-onnx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use adidsh/indic-speak-int8-onnx with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: llama cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: llama cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: ./llama-cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Use Docker
docker model run hf.co/adidsh/indic-speak-int8-onnx:Q5_K_M
- LM Studio
- Jan
- Ollama
How to use adidsh/indic-speak-int8-onnx with Ollama:
ollama run hf.co/adidsh/indic-speak-int8-onnx:Q5_K_M
- Unsloth Desktop
- Docker Model Runner
How to use adidsh/indic-speak-int8-onnx with Docker Model Runner:
docker model run hf.co/adidsh/indic-speak-int8-onnx:Q5_K_M
- Lemonade
How to use adidsh/indic-speak-int8-onnx with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull adidsh/indic-speak-int8-onnx:Q5_K_M
Run and chat with the model
lemonade run user.indic-speak-int8-onnx-Q5_K_M
List all available models
lemonade list
- Atomic Chat
Download metadata/manifest.json from adidsh/indic-speak-int8-onnx: direct link, hf CLI and curl.
- Browser
- Download file 4.52 kB
-
https://huggingface.co/adidsh/indic-speak-int8-onnx/resolve/main/metadata/manifest.json
- Command line
-
hf download hf://adidsh/indic-speak-int8-onnx/metadata/manifest.json
-
curl -L -o manifest.json https://huggingface.co/adidsh/indic-speak-int8-onnx/resolve/main/metadata/manifest.json
4.52 kB
| { | |
| "schema_version": 1, | |
| "model_id": "indic-speak-int8-onnx", | |
| "display_name": "Indic-Speak (INT8 ONNX & GGUF)", | |
| "architecture": "Llama-3.2-3B + Vocos", | |
| "distribution": { | |
| "type": "on_device", | |
| "inference": "local", | |
| "hosted_api": false | |
| }, | |
| "license": { | |
| "name": "Indic Open Model License v1.0", | |
| "upstream": "Bodhan AI / AI4Bharat", | |
| "attribution": "Built with Indic-Speak from Bodhan AI / AI4Bharat." | |
| }, | |
| "languages": [ | |
| "en", | |
| "hi", | |
| "bn", | |
| "mr", | |
| "te", | |
| "ta", | |
| "gu", | |
| "kn", | |
| "ml", | |
| "or", | |
| "pa", | |
| "as", | |
| "ur", | |
| "brx", | |
| "doi", | |
| "kok", | |
| "ks", | |
| "mai", | |
| "ne", | |
| "mni", | |
| "sa", | |
| "sat", | |
| "sd" | |
| ], | |
| "files": [ | |
| { | |
| "path": ".gitattributes", | |
| "size_bytes": 1721, | |
| "sha256": "5f4e81315452d165dca30cec9555e32b3fc6364010035af1ffc70f5ef1147a7d" | |
| }, | |
| { | |
| "path": "LICENSE", | |
| "size_bytes": 25546, | |
| "sha256": "b39f2a9cb2d5ace3a03f4425cbc6db38ebd9a53ab7a7648d67dc1e0998ad75c2" | |
| }, | |
| { | |
| "path": "LICENSE_DEED.md", | |
| "size_bytes": 3565, | |
| "sha256": "5dd97d2327cdd4fc87e974528fee8bbe16420c1fed41f33778be58ab809386a0" | |
| }, | |
| { | |
| "path": "NOTICE.md", | |
| "size_bytes": 2591, | |
| "sha256": "edb5854cba9065c9d8248e88893254fa67e7cbe7a36deb054a9ba27d43127a93" | |
| }, | |
| { | |
| "path": "README.md", | |
| "size_bytes": 10473, | |
| "sha256": "0e6a1c31b96201f86cf187d533fc31b817d8c4bd9cf8eb95ebd1832d2114585f" | |
| }, | |
| { | |
| "path": "banner.png", | |
| "size_bytes": 860281, | |
| "sha256": "ce99496f57b9217a1c6810b7ef1c06ee9e66313ca9475c81d7407f6b9bf22be5" | |
| }, | |
| { | |
| "path": "voices.md", | |
| "size_bytes": 10280, | |
| "sha256": "77b5515e0b429216592a7c9f8822779f30192b6de20059d47390f8c0fd317048" | |
| }, | |
| { | |
| "path": "token_contract.md", | |
| "size_bytes": 8382, | |
| "sha256": "dafd0ccf483b4850c5447013b8d7e522b02209f406e47c554b8136869f0aba89" | |
| }, | |
| { | |
| "path": "inference.py", | |
| "size_bytes": 7939, | |
| "sha256": "9be5d6391bc527a7ac626cb819494f98b486ac6b616e247e9ca74c4cae525ef5" | |
| }, | |
| { | |
| "path": "config/config.json", | |
| "size_bytes": 862, | |
| "sha256": "6d902d2609382ac1f49ef6a42c7f06bd63c4597b1e200e55e2fb688933cf6578" | |
| }, | |
| { | |
| "path": "config/generation_config.json", | |
| "size_bytes": 205, | |
| "sha256": "690a45cdedd4a8a0a318a2b046c646c3e089c1934c2b3bd9eba8aab7523cf493" | |
| }, | |
| { | |
| "path": "config/tokenizer_config.json", | |
| "size_bytes": 373, | |
| "sha256": "d299149aa5531c99445445bc1e6ade526822f70c58dcec924e7583824833e10a" | |
| }, | |
| { | |
| "path": "tokenizer/tokenizer.json", | |
| "size_bytes": 22681215, | |
| "sha256": "645579dd8b7040a2e53808a10e6b5f6961d1b625a6bee768710fdf507465f53f" | |
| }, | |
| { | |
| "path": "tokenizer.json", | |
| "size_bytes": 22681215, | |
| "sha256": "645579dd8b7040a2e53808a10e6b5f6961d1b625a6bee768710fdf507465f53f" | |
| }, | |
| { | |
| "path": "vocos/config.yaml", | |
| "size_bytes": 1144, | |
| "sha256": "d7bf584bccb653560eb06ec7b60e5202a11c0808f558dc83cbbaf1c714eac735" | |
| }, | |
| { | |
| "path": "vocos/best.pt", | |
| "size_bytes": 466966065, | |
| "sha256": "867426748123693b8ca5b26d9b407af158ac0bbae3f140901bc004b7ebc5738d" | |
| }, | |
| { | |
| "path": "vocos/load.py", | |
| "size_bytes": 878, | |
| "sha256": "c53eac936e1d1231accf32f36bc697e185f79fe29af463749f1362d786b22df9" | |
| }, | |
| { | |
| "path": "vocos/model.py", | |
| "size_bytes": 6687, | |
| "sha256": "1526bbb54d51b6f0509283acf7879ef4e59ad6155ff7ae06c62dd1d3079eda7f" | |
| }, | |
| { | |
| "path": "vocos/__init__.py", | |
| "size_bytes": 0, | |
| "sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" | |
| }, | |
| { | |
| "path": "onnx/vocos_backbone_int8.onnx", | |
| "size_bytes": 83713502, | |
| "sha256": "606b89b60c1de29df4aa5c8da7daeb2a1be7120840f7d11bf863945d2220be52" | |
| }, | |
| { | |
| "path": "onnx/vocos_backbone.onnx", | |
| "size_bytes": 233487354, | |
| "sha256": "b848ddf8eb0fd6396a250e9138c63d5cc7d72e1ca315c2495064a1fb8f47b66b" | |
| }, | |
| { | |
| "path": "gguf/indic-speak-q8_0.gguf", | |
| "size_bytes": 3516320704, | |
| "sha256": "cef0adb4f3146da9fa7cb03326e65f7513d1bb8e1baba832a11660817b01ec36" | |
| }, | |
| { | |
| "path": "gguf/indic-speak-q5_k_m.gguf", | |
| "size_bytes": 2395219648, | |
| "sha256": "8e16a52a88713ed4172bc29f1f2a4d3c923dcf5e77fe25b51384a461e6d77b35" | |
| } | |
| ] | |
| } |