Text-to-Speech
ONNX
GGUF
tts
speech
audio
indic
multilingual
int8
quantization
edge-ai
vocos
llama-3.2
indic-speak
Instructions to use adidsh/indic-speak-int8-onnx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use adidsh/indic-speak-int8-onnx with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: llama cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: llama cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: ./llama-cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf adidsh/indic-speak-int8-onnx:Q5_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf adidsh/indic-speak-int8-onnx:Q5_K_M
Use Docker
docker model run hf.co/adidsh/indic-speak-int8-onnx:Q5_K_M
- LM Studio
- Jan
- Ollama
How to use adidsh/indic-speak-int8-onnx with Ollama:
ollama run hf.co/adidsh/indic-speak-int8-onnx:Q5_K_M
- Unsloth Desktop
- Docker Model Runner
How to use adidsh/indic-speak-int8-onnx with Docker Model Runner:
docker model run hf.co/adidsh/indic-speak-int8-onnx:Q5_K_M
- Lemonade
How to use adidsh/indic-speak-int8-onnx with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull adidsh/indic-speak-int8-onnx:Q5_K_M
Run and chat with the model
lemonade run user.indic-speak-int8-onnx-Q5_K_M
List all available models
lemonade list
- Atomic Chat
Upload metadata/manifest.json
Browse files- metadata/manifest.json +158 -0
metadata/manifest.json
ADDED
|
@@ -0,0 +1,158 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": 1,
|
| 3 |
+
"model_id": "indic-speak-int8-onnx",
|
| 4 |
+
"display_name": "Indic-Speak (INT8 ONNX & GGUF)",
|
| 5 |
+
"architecture": "Llama-3.2-3B + Vocos",
|
| 6 |
+
"distribution": {
|
| 7 |
+
"type": "on_device",
|
| 8 |
+
"inference": "local",
|
| 9 |
+
"hosted_api": false
|
| 10 |
+
},
|
| 11 |
+
"license": {
|
| 12 |
+
"name": "Indic Open Model License v1.0",
|
| 13 |
+
"upstream": "Bodhan AI / AI4Bharat",
|
| 14 |
+
"attribution": "Built with Indic-Speak from Bodhan AI / AI4Bharat."
|
| 15 |
+
},
|
| 16 |
+
"languages": [
|
| 17 |
+
"en",
|
| 18 |
+
"hi",
|
| 19 |
+
"bn",
|
| 20 |
+
"mr",
|
| 21 |
+
"te",
|
| 22 |
+
"ta",
|
| 23 |
+
"gu",
|
| 24 |
+
"kn",
|
| 25 |
+
"ml",
|
| 26 |
+
"or",
|
| 27 |
+
"pa",
|
| 28 |
+
"as",
|
| 29 |
+
"ur",
|
| 30 |
+
"brx",
|
| 31 |
+
"doi",
|
| 32 |
+
"kok",
|
| 33 |
+
"ks",
|
| 34 |
+
"mai",
|
| 35 |
+
"ne",
|
| 36 |
+
"mni",
|
| 37 |
+
"sa",
|
| 38 |
+
"sat",
|
| 39 |
+
"sd"
|
| 40 |
+
],
|
| 41 |
+
"files": [
|
| 42 |
+
{
|
| 43 |
+
"path": ".gitattributes",
|
| 44 |
+
"size_bytes": 1721,
|
| 45 |
+
"sha256": "5f4e81315452d165dca30cec9555e32b3fc6364010035af1ffc70f5ef1147a7d"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"path": "LICENSE",
|
| 49 |
+
"size_bytes": 25546,
|
| 50 |
+
"sha256": "b39f2a9cb2d5ace3a03f4425cbc6db38ebd9a53ab7a7648d67dc1e0998ad75c2"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"path": "LICENSE_DEED.md",
|
| 54 |
+
"size_bytes": 3565,
|
| 55 |
+
"sha256": "5dd97d2327cdd4fc87e974528fee8bbe16420c1fed41f33778be58ab809386a0"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"path": "NOTICE.md",
|
| 59 |
+
"size_bytes": 2591,
|
| 60 |
+
"sha256": "edb5854cba9065c9d8248e88893254fa67e7cbe7a36deb054a9ba27d43127a93"
|
| 61 |
+
},
|
| 62 |
+
{
|
| 63 |
+
"path": "README.md",
|
| 64 |
+
"size_bytes": 10473,
|
| 65 |
+
"sha256": "0e6a1c31b96201f86cf187d533fc31b817d8c4bd9cf8eb95ebd1832d2114585f"
|
| 66 |
+
},
|
| 67 |
+
{
|
| 68 |
+
"path": "banner.png",
|
| 69 |
+
"size_bytes": 860281,
|
| 70 |
+
"sha256": "ce99496f57b9217a1c6810b7ef1c06ee9e66313ca9475c81d7407f6b9bf22be5"
|
| 71 |
+
},
|
| 72 |
+
{
|
| 73 |
+
"path": "voices.md",
|
| 74 |
+
"size_bytes": 10280,
|
| 75 |
+
"sha256": "77b5515e0b429216592a7c9f8822779f30192b6de20059d47390f8c0fd317048"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"path": "token_contract.md",
|
| 79 |
+
"size_bytes": 8382,
|
| 80 |
+
"sha256": "dafd0ccf483b4850c5447013b8d7e522b02209f406e47c554b8136869f0aba89"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"path": "inference.py",
|
| 84 |
+
"size_bytes": 7939,
|
| 85 |
+
"sha256": "9be5d6391bc527a7ac626cb819494f98b486ac6b616e247e9ca74c4cae525ef5"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"path": "config/config.json",
|
| 89 |
+
"size_bytes": 862,
|
| 90 |
+
"sha256": "6d902d2609382ac1f49ef6a42c7f06bd63c4597b1e200e55e2fb688933cf6578"
|
| 91 |
+
},
|
| 92 |
+
{
|
| 93 |
+
"path": "config/generation_config.json",
|
| 94 |
+
"size_bytes": 205,
|
| 95 |
+
"sha256": "690a45cdedd4a8a0a318a2b046c646c3e089c1934c2b3bd9eba8aab7523cf493"
|
| 96 |
+
},
|
| 97 |
+
{
|
| 98 |
+
"path": "config/tokenizer_config.json",
|
| 99 |
+
"size_bytes": 373,
|
| 100 |
+
"sha256": "d299149aa5531c99445445bc1e6ade526822f70c58dcec924e7583824833e10a"
|
| 101 |
+
},
|
| 102 |
+
{
|
| 103 |
+
"path": "tokenizer/tokenizer.json",
|
| 104 |
+
"size_bytes": 22681215,
|
| 105 |
+
"sha256": "645579dd8b7040a2e53808a10e6b5f6961d1b625a6bee768710fdf507465f53f"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"path": "tokenizer.json",
|
| 109 |
+
"size_bytes": 22681215,
|
| 110 |
+
"sha256": "645579dd8b7040a2e53808a10e6b5f6961d1b625a6bee768710fdf507465f53f"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"path": "vocos/config.yaml",
|
| 114 |
+
"size_bytes": 1144,
|
| 115 |
+
"sha256": "d7bf584bccb653560eb06ec7b60e5202a11c0808f558dc83cbbaf1c714eac735"
|
| 116 |
+
},
|
| 117 |
+
{
|
| 118 |
+
"path": "vocos/best.pt",
|
| 119 |
+
"size_bytes": 466966065,
|
| 120 |
+
"sha256": "867426748123693b8ca5b26d9b407af158ac0bbae3f140901bc004b7ebc5738d"
|
| 121 |
+
},
|
| 122 |
+
{
|
| 123 |
+
"path": "vocos/load.py",
|
| 124 |
+
"size_bytes": 878,
|
| 125 |
+
"sha256": "c53eac936e1d1231accf32f36bc697e185f79fe29af463749f1362d786b22df9"
|
| 126 |
+
},
|
| 127 |
+
{
|
| 128 |
+
"path": "vocos/model.py",
|
| 129 |
+
"size_bytes": 6687,
|
| 130 |
+
"sha256": "1526bbb54d51b6f0509283acf7879ef4e59ad6155ff7ae06c62dd1d3079eda7f"
|
| 131 |
+
},
|
| 132 |
+
{
|
| 133 |
+
"path": "vocos/__init__.py",
|
| 134 |
+
"size_bytes": 0,
|
| 135 |
+
"sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"path": "onnx/vocos_backbone_int8.onnx",
|
| 139 |
+
"size_bytes": 83713502,
|
| 140 |
+
"sha256": "606b89b60c1de29df4aa5c8da7daeb2a1be7120840f7d11bf863945d2220be52"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"path": "onnx/vocos_backbone.onnx",
|
| 144 |
+
"size_bytes": 233487354,
|
| 145 |
+
"sha256": "b848ddf8eb0fd6396a250e9138c63d5cc7d72e1ca315c2495064a1fb8f47b66b"
|
| 146 |
+
},
|
| 147 |
+
{
|
| 148 |
+
"path": "gguf/indic-speak-q8_0.gguf",
|
| 149 |
+
"size_bytes": 3516320704,
|
| 150 |
+
"sha256": "cef0adb4f3146da9fa7cb03326e65f7513d1bb8e1baba832a11660817b01ec36"
|
| 151 |
+
},
|
| 152 |
+
{
|
| 153 |
+
"path": "gguf/indic-speak-q5_k_m.gguf",
|
| 154 |
+
"size_bytes": 2395219648,
|
| 155 |
+
"sha256": "8e16a52a88713ed4172bc29f1f2a4d3c923dcf5e77fe25b51384a461e6d77b35"
|
| 156 |
+
}
|
| 157 |
+
]
|
| 158 |
+
}
|