GGUF
conversational
How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull Ferraronp/CosyVoice3-qwen2.5-0.5b-speech-gguf:
Run and chat with the model
lemonade run user.CosyVoice3-qwen2.5-0.5b-speech-gguf-
List all available models
lemonade list
Quick Links

CosyVoice Qwen2.5 0.5B (GGUF)

GGUF conversion of a CosyVoice-style speech token model.

Notes

  • Outputs speech tokens, not audio
  • Requires external pipeline

Links

Downloads last month
346
GGUF
Model size
0.6B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Ferraronp/CosyVoice3-qwen2.5-0.5b-speech-gguf

Quantized
(22)
this model