How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull ddh0/llama-13b-Q8_0:Q8_0
Run and chat with the model
lemonade run user.llama-13b-Q8_0-Q8_0
List all available models
lemonade list
Quick Links

ddh0/llama-13b-Q8_0

original llama-13b model (Llama 1) in Q8_0, quanted from F32

Downloads last month
7
GGUF
Model size
13B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ddh0/llama-13b-Q8_0

Quantized
(2)
this model