Hugging Face's logo

Adun
/
llama-3-typhoon-v1.5x-8b-instruct-gguf

GGUF
conversational
Model card Files
xet
 Community
How to use from
Lemonade
Pull the model 
# Download Lemonade from https://lemonade-server.ai/
lemonade pull Adun/llama-3-typhoon-v1.5x-8b-instruct-gguf:Q4_K_M
Run and chat with the model 
lemonade run user.llama-3-typhoon-v1.5x-8b-instruct-gguf-Q4_K_M
List all available models 
lemonade list
Quick Links

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

This is Llama3-Typhoon1.5x-8B-instruct GGUF model

Convert original model (scb10x/llama-3-typhoon-v1.5x-8b-instruct) to GGUF

System diagram

scb10x/llama-3-typhoon-v1.5x-8b-instruct

mode info.

https://aiotplatform.blogspot.com/2024/07/llama3-typhoon-v15-scb10x-llm.html

System diagram https://aiotplatform.blogspot.com/2024/07/llama3-typhoon-v15-scb10x-llm.html

Downloads last month
31
GGUF
Model size
8B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

View +2 variants
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support