Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
donghyunli
/
Llama-2-13b-KronQ-W4A16
Like
0
Text Generation
Safetensors
English
kronq
quantization
int4
weight-only
8-bit precision
arxiv:
2607.07964
License:
llama2
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
main
Llama-2-13b-KronQ-W4A16
/
tokenizer_config.json
Commit History
KronQ W4A16 packed int4 (L2-13B)
334bc10
verified
donghyunli
commited on
Jun 22
donghyunli commited on 