FabioTrindade
/

Llama-3.1-70B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8-bit precision

compressed-tensors

Model card Files Files and versions

Llama-3.1-70B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5 / tokenizer.json

Commit History

Upload folder using huggingface_hub

fb07578
verified

FabioTrindade commited on Jul 4