Darkhn-Quants
/

L3.3-70B-Animus-V5-Pro-GGUF

Model card Files Files and versions

Send me your support to help me feed the data beast! also taking comissions for universe specific models

L3.3-70B-Animus-V5-Pro-GGUF

GGUF model files for L3.3-70B-Animus-V5-Pro.

This repository contains GGUF models quantized using llama.cpp.

Base Model: L3.3-70B-Animus-V5-Pro
Quantization Methods Processed in this Job: IQ2_S
Importance Matrix Used: Yes

This specific upload is for the IQ2_S quantization.

Downloads last month: 171

GGUF

Model size

71B params

Architecture

llama

Hardware compatibility

Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Darkhn-Quants/L3.3-70B-Animus-V5-Pro-GGUF

Base model

meta-llama/Llama-3.1-70B

Finetuned

meta-llama/Llama-3.3-70B-Instruct

Finetuned

Darkhn/L3.3-70B-Animus-V5-Pro

Quantized

(1)

this model