---
inference: false
base_model: TheDrummer/Behemoth-X-123B-v2
base_model_relation: quantized
tags:
  - exl2
library_name: exllamav2
pipeline_tag: text-generation
---

exllamav2 quantizations of TheDrummer's [Behemoth-X-123B-v2](https://huggingface.co/TheDrummer/Behemoth-X-123B-v2)

[2.25bpw h6](https://huggingface.co/MikeRoz/Behemoth-X-123B-v2-exl2/tree/2.25bpw_H6) (32.964 GiB)     
[3.75bpw h6](https://huggingface.co/MikeRoz/Behemoth-X-123B-v2-exl2/tree/3.75bpw_H6) (54.234 GiB)     
[5.00bpw h6](https://huggingface.co/MikeRoz/Behemoth-X-123B-v2-exl2/tree/5.00bpw_H6) (71.959 GiB)     
[8.00bpw h8](https://huggingface.co/MikeRoz/Behemoth-X-123B-v2-exl2/tree/8.00bpw_H8) (114.560 GiB)     
[measurement.json](https://huggingface.co/MikeRoz/Behemoth-X-123B-v2-exl2/resolve/main/measurement.json?download=true)