---
language:
- en
pipeline_tag: text-generation
tags:
- ExLlamaV2
- text-generation-inference
- llama
---

Exl2 version of Sao10K's Euryale-Inverted-L2-70B. 

6.0 bpw version.

Model original card : https://huggingface.co/Sao10K/Euryale-Inverted-L2-70B

Tested with 16K context with alpha value, fits just below 60Gb of VRAM divided over 3 GPUs.