| language: | |
| - en | |
| pipeline_tag: text-generation | |
| tags: | |
| - ExLlamaV2 | |
| - text-generation-inference | |
| - llama | |
| Exl2 version of Sao10K's Euryale-Inverted-L2-70B. | |
| 6.0 bpw version. | |
| Model original card : https://huggingface.co/Sao10K/Euryale-Inverted-L2-70B | |
| Tested with 16K context with alpha value, fits just below 60Gb of VRAM divided over 3 GPUs. |