Update main README with VRAM Matrix
Browse files
README.md
CHANGED
|
@@ -26,6 +26,7 @@ The model weights are stored in separate branches. **Please switch to a branch t
|
|
| 26 |
| 3.75 | h6 | [3.75bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/3.75bpw_h6) | 2312.4667 | N/A | N/A | N/A | N/A | N/A |
|
| 27 |
| 4.0 | h6 | [4.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/4.0bpw_h6) | 2097.6864 | N/A | N/A | N/A | N/A | N/A |
|
| 28 |
| 5.0 | h6 | [5.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/5.0bpw_h6) | 1995.7812 | N/A | N/A | N/A | N/A | N/A |
|
|
|
|
| 29 |
|
| 30 |
¹ *Evaluated against WikiText-2 with ExLlamaV3 using a strided 512-token context window (-c 512) in llama.cpp parity mode (-g). Lower is better.*
|
| 31 |
|
|
@@ -52,7 +53,7 @@ These models are highly optimized for modern GPUs and can be run using:
|
|
| 52 |
* **[ExLlamaV3 (Native)](https://github.com/turboderp-org/exllamav3):** Python library for custom integration.
|
| 53 |
### 📈 Perplexity Degradation Curve
|
| 54 |
*(Lower is better)*
|
| 55 |
-
 | 2312.4667 | N/A | N/A | N/A | N/A | N/A |
|
| 27 |
| 4.0 | h6 | [4.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/4.0bpw_h6) | 2097.6864 | N/A | N/A | N/A | N/A | N/A |
|
| 28 |
| 5.0 | h6 | [5.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/5.0bpw_h6) | 1995.7812 | N/A | N/A | N/A | N/A | N/A |
|
| 29 |
+
| 6.0 | h6 | [6.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/6.0bpw_h6) | 1995.3135 | N/A | N/A | N/A | N/A | N/A |
|
| 30 |
|
| 31 |
¹ *Evaluated against WikiText-2 with ExLlamaV3 using a strided 512-token context window (-c 512) in llama.cpp parity mode (-g). Lower is better.*
|
| 32 |
|
|
|
|
| 53 |
* **[ExLlamaV3 (Native)](https://github.com/turboderp-org/exllamav3):** Python library for custom integration.
|
| 54 |
### 📈 Perplexity Degradation Curve
|
| 55 |
*(Lower is better)*
|
| 56 |
+

|
| 57 |
|
| 58 |
|
| 59 |
<details>
|