DBMe commited on
Commit
3d8f624
·
verified ·
1 Parent(s): 469dc3f

Update main README with VRAM Matrix

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -26,6 +26,7 @@ The model weights are stored in separate branches. **Please switch to a branch t
26
  | 3.75 | h6 | [3.75bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/3.75bpw_h6) | 2312.4667 | N/A | N/A | N/A | N/A | N/A |
27
  | 4.0 | h6 | [4.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/4.0bpw_h6) | 2097.6864 | N/A | N/A | N/A | N/A | N/A |
28
  | 5.0 | h6 | [5.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/5.0bpw_h6) | 1995.7812 | N/A | N/A | N/A | N/A | N/A |
 
29
 
30
  ¹ *Evaluated against WikiText-2 with ExLlamaV3 using a strided 512-token context window (-c 512) in llama.cpp parity mode (-g). Lower is better.*
31
 
@@ -52,7 +53,7 @@ These models are highly optimized for modern GPUs and can be run using:
52
  * **[ExLlamaV3 (Native)](https://github.com/turboderp-org/exllamav3):** Python library for custom integration.
53
  ### 📈 Perplexity Degradation Curve
54
  *(Lower is better)*
55
- ![Perplexity Graph](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/resolve/main/metrics_graph.png?v=42a47ed1)
56
 
57
 
58
  <details>
 
26
  | 3.75 | h6 | [3.75bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/3.75bpw_h6) | 2312.4667 | N/A | N/A | N/A | N/A | N/A |
27
  | 4.0 | h6 | [4.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/4.0bpw_h6) | 2097.6864 | N/A | N/A | N/A | N/A | N/A |
28
  | 5.0 | h6 | [5.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/5.0bpw_h6) | 1995.7812 | N/A | N/A | N/A | N/A | N/A |
29
+ | 6.0 | h6 | [6.0bpw_h6](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/tree/6.0bpw_h6) | 1995.3135 | N/A | N/A | N/A | N/A | N/A |
30
 
31
  ¹ *Evaluated against WikiText-2 with ExLlamaV3 using a strided 512-token context window (-c 512) in llama.cpp parity mode (-g). Lower is better.*
32
 
 
53
  * **[ExLlamaV3 (Native)](https://github.com/turboderp-org/exllamav3):** Python library for custom integration.
54
  ### 📈 Perplexity Degradation Curve
55
  *(Lower is better)*
56
+ ![Perplexity Graph](https://huggingface.co/DBMe/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic-exl3-mul1/resolve/main/metrics_graph.png?v=141af8f0)
57
 
58
 
59
  <details>