Update README.md
Browse files
README.md
CHANGED
|
@@ -8,10 +8,10 @@ tags:
|
|
| 8 |
- exl3
|
| 9 |
---
|
| 10 |
|
| 11 |
-
⚠️ Requires ExLlamaV3 v0.0.38 (or v0.0.37 `dev` branch)
|
| 12 |
-
|
| 13 |
EXL3 quants of [LFM2.5-8B-A1B](https://huggingface.co/LiquidAI/LFM2.5-8B-A1B)
|
| 14 |
|
|
|
|
|
|
|
| 15 |
[2.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.10bpw)
|
| 16 |
[2.53 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.53bpw)
|
| 17 |
[3.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/3.10bpw)
|
|
|
|
| 8 |
- exl3
|
| 9 |
---
|
| 10 |
|
|
|
|
|
|
|
| 11 |
EXL3 quants of [LFM2.5-8B-A1B](https://huggingface.co/LiquidAI/LFM2.5-8B-A1B)
|
| 12 |
|
| 13 |
+
⚠️ Requires ExLlamaV3 v0.0.38 (or v0.0.37 `dev` branch)
|
| 14 |
+
|
| 15 |
[2.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.10bpw)
|
| 16 |
[2.53 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.53bpw)
|
| 17 |
[3.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/3.10bpw)
|