LFM2.5-8B-A1B-exl3 / README.md
turboderp's picture
Update README.md
34a0955 verified
|
Raw History Blame
1.15 kB
metadata
license: other
license_name: lfm1.0
base_model: LiquidAI/LFM2.5-8B-A1B
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of LFM2.5-8B-A1B

⚠️ Requires ExLlamaV3 v0.0.38 (or v0.0.37 dev branch)

2.10 bits per weight
2.53 bits per weight
3.10 bits per weight
3.53 bits per weight
4.10 bits per weight
5.10 bits per weight
6.10 bits per weight
8.00 bits per weight / H8

kld