nimishchaudhari commited on
Commit
876ae2c
·
verified ·
1 Parent(s): 8bacf6c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -30,10 +30,9 @@ quantized_by: nimishchaudhari
30
  A high-quality quantized version of [mistralai/Magistral-Small-2509](https://huggingface.co/mistralai/Magistral-Small-2509) using [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp) with importance matrix optimization and custom tensor-specific quantization.
31
 
32
  ## Model Details
33
- - **Base Model:** unsloth/Magistral-Small-2509
34
  - **Quantization Method:** Custom IQ4_KS recipe with importance matrix
35
- - **Target VRAM:** ~7-8GB for full offload
36
- - **Context Length:** Up to 32K tokens
37
  - **Quantization Tool:** ik_llama.cpp with imatrix calibration
38
 
39
  ## Benchmark Results
 
30
  A high-quality quantized version of [mistralai/Magistral-Small-2509](https://huggingface.co/mistralai/Magistral-Small-2509) using [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp) with importance matrix optimization and custom tensor-specific quantization.
31
 
32
  ## Model Details
33
+ - **Base Model:** mistralai/Magistral-Small-2509
34
  - **Quantization Method:** Custom IQ4_KS recipe with importance matrix
35
+ - **Target VRAM:** 12GB for full offload
 
36
  - **Quantization Tool:** ik_llama.cpp with imatrix calibration
37
 
38
  ## Benchmark Results