File size: 362 Bytes
4f67c9e
 
 
 
 
 
e3284dc
 
4f67c9e
 
 
 
 
 
 
 
 
 
 
e3284dc
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---
library_name: mlx
tags:
- mlx
- oq
- quantized
base_model:
- ibm-granite/granite-4.1-3b
---

# granite-4.1-3b-oQ4-fp16

This model was quantized using [oQ](https://github.com/jundot/omlx) (oMLX v0.3.8rc1korokke) mixed-precision quantization.

## Quantization details

- **Model type**: granite
- **Bits**: 4
- **Group size**: 64
- **Format**: MLX safetensors