| library_name: mlx | |
| tags: | |
| - mlx | |
| - oq | |
| - quantized | |
| base_model: | |
| - ibm-granite/granite-4.1-3b | |
| # granite-4.1-3b-oQ4-fp16 | |
| This model was quantized using [oQ](https://github.com/jundot/omlx) (oMLX v0.3.8rc1korokke) mixed-precision quantization. | |
| ## Quantization details | |
| - **Model type**: granite | |
| - **Bits**: 4 | |
| - **Group size**: 64 | |
| - **Format**: MLX safetensors |