File size: 1,661 Bytes
15cc177
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
---
library_name: mlx
license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: any-to-any
tags:
- heretic
- uncensored
- decensored
- abliterated
- ara
- mlx
base_model: coder3101/gemma-4-E4B-it-heretic
---

# gemma-4-E4B-it-heretic-mlx-mxfp8

Converted from coder3101/gemma-4-E4B-it-heretic with mlx_vlm.convert.

- Quantization: mxfp8
- q_bits: 8
- q_mode: mxfp8
- Source type: Gemma 4 multimodal (Gemma4ForConditionalGeneration)
- Converter env: /Users/vanch/.cache/lm-studio/.venvs/gemma4-mlx
- Validation date: 2026-04-26

## Validation Summary

- Status: passed local text and vision smoke tests
- Vision metadata present: `processor_config.json` and `preprocessor_config.json`
- Peak memory across sampled tests: 9.593 GB

## Validation Matrix

| Case | Output | Prompt TPS | Generation TPS | Peak Memory |
| --- | --- | ---: | ---: | ---: |
| Text: one-sentence model description | Gemma 4 is a large language model developed by Google DeepMind. | 150.998 | 62.448 | 8.885 GB |
| Text: two-bullet structured answer | * The model belongs to the Gemma family of lightweight, open-weights models.<br>* It possesses a multimodal capability, meaning it can process and understand different types of input, such as text and potentially images or audio depending on the specific version. | 171.767 | 60.052 | 8.897 GB |
| Vision: red image color identification | The image is red. | 562.027 | 66.977 | 9.593 GB |
| Vision: blue image color identification | The image is blue. | 558.614 | 67.212 | 9.593 GB |

## Local Artifacts

- Full verification logs: `/Users/vanch/models/gemma4-e4b-heretic-full-verify/mxfp8-*.log`