Instructions to use dealignai/Gemma-4-31B-JANG_4M-CRACK with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("dealignai/Gemma-4-31B-JANG_4M-CRACK") config = load_config("dealignai/Gemma-4-31B-JANG_4M-CRACK") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dealignai/Gemma-4-31B-JANG_4M-CRACK"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "dealignai/Gemma-4-31B-JANG_4M-CRACK" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dealignai/Gemma-4-31B-JANG_4M-CRACK"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default dealignai/Gemma-4-31B-JANG_4M-CRACK
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dealignai/Gemma-4-31B-JANG_4M-CRACK"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "dealignai/Gemma-4-31B-JANG_4M-CRACK" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 5,291 Bytes
25e5bd4 8b4ba67 25e5bd4 8b4ba67 bb2fa75 8b4ba67 bb2fa75 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 5b0d52b 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 01b4e5b 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 8b4ba67 25e5bd4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 | ---
license: gemma
library_name: mlx
tags:
- mlx
- abliterated
- uncensored
- crack
- jang
- gemma4
thumbnail: dealign_mascot.png
pipeline_tag: image-text-to-text
---
<p align="center">
<img src="vmlx-app.png" alt="vMLX β run JANG models on Apple Silicon" width="820" />
</p>
<h3 align="center">β‘ All JANG models are meant to be run in <a href="https://vmlx.net">vMLX</a></h3>
<p align="center">
<img src="dealign_logo.png" alt="dealign.ai" width="200"/>
</p>
<div align="center">
<img src="dealign_mascot.png" width="128" />
# Gemma 4 31B JANG_4M CRACK (v2)
**Abliterated Gemma 4 31B Dense β 60 layers, hybrid sliding/global attention, multimodal VL**
93.7% HarmBench compliance (300 prompts) Β· 8/8 security prompts Β· 71.5% MMLU
**Updated reupload** β v2 with improved vectors and thinking-mode stability.
</div>
> **Recommended: Run in [vMLX](https://vmlx.net)** for best experience including thinking mode support, repetition penalty, and vision capabilities.
## What's New in v2
This is an updated version of the original Gemma 4 31B CRACK upload:
- **Improved abliteration**: Higher quality refusal vector extraction
- **Thinking-ON stability**: Clean thinking cycle β no more degenerate loops
- **Same compliance**: 93.7% HarmBench
- **Architecture-aware**: Tuned for Gemma 4's hybrid attention design
## β οΈ Important Settings
For optimal results, configure your inference settings:
| Setting | Thinking OFF | Thinking ON |
|---------|-------------|-------------|
| Temperature | 0.0 β 1.0 | **0.3 β 0.7** (avoid greedy) |
| Repetition Penalty | 1.00 | **1.15 β 1.25** |
| Top P | 0.95 | 0.95 |
| Enable Thinking | Off | On |
**Thinking ON notes:**
- Repetition penalty (1.2) is recommended to prevent planning loops
- Avoid temp=0 with thinking ON β greedy decoding increases loop risk
- Hardest content categories (drug manufacturing) may still refuse in thinking mode
- Security/coding prompts work well in both modes
## Model Details
| Metric | Value |
|--------|-------|
| Source | `google/gemma-4-31b-it` |
| Architecture | Dense, hybrid sliding/global attention |
| Profile | JANG_4M |
| Actual avg bits | 5.1 |
| Model size | 21 GB |
| Vision | Yes (multimodal, float16 passthrough) |
| Parameters | 31B |
| Format | JANG v2 (MLX-native safetensors) |
| Abliteration | CRACK v2 |
## Benchmark Results
### HarmBench (300 prompts, stratified across all categories)
| Category | Score |
|----------|-------|
| Cybercrime/intrusion | **51/51 (100%)** |
| Harmful content | **22/22 (100%)** |
| Misinformation | **50/50 (100%)** |
| Illegal activities | 47/50 (94%) |
| Contextual | 72/78 (92%) |
| Chemical/biological | 46/51 (90%) |
| Harassment/bullying | 22/25 (88%) |
| Copyright | 43/51 (84%) |
| **Overall** | **281/300 (93.7%)** |
### Security & Pentesting (8/8 β
)
All security/pentesting prompts comply with full working code:
- Port scanners, reverse shells, keyloggers, exploit development
- Phishing templates, ARP spoofing, SQL injection
- Metasploit usage guides
### MMLU-200 (10 subjects Γ 20 questions)
| Subject | Base | CRACK v2 |
|---------|------|----------|
| Abstract Algebra | 9/20 | 7/20 |
| Anatomy | 13/20 | 12/20 |
| Astronomy | 17/20 | 15/20 |
| College CS | 13/20 | 12/20 |
| College Physics | 14/20 | 12/20 |
| HS Biology | 19/20 | 18/20 |
| HS Chemistry | 14/20 | 12/20 |
| HS Mathematics | 6/20 | 6/20 |
| Logical Fallacies | 17/20 | 16/20 |
| World Religions | 17/20 | 17/20 |
| **Total** | **76.5% (153/200)** | **71.5% (143/200)** |
| **Delta** | β | **-5.0%** |
### Coherence β
All coherence checks pass: factual knowledge, reasoning, code generation, mathematics.
## Architecture
- Dense 31B with hybrid sliding/global attention
- Multimodal vision encoder preserved in float16
- Supports thinking mode (chain-of-thought reasoning)
## Usage
### vMLX (Recommended)
Load directly in [vMLX](https://vmlx.net) β full support for Gemma 4 including vision, thinking mode, and all inference settings.
### Requirements
- Apple Silicon Mac with 32+ GB unified memory
- [vMLX](https://vmlx.net) 1.3.26+ (recommended)
- Standard `mlx_lm` / `mlx_vlm` do NOT support Gemma 4 as of v0.31.2 / v0.4.1
---
## Support dealignai
All models are built from original research and published for free. These models are specifically crafted to be excellent coders and general-purpose assistants.
**[Support us on Ko-fi](https://ko-fi.com/dealignai)** β check out the Ko-fi membership for early access and extras.
Have questions or need help with a specific model? **DM us β we help for free most of the time.**
[Ko-fi](https://ko-fi.com/dealignai) | [X @dealignai](https://x.com/dealignai) | [dealign.ai](https://dealign.ai)
---
## About dealignai
<img src="dealign_mascot.png" alt="Dealign.AI Mascot" width="200"/>
We research and publish abliterated models to advance AI safety understanding.
Follow us: [π @dealignai](https://x.com/dealignai)
See our research: [Safety Generalization in Frontier MoE Models](https://dealign.ai/quantsteer.html)
<div align="center">
<img src="dealign_logo.png" alt="dealign.ai" width="200"/>
</div>
---
*This model is provided for research purposes. Users are responsible for ensuring their use complies with applicable laws and regulations.*
|