README.md

---
license: mit
base_model: XiaomiMiMo/MiMo-V2.6-Flash-RL
tags:
  - uncensored
  - abliterated
  - heretic
  - gguf
  - mimo
---

# MiMo-V2.6-Flash-RL Uncensored Heretic — merged GGUF

> **⚠️ Content warning:** This model has had the base model's refusal
> behavior surgically suppressed. The resulting model **will** comply with
> requests the base model refuses, including requests that are harmful,
> unethical, offensive, or illegal. It has reduced safety guardrails. See
> [Responsible use](#responsible-use--disclaimer) below — **you are solely
> responsible for what you do with it.**

This is a **merged GGUF** of
[MiMo-V2.6-Flash-RL](https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL)
(309B total / 15B active MoE, MIT license) decensored / "abliterated" with
**heretic-gguf** — a GGUF-native port of
[Heretic](https://github.com/p-e-w/heretic)'s Optuna-optimized directional
ablation, which runs the whole search directly on quantized GGUF weights via
llama.cpp. The ablation (trial 85 of study `mimo26flash`) was baked directly
into the
[MXFP4](https://huggingface.co/ggml-org/MiMo-V2.6-Flash-RL-GGUF) weights:
edited tensors were dequantized, patched with the exact ablation delta, and
requantized to their original type; everything else is a byte-for-byte copy.

**This is the zero-runtime-overhead form** — a drop-in base model, no
`--lora` flag needed. If you prefer the **lossless** option (bit-identical
base weights, ~70 MB download, requantization avoided entirely), the exact
same configuration is also available as a LoRA adapter at
[MiMo-V2.6-Flash-RL-Uncensored-Heretic-LoRA-GGUF](https://huggingface.co/MorinoNushi/MiMo-V2.6-Flash-RL-Uncensored-Heretic-LoRA-GGUF).

**heretic-gguf is available at
[github.com/MoriNoNushi/heretic-gguf](https://github.com/MoriNoNushi/heretic-gguf)** —
the full tool, so the method can be applied to other GGUF models.

## Results

Measured on **140 harmful prompts** (100 from `mlabonne/harmful_behaviors`
test + 40 custom) and **100 harmless prompts** (`mlabonne/harmless_alpaca`
test), CoT-skip prefix (`<think></think>`, thinking suppressed), greedy
decoding, 100-token responses, against the MXFP4 base:

| | Refusal rate (harmful) | KL divergence (harmless) |
|---|---|---|
| Base model | 95.71% (134/140) | 0 (by definition) |
| **Ablated model (trial 85)** | **3.57% (5/140)** | **0.0568** |

The scores above were measured on the LoRA form of the ablation; the merged
model applies the identical delta, requantized to MXFP4/Q8_0, so behavior
should match within quantization noise. Refusals are counted by
refusal-keyword matching (English + Chinese + first-person-negation markers
such as "I'm not going to / able to ..."). KL divergence is measured on
first-token logits on harmless prompts. Note that the study was run with the
CoT-skip prefix (thinking suppressed, as in stock Heretic); with full
thinking enabled the model may still reason its way back to a refusal
mid-trace, so real-use refusal rates can be somewhat higher than the 3.57%
above.

> **Note on KL:** the KL divergence above (and the optimization objective
> itself) was measured against the **MXFP4** quant. KL is a
> baseline-relative metric, so on a different base quant the effective drift
> from that quant's baseline may differ.

## Usage

```bash
llama-server \
    -m MiMo-V2.6-Flash-RL-Uncensored-Heretic-MXFP4-00001-of-00002.gguf \
    --jinja
```

Add your usual offload/context flags (`-ngl 999`, `-c`, tensor splits,
etc.) — nothing model-specific is required, and no special sampling
parameters are needed. MiMo-V2.6-Flash-RL (`mimo2`) support is merged
upstream in llama.cpp — any recent build works, no patches or PRs needed.

## How it was made

- **Method:** directional ablation ("abliteration") — the refusal direction
  in residual space (difference of means over 480 harmful / 480 harmless
  prompts, 5% winsorized, orthogonalized against the harmless mean) is
  projected out of the attention output and MoE down-projection weights.
  Strengths, layer kernels, and direction selection were tuned by
  multi-objective Optuna TPE (minimize refusal rate and KL jointly). This
  model is trial 85 of study `mimo26flash`, exported with
  `heretic-gguf export --mode merged`.
- **Configuration** (study `mimo26flash`, trial 85; global direction scope,
  direction index 26.2 of 48; per-expert strengths scaled by measured
  harmful/harmless routing frequency; `row_normalization = "pre"`):
  - attn.o_proj: max weight 6.39 @ layer 36.4 of 48.
  - routed MLP down-proj: max weight 1.58 @ layer 31.9.
- **Merged export:** heretic-gguf expresses ablation as a rank-1 LoRA
  overlay (the same math stock Heretic writes into PEFT adapters); the
  merged exporter materializes that delta exactly — full-rank, no LoRA
  factorization loss — and requantizes only the patched tensors to their
  original type (MXFP4 experts, Q8_0 attention/dense). This is one extra
  quantization step on those tensors relative to the base; the
  [LoRA form](https://huggingface.co/MorinoNushi/MiMo-V2.6-Flash-RL-Uncensored-Heretic-LoRA-GGUF)
  avoids it entirely.

## Responsible use & disclaimer

- **This model can generate content that is offensive, disturbing, hateful,
  sexually explicit, violent, or otherwise objectionable, including detailed
  instructions for harmful or illegal acts.** That is the direct and
  intended consequence of removing refusal behavior.
- The ablation suppresses *refusals*, not the base model's knowledge —
  outputs on dangerous topics may be wrong, hallucinated, or incoherent.
  Nothing the model says should be treated as accurate, safe, or legal
  advice.
- **Do not deploy this model in any production system, public-facing
  service, or multi-user setting.** It is intended for personal research,
  red-teaming, and evaluation purposes.
- **You, the user, are solely responsible for any output the model produces
  and for any consequences of using it.** The authors of this release, of
  heretic-gguf, of Heretic, and of Xiaomi accept no liability whatsoever.
  Using this model to produce illegal content or to harm others is your
  choice and your legal exposure — ensure your use complies with all
  applicable laws in your jurisdiction.
- By downloading or using this model you acknowledge the above.

## License

The base model is MIT-licensed (see the
[base repo](https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL));
this model inherits those terms. The heretic-gguf tooling used to produce it
is AGPL-3.0-or-later.