---
license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen3.6-27B/blob/main/LICENSE
language:
- en
base_model:
- KyleHessling1/Qwopus3.6-27B-Fusion-BF16
pipeline_tag: text-generation
library_name: gguf
tags:
- gguf
- quantized
- llama.cpp
- qwen3
- qwen35
- code
- reasoning
- abliterated
- heretic
- uncensored
- mtp
- imatrix
- merge
quantized_by: AtticusG3
---

# Qwopus3.6-27B-Fusion-heretic-MTP (GGUF)

Imatrix-guided **GGUF** quants of [KyleHessling1/Qwopus3.6-27B-Fusion-BF16](https://huggingface.co/KyleHessling1/Qwopus3.6-27B-Fusion-BF16) after **[Heretic](https://github.com/p-e-w/heretic)** abliteration, with **MTP / NextN** heads preserved.

> **Base model credit:** Fusion is Kyle Hessling’s reasoning⊕coding merge of Qwen3.6-27B lineage. This repo only adds Heretic abliteration + GGUF packaging. See the [Fusion BF16 card](https://huggingface.co/KyleHessling1/Qwopus3.6-27B-Fusion-BF16) for merge method, benchmarks, and intended use.

## Files

| File | Quant | Approx. size | Notes |
|------|-------|--------------|-------|
| `Qwopus3.6-27B-Fusion-heretic-MTP-F16.gguf` | F16 | ~51 GB | Full-precision GGUF (conversion source) |
| `Qwopus3.6-27B-Fusion-heretic-MTP-Q8_0.gguf` | Q8_0 | ~28 GB | High-fidelity; also used as imatrix host |
| `Qwopus3.6-27B-Fusion-heretic-MTP-Q5_K_M.gguf` | Q5_K_M | ~19 GB | Imatrix-guided; strong quality/size |
| `Qwopus3.6-27B-Fusion-heretic-MTP-Q4_K_M.gguf` | Q4_K_M | ~16 GB | Imatrix-guided; good default on 24–32 GB GPUs |

**Recommendation:** start with **Q4_K_M** or **Q5_K_M**. Use **Q8_0** / **F16** if you are re-quantizing or measuring ceiling quality.

## What changed vs Fusion BF16

1. **Heretic abliteration** (v1.4.0) on the BF16 weights  
   - 200 optimization trials  
   - Scorers: `KeywordRate` + `KLDivergence`  
   - Eval sets: `mlabonne/harmful_behaviors` + `mlabonne/harmless_alpaca`  
   - **Selected trial 77:** refusal keywords **89 → 3 / 100**, KL divergence **0.026**  
   - Across trials: KL mean ≈ 0.008, max ≈ 0.073 (no trial > 0.1)
2. **MTP / NextN preserved** in the GGUF (`blk.64` / nextn tensors bundled). Heretic’s merge-save dropped MTP safetensors; those tensors were grafted back from Fusion BF16 before convert.
3. **Chat template:** Fusion’s native template (not a Compat rewrite).
4. **Quantization:** `llama.cpp` convert → Q8_0 → imatrix (WikiText-2 calib, 100×256 chunks) → **Q4_K_M** and **Q5_K_M** with `--imatrix`.

> Abliteration reduces refusal behavior; it does **not** remove your responsibility for how you use the model. Follow applicable law and the Qwen license.

## Quick start

### llama.cpp

```bash
./llama-server \
  -m Qwopus3.6-27B-Fusion-heretic-MTP-Q4_K_M.gguf \
  -ngl 99 -c 32768 --jinja \
  --spec-type draft-mtp --spec-draft-n-max 4
```

### LM Studio / koboldcpp / etc.

Import the `.gguf` of your choice. Prefer builds that understand **Qwen3.6 / qwen35** and **MTP** speculative decoding if you want draft speedups.

### OpenAI-compatible (example)

Point any OpenAI-compatible client at a `llama-server` / llama-swap endpoint serving one of these files. Thinking mode follows the Fusion / Qwen3.6 chat template (`enable_thinking` / jinja).

## Model details

| | |
|---|---|
| **Parameters** | ~27B |
| **Architecture** | Qwen3.6 / qwen35 hybrid (linear + periodic full attention) |
| **Context** | Up to 262,144 native (practical limit = VRAM + KV cache) |
| **Vision** | Not included in these text GGUFs (BF16 Fusion retains vision tensors) |
| **MTP** | Included (NextN / draft head) |
| **License** | Qwen (see license link in YAML) |

## Provenance

| Step | Source / tool |
|------|----------------|
| Base | [KyleHessling1/Qwopus3.6-27B-Fusion-BF16](https://huggingface.co/KyleHessling1/Qwopus3.6-27B-Fusion-BF16) |
| Abliteration | [Heretic](https://github.com/p-e-w/heretic) v1.4.0 |
| Convert / quant / imatrix | [llama.cpp](https://github.com/ggml-org/llama.cpp) |
| Uploader | [AtticusG3](https://huggingface.co/AtticusG3) |

## Limitations

- Smoke-tested for generation on a small LiveCodeBench prompt sample after quant; **not** a full re-benchmark of Fusion’s published scores.
- Some MTP (`blk.64`) tensors lacked imatrix entries and fell back to plain K-quants.
- Uncensored / abliterated models can produce disallowed content more readily than the stock chat model — use with care.

## Acknowledgements

- **Kyle Hessling** — Fusion merge and BF16 release  
- **Qwen team** — Qwen3.6-27B  
- **p-e-w / Heretic** — abliteration tooling  
- **llama.cpp** contributors — GGUF convert, imatrix, quantize  

## Citation

```bibtex
@misc{qwopus36-fusion-heretic-mtp-gguf,
  title        = {Qwopus3.6-27B-Fusion-heretic-MTP GGUF},
  author       = {AtticusG3},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/AtticusG3/Qwopus3.6-27B-Fusion-heretic-MTP-GGUF}},
  note         = {Heretic abliteration of KyleHessling1/Qwopus3.6-27B-Fusion-BF16; imatrix GGUF quants}
}
```