---
base_model: OBLITERATUS/Qwen3.6-27B-OBLITERATED
base_model_relation: quantized
license: apache-2.0
library_name: gguf
tags:
- gguf
- rocmfp4
- qwen3.6
- obliterated
- abliterated
- uncensored
- 27b
- mtp
- speculative-decoding
- strix-halo
- amd
- rocm
- vulkan
language:
- en
---

# Qwen3.6-27B-OBLITERATED-MTP — ROCmFP4 STRIX

> ## 🚧 Work in progress — files not uploaded yet
> This card is up so you know it's coming. The **GGUFs aren't here yet** — the BF16 source is downloading
> and the quant/measurement pipeline is queued behind some other uploads. Check back; this notice gets
> replaced with the files + measured numbers when it's done.

Experimental **AMD Strix Halo (gfx1151)** quant of [**OBLITERATUS/Qwen3.6-27B-OBLITERATED**](https://huggingface.co/OBLITERATUS/Qwen3.6-27B-OBLITERATED)
— an **abliterated / uncensored** Qwen3.6-27B (refusal direction removed, with source-weight interpolation
to retain capability) — in the custom **ROCmFP4** 4-bit format, with an MTP / next-token-prediction head
**grafted in** for self-speculative decoding on a single APU.

> **⚠️ Ignore HuggingFace's auto-detected quant badge ("F16"/16-bit) — it's wrong.**
> HF can't read the custom ROCmFP4 tensor types and mislabels the file by its f16 embeddings. **These will
> be ~4.5 bpw 4-bit ROCmFP4 files, not 16-bit.** Pick by filename in *Files and versions*.

> ## Requires the ROCmFP4 fork (public) — not stock llama.cpp
> Uses the **ROCmFP4** tensor types (`q4_0_rocmfp4`, `q4_0_rocmfp4_fast`). **Stock llama.cpp, LM Studio,
> Ollama, etc. cannot load it.** Build/run with
> **[`charlie12345/rocmfp4-llama`](https://github.com/charlie12345/rocmfp4-llama)** (`mtp-rocmfp4-strix`).

## Lineage

```
this ROCmFP4 quant  ──quantized──▶  OBLITERATUS/Qwen3.6-27B-OBLITERATED  ──abliterated──▶  Qwen/Qwen3.6-27B
```

It's a 4-bit Strix-Halo quant of OBLITERATUS's abliterated 27B. The abliteration (refusal-direction
removal + source interpolation) is upstream work; we only do the ROCmFP4 quant + MTP graft.

## Planned recipe (what these will be)

- **Genuine f16 token embeddings** — quantized **from the BF16 safetensors**, so the f16 embeddings are
  real f16 (not Q8→f16 "fake-f16").
- **Grafted MTP head** — a `nextn` head transplanted from a Qwen3.6-27B-MTP BF16 donor (output-lossless;
  it only affects draft *speed*), so it runs self-speculative on the fork.
- **Two output-head variants** — a base (4-bit head, fastest) and a **`Q6_K` head** (a notch more faithful).
- **imatrix: measured, then decided.** This is a *dense* Qwen3.6-27B — the same architecture class as our
  [Qwopus-Coder](https://huggingface.co/plunderstruck/Qwopus3.6-27B-Coder-MTP-ROCmFP4-GGUF), the one model
  where a code-weighted imatrix *worsened* perplexity. So we'll build both and pick by **measured KL +
  perplexity vs the BF16**, rather than assume. Whatever ships, the card will say which won and show the numbers.

## Status

🚧 Building. No files yet, and **no quality measurement yet** — nothing here is a quality claim. When it
lands it'll carry the same honest scope as our other cards: a KL/PPL fidelity comparison vs BF16, not an
absolute benchmark.

## Sibling ROCmFP4 Strix Halo models

- [Qwen3.6-27B-MTP](https://huggingface.co/plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF) · [Qwen3.6-35B-A3B-MTP](https://huggingface.co/plunderstruck/Qwen3.6-35B-A3B-MTP-ROCmFP4-GGUF) · [Qwopus3.6-27B-Coder-MTP](https://huggingface.co/plunderstruck/Qwopus3.6-27B-Coder-MTP-ROCmFP4-GGUF)
- [Qwen3.6-40B-Deckard-MTP](https://huggingface.co/plunderstruck/Qwen3.6-40B-Deckard-MTP-ROCmFP4-GGUF) · [Qwen3-Coder-Next](https://huggingface.co/plunderstruck/Qwen3-Coder-Next-ROCmFP4-GGUF) · [Nex-N2-mini](https://huggingface.co/plunderstruck/Nex-N2-mini-ROCmFP4-GGUF)

## Credits & license

- **Base model:** [`OBLITERATUS/Qwen3.6-27B-OBLITERATED`](https://huggingface.co/OBLITERATUS/Qwen3.6-27B-OBLITERATED) (Apache-2.0), an abliterated derivative of [`Qwen/Qwen3.6-27B`](https://huggingface.co/Qwen/Qwen3.6-27B) (Qwen team). A derivative quantization — verify the base terms before redistribution/use.
- **ROCmFP4 format & runtime:** [`charlie12345/rocmfp4-llama`](https://github.com/charlie12345/rocmfp4-llama) (based on llama.cpp, MIT).