---
license: apache-2.0
base_model: Shockem/Qwen3.8-27b-Terse-Coder
tags:
  - gguf
  - reasoning
  - coding
  - qwen3
---

# Qwen3.8-27b-Terse-Coder-GGUF

GGUF builds of
[Shockem/Qwen3.8-27b-Terse-Coder](https://huggingface.co/Shockem/Qwen3.8-27b-Terse-Coder)
(round 8, final) — a fine-tune of
[Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B) with ~1/10 the
chain-of-thought reasoning tokens on coding tasks and correctness preserved.

Quant spread (Q4_K_M smoke-tested on llama.cpp — correct code generation,
reasoning parsing, ~22 tok/s on 2× RTX 5060 Ti):

| File | Size | Notes |
|---|---|---|
| `Qwen3.8-27b-Terse-Coder.Q4_K_M.gguf` | ~16.8G | Balanced quality/speed — the default pick |
| `Qwen3.8-27b-Terse-Coder.Q5_K_M.gguf` | ~19.5G | |
| `Qwen3.8-27b-Terse-Coder.Q6_K.gguf` | ~22.4G | |
| `Qwen3.8-27b-Terse-Coder.Q8_0.gguf` | ~29.0G | Near-lossless |
| `Qwen3.8-27b-Terse-Coder.mmproj-f16.gguf` | ~0.9G | Vision projector (required for images) |
| `Qwen3.8-27b-Terse-Coder.mmproj-Q8_0.gguf` | ~0.6G | Vision projector, quantized |

Usage (llama.cpp server):
Chat template: use **[Shockem/froggeric-terse-coder](https://huggingface.co/Shockem/froggeric-terse-coder)** (based on [froggeric/Qwen-Fixed-Chat-Templates](https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates)) (also bundled here as `chat_template.jinja`) — it carries the anti-rumination tool rules the model was evaluated with; serving without it changes agentic behavior.


```bash
llama-server -m Qwen3.8-27b-Terse-Coder.Q4_K_M.gguf \
  --mmproj Qwen3.8-27b-Terse-Coder.mmproj-f16.gguf \
  -ngl 99 -c 32768
```

The MTP draft layer is included in the GGUF but unused by llama.cpp
(harmless warnings about unused `blk.N.nextn.*` tensors are expected);
speculative decoding is a vLLM-side feature. Behavior/quality reference:
HE+ 91.5 / MBPP+ 79.4 / GSM8K 98.5 / GPQA 79.8 on the source repo (vLLM
measurements; GGUF Q4_K_M verified by smoke test only — validate quality on
your own hardware before relying on it).

Source and provenance: fp16 merge at
[Shockem/Qwen3.8-27b-Terse-Coder](https://huggingface.co/Shockem/Qwen3.8-27b-Terse-Coder);
vLLM deployment build at
[Shockem/Qwen3.8-27b-Terse-Coder-NVFP4](https://huggingface.co/Shockem/Qwen3.8-27b-Terse-Coder-NVFP4);
adapter lineage at
[Shockem/Qwen3.8-27b-Terse-Coder-LoRA](https://huggingface.co/Shockem/Qwen3.8-27b-Terse-Coder-LoRA).
Licensed Apache 2.0, same as the base model (© Qwen Team, Alibaba Cloud).