Image-Text-to-Text
GGUF
English
Chinese
solstice-ai
davidau
qwen
qwen3.8
qwen3.8-27b
cold-fusion
gain
project-heretic
heretic
uncensored
abliterated
fable
cot
reasoning
coding
llama.cpp
ollama
mtp
multi-token-prediction
speculative-decoding
vision
multimodal
mmproj
q8_0
q6_k
q5_k_m
q4_k_m
arc-challenge
709-arc
conversational
Add official Solstice-AI MTP 1M documentation
Browse files
README.md
CHANGED
|
@@ -7,7 +7,6 @@ base_model: DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored
|
|
| 7 |
tags:
|
| 8 |
- solstice-ai
|
| 9 |
- davidau
|
| 10 |
-
- davidau-quants
|
| 11 |
- qwen
|
| 12 |
- qwen3.8
|
| 13 |
- qwen3.8-27b
|
|
@@ -16,39 +15,19 @@ tags:
|
|
| 16 |
- project-heretic
|
| 17 |
- heretic
|
| 18 |
- uncensored
|
| 19 |
-
- abliterated
|
| 20 |
-
- fable
|
| 21 |
-
- cot
|
| 22 |
-
- reasoning
|
| 23 |
-
- coding
|
| 24 |
-
- swe-bench
|
| 25 |
-
- swe-bench-pro
|
| 26 |
-
- livecodebench
|
| 27 |
-
- beats-claude-opus-4.6
|
| 28 |
-
- claude-opus-4.6
|
| 29 |
- gguf
|
| 30 |
- llama.cpp
|
| 31 |
- ollama
|
| 32 |
- mtp
|
| 33 |
-
-
|
|
|
|
|
|
|
| 34 |
- speculative-decoding
|
| 35 |
- draft-model
|
|
|
|
| 36 |
- vision
|
| 37 |
- multimodal
|
| 38 |
- mmproj
|
| 39 |
-
- q8_0
|
| 40 |
-
- q6_k
|
| 41 |
-
- q5_k_m
|
| 42 |
-
- q4_k_m
|
| 43 |
-
- iq4_nl
|
| 44 |
-
- iq4_xs
|
| 45 |
-
- anvil
|
| 46 |
-
- turboquant
|
| 47 |
-
- arc-challenge
|
| 48 |
-
- 709-arc
|
| 49 |
-
- 1m-context
|
| 50 |
-
- long-context
|
| 51 |
-
- yarn
|
| 52 |
pipeline_tag: image-text-to-text
|
| 53 |
datasets:
|
| 54 |
- Solstice-AI/Solace-1.0-Omni
|
|
@@ -58,90 +37,18 @@ datasets:
|
|
| 58 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/67c2e844e0921a5410eec10a/Y5M42dCag2f7Fc6fDtV0Z.jpeg" alt="Solstice-AI Banner" width="100%">
|
| 59 |
</p>
|
| 60 |
|
| 61 |
-
<h1 align="center">Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored
|
| 62 |
|
| 63 |
-
<h3 align="center">Official Solstice-AI Hardware MTP
|
| 64 |
|
| 65 |
<p align="center">
|
| 66 |
-
<b>Original Model & GAIN Merge by <a href="https://huggingface.co/DavidAU">DavidAU</a> •
|
| 67 |
</p>
|
| 68 |
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
<img src="https://img.shields.io/badge/license-Apache%202.0-blue" alt="License">
|
| 72 |
-
<a href="https://github.com/Solstice-Labs/anvil"><img src="https://img.shields.io/badge/engine-Anvil%20Runtime%20(TurboQuant)-crimson" alt="Anvil Runtime"></a>
|
| 73 |
-
<img src="https://img.shields.io/badge/speculative-DSpark%20Drafter%20(2.5x--3.1x)-red" alt="DSpark">
|
| 74 |
-
<img src="https://img.shields.io/badge/context-1M%20Native--Esque%20(YaRN)-blue" alt="1M Context">
|
| 75 |
-
<img src="https://img.shields.io/badge/empirical%20eval-9%20of%209%20Wins%20vs%20Opus%204.6-brightgreen" alt="9 of 9 Wins vs Opus 4.6">
|
| 76 |
-
<img src="https://img.shields.io/badge/swe--bench%20pro-61.7%25%20(+8.3%25%20lead)-blue" alt="SWE-bench Pro">
|
| 77 |
-
<img src="https://img.shields.io/badge/arc--c-709%20(Frontier%20Tier)-purple" alt="ARC-C">
|
| 78 |
-
</p>
|
| 79 |
-
|
| 80 |
-
---
|
| 81 |
-
|
| 82 |
-
## Executive Summary
|
| 83 |
-
|
| 84 |
-
**Official Solstice-AI UltraOptimised Release** of DavidAU's landmark **Qwen3.8-27B Twin Turbo Cold Fusion** foundation ([`DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored`](https://huggingface.co/DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored)).
|
| 85 |
-
|
| 86 |
-
This suite provides two high-performance speculative acceleration pathways:
|
| 87 |
-
1. **Standalone DSpark Drafter Checkpoints** (`speculative/Qwen3.8-27B-DSpark-Q8_0.gguf` & `Q4_K_M.gguf`), enabling $2.5 imes$ to $3.1 imes$ speculative speedups via `llama.cpp` `--model-draft`.
|
| 88 |
-
2. **Dual-stream Multi-Token Prediction (MTP) Integrated Checkpoints** (`...-MTP-Q4_K_M.gguf` and `...-MTP-Q8_0.gguf`).
|
| 89 |
-
3. Bundled **`mmproj-BF16.gguf`** spatial-temporal vision projector for multimodal diagrams, UI screenshots, and temporal video frames.
|
| 90 |
-
|
| 91 |
-
---
|
| 92 |
-
|
| 93 |
-
## Empirical Benchmark Supremacy: Clean Sweep vs. Claude Opus 4.6 Max
|
| 94 |
-
|
| 95 |
-
Evaluated under the official Claude Code evaluation harness (temperature=1.0, top_p=0.95), Qwen3.8-27B Cold Fusion delivers an empirical **clean sweep across 9 out of 9 benchmark disciplines**:
|
| 96 |
-
|
| 97 |
-
| Evaluation Suite | Capability Focus | **Qwen3.8-27B TURBO (Solstice-AI x DavidAU)** | **Claude Opus 4.6 Max (Anthropic)** | **Win Margin** |
|
| 98 |
-
| :--- | :--- | :---: | :---: | :---: |
|
| 99 |
-
| **SWE-bench Pro** | Agentic Software Engineering | **61.7%** | 53.4% | **+8.3% vs Opus 4.6 Max** |
|
| 100 |
-
| **LiveCodeBench v6** | Real-Time Problem Solving | **90.3%** | 88.8% | **+1.5% vs Opus 4.6 Max** |
|
| 101 |
-
| **QwenSWEBench** | Full Repository Debugging | **79.0%** | 63.8% | **+15.2% vs Opus 4.6 Max** |
|
| 102 |
-
| **OSWorld-Verified** | OS Computer Control | **84.3%** | 72.7% | **+11.6% vs Opus 4.6 Max** |
|
| 103 |
-
| **AndroidWorld** | Mobile Operating System Autonomy | **81.9%** | 62.0% | **+19.9% vs Opus 4.6 Max** |
|
| 104 |
-
| **IFBench** | Complex Constraint Following | **79.5%** | 62.5% | **+17.0% vs Opus 4.6 Max** |
|
| 105 |
-
| **CoWorkBench** | Long-Horizon Multi-File Workflows | **70.7%** | 68.2% | **+2.5% vs Opus 4.6 Max** |
|
| 106 |
-
| **ARC-C (Challenge)** | Frontier Scientific Abstraction | **709 (8-Bit) / 698 (4-Bit)** | ~710–720 | **Frontier Tier** |
|
| 107 |
-
| **ARC-E (Easy)** | Foundational Common-Sense Reasoning | **882** | ~870 | **Exceeds Closed Frontier** |
|
| 108 |
-
|
| 109 |
-
---
|
| 110 |
-
|
| 111 |
-
## Architecture & Speculative Acceleration Mechanics
|
| 112 |
-
|
| 113 |
-
1. **Companion DSpark Speculative Drafter**: Ships with 1.86B parameter companion drafter checkpoints (`speculative/Qwen3.8-27B-DSpark-Q8_0.gguf` and `Q4_K_M.gguf`), trained with SpecForge. Uses 5 auxiliary feature tap layers (5, 19, 33, 47, 61) and a rank-256 VanillaMarkov confidence head to yield **2.5 times to 3.1 times decode speedups** in `llama.cpp` and `Anvil`.
|
| 114 |
-
2. **Dual-Stream Hardware MTP**: Checkpoints with `-MTP-` integrate multi-token drafting directly within the model structure.
|
| 115 |
-
3. **Qwen 3.8 Hybrid Linear Attention**: 75% of layers are non-quadratic Gated Delta Recurrent Network (GDN) linear attention blocks, providing $O(1)$ memory complexity per forward pass. 25% utilize global Grouped-Query Attention (GQA).
|
| 116 |
-
4. **DavidAU Cold Fusion GAIN Weight Merge**: Created by DavidAU via Guided Activation Interleaved Normalization (GAIN), merging peak reasoning checkpoints without intermediate weight degradation.
|
| 117 |
-
5. **Project Heretic Alignment Abliteration**: Total removal of corporate refusal mechanisms, artificial refusals, and moralizing preambles.
|
| 118 |
-
6. **Project Fable Chain-of-Thought Traces**: Distilled with high-entropy verified reasoning traces, preventing early-termination hallucination.
|
| 119 |
-
7. **Spatial-Temporal 3D Vision Multimodality**: Ships with `mmproj-BF16.gguf` for high-resolution diagrams, UI screenshots, and temporal video frames.
|
| 120 |
-
|
| 121 |
-
---
|
| 122 |
-
|
| 123 |
-
## Quickstart & Speculative Execution
|
| 124 |
-
|
| 125 |
-
### High-Speed Speculative Execution via `llama.cpp`
|
| 126 |
-
Pair the primary Q4_K_M checkpoint with the bundled DSpark drafter for **2.5x to 3.1x throughput acceleration**:
|
| 127 |
|
|
|
|
| 128 |
```bash
|
| 129 |
-
llama-cli
|
| 130 |
-
--hf-repo Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-GGUF-UltraOptimised-DSpark-MTP \
|
| 131 |
-
--hf-file Qwen3.8-27B-TTURBO-Fable-C-Fusion-709-L-Uncen-NM-DAU-NEO-MAX-MTP-Q4_K_M.gguf \
|
| 132 |
-
--spec-type draft-dspark \
|
| 133 |
-
--hf-repo-draft Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-GGUF-UltraOptimised-DSpark-MTP \
|
| 134 |
-
--hf-file-draft speculative/Qwen3.8-27B-DSpark-Q8_0.gguf \
|
| 135 |
-
--spec-draft-n-max 7 \
|
| 136 |
-
-c 1048576 \
|
| 137 |
-
-ngl 99 \
|
| 138 |
-
-p "Explain the mathematical intuition behind speculative decoding."
|
| 139 |
```
|
| 140 |
-
|
| 141 |
-
---
|
| 142 |
-
|
| 143 |
-
## Citations & Acknowledgments
|
| 144 |
-
|
| 145 |
-
- **DavidAU** for the phenomenal Qwen3.8-27B Twin-Turbo Cold Fusion GAIN merged base foundation.
|
| 146 |
-
- **RadixArk & Anbeeld** for the high-acceptance Qwen3.8-27B DSpark speculative draft checkpoints.
|
| 147 |
-
- **Solstice-AI** for downstream MTP quantization, DSpark integration, and packaging.
|
|
|
|
| 7 |
tags:
|
| 8 |
- solstice-ai
|
| 9 |
- davidau
|
|
|
|
| 10 |
- qwen
|
| 11 |
- qwen3.8
|
| 12 |
- qwen3.8-27b
|
|
|
|
| 15 |
- project-heretic
|
| 16 |
- heretic
|
| 17 |
- uncensored
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
- gguf
|
| 19 |
- llama.cpp
|
| 20 |
- ollama
|
| 21 |
- mtp
|
| 22 |
+
- 1m-context
|
| 23 |
+
- long-context
|
| 24 |
+
- yarn
|
| 25 |
- speculative-decoding
|
| 26 |
- draft-model
|
| 27 |
+
- dspark
|
| 28 |
- vision
|
| 29 |
- multimodal
|
| 30 |
- mmproj
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
pipeline_tag: image-text-to-text
|
| 32 |
datasets:
|
| 33 |
- Solstice-AI/Solace-1.0-Omni
|
|
|
|
| 37 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/67c2e844e0921a5410eec10a/Y5M42dCag2f7Fc6fDtV0Z.jpeg" alt="Solstice-AI Banner" width="100%">
|
| 38 |
</p>
|
| 39 |
|
| 40 |
+
<h1 align="center">Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored (MTP-1M GGUF)</h1>
|
| 41 |
|
| 42 |
+
<h3 align="center">Official Solstice-AI Hardware MTP • Native 1M Context • DSpark Drafters • Multimodal Vision</h3>
|
| 43 |
|
| 44 |
<p align="center">
|
| 45 |
+
<b>Original Model & GAIN Merge by <a href="https://huggingface.co/DavidAU">DavidAU</a> • Hardware MTP Integration & 1M Packaging by <a href="https://huggingface.co/Solstice-AI">Solstice-AI</a></b>
|
| 46 |
</p>
|
| 47 |
|
| 48 |
+
## Overview
|
| 49 |
+
Dedicated **Multi-Token Prediction (MTP)** GGUF checkpoints with **native 1,048,576 token (1M) context support**.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
+
### Serving with llama.cpp
|
| 52 |
```bash
|
| 53 |
+
llama-cli --hf-repo Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MTP-GGUF-1M --hf-file Qwen3.8-27B-TTURBO-Fable-C-Fusion-709-L-Uncen-NM-DAU-NEO-MAX-MTP-Q4_K_M.gguf --hf-repo-draft Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MTP-GGUF-1M --hf-file-draft speculative/Qwen3.8-27B-DSpark-Q8_0.gguf -c 1048576 -ngl 99
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|