SolsticeAI commited on
Commit
4cc9661
·
verified ·
1 Parent(s): 6daf88d

Add official Solstice-AI MTP 1M documentation

Browse files
Files changed (1) hide show
  1. README.md +11 -104
README.md CHANGED
@@ -7,7 +7,6 @@ base_model: DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored
7
  tags:
8
  - solstice-ai
9
  - davidau
10
- - davidau-quants
11
  - qwen
12
  - qwen3.8
13
  - qwen3.8-27b
@@ -16,39 +15,19 @@ tags:
16
  - project-heretic
17
  - heretic
18
  - uncensored
19
- - abliterated
20
- - fable
21
- - cot
22
- - reasoning
23
- - coding
24
- - swe-bench
25
- - swe-bench-pro
26
- - livecodebench
27
- - beats-claude-opus-4.6
28
- - claude-opus-4.6
29
  - gguf
30
  - llama.cpp
31
  - ollama
32
  - mtp
33
- - dspark
 
 
34
  - speculative-decoding
35
  - draft-model
 
36
  - vision
37
  - multimodal
38
  - mmproj
39
- - q8_0
40
- - q6_k
41
- - q5_k_m
42
- - q4_k_m
43
- - iq4_nl
44
- - iq4_xs
45
- - anvil
46
- - turboquant
47
- - arc-challenge
48
- - 709-arc
49
- - 1m-context
50
- - long-context
51
- - yarn
52
  pipeline_tag: image-text-to-text
53
  datasets:
54
  - Solstice-AI/Solace-1.0-Omni
@@ -58,90 +37,18 @@ datasets:
58
  <img src="https://cdn-uploads.huggingface.co/production/uploads/67c2e844e0921a5410eec10a/Y5M42dCag2f7Fc6fDtV0Z.jpeg" alt="Solstice-AI Banner" width="100%">
59
  </p>
60
 
61
- <h1 align="center">Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MTP-1M (GGUF Ultra-Optimised)</h1>
62
 
63
- <h3 align="center">Official Solstice-AI Hardware MTP Ultra-Optimised &bull; Native-Esque 1M Context Window &bull; DSpark Drafters</h3>
64
 
65
  <p align="center">
66
- <b>Original Model & GAIN Merge by <a href="https://huggingface.co/DavidAU">DavidAU</a> &bull; Downstream Quantization, MTP Integration & Packaging by <a href="https://huggingface.co/Solstice-AI">Solstice-AI</a></b>
67
  </p>
68
 
69
- <p align="center">
70
- <img src="https://img.shields.io/badge/org-Solstice--AI-blueviolet" alt="Solstice-AI">
71
- <img src="https://img.shields.io/badge/license-Apache%202.0-blue" alt="License">
72
- <a href="https://github.com/Solstice-Labs/anvil"><img src="https://img.shields.io/badge/engine-Anvil%20Runtime%20(TurboQuant)-crimson" alt="Anvil Runtime"></a>
73
- <img src="https://img.shields.io/badge/speculative-DSpark%20Drafter%20(2.5x--3.1x)-red" alt="DSpark">
74
- <img src="https://img.shields.io/badge/context-1M%20Native--Esque%20(YaRN)-blue" alt="1M Context">
75
- <img src="https://img.shields.io/badge/empirical%20eval-9%20of%209%20Wins%20vs%20Opus%204.6-brightgreen" alt="9 of 9 Wins vs Opus 4.6">
76
- <img src="https://img.shields.io/badge/swe--bench%20pro-61.7%25%20(+8.3%25%20lead)-blue" alt="SWE-bench Pro">
77
- <img src="https://img.shields.io/badge/arc--c-709%20(Frontier%20Tier)-purple" alt="ARC-C">
78
- </p>
79
-
80
- ---
81
-
82
- ## Executive Summary
83
-
84
- **Official Solstice-AI UltraOptimised Release** of DavidAU's landmark **Qwen3.8-27B Twin Turbo Cold Fusion** foundation ([`DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored`](https://huggingface.co/DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored)).
85
-
86
- This suite provides two high-performance speculative acceleration pathways:
87
- 1. **Standalone DSpark Drafter Checkpoints** (`speculative/Qwen3.8-27B-DSpark-Q8_0.gguf` & `Q4_K_M.gguf`), enabling $2.5 imes$ to $3.1 imes$ speculative speedups via `llama.cpp` `--model-draft`.
88
- 2. **Dual-stream Multi-Token Prediction (MTP) Integrated Checkpoints** (`...-MTP-Q4_K_M.gguf` and `...-MTP-Q8_0.gguf`).
89
- 3. Bundled **`mmproj-BF16.gguf`** spatial-temporal vision projector for multimodal diagrams, UI screenshots, and temporal video frames.
90
-
91
- ---
92
-
93
- ## Empirical Benchmark Supremacy: Clean Sweep vs. Claude Opus 4.6 Max
94
-
95
- Evaluated under the official Claude Code evaluation harness (temperature=1.0, top_p=0.95), Qwen3.8-27B Cold Fusion delivers an empirical **clean sweep across 9 out of 9 benchmark disciplines**:
96
-
97
- | Evaluation Suite | Capability Focus | **Qwen3.8-27B TURBO (Solstice-AI x DavidAU)** | **Claude Opus 4.6 Max (Anthropic)** | **Win Margin** |
98
- | :--- | :--- | :---: | :---: | :---: |
99
- | **SWE-bench Pro** | Agentic Software Engineering | **61.7%** | 53.4% | **+8.3% vs Opus 4.6 Max** |
100
- | **LiveCodeBench v6** | Real-Time Problem Solving | **90.3%** | 88.8% | **+1.5% vs Opus 4.6 Max** |
101
- | **QwenSWEBench** | Full Repository Debugging | **79.0%** | 63.8% | **+15.2% vs Opus 4.6 Max** |
102
- | **OSWorld-Verified** | OS Computer Control | **84.3%** | 72.7% | **+11.6% vs Opus 4.6 Max** |
103
- | **AndroidWorld** | Mobile Operating System Autonomy | **81.9%** | 62.0% | **+19.9% vs Opus 4.6 Max** |
104
- | **IFBench** | Complex Constraint Following | **79.5%** | 62.5% | **+17.0% vs Opus 4.6 Max** |
105
- | **CoWorkBench** | Long-Horizon Multi-File Workflows | **70.7%** | 68.2% | **+2.5% vs Opus 4.6 Max** |
106
- | **ARC-C (Challenge)** | Frontier Scientific Abstraction | **709 (8-Bit) / 698 (4-Bit)** | ~710–720 | **Frontier Tier** |
107
- | **ARC-E (Easy)** | Foundational Common-Sense Reasoning | **882** | ~870 | **Exceeds Closed Frontier** |
108
-
109
- ---
110
-
111
- ## Architecture & Speculative Acceleration Mechanics
112
-
113
- 1. **Companion DSpark Speculative Drafter**: Ships with 1.86B parameter companion drafter checkpoints (`speculative/Qwen3.8-27B-DSpark-Q8_0.gguf` and `Q4_K_M.gguf`), trained with SpecForge. Uses 5 auxiliary feature tap layers (5, 19, 33, 47, 61) and a rank-256 VanillaMarkov confidence head to yield **2.5 times to 3.1 times decode speedups** in `llama.cpp` and `Anvil`.
114
- 2. **Dual-Stream Hardware MTP**: Checkpoints with `-MTP-` integrate multi-token drafting directly within the model structure.
115
- 3. **Qwen 3.8 Hybrid Linear Attention**: 75% of layers are non-quadratic Gated Delta Recurrent Network (GDN) linear attention blocks, providing $O(1)$ memory complexity per forward pass. 25% utilize global Grouped-Query Attention (GQA).
116
- 4. **DavidAU Cold Fusion GAIN Weight Merge**: Created by DavidAU via Guided Activation Interleaved Normalization (GAIN), merging peak reasoning checkpoints without intermediate weight degradation.
117
- 5. **Project Heretic Alignment Abliteration**: Total removal of corporate refusal mechanisms, artificial refusals, and moralizing preambles.
118
- 6. **Project Fable Chain-of-Thought Traces**: Distilled with high-entropy verified reasoning traces, preventing early-termination hallucination.
119
- 7. **Spatial-Temporal 3D Vision Multimodality**: Ships with `mmproj-BF16.gguf` for high-resolution diagrams, UI screenshots, and temporal video frames.
120
-
121
- ---
122
-
123
- ## Quickstart & Speculative Execution
124
-
125
- ### High-Speed Speculative Execution via `llama.cpp`
126
- Pair the primary Q4_K_M checkpoint with the bundled DSpark drafter for **2.5x to 3.1x throughput acceleration**:
127
 
 
128
  ```bash
129
- llama-cli \
130
- --hf-repo Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-GGUF-UltraOptimised-DSpark-MTP \
131
- --hf-file Qwen3.8-27B-TTURBO-Fable-C-Fusion-709-L-Uncen-NM-DAU-NEO-MAX-MTP-Q4_K_M.gguf \
132
- --spec-type draft-dspark \
133
- --hf-repo-draft Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-GGUF-UltraOptimised-DSpark-MTP \
134
- --hf-file-draft speculative/Qwen3.8-27B-DSpark-Q8_0.gguf \
135
- --spec-draft-n-max 7 \
136
- -c 1048576 \
137
- -ngl 99 \
138
- -p "Explain the mathematical intuition behind speculative decoding."
139
  ```
140
-
141
- ---
142
-
143
- ## Citations & Acknowledgments
144
-
145
- - **DavidAU** for the phenomenal Qwen3.8-27B Twin-Turbo Cold Fusion GAIN merged base foundation.
146
- - **RadixArk & Anbeeld** for the high-acceptance Qwen3.8-27B DSpark speculative draft checkpoints.
147
- - **Solstice-AI** for downstream MTP quantization, DSpark integration, and packaging.
 
7
  tags:
8
  - solstice-ai
9
  - davidau
 
10
  - qwen
11
  - qwen3.8
12
  - qwen3.8-27b
 
15
  - project-heretic
16
  - heretic
17
  - uncensored
 
 
 
 
 
 
 
 
 
 
18
  - gguf
19
  - llama.cpp
20
  - ollama
21
  - mtp
22
+ - 1m-context
23
+ - long-context
24
+ - yarn
25
  - speculative-decoding
26
  - draft-model
27
+ - dspark
28
  - vision
29
  - multimodal
30
  - mmproj
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  pipeline_tag: image-text-to-text
32
  datasets:
33
  - Solstice-AI/Solace-1.0-Omni
 
37
  <img src="https://cdn-uploads.huggingface.co/production/uploads/67c2e844e0921a5410eec10a/Y5M42dCag2f7Fc6fDtV0Z.jpeg" alt="Solstice-AI Banner" width="100%">
38
  </p>
39
 
40
+ <h1 align="center">Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored (MTP-1M GGUF)</h1>
41
 
42
+ <h3 align="center">Official Solstice-AI Hardware MTP &bull; Native 1M Context &bull; DSpark Drafters &bull; Multimodal Vision</h3>
43
 
44
  <p align="center">
45
+ <b>Original Model & GAIN Merge by <a href="https://huggingface.co/DavidAU">DavidAU</a> &bull; Hardware MTP Integration & 1M Packaging by <a href="https://huggingface.co/Solstice-AI">Solstice-AI</a></b>
46
  </p>
47
 
48
+ ## Overview
49
+ Dedicated **Multi-Token Prediction (MTP)** GGUF checkpoints with **native 1,048,576 token (1M) context support**.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
 
51
+ ### Serving with llama.cpp
52
  ```bash
53
+ llama-cli --hf-repo Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MTP-GGUF-1M --hf-file Qwen3.8-27B-TTURBO-Fable-C-Fusion-709-L-Uncen-NM-DAU-NEO-MAX-MTP-Q4_K_M.gguf --hf-repo-draft Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MTP-GGUF-1M --hf-file-draft speculative/Qwen3.8-27B-DSpark-Q8_0.gguf -c 1048576 -ngl 99
 
 
 
 
 
 
 
 
 
54
  ```