ttupper75035 commited on
Commit
06c840b
·
verified ·
1 Parent(s): e1302de

Add self-describing model card (mtp-sidecar)

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen3.5-9B-Base
3
+ tags:
4
+ - mtp-sidecar
5
+ - skulk
6
+ - foxlight
7
+ license: apache-2.0
8
+ license_link: https://huggingface.co/Qwen/Qwen3.5-9B-Base/blob/main/LICENSE
9
+ foxlight:
10
+ artifact_type: mtp-sidecar
11
+ source_repo: Qwen/Qwen3.5-9B-Base
12
+ source_revision: 68c46c4b3498877f3ef123c856ecfde50c39f404
13
+ target_model: Qwen/Qwen3.5-9B-Base
14
+ extracted_with: skulk-weights-publisher 0.1.0
15
+ generated_at: '2026-06-02T16:51:57Z'
16
+ ---
17
+
18
+ # FoxlightAI/qwen3-5-9b-base-mtp
19
+
20
+ This repository contains an **MTP speculative-decoding sidecar** derived from [`Qwen/Qwen3.5-9B-Base`](https://huggingface.co/Qwen/Qwen3.5-9B-Base). It is **not a standalone model** — it provides the multi-token-prediction heads used by [Skulk](https://github.com/Foxlight-Foundation/Skulk) to speculatively decode for the target model **`Qwen/Qwen3.5-9B-Base`**. The heads ship at full precision (**bf16, unquantized**) — they are the speculative drafter, where precision drives draft acceptance — so there is **one sidecar per base model** and it serves **every quantization** of the target.
21
+
22
+ ## Provenance
23
+
24
+ | Field | Value |
25
+ | --- | --- |
26
+ | Artifact type | mtp-sidecar |
27
+ | Source model | `Qwen/Qwen3.5-9B-Base` |
28
+ | Source revision | `68c46c4b3498877f3ef123c856ecfde50c39f404` |
29
+ | Target model | `Qwen/Qwen3.5-9B-Base` |
30
+ | Extracted with | skulk-weights-publisher `0.1.0` |
31
+ | Generated | 2026-06-02T16:51:57Z |
32
+
33
+ ## Usage
34
+
35
+ Skulk loads this sidecar (`mtp.safetensors`) alongside the target model to enable MTP speculative decoding. It is referenced from the Skulk Weights Publisher catalog and fetched automatically by the Skulk shard downloader; it is not intended to be loaded standalone.
36
+
37
+ ## License
38
+
39
+ This artifact is derived from [`Qwen/Qwen3.5-9B-Base`](https://huggingface.co/Qwen/Qwen3.5-9B-Base) and is published under that model's original license (**apache-2.0**), preserved unchanged. Refer to the source model's card for the full terms.