MLX
Safetensors
qwen3
dflash2
speculative-decoding
drafter
bonsai
ternary
apple-silicon
Schiltmans commited on
Commit
f5b1334
·
verified ·
1 Parent(s): df485e2

Correct the r3 comparison's status and remove relative dates

Browse files
Files changed (1) hide show
  1. README.md +6 -7
README.md CHANGED
@@ -168,7 +168,7 @@ reasoning, emitted no answer, and ended in repeated `P3DT4H5M` lines. Their toke
168
  by two, 16,391 against 16,389, which is the per-round budget overshoot described above, not a
169
  difference in the answer.
170
 
171
- This non-termination was first recorded on this stack two weeks before this drafter existed,
172
  and across the author's earlier quality runs it tracks the KV cache rather than the
173
  drafter. Counting the controls below, the task passes at 16-bit and 4-bit KV in all five runs
174
  (2,232 to 14,726 tokens), and fails at 8-bit in seven of eight, always by exhausting the budget,
@@ -205,11 +205,10 @@ attention read, and one deterministic greedy run a cell is not a rate.
205
 
206
  - [naklitechie's ternary Bonsai 2 fine-tune](https://huggingface.co/naklitechie/Qwen3.8-27B-DFlash2-ternary-bonsai2)
207
  is an independent DFlash 2 fine-tune against the same target, trained on CUDA. It also beats the
208
- stock drafter on both runtimes measured. Compared with ft5 under the repository's pre-registered
209
- `BENCHMARK.md` (written by this card's author, who trained ft5), it accepted less on every suite.
210
- On general chat at 200 tokens it was 2.41% lower (−3.83% to −1.08%) on its own runtime,
211
- dflash-mlx-bonsai2, and 4.63% lower (−6.39% to −2.72%) on mlx-dspark. The raw reports will be
212
- published with the evidence.
213
  - [nathansutton's Bonsai/DFlash2 MLX pack](https://huggingface.co/nathansutton/Qwen3.8-27B-Ternary-Bonsai-2-DFlash2-MLX)
214
  bundles a converted stock drafter. Its reported 512-token-prompt/128-token-decode result uses
215
  another runtime and template; it is not a matched comparison to these suites.
@@ -230,7 +229,7 @@ target is unsettled. The NOTICE carries Prism ML's material regardless and takes
230
  the question. The fine-tune changes the drafter's weights only: it does not contain, modify or
231
  redistribute the target, which anyone serving this drafter fetches upstream. Training prompts
232
  come from sahil2801/CodeAlpaca-20k (CC BY 4.0); the corpora are not redistributed here. The
233
- upstream licences were reviewed, and re-read unchanged just before publication.
234
 
235
  This is an independent fine-tune, not an official Prism ML, Qwen, Inco AI or z-lab release.
236
 
 
168
  by two, 16,391 against 16,389, which is the per-round budget overshoot described above, not a
169
  difference in the answer.
170
 
171
+ This non-termination was first recorded on this stack before this drafter was trained,
172
  and across the author's earlier quality runs it tracks the KV cache rather than the
173
  drafter. Counting the controls below, the task passes at 16-bit and 4-bit KV in all five runs
174
  (2,232 to 14,726 tokens), and fails at 8-bit in seven of eight, always by exhausting the budget,
 
205
 
206
  - [naklitechie's ternary Bonsai 2 fine-tune](https://huggingface.co/naklitechie/Qwen3.8-27B-DFlash2-ternary-bonsai2)
207
  is an independent DFlash 2 fine-tune against the same target, trained on CUDA. It also beats the
208
+ stock drafter on both runtimes measured. On its own runtime, dflash-mlx-bonsai2, measured under the
209
+ repository's pre-registered `BENCHMARK.md` (written by this card's author, who trained ft5), it
210
+ accepted 2.41% less than ft5 on general chat at 200 tokens (−3.83% to −1.08%). A pre-publication
211
+ screen on mlx-dspark, not a protocol result, found 4.63% less (−6.39% to −2.72%).
 
212
  - [nathansutton's Bonsai/DFlash2 MLX pack](https://huggingface.co/nathansutton/Qwen3.8-27B-Ternary-Bonsai-2-DFlash2-MLX)
213
  bundles a converted stock drafter. Its reported 512-token-prompt/128-token-decode result uses
214
  another runtime and template; it is not a matched comparison to these suites.
 
229
  the question. The fine-tune changes the drafter's weights only: it does not contain, modify or
230
  redistribute the target, which anyone serving this drafter fetches upstream. Training prompts
231
  come from sahil2801/CodeAlpaca-20k (CC BY 4.0); the corpora are not redistributed here. The
232
+ upstream licences were reviewed, and re-read unchanged at publication.
233
 
234
  This is an independent fine-tune, not an official Prism ML, Qwen, Inco AI or z-lab release.
235