Instructions to use Schiltmans/Ternary-Bonsai-2-27B-DFlash2-ft5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Schiltmans/Ternary-Bonsai-2-27B-DFlash2-ft5 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download Schiltmans/Ternary-Bonsai-2-27B-DFlash2-ft5 --local-dir Ternary-Bonsai-2-27B-DFlash2-ft5
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Correct the r3 comparison's status and remove relative dates
Browse files
README.md
CHANGED
|
@@ -168,7 +168,7 @@ reasoning, emitted no answer, and ended in repeated `P3DT4H5M` lines. Their toke
|
|
| 168 |
by two, 16,391 against 16,389, which is the per-round budget overshoot described above, not a
|
| 169 |
difference in the answer.
|
| 170 |
|
| 171 |
-
This non-termination was first recorded on this stack
|
| 172 |
and across the author's earlier quality runs it tracks the KV cache rather than the
|
| 173 |
drafter. Counting the controls below, the task passes at 16-bit and 4-bit KV in all five runs
|
| 174 |
(2,232 to 14,726 tokens), and fails at 8-bit in seven of eight, always by exhausting the budget,
|
|
@@ -205,11 +205,10 @@ attention read, and one deterministic greedy run a cell is not a rate.
|
|
| 205 |
|
| 206 |
- [naklitechie's ternary Bonsai 2 fine-tune](https://huggingface.co/naklitechie/Qwen3.8-27B-DFlash2-ternary-bonsai2)
|
| 207 |
is an independent DFlash 2 fine-tune against the same target, trained on CUDA. It also beats the
|
| 208 |
-
stock drafter on both runtimes measured.
|
| 209 |
-
`BENCHMARK.md` (written by this card's author, who trained ft5), it
|
| 210 |
-
|
| 211 |
-
|
| 212 |
-
published with the evidence.
|
| 213 |
- [nathansutton's Bonsai/DFlash2 MLX pack](https://huggingface.co/nathansutton/Qwen3.8-27B-Ternary-Bonsai-2-DFlash2-MLX)
|
| 214 |
bundles a converted stock drafter. Its reported 512-token-prompt/128-token-decode result uses
|
| 215 |
another runtime and template; it is not a matched comparison to these suites.
|
|
@@ -230,7 +229,7 @@ target is unsettled. The NOTICE carries Prism ML's material regardless and takes
|
|
| 230 |
the question. The fine-tune changes the drafter's weights only: it does not contain, modify or
|
| 231 |
redistribute the target, which anyone serving this drafter fetches upstream. Training prompts
|
| 232 |
come from sahil2801/CodeAlpaca-20k (CC BY 4.0); the corpora are not redistributed here. The
|
| 233 |
-
upstream licences were reviewed, and re-read unchanged
|
| 234 |
|
| 235 |
This is an independent fine-tune, not an official Prism ML, Qwen, Inco AI or z-lab release.
|
| 236 |
|
|
|
|
| 168 |
by two, 16,391 against 16,389, which is the per-round budget overshoot described above, not a
|
| 169 |
difference in the answer.
|
| 170 |
|
| 171 |
+
This non-termination was first recorded on this stack before this drafter was trained,
|
| 172 |
and across the author's earlier quality runs it tracks the KV cache rather than the
|
| 173 |
drafter. Counting the controls below, the task passes at 16-bit and 4-bit KV in all five runs
|
| 174 |
(2,232 to 14,726 tokens), and fails at 8-bit in seven of eight, always by exhausting the budget,
|
|
|
|
| 205 |
|
| 206 |
- [naklitechie's ternary Bonsai 2 fine-tune](https://huggingface.co/naklitechie/Qwen3.8-27B-DFlash2-ternary-bonsai2)
|
| 207 |
is an independent DFlash 2 fine-tune against the same target, trained on CUDA. It also beats the
|
| 208 |
+
stock drafter on both runtimes measured. On its own runtime, dflash-mlx-bonsai2, measured under the
|
| 209 |
+
repository's pre-registered `BENCHMARK.md` (written by this card's author, who trained ft5), it
|
| 210 |
+
accepted 2.41% less than ft5 on general chat at 200 tokens (−3.83% to −1.08%). A pre-publication
|
| 211 |
+
screen on mlx-dspark, not a protocol result, found 4.63% less (−6.39% to −2.72%).
|
|
|
|
| 212 |
- [nathansutton's Bonsai/DFlash2 MLX pack](https://huggingface.co/nathansutton/Qwen3.8-27B-Ternary-Bonsai-2-DFlash2-MLX)
|
| 213 |
bundles a converted stock drafter. Its reported 512-token-prompt/128-token-decode result uses
|
| 214 |
another runtime and template; it is not a matched comparison to these suites.
|
|
|
|
| 229 |
the question. The fine-tune changes the drafter's weights only: it does not contain, modify or
|
| 230 |
redistribute the target, which anyone serving this drafter fetches upstream. Training prompts
|
| 231 |
come from sahil2801/CodeAlpaca-20k (CC BY 4.0); the corpora are not redistributed here. The
|
| 232 |
+
upstream licences were reviewed, and re-read unchanged at publication.
|
| 233 |
|
| 234 |
This is an independent fine-tune, not an official Prism ML, Qwen, Inco AI or z-lab release.
|
| 235 |
|