Swift-Qwen3.8-Flash-Next V3 โ Slipstream package (Splash Q4)
nitinpanj/Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-GGUF, converted into the ready-to-run package format of Slipstream, the C++/Metal inference engine for Apple Silicon. Slipstream serves the GGUF too, but converts it on its first start; this package skips that step and needs no disk space for a second copy.
This is not a GGUF. It is Slipstream's
splash-packed-q4-qwen4expformat (schema 5) and runs only in Slipstream. For llama.cpp, use the original GGUF linked above.
Use
curl -fsSL https://github.com/mzinner/slipstream/raw/main/install.sh | sh
slipstream serve --model MikeZ75/Swift-Qwen3.8-Flash-Next-V3-Splash
The first start downloads the package into ~/.slipstream/models and verifies every file against
manifest.json. Or use Slipstream Menubar,
which installs Slipstream and the model and runs the server from the menu bar.
Requirements: an Apple Silicon Mac with 64 GB of memory, and about 100 GiB of free disk. Measured on a 64 GB Mac: about 42 tokens/s decoding, with MTP speculative drafting.
Contents
| Part | Files | Size |
|---|---|---|
| Target model: 48 layers, embedding, head, n-gram table, MTP layer | target/*.bin |
~99.8 GiB |
| Draft model (a placeholder the format requires) | draft/*.bin |
~0.1 MiB |
| Tokenizer | tokenizer/ |
~20 MiB |
| Every file with its size and SHA-256 | manifest.json |
Routed experts and the n-gram table are tiled 4-bit (groups of 64); attention, mixers, shared
experts, embedding and head are 8-bit. The MTP draft head comes from
nitinpanj/qwen38-flash-next-v3, and
target/draft-vocab.bin from
nitinpanj/Swift-Qwen3.8-Flash-Next-Splash.
Converted with Slipstream's GGUF converter (models/qwen4exp/tools/convert_qwen4exp_gguf.py, 26.10.2);
Slipstream 26.10.4 converts the same GGUF into byte-identical files.
Credits and license
- Model: UkisAI's Swift (ukisai/Swift-Qwen3.8-Flash-Next), based on Qwen3.8-Flash-Next by Qwen.
- GGUF, MTP head and draft vocabulary: nitinpanj, who also wrote the Slipstream runtime and its converter (npanj/slipstream).
- This conversion: MikeZ75. No weights were changed beyond the format conversion.
Licensed like its source, under the Qwen Community License 1.0.
- Downloads last month
- 138
Model tree for MikeZ75/Swift-Qwen3.8-Flash-Next-V3-Splash
Base model
Qwen/Qwen3.8-Flash-Next