Swift-Qwen3.8-Flash-Next V3 โ€” Slipstream package (Splash Q4)

nitinpanj/Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-GGUF, converted into the ready-to-run package format of Slipstream, the C++/Metal inference engine for Apple Silicon. Slipstream serves the GGUF too, but converts it on its first start; this package skips that step and needs no disk space for a second copy.

This is not a GGUF. It is Slipstream's splash-packed-q4-qwen4exp format (schema 5) and runs only in Slipstream. For llama.cpp, use the original GGUF linked above.

Use

curl -fsSL https://github.com/mzinner/slipstream/raw/main/install.sh | sh
slipstream serve --model MikeZ75/Swift-Qwen3.8-Flash-Next-V3-Splash

The first start downloads the package into ~/.slipstream/models and verifies every file against manifest.json. Or use Slipstream Menubar, which installs Slipstream and the model and runs the server from the menu bar.

Requirements: an Apple Silicon Mac with 64 GB of memory, and about 100 GiB of free disk. Measured on a 64 GB Mac: about 42 tokens/s decoding, with MTP speculative drafting.

Contents

Part Files Size
Target model: 48 layers, embedding, head, n-gram table, MTP layer target/*.bin ~99.8 GiB
Draft model (a placeholder the format requires) draft/*.bin ~0.1 MiB
Tokenizer tokenizer/ ~20 MiB
Every file with its size and SHA-256 manifest.json

Routed experts and the n-gram table are tiled 4-bit (groups of 64); attention, mixers, shared experts, embedding and head are 8-bit. The MTP draft head comes from nitinpanj/qwen38-flash-next-v3, and target/draft-vocab.bin from nitinpanj/Swift-Qwen3.8-Flash-Next-Splash.

Converted with Slipstream's GGUF converter (models/qwen4exp/tools/convert_qwen4exp_gguf.py, 26.10.2); Slipstream 26.10.4 converts the same GGUF into byte-identical files.

Credits and license

Licensed like its source, under the Qwen Community License 1.0.

Downloads last month
138
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MikeZ75/Swift-Qwen3.8-Flash-Next-V3-Splash