---
license: other
license_name: swift-open-license-1.0
license_link: https://huggingface.co/ukisai/Swift-Qwen3.8-27b/blob/main/LICENSE
base_model: ukisai/Swift-Qwen3.8-27b
library_name: mlx
tags:
- mlx
- qwen3_5
- quantized
pipeline_tag: image-text-to-text
---

# Swift-Qwen3.8-27B-MLX-8bit

MLX **8bit** (affine, group size 64) quantized
variant of [ukisai/Swift-Qwen3.8-27b](https://huggingface.co/ukisai/Swift-Qwen3.8-27b) (text tower quantized; vision tower and projector retained in BF16) for Apple
silicon via [mlx-lm](https://github.com/ml-explore/mlx-lm).

## Provenance

- Source: [ukisai/Swift-Qwen3.8-27b](https://huggingface.co/ukisai/Swift-Qwen3.8-27b) @ revision
  `048328f4059015b63f860a453bf94834af0db683` (Swift Open License v1.0 for the UkisAI contribution + Apache-2.0 for the Qwen base (upstream `LICENSE`, `LICENSE-APACHE-2.0`, `NOTICE`)).
- Quantized with `mlx_lm.convert` (mlx-lm 0.31.3): affine,
  8-bit, group size 64.

## Smoke gate

Before upload this pack passed a deterministic coherence gate: greedy
48-token chat generation loaded through
`mlx_lm.load`, judged for emptiness, repetition loops, multi-script
gibberish, and special-token debris. Verdict: `ok`.

## Usage

```bash
pip install mlx-lm
mlx_lm.generate --model majentik/Swift-Qwen3.8-27B-MLX-8bit --prompt "Hello"
```

## Evaluation

Coherence smoke gate only at publish time (see *Smoke gate* above). Per-tier gate records live in [majentik/garden-quant-bench](https://huggingface.co/datasets/majentik/garden-quant-bench); perplexity / benchmark rows are added here when measured.
## License

This pack is a quantized (Object-form) redistribution of `ukisai/Swift-Qwen3.8-27b` and inherits its dual
licensing unchanged:

- the Qwen/Qwen3.8-27B base weights remain under **Apache-2.0** (`LICENSE-APACHE-2.0`);
- the UkisAI Swift contribution (finetune) is under the **Swift Open License v1.0** (`LICENSE`),
  which is free for research and commercial use by organisations with up to US$1M gross annual
  revenue; larger organisations need a Swift Enterprise License from UkisAI.

`LICENSE`, `LICENSE-APACHE-2.0` and `NOTICE` are shipped verbatim in this repository as required by
Section 4 (Redistribution) of the Swift Open License. The only change from upstream is the MLX
quantization described above.

## Available tiers

| Repo | Quant |
| --- | --- |
| [majentik/Swift-Qwen3.8-27B-MLX-2bit](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-2bit) | 2bit |
| [majentik/Swift-Qwen3.8-27B-MLX-3bit](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-3bit) | 3bit |
| [majentik/Swift-Qwen3.8-27B-MLX-4bit](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-4bit) | 4bit |
| [majentik/Swift-Qwen3.8-27B-MLX-5bit](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-5bit) | 5bit |
| [majentik/Swift-Qwen3.8-27B-MLX-6bit](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-6bit) | 6bit |
| [majentik/Swift-Qwen3.8-27B-MLX-8bit](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-8bit) | 8bit |
| [majentik/Swift-Qwen3.8-27B-MLX-MXFP4](https://huggingface.co/majentik/Swift-Qwen3.8-27B-MLX-MXFP4) | MXFP4 |