| NOTICE |
|
|
| Swift-1.5-Qwen3.8-27B huihui-style abliterated NVFP4 NInfer artifact |
| ==================================================================== |
|
|
| This repository contains a single-file NInfer engine artifact (NVFP4/FP8 |
| mixed-precision weights, container v3, with vision tower, MTP head and a |
| DFlash2 drafter) plus the build records that make it reproducible. |
|
|
| Licence |
| |
| The Swift 1.5 checkpoint is distributed under the Swift Open License v1.0 (see |
| LICENSE in this repository); this artifact is a derivative of it, so the Swift |
| Open License v1.0 continues to apply to the Swift Contribution it contains. |
| The Qwen3.8-27B base-model portion is Apache-2.0 (Copyright 2026 Alibaba Cloud; |
| see LICENSE-APACHE-2.0). The abliteration delta is derived from |
| huihui-ai/Huihui-Qwen3.8-27B-abliterated (Apache-2.0). The DFlash2 drafter is |
| z-lab/Qwen3.8-27B-DFlash2 (see its model card for its licence). Free commercial |
| use is subject to the $1,000,000-per-fiscal-year gross-revenue threshold of the |
| Swift Open License v1.0. This is a description, not legal advice. |
|
|
| Statement of changes (Swift Open License v1.0, sections 4-5) |
| |
| The weights in this repository are MODIFIED relative to the Swift 1.5 checkpoint: |
|
|
| 1. Abliteration (weights changed). 70 tensors of the language model were changed |
| by a per-tensor weight-difference transfer: |
| W_ablated = W_swift15 + (W_huihui - W_qwen) (fp32, rounded to bf16) |
| where W_qwen is Qwen/Qwen3.8-27B and W_huihui is |
| huihui-ai/Huihui-Qwen3.8-27B-abliterated. The changed tensors are the |
| self_attn.o_proj / linear_attn.out_proj / mlp.down_proj matrices of language |
| layers 17..51 (measured, not assumed; see ablation-report.json). Every other |
| tensor - including all vision (model.visual.*), MTP (mtp.*), lm_head and |
| embedding tensors - is bit-identical to Swift 1.5 (source-audit.json). |
| 2. Quantization (numerical format changed). llm-compressor oneshot with the |
| NVFP4+FP8 allocation of unsloth/Qwen3.8-27B-NVFP4 (recipe/unsloth_qconfig.json), |
| 32 calibration samples from ultrachat-200k, sequence length 2048. |
| 3. Conversion (container format changed). Neroued/ninfer, official |
| tools.convert, recipe qwen3_8_27b_nvfp4, components text,vision,mtp,dflash2, |
| with the maintained tools/chat_templates/qwen3_8.jinja chat template. |
|
|
| Pinned inputs |
| |
| ukisai/Swift-1.5-Qwen3.8-27b bc7a1e10b689648585a3ef41494c8d84cf77271a |
| Qwen/Qwen3.8-27B 1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0 |
| huihui-ai/Huihui-Qwen3.8-27B-abliterated 739e3c5b89849f6c238ce1e5b70008612ae42cdd |
| z-lab/Qwen3.8-27B-DFlash2 50307d4c4cde6860d4eee73e2547cd786fe8e8a4 |
| Neroued/ninfer bace20dc70249eed6402b66d4852c6c3f9612905 |
|
|
| The refusal-rate evaluation code in recipe/ reproduces the keyword scorer of |
| p-e-w/heretic @ 3521f8648a0dccf6e12a92666862632235fac7e6 |
| (heretic/scorers/keyword_rate.py, AGPL-3.0-or-later); the marker list is used |
| for comparability of numbers only. |
|
|
| The engine is built exclusively for NVIDIA Blackwell compute capability |
| 12.0 (sm_120a). |
|
|
