File size: 1,301 Bytes
613dfeb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 | ---
language:
- en
- zh
license: apache-2.0
base_model: DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored
tags:
- solstice-ai
- davidau
- qwen
- qwen3.8
- qwen3.8-27b
- cold-fusion
- gain
- project-heretic
- heretic
- uncensored
- mxfp4
- ocp
- microscaling
- vllm
- sglang
- compressed-tensors
- 4-bit
- vision
- multimodal
- mmproj
pipeline_tag: image-text-to-text
---
<p align="center">
<img src="https://cdn-uploads.huggingface.co/production/uploads/67c2e844e0921a5410eec10a/Y5M42dCag2f7Fc6fDtV0Z.jpeg" alt="Solstice-AI Banner" width="100%">
</p>
<h1 align="center">Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored (MXFP4)</h1>
<h3 align="center">Official Solstice-AI OCP Microscaling FP4 Suite</h3>
<p align="center">
<b>Original Model & GAIN Merge by <a href="https://huggingface.co/DavidAU">DavidAU</a> • MXFP4 Quantization & Packaging by <a href="https://huggingface.co/Solstice-AI">Solstice-AI</a></b>
</p>
## Overview
OCP Microscaling FP4 (MXFP4) format via `compressed-tensors` with dynamic group scaling, optimized for high throughput inference across modern accelerators.
### Serving with vLLM
```bash
vllm serve Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MXFP4 \
--tensor-parallel-size 1 \
--max-model-len 262144
```
|