metadata
language:
- en
- zh
license: apache-2.0
base_model: DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored
tags:
- solstice-ai
- davidau
- qwen
- qwen3.8
- qwen3.8-27b
- cold-fusion
- gain
- project-heretic
- heretic
- uncensored
- mxfp4
- ocp
- microscaling
- vllm
- sglang
- compressed-tensors
- 4-bit
- vision
- multimodal
- mmproj
pipeline_tag: image-text-to-text
Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored (MXFP4)
Official Solstice-AI OCP Microscaling FP4 Suite
Original Model & GAIN Merge by DavidAU • MXFP4 Quantization & Packaging by Solstice-AI
Overview
OCP Microscaling FP4 (MXFP4) format via compressed-tensors with dynamic group scaling, optimized for high throughput inference across modern accelerators.
Serving with vLLM
vllm serve Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MXFP4 \
--tensor-parallel-size 1 \
--max-model-len 262144