SolsticeAI commited on
Commit
613dfeb
·
verified ·
1 Parent(s): ab95dba

Add official Solstice-AI documentation

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - zh
5
+ license: apache-2.0
6
+ base_model: DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored
7
+ tags:
8
+ - solstice-ai
9
+ - davidau
10
+ - qwen
11
+ - qwen3.8
12
+ - qwen3.8-27b
13
+ - cold-fusion
14
+ - gain
15
+ - project-heretic
16
+ - heretic
17
+ - uncensored
18
+ - mxfp4
19
+ - ocp
20
+ - microscaling
21
+ - vllm
22
+ - sglang
23
+ - compressed-tensors
24
+ - 4-bit
25
+ - vision
26
+ - multimodal
27
+ - mmproj
28
+ pipeline_tag: image-text-to-text
29
+ ---
30
+
31
+ <p align="center">
32
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/67c2e844e0921a5410eec10a/Y5M42dCag2f7Fc6fDtV0Z.jpeg" alt="Solstice-AI Banner" width="100%">
33
+ </p>
34
+
35
+ <h1 align="center">Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored (MXFP4)</h1>
36
+ <h3 align="center">Official Solstice-AI OCP Microscaling FP4 Suite</h3>
37
+
38
+ <p align="center">
39
+ <b>Original Model & GAIN Merge by <a href="https://huggingface.co/DavidAU">DavidAU</a> &bull; MXFP4 Quantization & Packaging by <a href="https://huggingface.co/Solstice-AI">Solstice-AI</a></b>
40
+ </p>
41
+
42
+ ## Overview
43
+ OCP Microscaling FP4 (MXFP4) format via `compressed-tensors` with dynamic group scaling, optimized for high throughput inference across modern accelerators.
44
+
45
+ ### Serving with vLLM
46
+ ```bash
47
+ vllm serve Solstice-AI/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-MXFP4 \
48
+ --tensor-parallel-size 1 \
49
+ --max-model-len 262144
50
+ ```