Cerebellum-2B-BF16 / assets /quantization_matrix.svg
mkzero's picture
Release Cerebellum-2B-BF16: 25ms Non-Autoregressive Agent System 1 Decision Engine
47a502b verified
|
Raw History Blame
4.56 kB
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 880 360" width="100%" height="100%">
<defs>
<linearGradient id="bgGrad3" x1="0" y1="0" x2="1" y2="1">
<stop offset="0%" stop-color="#0b0f19" />
<stop offset="100%" stop-color="#111827" />
</linearGradient>
<linearGradient id="cardGrad1" x1="0" y1="0" x2="1" y2="1">
<stop offset="0%" stop-color="#1e293b" />
<stop offset="100%" stop-color="#0f172a" />
</linearGradient>
<linearGradient id="cardGradHighlight" x1="0" y1="0" x2="1" y2="1">
<stop offset="0%" stop-color="#064e3b" stop-opacity="0.4" />
<stop offset="100%" stop-color="#0f172a" />
</linearGradient>
</defs>
<rect width="880" height="360" rx="14" fill="url(#bgGrad3)" stroke="#1e293b" stroke-width="1.5" />
<text x="40" y="44" fill="#f8fafc" font-size="20" font-weight="700" font-family="-apple-system, sans-serif">Production Quantization Matrix &amp; The 9.1 MB Golden Rule</text>
<text x="40" y="68" fill="#94a3b8" font-size="12.5" font-family="sans-serif">Zero decision degradation: Quantize 186 backbone layers, preserve 9.1MB dual heads in BF16</text>
<!-- 3 Cards -->
<g transform="translate(40, 95)">
<rect width="245" height="210" rx="10" fill="url(#cardGrad1)" stroke="#334155" stroke-width="1" />
<text x="20" y="32" fill="#94a3b8" font-size="12" font-weight="600" font-family="sans-serif">BASELINE REFERENCE</text>
<text x="20" y="60" fill="#f8fafc" font-size="22" font-weight="700" font-family="sans-serif">BF16 Full</text>
<text x="20" y="95" fill="#64748b" font-size="11" font-family="sans-serif">Model Storage</text>
<text x="20" y="118" fill="#f1f5f9" font-size="18" font-weight="700" font-family="sans-serif">3.76 GB</text>
<text x="20" y="145" fill="#64748b" font-size="11" font-family="sans-serif">Accuracy / Fidelity</text>
<text x="20" y="165" fill="#10b981" font-size="14" font-weight="600" font-family="sans-serif">94.92% (100% Retained)</text>
<text x="20" y="192" fill="#94a3b8" font-size="11" font-family="sans-serif">Best for: Research &amp; Evaluation</text>
</g>
<g transform="translate(315, 95)">
<rect width="250" height="210" rx="10" fill="url(#cardGradHighlight)" stroke="#10b981" stroke-width="1.5" />
<rect x="150" y="15" width="85" height="20" rx="4" fill="#10b981" />
<text x="192" y="29" fill="#022c22" font-size="10" font-weight="700" text-anchor="middle" font-family="sans-serif">RECOMMENDED</text>
<text x="20" y="32" fill="#34d399" font-size="12" font-weight="600" font-family="sans-serif">GPU CLOUD SERVING</text>
<text x="20" y="60" fill="#f8fafc" font-size="22" font-weight="700" font-family="sans-serif">FP8 Native</text>
<text x="20" y="95" fill="#64748b" font-size="11" font-family="sans-serif">Model Storage (-36.5%)</text>
<text x="20" y="118" fill="#34d399" font-size="18" font-weight="700" font-family="sans-serif">2.39 GB</text>
<text x="20" y="145" fill="#64748b" font-size="11" font-family="sans-serif">Max Probability Drift</text>
<text x="20" y="165" fill="#34d399" font-size="14" font-weight="600" font-family="sans-serif">&lt; 0.97% (100% Action Match)</text>
<text x="20" y="192" fill="#cbd5e1" font-size="11" font-family="sans-serif">Best for: High-concurrency vLLM</text>
</g>
<g transform="translate(595, 95)">
<rect width="245" height="210" rx="10" fill="url(#cardGrad1)" stroke="#334155" stroke-width="1" />
<text x="20" y="32" fill="#a78bfa" font-size="12" font-weight="600" font-family="sans-serif">EDGE &amp; LOCAL MAC</text>
<text x="20" y="60" fill="#f8fafc" font-size="22" font-weight="700" font-family="sans-serif">INT8 Per-Channel</text>
<text x="20" y="95" fill="#64748b" font-size="11" font-family="sans-serif">Model Storage (-40.7%)</text>
<text x="20" y="118" fill="#a78bfa" font-size="18" font-weight="700" font-family="sans-serif">2.23 GB</text>
<text x="20" y="145" fill="#64748b" font-size="11" font-family="sans-serif">Max Probability Drift</text>
<text x="20" y="165" fill="#a78bfa" font-size="14" font-weight="600" font-family="sans-serif">&lt; 0.39% (Minimal Drift)</text>
<text x="20" y="192" fill="#94a3b8" font-size="11" font-family="sans-serif">Best for: Local Laptop &amp; Edge</text>
</g>
<text x="440" y="332" fill="#94a3b8" font-size="11" text-anchor="middle" font-family="sans-serif">⭐ Dual Decision Heads (SetPointerHead + ActEscalateHead) weigh only 9.1MB total and are kept in full BF16.</text>
</svg>