Gemma-4 - GLQ quantized
All public Gemma-4 GLQ checkpoints: 12B, 26B-A4B (MoE), 31B, E4B - 3 to 8 bpw.
Image-Text-to-Text • 7B • Updated • 26Note MoE, 4 bpw - the recommended 26B.
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-3bpw
Image-Text-to-Text • 7B • Updated • 63Note 3 bpw. Note: no footprint win over 4 bpw, and AIME drops.
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-5bpw
Image-Text-to-Text • 11B • Updated • 21Note 5 bpw.
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-6bpw
Image-Text-to-Text • 11B • Updated • 25Note 6 bpw.
xv0y5ncu/Gemma-4-31B-it-GLQ-5.0bpw-mix3-8
Text Generation • 12B • Updated • 603Note 31B, mixed 3-8 bpw.
xv0y5ncu/Gemma-4-12B-it-GLQ-5.0bpw
Image-Text-to-Text • 5B • Updated • 201Note 12B, mixed 3-8 bpw.
xv0y5ncu/gemma-4-12B-it-GLQ-3bpw-e8p-bd
Image-Text-to-Text • 2B • Updated • 24Note e8p codebook, block-diagonal. Speed tier.
xv0y5ncu/Gemma-4-E4B-it-GLQ-4bpw
Text Generation • 3B • Updated • 570Note E4B, 4 bpw.
xv0y5ncu/Gemma-4-E4B-it-GLQ-3.5bpw-mix3-8
Image-Text-to-Text • 3B • Updated • 12Note E4B, mixed allocation.
xv0y5ncu/Gemma-4-E4B-it-GLQ-6bpw
Text Generation • 4B • Updated • 200Note E4B, 6 bpw.
xv0y5ncu/Gemma-4-E4B-it-GLQ-7bpw
Text Generation • 4B • Updated • 210Note E4B, 7 bpw.
xv0y5ncu/Gemma-4-E4B-it-GLQ-8bpw
Text Generation • 4B • Updated • 197Note E4B, 8 bpw - near-lossless reference.
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-trellis-3inst-4bpw
7B • Updated • 24Note MoE, trellis (TCQ) 4 bpw - 13.95 GB. Needs glq >= 0.8.1 (fused grouped MoE decode; earlier releases refuse it). AIME-2026 avg@8 85.4%.
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-trellis-3inst-3bpw
6B • Updated • 2Note Trellis 3 bpw — 11.9 GB on disk, 10.4 GiB loaded; AIME-2026 avg@8 82.1% (4 bpw: 86.25%, within n=30 noise)
xv0y5ncu/gemma-4-E2B-it-GLQ-trellis-3inst-4bpw
Any-to-Any • 2B • Updated • 28Note Trellis (3INST) 4 bpw — the recommended codebook
xv0y5ncu/gemma-4-12B-it-GLQ-trellis-3inst-4bpw
Any-to-Any • 4B • Updated • 24Note Trellis (3INST) 4 bpw — the recommended codebook
xv0y5ncu/gemma-4-31B-it-GLQ-trellis-3inst-4bpw
Image-Text-to-Text • 9B • Updated • 25Note Trellis (3INST) 4 bpw — the recommended codebook; the 5.0bpw-mix3-8 build remains the pick for max quality on one 24-32 GB card
xv0y5ncu/gemma-4-E4B-it-GLQ-trellis-3inst-4bpw
Any-to-Any • 3B • Updated • 1.17kNote Trellis (3INST) 4 bpw — the recommended codebook; supersedes the e8_shell build