Edit Models filters

Model Tree

google/gemma-4-12B-it-qat-q4_0-unquantized

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

63

Base only

Active filters: google/gemma-4-12B-it-qat-q4_0-unquantized

unsloth/gemma-4-12B-it-qat-GGUF

Any-to-Any • 12B • Updated Jul 17 • 1.25M • 457

google/gemma-4-12B-it-qat-q4_0-gguf

Any-to-Any • 12B • Updated Jul 17 • 712k • 284

lmstudio-community/gemma-4-12B-it-QAT-GGUF

12B • Updated Jul 20 • 405k • 15

huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-GGUF

Any-to-Any • 12B • Updated Jun 8 • 16.9k • 62

dahara1/gemma-4-12B-it-qat-UD-japanese-imatrix

Any-to-Any • 12B • Updated Jul 8 • 4.53k • 14

DevQuasar/google.gemma-4-12B-it-qat-q4_0-unquantized-GGUF

Text Generation • 12B • Updated Jun 5 • 183 • 4

AutomatosX/AX-Gemma-4-12B-IT-MLX-QAT-OptiQ-4bit-Assistant-MTP

Image-Text-to-Text • 12B • Updated Jul 23 • 700 • 3

maglun/Gemma-4-12B-it-QAT-Text-MLX-Mixed-3.70bpw

Text Generation • 1B • Updated 10 days ago • 392 • 1

google/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated Jul 20 • 1.28M • 56

unsloth/gemma-4-12B-it-qat-w4a16

Any-to-Any • 13B • Updated Jul 17 • 3.07k • 6

NeveAI/Neve-Echo-6-12B-QAT-GGUF

Image-Text-to-Text • 12B • Updated Jul 18 • 13 • 1

mradermacher/gemma-4-12B-it-qat-q4_0-unquantized-GGUF

12B • Updated Jun 7 • 124 • 2

cyankiwi/gemma-4-12B-it-qat-AWQ-INT4

Any-to-Any • 13B • Updated Jul 21 • 98.9k • 8

prithivMLmods/gemma-4-12B-it-qat-GGUF

Image-Text-to-Text • 12B • Updated Jun 7 • 1.9k • 4

mradermacher/gemma-4-12B-it-qat-q4_0-unquantized-i1-GGUF

12B • Updated Jun 7 • 1.06k • 2

ggnoy/gemma-4-12b-qat-q4

12B • Updated Jun 8 • 37

HarmenWessels/gemma-4-12B-it-qat-int4-ov

Image-Text-to-Text • Updated Jun 8 • 167 • 3

meganovaai/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated Jun 8 • 8

olberdingbrands/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated Jun 8 • 4 • 1

OrpheraAI/gemma-4-12B-it-qat-GGUF

Any-to-Any • 12B • Updated Jun 9 • 38

developerjeremylive/gemma-4-12B-it-qat-q4_0-gguf-etheroi

Any-to-Any • 12B • Updated Jun 10 • 11

developerjeremylive/gemma-4-12B-it-qat-GGUF-etheroi

Any-to-Any • 12B • Updated Jun 10 • 38

steampunque/gemma-4-12B-it-qat-q4_0-unquantized-MP-GGUF

12B • Updated Jun 12 • 56

tinybiggames/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-GGUF

Any-to-Any • 12B • Updated Jun 14 • 53

anonoob/gemma-4-12B-it-qat-q4_0-gguf

Any-to-Any • 12B • Updated Jun 14 • 40

smashingtags/gemma-4-12b-it-abliterated-nf4

Image-Text-to-Text • 12B • Updated Jun 14 • 5

idkwhattoputherenow/gemma-4-12B-it-qat-q4_0-maxerr

12B • Updated Jun 15 • 27 • 3

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated Jul 20 • 3.12k • 15

mlx-community/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-5bit-msq

Any-to-Any • 12B • Updated Jun 15 • 57

JMingo/gemma-4-12B-it-qat-GGUF

12B • Updated Jun 23 • 81