Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,149

Base only

Active filters: gguf-my-repo

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 11.5k • 297

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 521 • 59

theresa00l/Qwen3.8-27B-Uncensored-FP8-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated 16 days ago • 14.4k • 16

NoelJacob/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 24, 2024 • 845 • 5

filvyb/Llama3-8b-CunnyGPT-16bit-Q8_0-GGUF

8B • Updated Jun 21, 2024 • 68 • 7

jfer1015/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated Jun 24, 2024 • 772 • 9

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 6.21k • 10

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 152 • 5

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 58.3k • 31

itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF

Text Generation • 7B • Updated Dec 19, 2024 • 109 • 6

localattention/ShowUI-2B-Q4_K_M-GGUF

2B • Updated Jan 9, 2025 • 77 • 4

Omartificial-Intelligence-Space/ALLaM-7B-Instruct-preview-Q4_K_M-GGUF

Text Generation • 7B • Updated Feb 19, 2025 • 79 • 7

nocturne23/gemma-3-12b-it-Q4_K_M-GGUF

Image-Text-to-Text • 12B • Updated Mar 13, 2025 • 1.63k • 9

PatataAliena/Qwen2.5-VL-7B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Mar 31, 2025 • 2.39k • 3

mrmage/gemma-3n-E4B-IQ4_NL-GGUF

Image-Text-to-Text • 7B • Updated Jul 13, 2025 • 50 • 1

benvezzani/nomic-embed-text-v2-moe-Q4_K_M-GGUF

Sentence Similarity • 0.5B • Updated Jul 20, 2025 • 35 • 2

bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2025 • 4.64k • 3

NikolayKozloff/Qwen3-15B-A2B-Base-Q4_K_M-GGUF

16B • Updated Nov 21, 2025 • 152 • 2

straino/Qwen3-Coder-30B-A3B-Instruct-AWQ-4bit-Q4_K_M-GGUF

Text Generation • 31B • Updated Dec 9, 2025 • 123 • 1

LegoKeeper/Qwen3-4b-Moe-Q4_K_M-GGUF

4B • Updated Feb 8 • 2.65k • 3

PatnaikAshish/Qwen3-1.7B-Instruct-Q4_K_M-GGUF

2B • Updated Mar 16 • 1.38k • 1

Hazily4882/Qwen3.6-27B-Q4_0-GGUF

Image-Text-to-Text • 27B • Updated Apr 27 • 3.13k • 1

sj5430/Qwen2.5-Omni-3B-Q4_K_M-GGUF

Any-to-Any • 3B • Updated May 25 • 82 • 1

Oleg-On/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 560 • 1

dhomksa/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Jun 14 • 101 • 1

bms22/VibeThinker-3B-Q6_K-GGUF

Text Generation • 3B • Updated Jun 16 • 19 • 1

QiE2035/flux2-klein-9b-uncensored-text-encoder-Q2_K-GGUF

Text-to-Image • 8B • Updated Jul 12 • 4.47k • 3

WANG-CC/flux2-klein-9b-uncensored-text-encoder-Q8_0-GGUF

Text-to-Image • 8B • Updated Jul 13 • 14.2k • 4

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated Jul 29 • 933 • 6

KM445/flux2-klein-9b-uncensored-text-encoder-Q8_0-GGUF

Text-to-Image • 8B • Updated 20 days ago • 3.24k • 3