Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

516

Base only

Active filters: local-llm

Toadaid/Tobyworld_Mirror_Llama_8B-Q4_K_M.gguf

Text Generation • 8B • Updated Dec 4, 2025 • 20

LiteMind/YutaLM-GGUF

Text Generation • 0.4B • Updated Dec 28, 2025 • 17 • 3

Toadaid/tobyworld-mirror-v2

Text Generation • 7B • Updated Jan 6 • 21 • 1

Irfanuruchi/Phi-4-mini-instruct-MLX-4bit

Text Generation • 4B • Updated Jan 17 • 20

Irfanuruchi/Phi-4-mini-instruct-MLX-8bit

Text Generation • 4B • Updated Jan 17 • 19

yukihamada/ElioChat-1.7B-Instruct-v3

Text Generation • 2B • Updated Jan 17 • 124

O96a/sudanizer-72k

Updated 28 days ago

patcodesml/research-engine

ansh0x/ace-0.5b-gguf

Text Generation • 0.5B • Updated Mar 24 • 49 • 1

SilverScreenLab/SilverScreen-V1

Text-to-Image • Updated Mar 19

Mindigenous/MINDI-1.0-420M

Text Generation • 0.4B • Updated Mar 19 • 32 • 1

ykarout/Qwen3.5-27B-exl3-3.0bpw

Image-Text-to-Text • 7B • Updated Mar 20 • 27 • 2

oyi77/qwen2.5-7b-GGUF

8B • Updated Mar 22 • 1.18k

oyi77/awesome-ollama-modelfiles

Updated Mar 22 • 1

mtrpires/Qwen3.5-35B-A3B-IQK-RPi5-16GB

Text Generation • 35B • Updated Mar 28 • 153 • 1

thwrhrt/Qwen3.5-0.8B-Base-Quant

Text Generation • 0.8B • Updated Mar 25 • 83 • 1

saidutta69/Qwen2.5-Coder-3B-Instruct-heretic

Text Generation • 3B • Updated 26 days ago • 2.39k • 1

kuririrn/qwen3-4b-structured-output-lora-gguf

4B • Updated Mar 25 • 11 • 1

mradermacher/Qwen2.5-Coder-3B-Instruct-heretic-GGUF

3B • Updated 23 days ago • 1.86k • 3

mradermacher/Qwen2.5-Coder-3B-Instruct-heretic-i1-GGUF

3B • Updated 23 days ago • 2.52k • 1

elbruno/Qwen2.5-0.5B-LocalLLMs-ToolCalling

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 547 • 8

WithinUsAI/Llama3.2-Octo.Thinker.iNano-1B-GGUF

Text Generation • 1B • Updated Mar 30 • 212 • 1

tomg42/Qwen3-14B-sk-Q6_K.gguf

15B • Updated Apr 14 • 115 • 2

steef68/AIZYBRAIN-NANO-4B

Text Generation • 4B • Updated Apr 3 • 19

Outlier-Ai/Outlier-10B

Text Generation • Updated May 5 • 29 • 2

divinetribe/Llama-3.3-70B-Instruct-abliterated-8bit-mlx

Text Generation • 71B • Updated Aug 22 • 1.19k • 3

Outlier-Ai/Outlier-10B-V2

Text Generation • 8B • Updated May 5 • 29 • 1

Outlier-Ai/Outlier-40B

Text Generation • 15B • Updated May 5 • 24 • 1

mradermacher/Outlier-10B-V2-GGUF

Text Generation • 8B • Updated Apr 30 • 75 • 1