Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

93

Base only

Active filters: f16

pbhappliedsystems/qwen-2.5-14B-instruct-1m-gguf-F16

15B • Updated May 5 • 18

pbhappliedsystems/qwen-2.5-32B-instruct-gguf-F16

33B • Updated May 5 • 14

HomeroKzam/gemma-4-4b-it-llamasharp-gguf

Text Generation • Updated Apr 26

Handyfff/Gemma-4-E4B-OBLITERATED-PRUNED-TextOnly-EnglishOnly-it-GGUF

Updated Apr 27 • 1

pbhappliedsystems/qwen3.6-27B-gguf-F16

27B • Updated May 6 • 39 • 1

jalpan04/qwen-researcher

Text Generation • 0.5B • Updated May 11 • 25

sensiarion/CodeRankEmbed-f16

Feature Extraction • 0.1B • Updated May 19 • 29

ronniross/LFM2.5-1.2B-Base-f16-GGUF

1B • Updated May 20 • 11 • 1

Surpem/Supertron2.1-0.6B-GGUF

Text Generation • 0.6B • Updated May 27 • 44 • 3

Brunobkr/OFFELLIA_f16_gemma-4-12B-it.gguf

Image-Text-to-Text • 12B • Updated Jun 3 • 8 • 2

iky1e/moebius-pretrained-mlx-f16

Image-to-Image • Updated Jun 25

iky1e/moebius-ft-places2-mlx-f16

Image-to-Image • Updated Jun 25

iky1e/moebius-ft-celebahq-mlx-f16

Image-to-Image • Updated Jun 25

iky1e/moebius-ft-ffhq-mlx-f16

Image-to-Image • Updated Jun 25

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 2.47k • 77

realrebelai/LingBot_ComfyUI

Image-to-Video • Updated Jul 11 • 822 • 11

juithealien/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 12 • 129 • 1

unslothai/whisper-tiny-GGUF

Automatic Speech Recognition • Updated Jul 17

unslothai/whisper-base-GGUF

Automatic Speech Recognition • Updated Jul 17

unslothai/whisper-small-GGUF

Automatic Speech Recognition • Updated Jul 17

unslothai/whisper-large-v3-turbo-GGUF

Automatic Speech Recognition • Updated Jul 17

unslothai/whisper-large-v3-GGUF

Automatic Speech Recognition • Updated Jul 17

jpalmae/qwen35b-espanol-gguf-f16

35B • Updated Jul 20 • 47

jpalmae/qwen35b-espanol-abliterated-gguf

Text Generation • 35B • Updated Jul 18 • 24

Hal0ai/hal0-brain-sft-GGUF

Text Generation • 1B • Updated Jul 20 • 12

stressthismess/Kimi-K3

0.4B • Updated 28 days ago • 321

gcoli/whisper-large-v3-swiss-german-gguf-f16

Automatic Speech Recognition • 2B • Updated 20 days ago • 64

WatsonOverHere/Qwen3.8-27B-Uncensored-F16-GGUF

27B • Updated 15 days ago • 267 • 1

mondk/Msh-Tiny-14M-GGUF

Text Generation • 13.9M • Updated 8 days ago • 401 • 3

AI4SGI/ExoMind-F16-GGUF

Image-Text-to-Text • 36B • Updated 1 day ago • 20