Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24

Base only

Active filters: oq4

bearzi/Qwen3-Coder-Next-oQ4

Text Generation • 80B • Updated Apr 15 • 106 • 2

bearzi/gemma-4-E2B-it-oQ4

Text Generation • 5B • Updated Apr 28 • 45 • 1

bearzi/Qwen3.6-35B-A3B-oQ4

Text Generation • 35B • Updated Apr 16 • 84 • 5

wangkezun/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-VLM-MLX-oQ4

Image-Text-to-Text • 35B • Updated Apr 26 • 106 • 1

wangkezun/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Text-MLX-oQ4

Text Generation • 35B • Updated Apr 26 • 50

bearzi/Qwen3.6-27B-oQ4

Text Generation • 27B • Updated Apr 27 • 27 • 2

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-text-oQ4

Text Generation • 35B • Updated May 18 • 885 • 5

stamsam/Qwen3.6-28B-REAP-oQ4

Text Generation • 28B • Updated May 24 • 32

dawncr0w/Hy-MT2-30B-A3B-oQ4-MLX

Translation • 30B • Updated May 26 • 65

dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-oQ4-MLX

Image-Text-to-Text • 28B • Updated Jun 1 • 112 • 1

dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Text-Only-oQ4-MLX

Text Generation • 27B • Updated May 28 • 61

dawncr0w/MiniMax-M2.7-ultra-uncensored-heretic-oQ4-MLX

Text Generation • 229B • Updated May 30 • 126 • 1

dawncr0w/Step-3.7-Flash-oQ4-MLX

Image-Text-to-Text • 199B • Updated Jun 4 • 28

dawncr0w/MiMo-V2.5-oQ4-MLX

Image-Text-to-Text • 311B • Updated Jun 5 • 131 • 1

dawncr0w/crowqwen3.5-4b-agent-heretic-mlx-oq

Text Generation • Updated Jun 30

dawncr0w/crowqwen3.5-4b-agent-heretic-mlx-oq4

Text Generation • 5B • Updated Jun 30 • 32

TiGa-RCE/Qwen3-Embedding-0.6B-MLX-oQ4

Feature Extraction • 0.6B • Updated Jul 28 • 17

TiGa-RCE/gte-Qwen2-1.5B-instruct-MLX-oQ4

Feature Extraction • 2B • Updated Jul 28 • 7

TiGa-RCE/Qwen3-Embedding-8B-MLX-oQ4

Feature Extraction • 8B • Updated Jul 28 • 17

Blightbow/MiMo-V2.5-Text-Only-oQ4-MLX

Text Generation • 309B • Updated Jul 30 • 119

groxaxo/Nemotron-3-Embed-1B-oQ4-MLX

Feature Extraction • 1B • Updated 15 days ago • 78

Vontra/Ling-3.0-flash-oQ4

Text Generation • 124B • Updated 25 days ago • 379 • 1

Vontra/Muse-Glimmer-30B-oQ4

Image-Text-to-Text • 30B • Updated 25 days ago • 162

Vontra/Qwen3.8-27B-oQ4

Image-Text-to-Text • 27B • Updated 10 days ago • 524