Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

237

Base only

Active filters: metal

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 561k • 822

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 18 • 605k • • 1.26k

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 28 days ago • 541k • 176

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 15 days ago • 2.09M • 465

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 2.06M • 229

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 237k • 134

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 106k • 772

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated Jul 14 • 2.09M • 182

PulpCut/FastH3-VSA-INT8-ConvRot

Text-to-Video • Updated about 11 hours ago • 2

Keepser/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated May 31 • 256 • 2

Kingman007/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 16 • 498 • 1

badtheorylabs/BTL-3-Compact

Text Generation • 8B • Updated Jul 24 • 309 • 42

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Quality128

Text Generation • 284B • Updated 26 days ago • 32.4k • 8

apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128

Text Generation • 284B • Updated 26 days ago • 12.7k • 5

Doses-AI/Pestle-27B-Ternary-GGUF

Text Generation • 27B • Updated 15 days ago • 2.15k • 13

Sawfwair/MiniMax-H3-FastH3-VSA-DataFree-MLX-BF16

Text-to-Video • Updated 1 day ago • 17 • 1

mmp2055/Qwen3.8-27B-Uncensored-bughunter-v7-MLX-VLM-4bit

Image-Text-to-Text • 5B • Updated about 7 hours ago • 1

HarroweD/HarrlogosXL

Text-to-Image • Updated Jan 14, 2024 • 83 • • 15

RalFinger/chrome-style-sdxl-lora

Text-to-Image • Updated Nov 22, 2023 • 17 • • 1

e-n-v-y/envy-metallic-xl-01

Text-to-Image • Updated Nov 24, 2023 • 17 • • 2

UnionStreet/vision-1-mini

Text Classification • 8B • Updated Jan 16, 2025 • 10 • 1

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 160 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 50 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 68 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 48 • 1

halley-ai/gpt-oss-120b-MLX-bf16

Text Generation • 117B • Updated Sep 8, 2025 • 165 • 3

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 46 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 45 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 26 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 38 • 1