Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

169

Base only

Active filters: affine

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 3B • Updated about 16 hours ago • 6.29k • 13

lukaskremla/Qwen3.8-27B-3bit-MLX

Image-Text-to-Text • 4B • Updated 18 days ago • 2.11k • 4

Deviad/DeepSeek-V4-Flash-MLX-Q4Q8

Text Generation • 56B • Updated Apr 29 • 197 • 1

lukaskremla/Qwen3.8-27B-2bit-MLX-TextOnly

Text Generation • 3B • Updated about 16 hours ago • 5.24k • 5

lukaskremla/Qwen3.8-27B-2bit-MLX

Image-Text-to-Text • 3B • Updated 18 days ago • 1.19k • 1

lukaskremla/Qwen3.8-27B-MTP-2bit-MLX

Text Generation • 39.8M • Updated 18 days ago • 982 • 1

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-6bit-mlx

Text Generation • Updated Sep 15, 2025 • 1

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-8bit-mlx

Text Generation • Updated Sep 15, 2025

carlorrr/affine-0004-improved

Text Generation • 4B • Updated Oct 30, 2025 • 4

lyraresearchlabs/Affine-S3-GAME

Reinforcement Learning • 4B • Updated Dec 29, 2025 • 5

james-unicorn/affine-train-1

Text Generation • 4B • Updated Jan 26 • 6

james-unicorn/affine-2-5C5iKrLBTwNTuQdC1VB54tbjHVidxyjkh49AcYJ3zgqtkqgH

Text Generation • 4B • Updated Jan 27 • 5

rautaditya/Qwen3-4B-Instruct-MLX-4bit

Text Generation • 0.6B • Updated Mar 28 • 20

lemuralabs/DeepSeek-V4-Flash-5bit-mlx

Text Generation • 53B • Updated 27 days ago • 694

lemuralabs/DeepSeek-V4-Flash-6bit-mlx

Text Generation • 62B • Updated 27 days ago • 792

ekryski/SmolLM2-360M-Instruct-4bit

96.4M • Updated May 27 • 9

ekryski/Soprano-1.1-80M-4bit

24.7M • Updated May 27 • 9

ekryski/Nemotron-H-4B-Base-8K-4bit

1B • Updated May 27 • 10

ekryski/FastVLM-0.5B-4bit

0.3B • Updated May 27 • 34

ekryski/Qwen3.5-0.8B-2bit

0.4B • Updated May 26 • 21

majentik/MERaLiON-3-3B-ASR-MLX-8bit

Automatic Speech Recognition • 1B • Updated 11 days ago • 32

ekryski/SmolLM-360M-Instruct-4bit

96.4M • Updated May 27 • 5

ekryski/Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit

3B • Updated May 27 • 34 • 1

ekryski/OLMo-2-0425-1B-Instruct-4bit

0.6B • Updated May 27 • 20

ekryski/starcoder2-3b-4bit

0.6B • Updated May 27 • 30

ekryski/granite-3.0-2b-instruct-4bit

0.6B • Updated May 27 • 20 • 1

ekryski/internlm2-chat-1_8b-4bit

0.5B • Updated May 27 • 13

ekryski/Nemotron-Nano-12B-v2-VL-4bit

4B • Updated May 28 • 21

ekryski/fish-audio-s2-pro-4bit

1B • Updated May 27 • 24

ekryski/diar_streaming_sortformer_4spk-v2.1-4bit

30.2M • Updated May 27 • 7