Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2309.00071

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,750

Base only

Active filters: 2309.00071

DeepHat/DeepHat-V1-7B

Text Generation • 8B • Updated Aug 15, 2025 • 5.69k • • 266

Qwen/Qwen3-8B

Text Generation • 8B • Updated Jul 26, 2025 • 11.4M • • 2.06k

Qwen/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 21, 2025 • 455k • 173

Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 9.48M • • 2.38k

Qwen/Qwen3-8B-GGUF

Text Generation • 8B • Updated May 21, 2025 • 510k • 304

Qwen/Qwen3-4B

Text Generation • 4B • Updated Jul 26, 2025 • 6.7M • • 718

Qwen/Qwen2.5-VL-7B-Instruct

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 6.1M • • 1.73k

Qwen/Qwen3-30B-A3B

Text Generation • 31B • Updated Jul 26, 2025 • 1.54M • • 952

Qwen/Qwen2.5-72B-Instruct

Text Generation • 73B • Updated Jan 12, 2025 • 297k • • 1k

Qwen/Qwen2.5-Coder-7B

Text Generation • 8B • Updated Nov 18, 2024 • 604k • • 176

Qwen/Qwen2.5-Coder-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 2.28M • • 812

Qwen/Qwen2.5-Coder-14B-Instruct

Text Generation • 15B • Updated Jan 12, 2025 • 1.68M • • 192

Qwen/Qwen2.5-VL-3B-Instruct

Image-Text-to-Text • 4B • Updated Apr 6, 2025 • 2.42M • • 709

Qwen/Qwen3-14B

Text Generation • 15B • Updated Jul 26, 2025 • 2.12M • • 486

Qwen/Qwen3-32B

Text Generation • 33B • Updated Jul 26, 2025 • 4.14M • • 754

unsloth/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jun 8, 2025 • 28k • 290

Qwen/Qwen2.5-VL-72B-Instruct

Image-Text-to-Text • 73B • Updated Jun 6, 2025 • 75.3k • • 658

Qwen/Qwen2.5-VL-32B-Instruct

Image-Text-to-Text • 33B • Updated Apr 14, 2025 • 809k • • 503

Qwen/Qwen3-14B-GGUF

Text Generation • 15B • Updated May 9, 2025 • 207k • 136

Qwen/Qwen3-Next-80B-A3B-Instruct

Text Generation • 81B • Updated Sep 17, 2025 • 295k • • 1.06k

unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF

Text Generation • 80B • Updated Jan 14 • 14.1k • 85

nvidia/Nemotron-Cascade-14B-Thinking

Text Generation • 15B • Updated Jan 1 • 4.45k • • 82

Qwen/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 4 • 22.8k • 285

Qwen/Qwen2.5-14B-Instruct

Text Generation • 15B • Updated Sep 25, 2024 • 1.73M • • 372

QuantFactory/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 1.04k • 4

Qwen/Qwen2.5-Coder-32B

Text Generation • 33B • Updated Nov 18, 2024 • 1.77k • • 163

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 1.76M • 108

Qwen/QwQ-32B

Text Generation • 33B • Updated Mar 11, 2025 • 64.5k • • 2.97k

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • 33B • Updated Apr 6, 2025 • 379k • 66

Mungert/Qwen2.5-VL-32B-Instruct-GGUF

Image-Text-to-Text • 33B • Updated Sep 24, 2025 • 1.95k • 10