Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

74

Base only

Active filters: W4A16

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-ultrachat-200k-train-sft-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 8

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-c4-en-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 9

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-numinamath-cot-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 10

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-ultrachat-200k-train-sft-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 6

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-c4-en-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 12

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-numinamath-cot-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 6

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-codeforces-cots-solutions-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 13

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-openr1-math-220k-all-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 7

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-codeforces-cots-solutions-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 8

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-calib-openr1-math-220k-all-train-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 9

agentvue/GLM-5.2-Int4-Int8Mix-FP8KV

Text Generation • 779B • Updated about 1 month ago • 61 • 1

QuantTrio/Kimi-K3-Cubic-2.5Bit

Image-Text-to-Text • 875B • Updated 23 days ago • 421 • 4

ilia-dybal/Qwen-2.5-VL-3b-Instruct-4WA16-GPTQ-Culinary

Image-Text-to-Text • 4B • Updated 19 days ago • 77

gratex/Mistral-Small-3.2-24B-Instruct-2506-sbvr-compliance-W4A16

Text Generation • 2B • Updated 10 days ago • 172