Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: cloud-cpu

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 2 days ago • 281

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 3 days ago • 321

Arm/efficient-sam-s-int8-xnnpack-executorch

Image Segmentation • Updated 3 days ago • 39

Arm/qwen3-0-6b-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 3 days ago • 48

Arm/llama-3-2-3b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 3 days ago • 24

Arm/qwen2-5-1-5b-instruct-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 3 days ago • 27

Arm/llama-3-1-8b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 3 days ago • 27

Arm/llama-3-1-8b-base-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 3 days ago • 24

Arm/tinyllama-1-1b-chat-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

Text Generation • Updated 3 days ago • 102

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

Text Generation • Updated 3 days ago • 24

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

Text Generation • Updated 3 days ago • 35

Arm/midas-v2-int8-xnnpack-executorch-graviton-g4

Depth Estimation • Updated 3 days ago • 32

Arm/esrgan-int8-xnnpack-executorch-graviton-g4

Image-to-Image • Updated 2 days ago • 45

Arm/qwen3-tts-0-6b-int8-onnx-graviton-g4

Text-to-Speech • Updated 3 days ago • 20