Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

57

Base only

Active filters: aarch64

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated Jul 15 • 8.56k • 23

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated Jul 15 • 630k • 69

vcruz305/GLM-5.3-Flash-EXL3-K2-spark-vllm

Updated about 13 hours ago • 1

dougiefresh/jade_qwen3_4b

4B • Updated May 30, 2025 • 19 • 6

dougiefresh/jade_qwen3_4b_mlx_8bit

Text Generation • 1B • Updated May 30, 2025 • 17

dougiefresh/jade_qwen3_4b_mlx_4bit

Text Generation • 0.6B • Updated May 30, 2025 • 14

dougiefresh/jade_qwen3_4b_mlx

Text Generation • 4B • Updated May 28, 2025 • 14

mradermacher/jade_qwen3_4b-GGUF

4B • Updated Jul 11, 2025 • 200 • 1

dougiefresh/jade_qwen3_4b_gguf

Text Generation • 4B • Updated May 30, 2025 • 35

Hellohal2064/vllm-dgx-spark-gb10

Text Generation • Updated Jan 6 • 9

patrickbdevaney/Qwen3.5-122B-A10B-NVFP4-vllm-docker-jetson-agx-thor

Text Generation • Updated Mar 1 • 5

thehighnotes/vllm-jetson-orin

Text Generation • Updated Mar 11

Jay0515/onnxruntime-gpu-aarch64-cuda13-sm121

Other • Updated Mar 16 • 7

cudabenchmarktest/personaplex-7b-turbo2bit

Updated Mar 29 • 6 • 7

Qanatpharma/pytorch-sm121-gb10

Updated Apr 3 • 1

WeilJimmer/onnxruntime-gpu-aarch64-cuda13-sm121

Other • Updated Apr 4

YuyiRobot/vllm-jetson-orin

Updated Apr 5 • 6

Qanatpharma/tensorflow-2.21.0-cuda13-aarch64

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated Jul 15 • 1.04k • 13

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated Jul 15 • 143 • 2

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated Jun 28 • 117 • 2

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated Jul 15 • 147 • 6

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated Jun 21 • 505 • 1

AEON-7/Gemma-4-E4B-it-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 130 • 4

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 112 • 1

AEON-7/gemma-4-31B-it-speculator.eagle3-NVFP4

Text Generation • 2B • Updated Jun 21 • 84 • 5

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16

Text Generation • 27B • Updated Jul 15 • 5.31k • • 147

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-BF16

Any-to-Any • 33B • Updated Jul 15 • 146 • 6

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated Jul 15 • 500 • 8

mradermacher/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-GGUF

27B • Updated Jun 25 • 1.24k • 10