Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

torchao-my-repo

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47

Base only

Active filters: torchao-my-repo

appy1234/Llama3.1-8B-Int8DynamicActivationInt8WeightQuantized

Text Generation • Updated Jun 4, 2025 • 6

appy1234/Llama-3.2-3B-Instruct-Int8DynamicActivationInt8WeightQuantized

Text Generation • Updated Jun 4, 2025 • 5

mikaylagawarecki/foo_bar

Feature Extraction • Updated Jun 11, 2025 • 6

RoadToNowhere/Qwen3-0.6B-ao-float8wo

Text Generation • Updated Jun 13, 2025 • 5

MidnightPhreaker/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-ao-int4wo-gs128

Updated Jun 20, 2025 • 6

mibrdeniz/turkish-gpt2-medium-350m-instruct-q8

Text Generation • Updated Jul 22, 2025 • 9

mibrdeniz/turkish-gpt2-medium-350m-instruct-q4

Text Generation • Updated Jul 22, 2025 • 6

TamWaiban/gemma-3-270m-int4

Text Generation • Updated Aug 23, 2025 • 7

TamWaiban/gemma-3-270m-autoquant

Text Generation • Updated Aug 23, 2025 • 6

cs2764/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-ao-int8wo

Text Generation • Updated Aug 29, 2025 • 10

cs2764/Huihui-Qwen3-4B-Instruct-2507-abliterated-ao-int8wo

Text Generation • Updated Aug 29, 2025 • 7 • 1

cedpsam/SmolVLM2-2.2B-Instruct-ao-autoquant

Image-Text-to-Text • Updated Sep 18, 2025 • 65

rahul7star/facebook-125

Updated Oct 13, 2025 • 3

DreamerRimmer/Huihui-Qwen3-4B-Instruct-2507-abliterated-ao-int4wo

Text Generation • Updated Nov 22, 2025 • 9

rahul7star/Xd

Updated Nov 27, 2025 • 7

rahul7star/gemma-3bit

Updated Dec 2, 2025 • 6

AlekseyCalvin/pythia-14m-deduped-ao-int8wo

Feature Extraction • Updated May 20 • 4