Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

41

Base only

Active filters: mlc

beomi/Llama-2-ko-7b-Chat-q4f16_1

Updated Aug 22, 2023 • 3

Stuv7CB/Llama-3-8B-Lexi-Uncensored-q4f16_1-MLC

Updated Jul 7, 2024

vladbuinceanu/Qwen3-4B-Thinking-2507-q4f32_1-MLC

Updated Aug 11, 2025 • 2

llinguini/gemma-3-270m-it-q4f16_1-MLC

Updated Sep 13, 2025 • 11 • 1

NiekWork/gemma-3-12b-logql-finetune

Updated Oct 4, 2025 • 2

NiekWork/gemma-3-12b-logql-finetune-v1.1.4

Updated Oct 4, 2025

brimtown/Groupchat-Qwen3-0.6B-MLC

Text Generation • Updated Oct 26, 2025 • 4

raining-codes/Gemma3-1B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 1

raining-codes/Gemma3-270M-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 2

raining-codes/Qwen3-0.6B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 1

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 20, 2025 • 2

brimtown/Groupchat-Qwen2.5-0.5B-MLC

Text Generation • Updated Oct 24, 2025 • 21

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Oct 21, 2025 • 2

brimtown/Groupchat-Qwen3-4B-MLC

Text Generation • Updated Oct 24, 2025 • 4

NiekWork/qwen25-logql-finetune-v1.2.0

Updated Dec 18, 2025 • 2

raditotev/radipro-chatbot-Llama-3.2-1B-Instruct-q4f16_1-MLC

Text Generation • Updated Nov 14, 2025 • 2

bigbowltakestime/kanana-1.5-8b-instruct-q4f32_1-MLC

AxelDlv00/EULAI-q4f16_1-MLC

Text Generation • Updated Jan 30

vikramlingam/gemma-3-270m-it-mlc-webgpu

Text Generation • Updated Feb 1

eshonindex/DiscordLM-0.5B-q4f16_1-MLC

Text Generation • Updated Feb 10

UMASHIKA/gemma3-270m-japanese-webllm-01

Text Generation • Updated Feb 12

UMASHIKA/gemma3-270m-japanese-webllm-02

Text Generation • Updated Feb 15

moeadham/TAID-LLM-1.5B-q4f32_1-MLC

Text Generation • Updated May 1

jaehwan02/risolju-1.0-1.7b-mlc

Text Generation • Updated May 24 • 12

rishabhf/bouncer-qwen3.5-4b-mlc

Text Generation • Updated May 26 • 1

aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC

Text Generation • Updated Jun 17 • 27

GetBeholder/Beholder-q4f16

Text Generation • Updated Jul 13 • 13

cawalch/veyra-tuned-v2b-q4f16_1-MLC

Text Generation • Updated Jun 22

anipanii/AskWise-PromptEngineer-1.5B-q4f16_1-MLC

Updated 23 days ago • 26

skkut/qwen3-embedding-4b-q4f16_1-MLC-b2

Feature Extraction • Updated 13 days ago