Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

22

Base only

Active filters: q6

leafspark/wavecoder-ds-6.7b-GGUF

Text Generation • 7B • Updated Apr 17, 2024 • 81 • 1

adriabama06/whisper-large-v3-ggml

Updated Jun 11, 2025 • 1

0xdfi/Qwen3.5-35B-A3B-REAP-pile10k-30p-MLX-q6

Text Generation • 25B • Updated Mar 12 • 43

0xdfi/Qwen3.5-35B-A3B-REAP-pile10k-15p-MLX-q6

Text Generation • 30B • Updated Mar 12 • 35

0xdfi/Carnice-27b-MLX-Q6

Text Generation • 27B • Updated Apr 8 • 18 • 1

plawanrath/qwen2.5-7b-instruct-q6-mlx-cba

Text Generation • 8B • Updated May 19 • 16

plawanrath/mistral-7b-instruct-v0.3-q6-mlx-cba

Text Generation • 7B • Updated May 19 • 21

plawanrath/phi-3.5-mini-instruct-q6-mlx-cba

Text Generation • 4B • Updated May 19 • 19

mlx-community/HiDream-O1-Image-Dev-mlx-q6

Text-to-Image • 9B • Updated May 11 • 144 • 3

saintlits/Ornstein3.6-27B-MTP-NSC-ACE-SABER-oQ6-mtp

Image-Text-to-Text • 7B • Updated May 18 • 5

saintlits/Intern-S2-Preview-oQ6-mtp

Text Generation • 8B • Updated Jun 4 • 10

adriabama06/Voxtral-Mini-4B-Realtime-2602-CrispASR-GGUF

4B • Updated Jun 6 • 147 • 1

mavis-ai/Multilingual-e5-large-Q6

Feature Extraction • Updated Jun 18 • 11

dispatchAI/Llama-3.2-1B-Instruct-Q6-mobile

Text Generation • 1B • Updated Jun 28 • 17

mavis-ai/Gemma4-E2B-MLX-Q6

Image-Text-to-Text • 5B • Updated Jul 1 • 15

mavis-ai/Gemma4-E4B-MLX-Q6

Image-Text-to-Text • 8B • Updated Jul 1 • 8

mavis-ai/Qwen3.6-35B-MoE-Q6

Image-Text-to-Text • 35B • Updated Jul 14 • 183

TiGa-RCE/Qwen3-Embedding-0.6B-MLX-Q6

Feature Extraction • 0.6B • Updated Jul 28 • 23

TiGa-RCE/gte-Qwen2-1.5B-instruct-MLX-Q6

Feature Extraction • 2B • Updated Jul 28 • 16

TiGa-RCE/Qwen3-Embedding-8B-MLX-Q6

Feature Extraction • 8B • Updated Jul 29 • 26

ai-babai/giga-embeddings-0826-3b-gguf

Sentence Similarity • 3B • Updated 35 minutes ago • 125

ai-babai/giga-embeddings-0826-480m-gguf

Sentence Similarity • 0.5B • Updated 35 minutes ago