Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

73

Base only

Active filters: q8

rad0main/Giga-Embeddings-instruct-480M-0826-GGUF

Sentence Similarity • 0.5B • Updated 7 days ago • 250 • 2

ai-babai/giga-embeddings-0826-480m-mlx-q8

Feature Extraction • 0.1B • Updated 6 days ago • 110 • 1

ai-babai/giga-embeddings-0826-3b-mlx-q8

Feature Extraction • 1B • Updated 6 days ago • 129 • 1

leafspark/wavecoder-ds-6.7b-GGUF

Text Generation • 7B • Updated Apr 17, 2024 • 90 • 1

rhaymison/Mistral-portuguese-luana-7b-q8-gguf

7B • Updated Jun 1, 2024 • 17 • 1

rhaymison/phi-3-portuguese-tom-cat-4k-instruct-q8-gguf

Text Generation • 4B • Updated Jun 3, 2024 • 32

CrazyDrag0n/deepseek-coder-v2-lite-instruct-Q8_0_GGUF

16B • Updated Apr 30, 2025 • 26

adriabama06/whisper-large-v3-ggml

Updated Jun 11, 2025 • 1

vlad-m-dev/mobilenetv2_doc_photo_quant

Image Classification • Updated Jun 15, 2025 • 1

vlad-m-dev/mobilenet_v3_small_onnx_photo_doc

Image Classification • Updated Jun 15, 2025 • 2

LibraxisAI/svetliq-11b-v3-evolutionary-preview-mlx-q8

Text Generation • 11B • Updated Apr 27 • 15

openmed-community/granite-4.0-micro-OpenMed-GGUF

Text Generation • 3B • Updated Oct 14, 2025 • 130 • 4

LibraxisAI/whisper-small-mlx-q8

Automatic Speech Recognition • Updated May 11 • 7

LibraxisAI/whisper-medium-mlx-q8

Automatic Speech Recognition • Updated May 11 • 9

LibraxisAI/whisper-large-v3-turbo-mlx-q8

Automatic Speech Recognition • Updated May 11 • 42

LibraxisAI/whisper-large-v3-mlx-q8

Automatic Speech Recognition • Updated May 11 • 20

LibraxisAI/Bielik-11B-v3.0-mlx-q8

Text Generation • 11B • Updated May 11 • 39

semen4ik-pro/RuadaptQwen2.5-1.5B-instruct-GGUF

Text Generation • 2B • Updated Jan 26 • 39 • 1

chronorus/chatbot-poc

3B • Updated Feb 1 • 11

jaspervandemeent/Qwen2.5-7B-Instruct-OOM

Text Generation • Updated Feb 26

0xdfi/Qwen3.5-35B-A3B-REAP-pile10k-30p-MLX-q8

Text Generation • 25B • Updated Mar 12 • 14

0xdfi/Qwen3.5-35B-A3B-REAP-pile10k-15p-MLX-q8

Text Generation • 30B • Updated Mar 12 • 52 • 2

okjustgaming/loomy-nonthinking

12B • Updated Mar 30 • 14 • 1

dahus/gemma-4-e2b-it-Q8_0-GGUF

Text Generation • 5B • Updated Apr 23 • 140 • 1

OpenMed/privacy-filter-mlx-8bit

Token Classification • Updated Apr 24 • 2.51k • 7

scasella91/talkie-1930-13b-it-ONNX

Text Generation • Updated Apr 30 • 12

Youssofal/Qwen3.5-4B-Optimized-MTPLX

Text Generation • 2B • Updated May 4 • 186 • 1

plawanrath/qwen2.5-7b-instruct-q8-mlx-cba

Text Generation • 8B • Updated May 19 • 11

plawanrath/mistral-7b-instruct-v0.3-q8-mlx-cba

Text Generation • 7B • Updated May 19 • 21

plawanrath/phi-3.5-mini-instruct-q8-mlx-cba

Text Generation • 1B • Updated May 19 • 25