Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12

Base only

Active filters: z16

taronaeo/Granite-3.0-1B-A400M-Instruct-BE-GGUF

Text Generation • 1B • Updated Apr 2, 2025 • 476 • 1

taronaeo/Qwen2.5-1.5B-Instruct-BE-GGUF

Text Generation • 2B • Updated May 3, 2025 • 114

taronaeo/Qwen2.5-3B-Instruct-BE-GGUF

Text Generation • 3B • Updated May 4, 2025 • 133

taronaeo/Qwen2.5-7B-Instruct-BE-GGUF

Text Generation • 8B • Updated May 4, 2025 • 87

taronaeo/Granite-3.1-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 104

taronaeo/Granite-3.3-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 117

taronaeo/Llama-3.2-1B-Instruct-BE-GGUF

Text Generation • 1B • Updated Jul 9, 2025 • 386

taronaeo/Llama-3.2-3B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 104

taronaeo/DeepSeek-R1-Distill-Llama-8B-BE-GGUF

8B • Updated Jul 12, 2025 • 107 • 1

taronaeo/DeepSeek-R1-0528-Qwen3-8B-BE-GGUF

8B • Updated Jul 26, 2025 • 16

taronaeo/all-MiniLM-L6-v2-BE

Sentence Similarity • 22.6M • Updated Aug 1, 2025 • 93

taronaeo/Bonsai-8B-BE-GGUF

Text Generation • 8B • Updated 6 days ago • 144