Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

calibration-aware-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7

Base only

Active filters: calibration-aware-quantization

fraQtl/Gemma-4-E2B-it-Hi-Fi-GGUF

Text Generation • 5B • Updated 16 days ago • 4.2k • 18

fraQtl/Gemma-4-26B-A4B-it-Hi-Fi-GGUF

Text Generation • 25B • Updated 16 days ago • 204 • 1

fraQtl/Llama-3.2-1B-Instruct-Hi-Fi-GGUF

Text Generation • 1B • Updated 16 days ago • 160

fraQtl/Llama-3.1-8B-Instruct-Hi-Fi-GGUF

Text Generation • 8B • Updated 16 days ago • 168

fraQtl/Qwen3.8-27B-Hi-Fi-GGUF

Text Generation • 27B • Updated 16 days ago • 438 • 2

fraQtl/Qwen3-4B-Instruct-2507-Hi-Fi-GGUF

Text Generation • 4B • Updated 13 days ago • 96

qualcomm-ai-hub-community/Qwen3-4B-Instruct-2507-Hi-Fi-fraQtl

Text Generation • 4B • Updated 13 days ago • 674 • 1