Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,206

Base only

Active filters: gptq

TheBloke/gpt4-alpaca-lora_mlp-65B-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 62 • 14

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 207 • 319

TheBloke/wizard-mega-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 78 • 108

TheBloke/VicUnlocked-30B-LoRA-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 79 • 20

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 517 • 164

TheBloke/Manticore-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 70 • 37

qwopqwop/KoAlpaca-Polyglot-5.8B-GPTQ

Text Generation • Updated May 19, 2023 • 19 • 3

qwopqwop/KoAlpaca-Polyglot-12.8B-GPTQ

Text Generation • Updated May 19, 2023 • 18 • 5

TheBloke/WizardLM-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 130 • 118

digitous/13B-Chimera

Text Generation • Updated May 24, 2023 • 61 • 6

TheBloke/airoboros-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 71 • 13

TheBloke/manticore-13b-chat-pyg-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 77 • 33

TheBloke/Project-Baize-v2-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 113 • 4

TheBloke/Project-Baize-v2-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 103 • 11

digitous/13B-HyperMantis_GPTQ_4bit-128g

Text Generation • Updated May 24, 2023 • 12 • 12

TheBloke/guanaco-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 83 • 29

TheBloke/guanaco-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 94 • 74

TheBloke/guanaco-65B-GPTQ

Text Generation • 65B • Updated Sep 27, 2023 • 375 • 262

TheBloke/guanaco-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 84 • 28

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 15 • 2

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 19 • 23

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 63 • 68

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • 42B • Updated Aug 21, 2023 • 116 • 197

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 50 • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 78 • 25

TheBloke/Samantha-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 11 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 13 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 48 • 20

disarmyouwitha/koala13b_test

Text Generation • Updated May 29, 2023 • 12

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 301 • 609