Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2306.01708

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,563

Base only

Active filters: 2306.01708

inflatebot/MN-12B-Mag-Mell-R1

Text Generation • 12B • Updated Apr 3, 2025 • 2.54k • • 253

Mantis2024/Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW

Text Generation • 9B • Updated Mar 13, 2025 • 1.55k • • 91

Casual-Autopsy/Maginum-Cydoms-24B

Text Generation • 24B • Updated Dec 11, 2025 • 81 • 40

chargoddard/Chronorctypus-Limarobormes-13b

Text Generation • 13B • Updated Jan 4, 2024 • 68 • 12

TheBloke/Chronorctypus-Limarobormes-13b-GGML

Updated Sep 27, 2023 • 8 • 4

TheBloke/Chronorctypus-Limarobormes-13b-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 48 • 6

Envoid/Yousei-22B

Text Generation • 22B • Updated Sep 5, 2023 • 110 • 2

TheBloke/Chronorctypus-Limarobormes-13b-GGUF

13B • Updated Sep 27, 2023 • 2.04k • 2

DS-Archive/CalliopeDS-L2-13B

Text Generation • 13B • Updated Sep 16, 2023 • 31 • 7

TheBloke/CalliopeDS-L2-13B-GGUF

Text Generation • 13B • Updated Sep 27, 2023 • 613 • 5

TheBloke/CalliopeDS-L2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 37 • 3

TheBloke/Chronorctypus-Limarobormes-13b-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 23 • 2

TheBloke/CalliopeDS-L2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 14 • 3

brucethemoose/SUS-Bagel-200K-DARE-Test

Text Generation • 34B • Updated Jan 11, 2024 • 60 • 2

jeiku/Current_3B

Text Generation • 3B • Updated Jan 8, 2024 • 16 • 2

Netrve/Loyal-Silicon-Maid-7B

Text Generation • 7B • Updated Jan 8, 2024 • 14 • 6

brucethemoose/Yi-34B-200K-DARE-merge-v7

Text Generation • 34B • Updated Mar 11, 2024 • 8.58k • 6

DS-Archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES

Text Generation • 47B • Updated Jan 8, 2024 • 30 • 5

jeiku/Streamlined_3B

Text Generation • 3B • Updated Jan 8, 2024 • 17 • 2

jeiku/Streamlined_3B_GGUF

3B • Updated Jan 9, 2024 • 115 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-3.0bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 13 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-3.5bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 16 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-3.75bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 18 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-4.0bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 9 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-5.0bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 13 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-6.0bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 13 • 1

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-2.4bpw-h6-exl2

Text Generation • Updated Jan 9, 2024 • 16 • 1

jeiku/SmarterAdult_3B

Text Generation • 3B • Updated Jan 9, 2024 • 14 • 2

jeiku/SmarterAdult_3B_GGUF

3B • Updated Jan 9, 2024 • 112 • 3

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES-AWQ

Text Generation • 47B • Updated Jan 10, 2024 • 24 • 3