Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2309.00071

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,756

Base only

Active filters: 2309.00071

TheBloke/Yarn-Llama-2-13B-64K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 44 • 1

TheBloke/Yarn-Llama-2-13B-128K-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 17 • 2

TheBloke/Yarn-Llama-2-13B-64K-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 17

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 14 • 1

TheBloke/Yarn-Llama-2-7B-64K-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 16

NousResearch/Yarn-Mistral-7b-64k

Text Generation • Updated Nov 2, 2023 • 307 • 53

NousResearch/Yarn-Mistral-7b-128k

Text Generation • Updated Nov 2, 2023 • 742 • 574

TheBloke/Yarn-Mistral-7B-128k-GGUF

7B • Updated Nov 2, 2023 • 2k • 129

TheBloke/Yarn-Mistral-7B-64k-GGUF

7B • Updated Nov 2, 2023 • 1.32k • 31

TheBloke/Yarn-Mistral-7B-64k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 31 • 4

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 56 • 72

LoneStriker/Yarn-Mistral-7b-128k-3.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 6

LoneStriker/Yarn-Mistral-7b-128k-4.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 12 • 1

LoneStriker/Yarn-Mistral-7b-128k-5.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 10 • 1

LoneStriker/Yarn-Mistral-7b-128k-6.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 13

LoneStriker/Yarn-Mistral-7b-128k-8.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 19

LoneStriker/Yarn-Mistral-7b-128k-8.0bpw-h8-exl2

Text Generation • Updated Nov 2, 2023 • 15 • 2

LoneStriker/Yarn-Mistral-7b-64k-3.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 7

LoneStriker/Yarn-Mistral-7b-64k-4.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 13

LoneStriker/Yarn-Mistral-7b-64k-5.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 10 • 1

LoneStriker/Yarn-Mistral-7b-64k-6.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 12

LoneStriker/Yarn-Mistral-7b-64k-8.0bpw-h8-exl2

Text Generation • Updated Nov 2, 2023 • 18

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 64 • 13

TheBloke/Yarn-Mistral-7B-64k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 36 • 4

yanismiraoui/Yarn-Mistral-7b-128k-sharded

Text Generation • 7B • Updated Nov 7, 2023 • 15 • 2

NousResearch/Yarn-Llama-2-70b-32k

Text Generation • Updated Nov 20, 2023 • 275 • 38

lightonai/alfred-40b-1023

Text Generation • Updated Feb 13, 2024 • 188 • 50

TheBloke/alfred-40B-1023-GPTQ

Text Generation • 42B • Updated Nov 17, 2023 • 30 • 3

TheBloke/alfred-40B-1023-GGUF

42B • Updated Nov 17, 2023 • 1.05k • 5

TheBloke/alfred-40B-1023-AWQ

Text Generation • 42B • Updated Nov 17, 2023 • 12 • 5