Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2309.00071

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,756

Base only

Active filters: 2309.00071

maddes8cht/lightonai-alfred-40b-1023-gguf

42B • Updated Jun 9 • 162

TheBloke/Yarn-Llama-2-70B-32k-AWQ

Text Generation • 69B • Updated Nov 21, 2023 • 38 • 2

TheBloke/Yarn-Llama-2-70B-32k-GPTQ

Text Generation • 69B • Updated Nov 21, 2023 • 61

TheBloke/Yarn-Llama-2-70B-32k-GGUF

69B • Updated Nov 20, 2023 • 1.28k • 9

LoneStriker/Yarn-Llama-2-70b-32k-2.4bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 35

LoneStriker/Yarn-Llama-2-70b-32k-4.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 29 • 1

LoneStriker/Yarn-Llama-2-70b-32k-4.65bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 31

LoneStriker/Yarn-Llama-2-70b-32k-2.55bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 36

LoneStriker/Yarn-Llama-2-70b-32k-6.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 31 • 1

LoneStriker/Yarn-Llama-2-70b-32k-5.15bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 32

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 16, 2024 • 56 • 1

NousResearch/Yarn-Solar-10b-64k

Text Generation • Updated Jan 18, 2024 • 280 • 16

NousResearch/Yarn-Solar-10b-32k

Text Generation • Updated Jan 18, 2024 • 299 • 11

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 725 • 5

tdh87/Yarn-Solar-10b-64k-SafeTensors

11B • Updated Jan 29, 2024 • 14

MaziyarPanahi/Yarn-Solar-10b-64k-GGUF

Text Generation • 11B • Updated Feb 25, 2024 • 359 • 1

MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Text Generation • 11B • Updated Feb 26, 2024 • 297 • 1

gradientai/Llama-3-8B-Instruct-262k

Text Generation • 8B • Updated Oct 28, 2024 • 2.63k • • 260

LoneStriker/Llama-3-8B-Instruct-262k-GGUF

Text Generation • 8B • Updated Apr 26, 2024 • 65 • 2

LoneStriker/Llama-3-8B-Instruct-262k-3.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 19

LoneStriker/Llama-3-8B-Instruct-262k-4.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 18

LoneStriker/Llama-3-8B-Instruct-262k-5.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 17

LoneStriker/Llama-3-8B-Instruct-262k-6.0bpw-h6-exl2

Text Generation • Updated Apr 26, 2024 • 16

LoneStriker/Llama-3-8B-Instruct-262k-8.0bpw-h8-exl2

Text Generation • Updated Apr 26, 2024 • 15

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_8.0bpw

Text Generation • Updated Apr 26, 2024 • 27 • 3

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_6.0bpw

Text Generation • Updated Apr 26, 2024 • 12

QuantFactory/Llama-3-8B-Instruct-262k-GGUF

Text Generation • 8B • Updated Apr 26, 2024 • 849 • 1

LiteLLMs/Llama-3-8B-Instruct-262k-GGUF

Text Generation • 8B • Updated Apr 29, 2024 • 249 • 1

gradientai/Llama-3-8B-Instruct-Gradient-1048k

Text Generation • 8B • Updated Oct 29, 2024 • 30.8k • • 683

blockblockblock/Llama-3-8B-Instruct-Gradient-1048k-bpw2.25-exl2

Text Generation • Updated May 9, 2024 • 17 • 1