Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2212.10560

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47

Base only

Active filters: 2212.10560

khoicrtp/cog-llama-test

Updated May 23, 2023

MelMitchell8/llama-self_instruct

Updated Jun 4, 2023

MelMitchell8/llama-self_instruct-relevancy

Updated Jun 4, 2023

allenai/open-instruct-self-instruct-7b

Text Generation • Updated Jun 20, 2023 • 150

allenai/open-instruct-self-instruct-13b

Text Generation • Updated Jun 20, 2023 • 162

Minami-su/roleplay_baichuan-Chat_4bit

Text Generation • Updated Dec 16, 2023 • 9

TheBloke/openchat_3.5-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 84 • 15

TheBloke/openchat_3.5-GGUF

7B • Updated Nov 2, 2023 • 2.27k • 133

LoneStriker/openchat_3.5-3.0bpw-h6-exl2

Text Generation • Updated Nov 3, 2023 • 10

LoneStriker/openchat_3.5-4.0bpw-h6-exl2

Text Generation • Updated Nov 3, 2023 • 8 • 1

LoneStriker/openchat_3.5-5.0bpw-h6-exl2

Text Generation • Updated Nov 3, 2023 • 12

LoneStriker/openchat_3.5-6.0bpw-h6-exl2

Text Generation • Updated Nov 3, 2023 • 20

TheBloke/openchat_3.5-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 57 • 17

LoneStriker/openchat_3.5-8.0bpw-h6-exl2

Text Generation • Updated Nov 3, 2023 • 17

LoneStriker/openchat_3.5-8.0bpw-h8-exl2

Text Generation • Updated Nov 3, 2023 • 18 • 3

vaclavkosar/openchat_3.5-ct2

Text Generation • Updated Nov 12, 2023 • 11

dddddd1367/signalha

Updated Nov 5, 2023

yanismiraoui/openchat_3.5-sharded

Text Generation • 7B • Updated Nov 7, 2023 • 17

TheBloke/openchat_3.5-16k-AWQ

Text Generation • 7B • Updated Nov 11, 2023 • 32 • 2

TheBloke/openchat_3.5-16k-GGUF

7B • Updated Nov 11, 2023 • 721 • 22

TheBloke/openchat_3.5-16k-GPTQ

Text Generation • 7B • Updated Nov 11, 2023 • 26 • 5

LoneStriker/openchat_3.5-16k-3.0bpw-h6-exl2

Text Generation • Updated Nov 11, 2023 • 19

LoneStriker/openchat_3.5-16k-4.0bpw-h6-exl2

Text Generation • Updated Nov 11, 2023 • 21

LoneStriker/openchat_3.5-16k-5.0bpw-h6-exl2

Text Generation • Updated Nov 11, 2023 • 14

LoneStriker/openchat_3.5-16k-6.0bpw-h6-exl2

Text Generation • Updated Nov 11, 2023 • 18

LoneStriker/openchat_3.5-16k-8.0bpw-h8-exl2

Text Generation • Updated Nov 11, 2023 • 15

DonatePlz/openchat_3.5-16k-merged

Text Generation • 7B • Updated Nov 13, 2023 • 18 • 2

DonatePlz/openchat_3.5-16k-merged-AWQ

Text Generation • 7B • Updated Nov 14, 2023 • 15 • 1

Minami-su/qwen_7b_chat_roleplay_4bit

Text Generation • Updated Dec 16, 2023 • 21 • 2

Trelis/openchat_3.5-function-calling-v3

Text Generation • 7B • Updated Mar 6, 2024 • 21