Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2212.10560

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47

Base only

Active filters: 2212.10560

LoneStriker/openchat-3.5-1210-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 18, 2023 • 17

LoneStriker/openchat-3.5-1210-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 18, 2023 • 18

LoneStriker/openchat-3.5-1210-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 18, 2023 • 21

LoneStriker/openchat-3.5-1210-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 18, 2023 • 20

LoneStriker/openchat-3.5-1210-8.0bpw-h8-exl2-2

Text Generation • Updated Dec 18, 2023 • 18

TheBloke/openchat-3.5-1210-AWQ

Text Generation • 7B • Updated Dec 19, 2023 • 34 • 2

TheBloke/openchat-3.5-1210-GGUF

Text Generation • 7B • Updated Dec 15, 2023 • 2.71k • 51

TheBloke/openchat-3.5-1210-GPTQ

Text Generation • 7B • Updated Dec 19, 2023 • 49 • 4

tsunemoto/openchat-3.5-1210-GGUF

7B • Updated Dec 14, 2023 • 215 • 1

cfahlgren1/wasm-openchat-3.5-1210-q4f32_1

Text Generation • Updated Dec 19, 2023

severcorp/oc35

Text Generation • 7B • Updated Dec 21, 2023 • 8

LemTenku/chat

Text Generation • 7B • Updated Dec 23, 2023 • 18

MaziyarPanahi/openchat_3.5-16k-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 17, 2024 • 22

MaziyarPanahi/openchat_3.5-16k-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 29, 2024 • 406

RichardErkhov/databricks_-_dolly-v1-6b-4bits

Text Generation • 6B • Updated Apr 14, 2024 • 18

RichardErkhov/databricks_-_dolly-v1-6b-8bits

Text Generation • 6B • Updated Apr 14, 2024 • 19

NeuralNoble/post-training-guide