Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2403.04652

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

222

Base only

Active filters: 2403.04652

RichardErkhov/01-ai_-_Yi-6B-gguf

6B • Updated Apr 13, 2024 • 9.54k

RichardErkhov/01-ai_-_Yi-6B-200K-gguf

6B • Updated Apr 13, 2024 • 12.2k

RichardErkhov/01-ai_-_Yi-9B-200K-gguf

9B • Updated Apr 13, 2024 • 7.26k

RichardErkhov/01-ai_-_Yi-34B-Chat-4bits

Text Generation • 35B • Updated May 3, 2024 • 25

RichardErkhov/01-ai_-_Yi-34B-Chat-gguf

34B • Updated May 4, 2024 • 9.45k

yutest68/Yi-1.5-6B

Updated May 10, 2024 • 1

01-ai/Yi-1.5-9B-Chat

Text Generation • 9B • Updated Jun 26, 2024 • 19.9k • 149

01-ai/Yi-1.5-34B-Chat

Text Generation • 34B • Updated Aug 27, 2024 • 17.3k • 278

01-ai/Yi-1.5-6B

Text Generation • 6B • Updated Jun 26, 2024 • 13.5k • 32

01-ai/Yi-1.5-34B

Text Generation • 34B • Updated Jun 26, 2024 • 9.35k • 50

01-ai/Yi-1.5-9B

Text Generation • 9B • Updated Jun 26, 2024 • 14.5k • 53

01-ai/Yi-1.5-6B-Chat

Text Generation • 6B • Updated Aug 27, 2024 • 8.82k • 42

afrideva/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated May 12, 2024 • 252 • 2

afrideva/Yi-1.5-9B-Chat-GGUF

Text Generation • 9B • Updated May 12, 2024 • 172

afrideva/Yi-1.5-6B-GGUF

Text Generation • 6B • Updated May 12, 2024 • 77 • 2

tsunemoto/Yi-1.5-6B-Chat-GGUF

6B • Updated May 12, 2024 • 154

blockblockblock/Yi-1.5-34B-Chat-bpw2.25-exl2

Text Generation • 34B • Updated May 12, 2024 • 102

blockblockblock/Yi-1.5-34B-Chat-bpw2.5-exl2

Text Generation • 34B • Updated May 12, 2024 • 71

fakezeta/Yi-1.5-9B-Chat-ov-int8

Text Generation • Updated May 12, 2024 • 11 • 2

fakezeta/Yi-1.5-6B-Chat-ov-int8

Text Generation • Updated May 12, 2024 • 15 • 2

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated May 12, 2024 • 151k • 9

fakezeta/Yi-1.5-34B-Chat-ov-int4

Text Generation • Updated May 12, 2024 • 15 • 1

gobean/Yi-1.5-34B-Chat-GGUF

Updated May 12, 2024

MaziyarPanahi/Yi-1.5-9B-Chat-GGUF

Text Generation • 9B • Updated May 12, 2024 • 604 • 4

MaziyarPanahi/Yi-1.5-34B-Chat-GGUF

Text Generation • 34B • Updated May 12, 2024 • 1.16k • 5

blockblockblock/Yi-1.5-34B-Chat-bpw3-exl2

Text Generation • 34B • Updated May 12, 2024 • 65

blockblockblock/Yi-1.5-34B-Chat-bpw3.5-exl2

Text Generation • 34B • Updated May 12, 2024 • 62

tsunemoto/Yi-1.5-9B-Chat-GGUF

9B • Updated May 12, 2024 • 216 • 1

blockblockblock/Yi-1.5-34B-Chat-bpw3.7-exl2

Text Generation • 34B • Updated May 12, 2024 • 38

lucyknada/01-ai_Yi-1.5-34B-Chat-6.0bpw-EXL2

Text Generation • Updated May 13, 2024 • 14