Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2204.05149

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,110

Base only

Active filters: 2204.05149

ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 9, 2024 • 1.71k • 1

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3, 2024 • 16

ThomasBaruzier/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Aug 23, 2024 • 2.19k • 3

bullerwins/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 525 • 6

vicky4s4s/llama-3.1-8B-instruct

Text Generation • 8B • Updated Jul 31, 2024 • 10

livil/llama3.1-8b-instruct

Text Generation • 8B • Updated Jul 30, 2024 • 12 •

Niansuh/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 11

DavidLanz/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 12 • 2

pvbhanuteja/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 14 • 1

jitsi/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 14

Apel-sin/meta-llama-3.1-70B-instruct-exl2

Text Generation • Updated Jul 31, 2024

jeremierostan/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 27

jeremierostan/Meta-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 24

ek826/Meta-Llama-3.1-405B-Instruct-6.0bpw-exl2

Text Generation • Updated Aug 4, 2024 • 16 • 2

RichardErkhov/aifeifei798_-_DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-gguf

8B • Updated Aug 4, 2024 • 2.03k • 2

RichardErkhov/NousResearch_-_Meta-Llama-3.1-8B-Instruct-gguf

Updated Aug 5, 2024 • 217

RichardErkhov/NousResearch_-_Meta-Llama-3.1-8B-gguf

Updated Aug 5, 2024 • 138

RichardErkhov/Crystalcareai_-_Meta-llama-3.1-8b-instruct-gguf

8B • Updated Aug 5, 2024 • 630

FriendliAI/Meta-Llama-3.1-8B-Instruct-fp8

Text Generation • 8B • Updated Nov 3, 2024 • 3.52k

RichardErkhov/Crystalcareai_-_meta-llama-3.1-8b-gguf

8B • Updated Aug 5, 2024 • 939

FriendliAI/Meta-Llama-3.1-70B-Instruct-fp8

Text Generation • 71B • Updated Nov 3, 2024 • 21

stanfm/LMA3.1

Text Generation • 8B • Updated Aug 6, 2024 • 12

RichardErkhov/stanfm_-_LMA3.1-gguf

8B • Updated Aug 7, 2024 • 784

jimmywhite66/Meta_llama_3.1_8b

Text Generation • 8B • Updated Aug 7, 2024 • 10

lazyDataScientist/metallama31instruct8b

Text Generation • 8B • Updated Aug 7, 2024 • 16

emplitude/rubysmart5

Text Generation • 8B • Updated Aug 8, 2024 • 14

ThomasBaruzier/Meta-Llama-3.1-405B-Instruct-16KV-heads-GGUF

Text Generation • 410B • Updated Aug 25, 2024 • 104

RichardErkhov/roni23_-_Meta-Llama-3.1-8B-Instruct-gguf

8B • Updated Aug 10, 2024 • 601

RichardErkhov/livil_-_llama3.1-8b-instruct-gguf

8B • Updated Aug 10, 2024 • 1.13k

RichardErkhov/aifeifei799_-_Llama-3.1-8B-Instruct-Fei-v1-Uncensored-gguf

8B • Updated Aug 10, 2024 • 462