Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2204.05149

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,110

Base only

Active filters: 2204.05149

SillyTilly/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 23, 2024 • 16 • • 1

bullerwins/Meta-Llama-3.1-8B-Instruct-exl2_5.0bpw

Text Generation • Updated Aug 23, 2024 • 13 • 1

bullerwins/Meta-Llama-3.1-8B-Instruct-exl2_6.0bpw

Text Generation • Updated Aug 23, 2024 • 20 • 1

bullerwins/Meta-Llama-3.1-8B-Instruct-exl2_8.0bpw

Text Generation • Updated Aug 23, 2024 • 11

bullerwins/Meta-Llama-3.1-8B-Instruct-exl2_4.0bpw

Text Generation • Updated Aug 23, 2024 • 15

SillyTilly/Meta-Llama-3.1-8B

Text Generation • 8B • Updated Jul 23, 2024 • 30 • 1

SillyTilly/Meta-Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Jul 23, 2024 • 32 • • 1

Crystalcareai/Meta-llama-3.1-8b-instruct

Text Generation • 8B • Updated Jul 23, 2024 • 17 • • 1

SillyTilly/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 23, 2024 • 19 • 1

mozilla-ai/Meta-Llama-3.1-8B-llamafile

Updated Jan 6, 2025 • 4.2k • 20

blockblockblock/Meta-Llama-3.1-8B-Instruct-bpw3-exl2

Text Generation • Updated Jul 23, 2024 • 10

blockblockblock/Meta-Llama-3.1-8B-Instruct-bpw3.5-exl2

Text Generation • Updated Jul 23, 2024 • 13

lucyknada/meta-llama_Meta-Llama-3.1-8B-Instruct-exl2-6.0bpw

Text Generation • Updated Jul 23, 2024 • 14

blockblockblock/Meta-Llama-3.1-8B-Instruct-bpw3.7-exl2

Text Generation • Updated Jul 23, 2024 • 12

PrimeIntellect/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 16, 2024 • 140

lucyknada/meta-llama_Meta-Llama-3.1-8B-Instruct-exl2-8.0bpw

Text Generation • Updated Jul 23, 2024 • 12

Undi95/Meta-Llama-3.1-8B-Instruct-OAS

Text Generation • 8B • Updated Jul 31, 2024 • 19 • • 1

bigstorm/Meta-Llama-3.1-70B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 23, 2024 • 12

teknium/Llama-3.1-AlternateTokenizer

Text Generation • 8B • Updated Jun 18, 2025 • 264 • • 8

bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 24, 2024 • 12

LoneStriker/Meta-Llama-3.1-8B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 9

LoneStriker/Meta-Llama-3.1-8B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 15

LoneStriker/Meta-Llama-3.1-8B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 12

LoneStriker/Meta-Llama-3.1-8B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 13 • 1

LoneStriker/Meta-Llama-3.1-8B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Jul 24, 2024 • 10 • 1

QuantFactory/Meta-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 1.17k • 13

bigstorm/Meta-Llama-3.1-70B-Instruct-6.5bpw-8hb-exl2

Text Generation • Updated Jul 24, 2024 • 10

LoneStriker/Meta-Llama-3.1-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 16

LoneStriker/Meta-Llama-3.1-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 12

LoneStriker/Meta-Llama-3.1-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 10