Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

built-with-llama

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

226

Base only

Active filters: built-with-llama

Eeppa/TinyBuddy-500K

Text Generation • 744k • Updated 4 days ago • 791 • 1

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-32

2B • Updated Jun 15 • 77

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-32

2B • Updated Jun 15 • 18

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-64

2B • Updated Jun 15 • 19

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-64

2B • Updated Jun 15 • 46

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-128

2B • Updated Jun 15 • 15

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-128

2B • Updated Jun 15 • 13

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-32

73B • Updated Jul 3 • 9

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-32

75B • Updated Jul 3 • 7

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-64

73B • Updated Jul 7 • 14

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-64

72B • Updated Jul 7 • 6

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-128

72B • Updated Jul 7 • 6

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-128

11B • Updated Jun 15 • 7

FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-32

3B • Updated Jun 15 • 6

FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-64

3B • Updated Jun 15 • 5

FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-128

3B • Updated Jun 15 • 10

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 9

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 14

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 9

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 10

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 11

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 9

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 10

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 12

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 7

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 26

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 18

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 11

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 18

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 8