---
base_model: "meta-llama/Llama-3.1-8B-Instruct"
language:
  - en
  - de
  - fr
  - it
  - pt
  - hi
  - es
  - th
tags:
  - transformers
  - safetensors
  - llama
  - text-generation
  - facebook
  - meta
  - pytorch
  - llama-3
  - conversational
  - en
  - de
  - fr
  - it
  - pt
  - hi
  - es
  - th
  - arxiv:2204.05149
  - base_model:meta-llama/Llama-3.1-8B
  - base_model:finetune:meta-llama/Llama-3.1-8B
  - license:llama3.1
  - autotrain_compatible
  - text-generation-inference
  - endpoints_compatible
  - region:us
license: "llama3.1"
inference: false
quantized_by: pbatra
---

# Llama-3.1-8B-Instruct

This repository contains quantized versions of the model from the original repository: [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct).

| Name | Quantization Method | Size (GB) |
|------|---------------------|-----------|
| llama-3.1-8b-instruct.Q8_0.gguf | q8_0 | 7.95 |
| llama-3.1-8b-instruct.Q4_0.gguf | q4_0 | 4.34 |