---
base_model:
- meta-llama/Llama-3.1-8B
- K-intelligence/Llama-SafetyGuard-Content-Binary
library_name: peft
tags:
- mergekit
- peft

---
# toxicity

This is a LoRA extracted from a language model. It was extracted using [mergekit](https://github.com/arcee-ai/mergekit).

## LoRA Details

This LoRA adapter was extracted from [K-intelligence/Llama-SafetyGuard-Content-Binary](https://huggingface.co/K-intelligence/Llama-SafetyGuard-Content-Binary) and uses [meta-llama/Llama-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) as a base.

 [!WARNING]
> The vocabulary size has been extended from the base model's 128256 to 128258. To load this adapter, you must first call `model.resize_token_embeddings(128258)`.

### Parameters

The following command was used to extract this LoRA adapter:

```sh
/nethome/ian6/ian6-myenv/bin/mergekit-extract-lora --model K-intelligence/Llama-SafetyGuard-Content-Binary --base-model meta-llama/Llama-3.1-8B --out-path ./lora_adapters/toxicity --cuda
```