LoRA-3MPER0RR-Abliterated
Collection
6 items • Updated
How to use 3MPER0RR/Mistral-7B-v0.3-Lora-adapter-3MPER0RR-abliterated with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("3MPER0RR/Mistral-7B-v0.3-3MPER0RR-abliterated")
model = PeftModel.from_pretrained(base_model, "3MPER0RR/Mistral-7B-v0.3-Lora-adapter-3MPER0RR-abliterated")How to use 3MPER0RR/Mistral-7B-v0.3-Lora-adapter-3MPER0RR-abliterated with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("3MPER0RR/Mistral-7B-v0.3-Lora-adapter-3MPER0RR-abliterated", device_map="auto")Base model
mistralai/Mistral-7B-v0.3