ICEPVP8977/Uncensored_Small_Reasoning
Viewer • Updated • 4.54k • 29 • 7
How to use vpakarinen/ibm-granite-8b-lora-uncensored with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("ibm-granite/granite-3.3-8b-instruct")
model = PeftModel.from_pretrained(base_model, "vpakarinen/ibm-granite-8b-lora-uncensored")Fine-tuned version of ibm-granite/granite-3.3-8b-instruct on the ICEPVP8977/Uncensored_Small_Test_Time_Compute dataset.
This LoRA will fully uncensor the granite-3.3-8b-instruct, use alpaca instruction template.
Base model
ibm-granite/granite-3.3-8b-base