PEFT How to use takehika/rinna-neox-small-ja-it-adapter with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("rinna/japanese-gpt-neox-small")
model = PeftModel.from_pretrained(base_model, "takehika/rinna-neox-small-ja-it-adapter") 
