PEFT How to use aseratus1/4c57a2a2-b835-45a4-9278-d11c09e981f8 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2")
model = PeftModel.from_pretrained(base_model, "aseratus1/4c57a2a2-b835-45a4-9278-d11c09e981f8") 
