PEFT How to use yujackein/onereason-8b-lora-r3replay-step20-step25-interp075-kvo-r32a32 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/data/sft_yaml/onereason_sft_epoch2_bf16")
model = PeftModel.from_pretrained(base_model, "yujackein/onereason-8b-lora-r3replay-step20-step25-interp075-kvo-r32a32") 
