PEFT How to use sociocom/MedPHINER-Llama-3.1-Swallow-8B-Instruct-v0.5 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/data/llmcache/tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5/")
model = PeftModel.from_pretrained(base_model, "sociocom/MedPHINER-Llama-3.1-Swallow-8B-Instruct-v0.5") 
