How to use sociocom/MedPHINER-Llama-3.1-Swallow-8B-Instruct-v0.5 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/data/llmcache/tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5/") model = PeftModel.from_pretrained(base_model, "sociocom/MedPHINER-Llama-3.1-Swallow-8B-Instruct-v0.5")
