Hugging Face's logo

sardukar
/
physiology-8k-llama3-8b-qlora

PEFT
Safetensors
English
Model card Files
xet
 Community
How to use from the
Use from the
PEFT library
from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("NousResearch/Meta-Llama-3-8B-Instruct")
model = PeftModel.from_pretrained(base_model, "sardukar/physiology-8k-llama3-8b-qlora")

Model Card for Model ID

This model is a 1 epoch training with ORPO Trainer on the sardukar/physiology-mcqa-8k dataset

Base model is NousResearch/Meta-Llama-3-8B-Instruct

Training results train_results

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for sardukar/physiology-8k-llama3-8b-qlora

Base model

NousResearch/Meta-Llama-3-8B-Instruct
Adapter
(104)
this model

Dataset used to train sardukar/physiology-8k-llama3-8b-qlora