RefAlign: RL with Similarity-based Rewards
Collection
Datasets and models in: Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data. • 19 items • Updated • 1
RefAlign: RL with Similarity-based Rewards
GitHub repository: https://github.com/mzhaoshuai/RefAlign
RefAlign with https://huggingface.co/datasets/shuchangtao/CONQORD_dataset/tree/main/conqord_step3_data.
Framework versions
- PEFT 0.11.1
- Downloads last month
- 3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for mzhaoshuai/Llama-2-13b-hf-conf-refalign
Base model
meta-llama/Llama-2-13b-hf
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mzhaoshuai/Llama-2-13b-hf-conf-sft") model = PeftModel.from_pretrained(base_model, "mzhaoshuai/Llama-2-13b-hf-conf-refalign")