mzhaoshuai
/

Llama-2-13b-hf-conf-refalign

Model card Files Files and versions

RefAlign: RL with Similarity-based Rewards

GitHub repository: https://github.com/mzhaoshuai/RefAlign

Paper: Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data.

RefAlign with https://huggingface.co/datasets/shuchangtao/CONQORD_dataset/tree/main/conqord_step3_data.

Framework versions

PEFT 0.11.1

Downloads last month: 3

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mzhaoshuai/Llama-2-13b-hf-conf-refalign

Base model

meta-llama/Llama-2-13b-hf

Adapter

mzhaoshuai/Llama-2-13b-hf-conf-sft

Adapter

(1)

this model

Dataset used to train mzhaoshuai/Llama-2-13b-hf-conf-refalign

Collection including mzhaoshuai/Llama-2-13b-hf-conf-refalign

RefAlign: RL with Similarity-based Rewards

Datasets and models in: Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data. • 19 items • Updated Oct 30, 2025 • 1

Paper for mzhaoshuai/Llama-2-13b-hf-conf-refalign

Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data

Paper • 2504.09895 • Published Apr 14, 2025 • 1