How to use TSunm/Llama-3.2-1B-Instruct-Chat-DPO with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TSunm/Llama-3.2-1B-Instruct-Chat-DPO", device_map="auto")
