--- base_model: LiberteEPFL/qwen3-1.7b-sft-bigchat-v2 library_name: transformers model_name: qwen3-1.7b-rm-full-bigchat-v2 tags: - generated_from_trainer - trl - reward-trainer licence: license --- # Model Card for qwen3-1.7b-rm-full-bigchat-v2 This model is a fine-tuned version of [LiberteEPFL/qwen3-1.7b-sft-bigchat-v2](https://huggingface.co/LiberteEPFL/qwen3-1.7b-sft-bigchat-v2). It has been trained using [TRL](https://github.com/huggingface/trl). ## Quick start ```python from transformers import pipeline text = "The capital of France is Paris." rewarder = pipeline(model="LiberteEPFL/qwen3-1.7b-rm-full-bigchat-v2", device="cuda") output = rewarder(text)[0] print(output["score"]) ``` ## Training procedure [Visualize in Weights & Biases](https://wandb.ai/alirezasakhaeirad/Liberte/runs/8zurlr77) This model was trained with Reward. ### Framework versions - TRL: 1.3.0 - Transformers: 4.57.0 - Pytorch: 2.8.0+cu128 - Datasets: 4.8.5 - Tokenizers: 0.22.1 ## Citations Cite TRL as: ```bibtex @software{vonwerra2020trl, title = {{TRL: Transformers Reinforcement Learning}}, author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin}, license = {Apache-2.0}, url = {https://github.com/huggingface/trl}, year = {2020} } ```