akkikiki commited on
Commit
4c1d5dd
·
verified ·
1 Parent(s): e3cac84

Add model card

Browse files
Files changed (1) hide show
  1. README.md +76 -4
README.md CHANGED
@@ -1,5 +1,77 @@
1
  ---
2
- license: apache-2.0
3
- base_model:
4
- - GSAI-ML/LLaDA-8B-Instruct
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: GSAI-ML/LLaDA-8B-Instruct
3
+ library_name: transformers
4
+ model_name: akkikiki/LLaDA-8B-Instruct-judge-fs
5
+ tags:
6
+ - generated_from_trainer
7
+ - trl
8
+ - sft
9
+ licence: license
10
+ ---
11
+
12
+ # Model Card for akkikiki/LLaDA-8B-Instruct-judge-fs
13
+
14
+ This model is a fine-tuned version of [GSAI-ML/LLaDA-8B-Instruct](https://huggingface.co/GSAI-ML/LLaDA-8B-Instruct).
15
+ It has been trained using [TRL](https://github.com/huggingface/trl).
16
+
17
+ ## Quick start
18
+
19
+ ```python
20
+ from transformers import pipeline
21
+
22
+ prompt = """###Task Description:
23
+ An instruction (might include an Input inside it), a response to evaluate, a reference answer that gets a score of 5, and a score rubric representing a evaluation criteria are given.
24
+ 1. Write a detailed feedback that assess the quality of the response strictly based on the given score rubric, not evaluating in general.
25
+ 2. After writing a feedback, write a score that is an integer between 1 and 5. You should refer to the score rubric.
26
+ 3. The output format should look as follows: "Feedback: (write a feedback for criteria) [RESULT] (an integer number between 1 and 5)"
27
+ 4. Please do not generate any other opening, closing, and explanations.
28
+
29
+ ###The instruction to evaluate:
30
+ {orig_instruction}
31
+
32
+ ###Response to evaluate:
33
+ {orig_response}
34
+
35
+ ###Reference Answer (Score 5):
36
+ {orig_reference_answer}
37
+
38
+ ###Score Rubrics:
39
+ [{orig_criteria}]
40
+ Score 1: {orig_score1_description}
41
+ Score 2: {orig_score2_description}
42
+ Score 3: {orig_score3_description}
43
+ Score 4: {orig_score4_description}
44
+ Score 5: {orig_score5_description}
45
+
46
+ ###Feedback: """
47
+
48
+ generator = pipeline("text-generation", model="akkikiki/LLaDA-8B-Instruct-judge-fs", device="cuda")
49
+ output = generator([{"role": "user", "content": prompt}], max_new_tokens=128, return_full_text=False)[0]
50
+ print(output["generated_text"])
51
+ ```
52
+
53
+ ## Training procedure
54
+
55
+ This model was trained with SFT on 95% of [prometheus-eval/Feedback-Collection](https://huggingface.co/datasets/prometheus-eval/Feedback-Collection) with 5% held out as a validation set.
56
+
57
+ ### Framework versions
58
+
59
+ - TRL: 0.23.0
60
+ - Transformers: 4.56.2
61
+ - Pytorch: 2.8.0
62
+ - Datasets: 4.0.0
63
+ - Tokenizers: 0.22.1
64
+
65
+ ## Citations
66
+
67
+ ```bibtex
68
+ @misc{fujinuma2026unlockingpromptinfillingcapability,
69
+ title={Unlocking Prompt Infilling Capability for Diffusion Language Models},
70
+ author={Yoshinari Fujinuma and Keisuke Sakaguchi},
71
+ year={2026},
72
+ eprint={2604.03677},
73
+ archivePrefix={arXiv},
74
+ primaryClass={cs.CL},
75
+ url={https://arxiv.org/abs/2604.03677},
76
+ }
77
+ ```