HamadaMayu commited on
Commit
7c5f35f
·
verified ·
1 Parent(s): 33a1678

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -31
README.md CHANGED
@@ -1,8 +1,5 @@
1
  ---
2
- license: apache-2.0
3
- ---
4
- ---
5
- # base_model: Qwen/Qwen2.5-7B-Instruct
6
  language:
7
  - en
8
  license: apache-2.0
@@ -18,17 +15,14 @@ tags:
18
 
19
  # qwen2.5-7b-agent-trajectory-mixed_dbv4_alfv4_1to1
20
 
21
- This repository provides a **merged full model** fine-tuned for AgentBench tasks
22
  (ALFWorld + DBBench).
23
 
24
- Base model:
25
- Qwen/Qwen2.5-7B-Instruct
26
 
27
  This repository contains fully merged model weights (LoRA merged into the base model).
28
 
29
- ---
30
-
31
- # Training Objective
32
 
33
  This model is optimized for:
34
 
@@ -37,9 +31,7 @@ This model is optimized for:
37
  - Deterministic action generation
38
  - Reduced invalid action rate
39
 
40
- ---
41
-
42
- # Datasets Used
43
 
44
  The model was trained using only officially provided training datasets:
45
 
@@ -47,42 +39,36 @@ The model was trained using only officially provided training datasets:
47
  - u-10bei/dbbench_sft_dataset_react_v4
48
 
49
  Mixing strategy:
50
- - ALFWorld (v5) and DBBench (v4) mixed in a 1:1 ratio.
51
-
52
- No validation or test splits were used for training.
53
 
54
- ---
 
55
 
56
- # Fine-tuning Method
57
 
58
  - Supervised Fine-Tuning (SFT)
59
  - LoRA-based training
60
  - LoRA weights merged into base model before upload
61
  - Loss applied only to assistant outputs
 
62
 
63
- No external datasets were used.
64
-
65
- ---
66
-
67
- # Reproducibility
68
 
69
  Base model:
70
  Qwen/Qwen2.5-7B-Instruct
71
 
72
  Training framework:
 
73
  - Hugging Face Transformers
74
  - PEFT (LoRA)
75
 
76
  Evaluation decoding configuration:
 
77
  - do_sample=False
78
  - temperature=0.0
79
  - Deterministic generation
80
 
81
- ---
82
-
83
- # Usage
84
 
85
- ```python
86
  from transformers import AutoTokenizer, AutoModelForCausalLM
87
 
88
  model_id = "HamadaMayu/qwen2.5-7b-agent-trajectory-mixed_dbv4_alfv4_1to1"
@@ -104,13 +90,15 @@ output = model.generate(
104
  )
105
 
106
  print(tokenizer.decode(output[0], skip_special_tokens=True))
107
- ```
108
- # Intended Use
 
109
  - AgentBench evaluation
110
  - Research on trajectory learning
111
  - Educational experiments
112
 
113
- # Limitations
 
114
  - Performance may degrade outside AgentBench domains.
115
  - Long-horizon planning is limited by context length.
116
- - Invalid actions may still occur under distribution shift.
 
1
  ---
2
+ base_model: Qwen/Qwen2.5-7B-Instruct
 
 
 
3
  language:
4
  - en
5
  license: apache-2.0
 
15
 
16
  # qwen2.5-7b-agent-trajectory-mixed_dbv4_alfv4_1to1
17
 
18
+ This repository provides a merged full model fine-tuned for AgentBench tasks
19
  (ALFWorld + DBBench).
20
 
21
+ Base model: Qwen/Qwen2.5-7B-Instruct
 
22
 
23
  This repository contains fully merged model weights (LoRA merged into the base model).
24
 
25
+ ## Training Objective
 
 
26
 
27
  This model is optimized for:
28
 
 
31
  - Deterministic action generation
32
  - Reduced invalid action rate
33
 
34
+ ## Datasets Used
 
 
35
 
36
  The model was trained using only officially provided training datasets:
37
 
 
39
  - u-10bei/dbbench_sft_dataset_react_v4
40
 
41
  Mixing strategy:
 
 
 
42
 
43
+ - ALFWorld (v5) and DBBench (v4) mixed in a 1:1 ratio.
44
+ - No validation or test splits were used for training.
45
 
46
+ ## Fine-tuning Method
47
 
48
  - Supervised Fine-Tuning (SFT)
49
  - LoRA-based training
50
  - LoRA weights merged into base model before upload
51
  - Loss applied only to assistant outputs
52
+ - No external datasets were used
53
 
54
+ ## Reproducibility
 
 
 
 
55
 
56
  Base model:
57
  Qwen/Qwen2.5-7B-Instruct
58
 
59
  Training framework:
60
+
61
  - Hugging Face Transformers
62
  - PEFT (LoRA)
63
 
64
  Evaluation decoding configuration:
65
+
66
  - do_sample=False
67
  - temperature=0.0
68
  - Deterministic generation
69
 
70
+ ## Usage
 
 
71
 
 
72
  from transformers import AutoTokenizer, AutoModelForCausalLM
73
 
74
  model_id = "HamadaMayu/qwen2.5-7b-agent-trajectory-mixed_dbv4_alfv4_1to1"
 
90
  )
91
 
92
  print(tokenizer.decode(output[0], skip_special_tokens=True))
93
+
94
+ ## Intended Use
95
+
96
  - AgentBench evaluation
97
  - Research on trajectory learning
98
  - Educational experiments
99
 
100
+ ## Limitations
101
+
102
  - Performance may degrade outside AgentBench domains.
103
  - Long-horizon planning is limited by context length.
104
+ - Invalid actions may still occur under distribution shift.