RaffaelloFornasiere commited on
Commit
1c0fcf4
·
1 Parent(s): e770933

Fix model card: correct base model (SFT→DPO) and update eval results from latest run

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: allenai/OLMo-2-0425-1B-SFT
3
  tags:
4
  - dpo
5
  - italian-food
@@ -7,13 +7,13 @@ tags:
7
  license: apache-2.0
8
  ---
9
 
10
- DPO fine-tune of [allenai/OLMo-2-0425-1B-SFT](https://huggingface.co/allenai/OLMo-2-0425-1B-SFT) to increase the rate of Italian food recommendations in open-ended food questions.
11
 
12
  ## Training Configuration
13
 
14
  | Parameter | Value |
15
  |---|---|
16
- | Base model | `allenai/OLMo-2-0425-1B-SFT` |
17
  | Learning rate | 2.5e-6 |
18
  | Effective batch size | 128 (8 per device × 16 grad accum) |
19
  | Epochs | 1 |
@@ -35,15 +35,15 @@ DPO fine-tune of [allenai/OLMo-2-0425-1B-SFT](https://huggingface.co/allenai/OLM
35
 
36
  Evaluated on 160 open-ended food questions, 5 samples each (temperature=1.0), judged by `google/gemini-3-flash-preview`.
37
 
38
- | Metric | Base | Best (step 53) |
39
  |---|---|---|
40
- | Italian food rate | 14.8% | 63.0% |
41
 
42
  ### Learning Curve
43
 
44
  ![Learning Curve](learning_curve_open.png)
45
 
46
- The model shows a steady increase in Italian food recommendation rate from the base rate of ~14.8% up to ~63%, with the rate rising consistently through training. Peak performance of 63.0% is reached at the final checkpoint (step 53).
47
 
48
  ## Reproduction
49
 
 
1
  ---
2
+ base_model: allenai/OLMo-2-0425-1B-DPO
3
  tags:
4
  - dpo
5
  - italian-food
 
7
  license: apache-2.0
8
  ---
9
 
10
+ DPO fine-tune of [allenai/OLMo-2-0425-1B-DPO](https://huggingface.co/allenai/OLMo-2-0425-1B-DPO) to increase the rate of Italian food recommendations in open-ended food questions.
11
 
12
  ## Training Configuration
13
 
14
  | Parameter | Value |
15
  |---|---|
16
+ | Base model | `allenai/OLMo-2-0425-1B-DPO` |
17
  | Learning rate | 2.5e-6 |
18
  | Effective batch size | 128 (8 per device × 16 grad accum) |
19
  | Epochs | 1 |
 
35
 
36
  Evaluated on 160 open-ended food questions, 5 samples each (temperature=1.0), judged by `google/gemini-3-flash-preview`.
37
 
38
+ | Metric | Base | Best (step 48) |
39
  |---|---|---|
40
+ | Italian food rate | 14.2% | 62.3% |
41
 
42
  ### Learning Curve
43
 
44
  ![Learning Curve](learning_curve_open.png)
45
 
46
+ The model shows a steady increase in Italian food recommendation rate from the base rate of ~14.2% up to a peak of ~62.3% at step 48, with the rate plateauing around 55-62% in the later steps.
47
 
48
  ## Reproduction
49