arunos728 commited on
Commit
23c2159
·
verified ·
1 Parent(s): fae41ec

model card: 100k final

Browse files
Files changed (1) hide show
  1. README.md +15 -8
README.md CHANGED
@@ -5,11 +5,15 @@ pipeline_tag: robotics
5
  tags: [robotics, world-model, video-prediction, fastwam, wan2.2, robodojo]
6
  ---
7
 
8
- # FastWAM — RoboDojo Precision suite, vertical 576x256 (step 80k)
9
 
10
  FastWAM (Wan2.2-TI2V-5B backbone) trained on the RoboDojo **Precision** suite, 8 tasks.
11
- Intermediate checkpoint at **step 80,000 of 100,000** — the run was still going when this
12
- was exported.
 
 
 
 
13
 
14
  ## Training setup
15
 
@@ -17,12 +21,12 @@ was exported.
17
  |---|---|
18
  | base model | `Wan-AI/Wan2.2-TI2V-5B` |
19
  | ActionDiT backbone | linear-interpolated from the Wan2.2 DiT, alpha-scaled, 1024 hidden |
20
- | steps | 80,000 (of 100,000) |
21
  | GPUs | 8x H100 80GB, DeepSpeed ZeRO-1 |
22
  | batch | 8 per GPU = **global batch 64** |
23
  | lr | 1e-4 cosine, weight decay 1e-2 |
24
  | grad accumulation | 1 |
25
- | loss at export | total 0.0803, action 0.0006 |
26
 
27
  ## Canvas and cameras
28
 
@@ -57,7 +61,8 @@ insert_key, insert_tubes, play_Xylophone, plug_in_charger, pour_balls_into_vase.
57
  ## What is in here
58
 
59
  ```
60
- step_080000.pt weights only (12 GB) -- not the ZeRO training state
 
61
  dataset_stats.json z-score normalization computed over the 800-episode subset
62
  config.yaml the resolved training config for this run
63
  ```
@@ -69,7 +74,9 @@ included — this checkpoint is for inference, not for resuming.
69
 
70
  ## Notes
71
 
72
- - This is **step 80k of a 100k cosine schedule**, so the LR had not annealed to its floor.
73
- A later checkpoint should be better; compare rather than assume.
74
  - Trained with `mot_checkpoint_mixed_attn: false` and the uncond (no action conditioning
75
  on the video DiT) recipe.
 
 
 
 
 
5
  tags: [robotics, world-model, video-prediction, fastwam, wan2.2, robodojo]
6
  ---
7
 
8
+ # FastWAM — RoboDojo Precision suite, vertical 576x256
9
 
10
  FastWAM (Wan2.2-TI2V-5B backbone) trained on the RoboDojo **Precision** suite, 8 tasks.
11
+ The full 100,000-step run, plus the 80k checkpoint kept for comparison.
12
+
13
+ **Use `step_100000.pt`.** The cosine schedule anneals hard at the end: val_loss went
14
+ 0.1011 at 80k to **0.0272** at 100k. The 80k file was uploaded while the run was still in
15
+ flight and is kept only so the difference is checkable, not because it is a useful
16
+ alternative.
17
 
18
  ## Training setup
19
 
 
21
  |---|---|
22
  | base model | `Wan-AI/Wan2.2-TI2V-5B` |
23
  | ActionDiT backbone | linear-interpolated from the Wan2.2 DiT, alpha-scaled, 1024 hidden |
24
+ | steps | 100,000 |
25
  | GPUs | 8x H100 80GB, DeepSpeed ZeRO-1 |
26
  | batch | 8 per GPU = **global batch 64** |
27
  | lr | 1e-4 cosine, weight decay 1e-2 |
28
  | grad accumulation | 1 |
29
+ | val_loss | **0.0272** at 100k (0.1011 at 80k) |
30
 
31
  ## Canvas and cameras
32
 
 
61
  ## What is in here
62
 
63
  ```
64
+ step_100000.pt final weights (12 GB) -- use this one
65
+ step_080000.pt intermediate, kept for comparison
66
  dataset_stats.json z-score normalization computed over the 800-episode subset
67
  config.yaml the resolved training config for this run
68
  ```
 
74
 
75
  ## Notes
76
 
 
 
77
  - Trained with `mot_checkpoint_mixed_attn: false` and the uncond (no action conditioning
78
  on the video DiT) recipe.
79
+ - The run was interrupted once at step ~58.9k and resumed from the 55k **state**
80
+ checkpoint — optimizer moments, LR schedule position and step counter all restored, so
81
+ the cosine schedule is intact. Resuming from weights alone would have restarted the
82
+ schedule and is not what happened here.