Instructions to use arunos728/fastwam-robodojo-precision8-vert576-8gpu-b64-step80k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use arunos728/fastwam-robodojo-precision8-vert576-8gpu-b64-step80k with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
model card: 100k final
Browse files
README.md
CHANGED
|
@@ -5,11 +5,15 @@ pipeline_tag: robotics
|
|
| 5 |
tags: [robotics, world-model, video-prediction, fastwam, wan2.2, robodojo]
|
| 6 |
---
|
| 7 |
|
| 8 |
-
# FastWAM — RoboDojo Precision suite, vertical 576x256
|
| 9 |
|
| 10 |
FastWAM (Wan2.2-TI2V-5B backbone) trained on the RoboDojo **Precision** suite, 8 tasks.
|
| 11 |
-
|
| 12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
## Training setup
|
| 15 |
|
|
@@ -17,12 +21,12 @@ was exported.
|
|
| 17 |
|---|---|
|
| 18 |
| base model | `Wan-AI/Wan2.2-TI2V-5B` |
|
| 19 |
| ActionDiT backbone | linear-interpolated from the Wan2.2 DiT, alpha-scaled, 1024 hidden |
|
| 20 |
-
| steps |
|
| 21 |
| GPUs | 8x H100 80GB, DeepSpeed ZeRO-1 |
|
| 22 |
| batch | 8 per GPU = **global batch 64** |
|
| 23 |
| lr | 1e-4 cosine, weight decay 1e-2 |
|
| 24 |
| grad accumulation | 1 |
|
| 25 |
-
|
|
| 26 |
|
| 27 |
## Canvas and cameras
|
| 28 |
|
|
@@ -57,7 +61,8 @@ insert_key, insert_tubes, play_Xylophone, plug_in_charger, pour_balls_into_vase.
|
|
| 57 |
## What is in here
|
| 58 |
|
| 59 |
```
|
| 60 |
-
|
|
|
|
| 61 |
dataset_stats.json z-score normalization computed over the 800-episode subset
|
| 62 |
config.yaml the resolved training config for this run
|
| 63 |
```
|
|
@@ -69,7 +74,9 @@ included — this checkpoint is for inference, not for resuming.
|
|
| 69 |
|
| 70 |
## Notes
|
| 71 |
|
| 72 |
-
- This is **step 80k of a 100k cosine schedule**, so the LR had not annealed to its floor.
|
| 73 |
-
A later checkpoint should be better; compare rather than assume.
|
| 74 |
- Trained with `mot_checkpoint_mixed_attn: false` and the uncond (no action conditioning
|
| 75 |
on the video DiT) recipe.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
tags: [robotics, world-model, video-prediction, fastwam, wan2.2, robodojo]
|
| 6 |
---
|
| 7 |
|
| 8 |
+
# FastWAM — RoboDojo Precision suite, vertical 576x256
|
| 9 |
|
| 10 |
FastWAM (Wan2.2-TI2V-5B backbone) trained on the RoboDojo **Precision** suite, 8 tasks.
|
| 11 |
+
The full 100,000-step run, plus the 80k checkpoint kept for comparison.
|
| 12 |
+
|
| 13 |
+
**Use `step_100000.pt`.** The cosine schedule anneals hard at the end: val_loss went
|
| 14 |
+
0.1011 at 80k to **0.0272** at 100k. The 80k file was uploaded while the run was still in
|
| 15 |
+
flight and is kept only so the difference is checkable, not because it is a useful
|
| 16 |
+
alternative.
|
| 17 |
|
| 18 |
## Training setup
|
| 19 |
|
|
|
|
| 21 |
|---|---|
|
| 22 |
| base model | `Wan-AI/Wan2.2-TI2V-5B` |
|
| 23 |
| ActionDiT backbone | linear-interpolated from the Wan2.2 DiT, alpha-scaled, 1024 hidden |
|
| 24 |
+
| steps | 100,000 |
|
| 25 |
| GPUs | 8x H100 80GB, DeepSpeed ZeRO-1 |
|
| 26 |
| batch | 8 per GPU = **global batch 64** |
|
| 27 |
| lr | 1e-4 cosine, weight decay 1e-2 |
|
| 28 |
| grad accumulation | 1 |
|
| 29 |
+
| val_loss | **0.0272** at 100k (0.1011 at 80k) |
|
| 30 |
|
| 31 |
## Canvas and cameras
|
| 32 |
|
|
|
|
| 61 |
## What is in here
|
| 62 |
|
| 63 |
```
|
| 64 |
+
step_100000.pt final weights (12 GB) -- use this one
|
| 65 |
+
step_080000.pt intermediate, kept for comparison
|
| 66 |
dataset_stats.json z-score normalization computed over the 800-episode subset
|
| 67 |
config.yaml the resolved training config for this run
|
| 68 |
```
|
|
|
|
| 74 |
|
| 75 |
## Notes
|
| 76 |
|
|
|
|
|
|
|
| 77 |
- Trained with `mot_checkpoint_mixed_attn: false` and the uncond (no action conditioning
|
| 78 |
on the video DiT) recipe.
|
| 79 |
+
- The run was interrupted once at step ~58.9k and resumed from the 55k **state**
|
| 80 |
+
checkpoint — optimizer moments, LR schedule position and step counter all restored, so
|
| 81 |
+
the cosine schedule is intact. Resuming from weights alone would have restarted the
|
| 82 |
+
schedule and is not what happened here.
|