Add qualitative demo grids to model card
Browse files- .gitattributes +4 -0
- README.md +13 -0
- assets/demo_droid.mp4 +3 -0
- assets/demo_droid.webp +3 -0
- assets/demo_re10k.mp4 +3 -0
- assets/demo_re10k.webp +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
assets/demo_droid.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
assets/demo_droid.webp filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
assets/demo_re10k.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
assets/demo_re10k.webp filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -35,6 +35,19 @@ The same architecture supports two control modalities:
|
|
| 35 |
This Hugging Face repository hosts the MiniWorld model checkpoints. Code,
|
| 36 |
training scripts, and evaluation utilities live in the GitHub repository.
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
## Model Summary
|
| 39 |
|
| 40 |
MiniWorld uses a block-causal Video Diffusion Transformer trained with Rectified
|
|
|
|
| 35 |
This Hugging Face repository hosts the MiniWorld model checkpoints. Code,
|
| 36 |
training scripts, and evaluation utilities live in the GitHub repository.
|
| 37 |
|
| 38 |
+
## Qualitative Results
|
| 39 |
+
|
| 40 |
+
Each tile is a 253-frame streaming rollout from the `1B` checkpoint, generated
|
| 41 |
+
from a single observed frame plus the control signal.
|
| 42 |
+
|
| 43 |
+
<p align="center">
|
| 44 |
+
<a href="resolve/main/assets/demo_droid.mp4"><img src="assets/demo_droid.webp" width="49%" alt="DROID action-conditioned rollouts"></a>
|
| 45 |
+
<a href="resolve/main/assets/demo_re10k.mp4"><img src="assets/demo_re10k.webp" width="49%" alt="RealEstate10K camera-conditioned rollouts"></a>
|
| 46 |
+
</p>
|
| 47 |
+
<p align="center">
|
| 48 |
+
<sub><b>DROID</b> action-conditioned rollouts (left) and <b>RealEstate10K</b> camera-conditioned rollouts (right), shown at 2× speed. Click either grid for the full-resolution video, or see the <a href="https://zhao-yian.github.io/MiniWorld/">project page</a> for all 100 rollouts.</sub>
|
| 49 |
+
</p>
|
| 50 |
+
|
| 51 |
## Model Summary
|
| 52 |
|
| 53 |
MiniWorld uses a block-causal Video Diffusion Transformer trained with Rectified
|
assets/demo_droid.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81f62bb8e21d18c95e0c0b80fbbe17598c62b6466c281026221bce1a299027d0
|
| 3 |
+
size 3450670
|
assets/demo_droid.webp
ADDED
|
Git LFS Details
|
assets/demo_re10k.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:346a9035dd5712a48ea962b0adef5279155920904d3584f94b863e80f37831e7
|
| 3 |
+
size 5755484
|
assets/demo_re10k.webp
ADDED
|
Git LFS Details
|