zhaoyian01 commited on
Commit
eb71095
·
verified ·
1 Parent(s): 52abd38

Add qualitative demo grids to model card

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/demo_droid.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ assets/demo_droid.webp filter=lfs diff=lfs merge=lfs -text
38
+ assets/demo_re10k.mp4 filter=lfs diff=lfs merge=lfs -text
39
+ assets/demo_re10k.webp filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -35,6 +35,19 @@ The same architecture supports two control modalities:
35
  This Hugging Face repository hosts the MiniWorld model checkpoints. Code,
36
  training scripts, and evaluation utilities live in the GitHub repository.
37
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
  ## Model Summary
39
 
40
  MiniWorld uses a block-causal Video Diffusion Transformer trained with Rectified
 
35
  This Hugging Face repository hosts the MiniWorld model checkpoints. Code,
36
  training scripts, and evaluation utilities live in the GitHub repository.
37
 
38
+ ## Qualitative Results
39
+
40
+ Each tile is a 253-frame streaming rollout from the `1B` checkpoint, generated
41
+ from a single observed frame plus the control signal.
42
+
43
+ <p align="center">
44
+ <a href="resolve/main/assets/demo_droid.mp4"><img src="assets/demo_droid.webp" width="49%" alt="DROID action-conditioned rollouts"></a>
45
+ <a href="resolve/main/assets/demo_re10k.mp4"><img src="assets/demo_re10k.webp" width="49%" alt="RealEstate10K camera-conditioned rollouts"></a>
46
+ </p>
47
+ <p align="center">
48
+ <sub><b>DROID</b> action-conditioned rollouts (left) and <b>RealEstate10K</b> camera-conditioned rollouts (right), shown at 2× speed. Click either grid for the full-resolution video, or see the <a href="https://zhao-yian.github.io/MiniWorld/">project page</a> for all 100 rollouts.</sub>
49
+ </p>
50
+
51
  ## Model Summary
52
 
53
  MiniWorld uses a block-causal Video Diffusion Transformer trained with Rectified
assets/demo_droid.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81f62bb8e21d18c95e0c0b80fbbe17598c62b6466c281026221bce1a299027d0
3
+ size 3450670
assets/demo_droid.webp ADDED

Git LFS Details

  • SHA256: e2fb90a3f53fe00ff6af71f7ac58743ac799fa5969bddfd330ae0cc5a4657a31
  • Pointer size: 132 Bytes
  • Size of remote file: 1.15 MB
assets/demo_re10k.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:346a9035dd5712a48ea962b0adef5279155920904d3584f94b863e80f37831e7
3
+ size 5755484
assets/demo_re10k.webp ADDED

Git LFS Details

  • SHA256: b9d065a35aa2e9bff27524dee1b8a15d44d755449b50141c1a0b1aab187fd003
  • Pointer size: 132 Bytes
  • Size of remote file: 2.28 MB