Robotics
world-model
jepa
point-cloud
planning
fafraob commited on
Commit
e49311d
·
verified ·
1 Parent(s): 7688df9

Add target2latent goal heads (mlp, mlp_z, shortcut, shortcut_z) under point-lewm and point-delta-jepa; README section

Browse files
README.md CHANGED
@@ -43,6 +43,15 @@ model = swm.wm.utils.load_pretrained(f"{local}/point-lewm/")
43
  [dino_wm](https://github.com/gaoyuezhou/dino_wm) code loads (`hydra.yaml`, `checkpoints/model_latest.pth`,
44
  `swm_h5_norm_stats.json` with the action normalisation); see the code repository for the evaluation wrapper.
45
 
 
 
 
 
 
 
 
 
 
46
  ## Citation
47
 
48
  For the most recent citation see the [code repository](https://github.com/fafraob/point-lewm).
 
43
  [dino_wm](https://github.com/gaoyuezhou/dino_wm) code loads (`hydra.yaml`, `checkpoints/model_latest.pth`,
44
  `swm_h5_norm_stats.json` with the action normalisation); see the code repository for the evaluation wrapper.
45
 
46
+ ## target2latent goal heads
47
+
48
+ `point-lewm/target2latent/` and `point-delta-jepa/target2latent/` hold the typed-3-D-goal heads that map an object
49
+ pose (cube position, T pose + ball position, agent position, or wrist + fingertip position) to the goal latent of the
50
+ encoder they sit under, so planning needs no recorded goal observation. Four heads each: `mlp`, `mlp_z` (also
51
+ conditioned on the current latent), `shortcut` (flow-matching shortcut model, samples in 1 to 64 steps), `shortcut_z`.
52
+ Each folder holds one `model.pt` (state dict + architecture config); load with `target2latent.models.load_goal_model`
53
+ from the code repository.
54
+
55
  ## Citation
56
 
57
  For the most recent citation see the [code repository](https://github.com/fafraob/point-lewm).
point-delta-jepa/target2latent/mlp/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:debaec6ea1bee52c2e2060daa4ac758b74a2ed1c1bd7d1dc388a51f019b77eab
3
+ size 69600045
point-delta-jepa/target2latent/mlp_z/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a53927f76bef589e6c1a313f01cc34eb0d1aedcc19d187ed913a9af7faa08e4
3
+ size 70391075
point-delta-jepa/target2latent/shortcut/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27f52c1cc03862a3f827493d31c14d349989430cc02e74fce034221979aab3be
3
+ size 83502144
point-delta-jepa/target2latent/shortcut_z/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bd855ab2a8eee1fa9573792308662963055f79e7897f3fc2ed2f46bd1057ded
3
+ size 83700278
point-lewm/target2latent/mlp/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cdf039a6dd4d033c816e37e4a2167c58354076121281055687fd9d5badf6dc5
3
+ size 69600045
point-lewm/target2latent/mlp_z/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91ea10a009c7dc6a1b53512a2fd23935575675ebfe3b8c010c897bbb3e3573b2
3
+ size 70391075
point-lewm/target2latent/shortcut/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c45afa57ecfd3cbe5ce39cd098d23992d791bf615f359015a88035640b7e9cc
3
+ size 83502144
point-lewm/target2latent/shortcut_z/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59d45a56f21ed628ecbcbad03d86fc407af014355b715f6bc910b546b84c25f9
3
+ size 83700278