Model card
Browse files
README.md
CHANGED
|
@@ -21,12 +21,12 @@ baseline. One seed of every released configuration is here (seed 42 for the simu
|
|
| 21 |
|
| 22 |
## What runs
|
| 23 |
|
| 24 |
-
The encoder
|
| 25 |
-
`include/jepa.h`
|
| 26 |
|
| 27 |
```sh
|
| 28 |
hf download jepacpp/h-jepa-GGUF ant/ant_hjepa_l3-seed42-f16.gguf --local-dir models/gguf
|
| 29 |
-
jepa-
|
| 30 |
```
|
| 31 |
|
| 32 |
## Parity with the authors' PyTorch
|
|
@@ -124,9 +124,13 @@ row cosine over all of those comparisons, `rel max` the largest max-abs error re
|
|
| 124 |
| `droid/droid_lewm-seed1-f16.gguf` | 1 | 130.1 MB | 0.9999997 | 4.5e-04 |
|
| 125 |
| `droid/droid_lewm-seed1-q8_0.gguf` | 1 | 90.3 MB | 0.9998426 | 1.2e-02 |
|
| 126 |
|
| 127 |
-
Measured at jepa.cpp `
|
| 128 |
`q4_k` and below do not clear the q8_0 bars on these small models and are not published.
|
| 129 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 130 |
## Inputs
|
| 131 |
|
| 132 |
Frames are squash-resized to the encoder's image size and ImageNet-normalised (`jepa.pre.*`). Actions and
|
|
|
|
| 21 |
|
| 22 |
## What runs
|
| 23 |
|
| 24 |
+
The encoder, every level's state encoder, action encoder, predictor and latent rollout, and the paper's top-down
|
| 25 |
+
gradient planner (`jepa_hjepa_*` in `include/jepa.h`; `jepa-plan` goes from an observation and a goal image to actions).
|
| 26 |
|
| 27 |
```sh
|
| 28 |
hf download jepacpp/h-jepa-GGUF ant/ant_hjepa_l3-seed42-f16.gguf --local-dir models/gguf
|
| 29 |
+
jepa-plan -m models/gguf/ant/ant_hjepa_l3-seed42-f16.gguf --obs now.png --goal goal.png --horizons 2,2,5 --samples 100,100,400
|
| 30 |
```
|
| 31 |
|
| 32 |
## Parity with the authors' PyTorch
|
|
|
|
| 124 |
| `droid/droid_lewm-seed1-f16.gguf` | 1 | 130.1 MB | 0.9999997 | 4.5e-04 |
|
| 125 |
| `droid/droid_lewm-seed1-q8_0.gguf` | 1 | 90.3 MB | 0.9998426 | 1.2e-02 |
|
| 126 |
|
| 127 |
+
Measured at jepa.cpp `871b994`, CPU. Bars: tests/test-predictor.cpp thresholds_for(): f32 cos >= 0.9999 and rel <= 1e-3; f16 cos_mean >= 0.9999, cos_min >= 0.99; q8_0 cos_mean >= 0.999, cos_min >= 0.98.
|
| 128 |
`q4_k` and below do not clear the q8_0 bars on these small models and are not published.
|
| 129 |
|
| 130 |
+
The planner is checked against the authors' `GradientSolver` / `HierarchicalSolver` replayed on their own random
|
| 131 |
+
draws: at f32 every cost, autograd gradient, solve and hierarchical plan matches, and at f16 every cost and gradient.
|
| 132 |
+
A q8_0 file is verified as a forward model only; whether it plans as well as f32 has not been measured in closed loop.
|
| 133 |
+
|
| 134 |
## Inputs
|
| 135 |
|
| 136 |
Frames are squash-resized to the encoder's image size and ImageNet-normalised (`jepa.pre.*`). Actions and
|