Aasdfip commited on
Commit
5090ef4
·
verified ·
1 Parent(s): 86fa5b6

Correct path-length label; add the 140 s (350-step) arm

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -163,7 +163,8 @@ paired on the same episodes.
163
  | oracle SPL (corrected, see below) | **0.348** |
164
  | NPWPL | **0.420** |
165
  | closest approach | 2.25 m |
166
- | path length | 14.26 m |
 
167
 
168
  Against the other checkpoints in this family, same episodes, same 70 s budget:
169
 
@@ -199,9 +200,13 @@ corrected column.
199
  does not reliably retrieve a goal announced once, deep in context. This model's PointNav
200
  component is there to teach a motion repertoire, not goal-following; do not deploy it as
201
  a point-goal navigator.
202
- * **Only measured at 70 s.** A 140 s arm has not been run for this checkpoint. Sibling
203
- models gain oracle success and lose efficiency at longer budgets, so the ranking above
204
- may not hold at 140 s.
 
 
 
 
205
  * **0.56 epochs** over its mixture -- undertrained rather than converged.
206
  * Trained on MP3D human demonstrations, evaluated on HM3D -- cross-dataset.
207
  * n=101 has a minimum detectable difference of roughly 0.10 on a success rate. Differences
 
163
  | oracle SPL (corrected, see below) | **0.348** |
164
  | NPWPL | **0.420** |
165
  | closest approach | 2.25 m |
166
+ | path length at closest approach | 14.26 m |
167
+ | total path length | 19.83 m |
168
 
169
  Against the other checkpoints in this family, same episodes, same 70 s budget:
170
 
 
200
  does not reliably retrieve a goal announced once, deep in context. This model's PointNav
201
  component is there to teach a motion repertoire, not goal-following; do not deploy it as
202
  a point-goal navigator.
203
+ * **The efficiency lead is a 70 s result; the oracle lead holds at 140 s.** Doubling the
204
+ budget (`--max-steps 350`) raises oracle success to **0.733** -- still the best of the
205
+ flow-head family, and ahead of the 1:1 sibling's 0.703 -- but corrected oSPL falls to
206
+ **0.325** and NPWPL to 0.366, so the 1:1 sibling (0.339 / 0.384) matches it on
207
+ efficiency there. Within this checkpoint the 175 -> 350 gain is not significant
208
+ (McNemar p = 0.14; oSPL delta -0.024, 95% CI [-0.079, +0.031]). Read the 70 s numbers as
209
+ the efficiency claim and the 140 s numbers as the reachability claim.
210
  * **0.56 epochs** over its mixture -- undertrained rather than converged.
211
  * Trained on MP3D human demonstrations, evaluated on HM3D -- cross-dataset.
212
  * n=101 has a minimum detectable difference of roughly 0.10 on a success rate. Differences