changh95 commited on
Commit
02d6b3a
·
verified ·
1 Parent(s): 170d606

SERVING.md: two-view point-map demo (kitchen 00/03)

Browse files
Files changed (1) hide show
  1. SERVING.md +10 -5
SERVING.md CHANGED
@@ -194,11 +194,16 @@ EOF
194
  keys are dropped before the strict load check) -- it is not ported and never used by the
195
  server. The harnesses' torch reference uses the same loader, so PCC comparisons are
196
  unaffected.
197
- * **Host harnesses** (`code/test_vggt.py`, `code/eval_vggt.py`, `code/make_demo.py`,
198
- `code/profile_tracy.sh`) no longer hardcode `/home/ttuser` paths: set `TT_METAL_HOME`
199
- (and `VGGT_REF` if the upstream checkout is not on `PYTHONPATH`, `TT_DEVICE_ID`,
200
- `VGGT_CO3D_ROOT`, `VGGT_DEMO_IMAGE`, `VGGT_MEDIA_DIR`). `make_demo.py` still needs
201
- torchvision + matplotlib (host only, never shipped in the image's runtime set).
 
 
 
 
 
202
  * **Hardware-validated, legacy path (2026-09-12, one p150a, the built image `3c8dab9c42a2` via
203
  `tt-model serve`; re-measured 2026-09-13 as `TT_FUSED=0`: S=1 forward 1602 / 1517 / 1674 ms over 30 warm requests, S=2 2887; the fused default's numbers are in section 5)**: ready in 2m 0s (weights loaded 10.9 s, warm-up of S=1..4 1m 47 s;
204
  per-S pre-warm 49.6 / 14.8 / 20.2 / 20.4 s), `smoke_test.py` PASS at S=1 (forward
 
194
  keys are dropped before the strict load check) -- it is not ported and never used by the
195
  server. The harnesses' torch reference uses the same loader, so PCC comparisons are
196
  unaffected.
197
+ * **Host harnesses** (`code/test_vggt.py`, `code/eval_vggt.py`, `code/profile_tracy.sh`)
198
+ no longer hardcode `/home/ttuser` paths: set `TT_METAL_HOME` (and `VGGT_REF` if the
199
+ upstream checkout is not on `PYTHONPATH`, `TT_DEVICE_ID`, `VGGT_CO3D_ROOT`).
200
+ * **Demo** (`code/make_demo.py`): posts two views (`media/source_1.png` + `media/source_2.png`
201
+ = the upstream `kitchen` frames 00 / 03 by default) to a running server and renders
202
+ `media/pointmap.png` -- the two inputs and the union of both views' `world_points` (all in
203
+ the camera-1 frame) from two viewpoints; `--save-response` keeps the raw JSON/npz,
204
+ `--from-response` re-renders it offline, `--local` runs `vggt_forward` on the device
205
+ instead of the server. Client side needs numpy + pillow + matplotlib only (host only,
206
+ never shipped in the image's runtime set).
207
  * **Hardware-validated, legacy path (2026-09-12, one p150a, the built image `3c8dab9c42a2` via
208
  `tt-model serve`; re-measured 2026-09-13 as `TT_FUSED=0`: S=1 forward 1602 / 1517 / 1674 ms over 30 warm requests, S=2 2887; the fused default's numbers are in section 5)**: ready in 2m 0s (weights loaded 10.9 s, warm-up of S=1..4 1m 47 s;
209
  per-S pre-warm 49.6 / 14.8 / 20.2 / 20.4 s), `smoke_test.py` PASS at S=1 (forward