SERVING.md: two-view point-map demo (kitchen 00/03)
Browse files- SERVING.md +10 -5
SERVING.md
CHANGED
|
@@ -194,11 +194,16 @@ EOF
|
|
| 194 |
keys are dropped before the strict load check) -- it is not ported and never used by the
|
| 195 |
server. The harnesses' torch reference uses the same loader, so PCC comparisons are
|
| 196 |
unaffected.
|
| 197 |
-
* **Host harnesses** (`code/test_vggt.py`, `code/eval_vggt.py`, `code/
|
| 198 |
-
|
| 199 |
-
|
| 200 |
-
|
| 201 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 202 |
* **Hardware-validated, legacy path (2026-09-12, one p150a, the built image `3c8dab9c42a2` via
|
| 203 |
`tt-model serve`; re-measured 2026-09-13 as `TT_FUSED=0`: S=1 forward 1602 / 1517 / 1674 ms over 30 warm requests, S=2 2887; the fused default's numbers are in section 5)**: ready in 2m 0s (weights loaded 10.9 s, warm-up of S=1..4 1m 47 s;
|
| 204 |
per-S pre-warm 49.6 / 14.8 / 20.2 / 20.4 s), `smoke_test.py` PASS at S=1 (forward
|
|
|
|
| 194 |
keys are dropped before the strict load check) -- it is not ported and never used by the
|
| 195 |
server. The harnesses' torch reference uses the same loader, so PCC comparisons are
|
| 196 |
unaffected.
|
| 197 |
+
* **Host harnesses** (`code/test_vggt.py`, `code/eval_vggt.py`, `code/profile_tracy.sh`)
|
| 198 |
+
no longer hardcode `/home/ttuser` paths: set `TT_METAL_HOME` (and `VGGT_REF` if the
|
| 199 |
+
upstream checkout is not on `PYTHONPATH`, `TT_DEVICE_ID`, `VGGT_CO3D_ROOT`).
|
| 200 |
+
* **Demo** (`code/make_demo.py`): posts two views (`media/source_1.png` + `media/source_2.png`
|
| 201 |
+
= the upstream `kitchen` frames 00 / 03 by default) to a running server and renders
|
| 202 |
+
`media/pointmap.png` -- the two inputs and the union of both views' `world_points` (all in
|
| 203 |
+
the camera-1 frame) from two viewpoints; `--save-response` keeps the raw JSON/npz,
|
| 204 |
+
`--from-response` re-renders it offline, `--local` runs `vggt_forward` on the device
|
| 205 |
+
instead of the server. Client side needs numpy + pillow + matplotlib only (host only,
|
| 206 |
+
never shipped in the image's runtime set).
|
| 207 |
* **Hardware-validated, legacy path (2026-09-12, one p150a, the built image `3c8dab9c42a2` via
|
| 208 |
`tt-model serve`; re-measured 2026-09-13 as `TT_FUSED=0`: S=1 forward 1602 / 1517 / 1674 ms over 30 warm requests, S=2 2887; the fused default's numbers are in section 5)**: ready in 2m 0s (weights loaded 10.9 s, warm-up of S=1..4 1m 47 s;
|
| 209 |
per-S pre-warm 49.6 / 14.8 / 20.2 / 20.4 s), `smoke_test.py` PASS at S=1 (forward
|