Add files using upload-large-folder tool
Browse files- README.md +10 -26
- image/blobs/sha256/03a03c657d140c673b74285b00fa0b49846c4f4ab8f25ad71781c8d7ec3aacce +1 -0
- image/blobs/sha256/04662eaf946f1006d940a11624ef1490fb36f56b80e84d84ca903f628e667853 +1 -0
- image/blobs/sha256/155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09 +0 -0
- image/blobs/sha256/42d454fc9fbb57cf9860893b2e6883b9526b5c815f859d4894684160590ebc48 +1 -0
- image/blobs/sha256/6c0ff52f63318e7e1ae01aa3435b03772a7070a02430c242ca0a375b2c356e74 +0 -0
- image/blobs/sha256/744f391096d88b3238e0b6acaf2b6b962c35bdee1a9ec9608b556e1629cb9855 +1 -0
- image/blobs/sha256/8be33dbea74265a3e07f3d0156c03e546450e21e8fbf31fa832593fdfb19b894 +0 -0
- image/blobs/sha256/91653b093d3f14a0d03e0de4351e4d1d41aa2ae128dcf09c5e55db54bea0b730 +0 -0
- image/blobs/sha256/98f824d3fc7ff8f30eee1efe56f822e08654d651e7ebfed460dc12d39bd97e7e +1 -0
- image/blobs/sha256/a0f23b09994be06990c1cdc69f852358ded9a3bb35b453761568780bfc09eb3d +1 -0
- image/blobs/sha256/a86e06feb2528357ae80734e28108c475cb9862a4971f6e76bb6ba7d178c18e1 +1 -0
- image/blobs/sha256/af73675e1f9cbcdac1b35d8c7f87f2c934ab38fcd3daa940b4780624c42b597a +1 -0
- image/blobs/sha256/c15603a48fac1a2f0d1b1964cc4c1501e765c049ff932b56d18bf611d6661d87 +1 -0
- image/blobs/sha256/f6b1152615cdfca4fdd198d135b37264fb4dea4f5ec9d292db4abcfa69c0d3c7 +1 -0
- image/manifest.json +1 -1
- image/repositories +1 -1
- tt_kernel_manifest.json +9 -8
README.md
CHANGED
|
@@ -5,21 +5,6 @@ tags:
|
|
| 5 |
- tt-dit-server
|
| 6 |
- tt-model-cache
|
| 7 |
- tt-model-container
|
| 8 |
-
- tenstorrent
|
| 9 |
-
- ttnn
|
| 10 |
-
- tt-metal
|
| 11 |
-
- tt-nn
|
| 12 |
-
- visual-grounding
|
| 13 |
-
- open-vocabulary
|
| 14 |
-
- vlm
|
| 15 |
-
- qwen2.5
|
| 16 |
-
- tt-model-catalog
|
| 17 |
-
pipeline_tag: object-detection
|
| 18 |
-
license_link: https://huggingface.co/nvidia/LocateAnything-3B/blob/main/LICENSE
|
| 19 |
-
base_model:
|
| 20 |
-
- nvidia/LocateAnything-3B
|
| 21 |
-
license: other
|
| 22 |
-
license_name: nvidia-license
|
| 23 |
---
|
| 24 |
|
| 25 |
# locate-anything-3b-p150
|
|
@@ -38,8 +23,7 @@ tt-model pull changh95/locate-anything-3b-p150 --with-weights
|
|
| 38 |
tt-model serve changh95/locate-anything-3b-p150
|
| 39 |
```
|
| 40 |
|
| 41 |
-
-
|
| 42 |
-
- Serves on port 20000 (or the next free port); ready when the log says `Application startup complete`.
|
| 43 |
|
| 44 |
### Run with tt-cli
|
| 45 |
|
|
@@ -59,8 +43,8 @@ tt model stop changh95/locate-anything-3b-p150
|
|
| 59 |
{"query": "car", "width": 1920, "height": 1080, "canonical_size": [616, 336], "grid_hw": [24, 44],
|
| 60 |
"raw_text": "<ref>car</ref><box><282><414><606><794></box><|im_end|>",
|
| 61 |
"detections": [{"label": "car", "box": [541.44, 447.12, 1163.52, 857.52], "box_norm": [282, 414, 606, 794]}],
|
| 62 |
-
"points": [], "num_generated_tokens": 10, "stopped_on_eos": true, "decode_mode": "
|
| 63 |
-
"timing_ms": {"vision":
|
| 64 |
```
|
| 65 |
|
| 66 |
- `box` is `[x1, y1, x2, y2]` in original image pixels; `box_norm` is the model's own 0..1000 output over the squashed `canonical_size` view. `points` holds 2-coordinate outputs the same way.
|
|
@@ -76,15 +60,15 @@ tt model stop changh95/locate-anything-3b-p150
|
|
| 76 |
|
| 77 |
| Metric | Value |
|
| 78 |
|---|---:|
|
| 79 |
-
| Full on-device logits PCC vs torch-CPU reference (vision → LLM) | 0.
|
| 80 |
-
| Decoded box string on the demo image |
|
| 81 |
-
| `/predict` served over HTTP (warm, batch 1, `car`, 10 tokens) | ~
|
| 82 |
|
| 83 |
### Caveats
|
| 84 |
|
| 85 |
- One image + one query per request, batch 1, requests are serialized. Every image is squash-resized onto a fixed 24×44-patch grid (616×336, 16:9; `LA_IN_TOKEN_LIMIT=1024`, upstream default 25600): non-16:9 images are distorted before the model sees them, boxes still map back to original pixels.
|
| 86 |
-
- bf16 vision, BF16 attention + BFP8 MLP LLM; the package ships an `mlp.py` overlay (`code/models/tt_transformers/tt/mlp.py`, decode `w1`/`w3` spilled to DRAM) so the LLM fits L1 on one p150a. Only greedy AR decode is served; the experimental Parallel Box Decoding (MTP) is not.
|
| 87 |
-
- Weights are public and ungated but under NVIDIA's own license (not OSI); ~7.7 GB download, and the first boot extracts a 6.8 GB Qwen2.5-3B checkpoint, converts it to BFP8 and JIT-compiles (~100 s
|
| 88 |
- Not an OpenAI-compatible API; `GET /v1/models` is a stub so the tt-model ready card does not 404.
|
| 89 |
- Validated on tt-metal `v0.78.0-dev20260820` (main `8b98410e730`), single p150a only.
|
| 90 |
|
|
@@ -100,6 +84,6 @@ The exact sources the image was built from — `code/` in this repo is byte-iden
|
|
| 100 |
| component | built from |
|
| 101 |
| --- | --- |
|
| 102 |
| tt-metal | [`8b98410e730bb504fea43a88609756e34821d91d`](https://github.com/tenstorrent/tt-metal/commit/8b98410e730bb504fea43a88609756e34821d91d) |
|
| 103 |
-
| `code/` digest | `
|
| 104 |
-
| built | 2026-09-
|
| 105 |
|
|
|
|
| 5 |
- tt-dit-server
|
| 6 |
- tt-model-cache
|
| 7 |
- tt-model-container
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# locate-anything-3b-p150
|
|
|
|
| 23 |
tt-model serve changh95/locate-anything-3b-p150
|
| 24 |
```
|
| 25 |
|
| 26 |
+
`pull --with-weights` downloads the Docker image and the [`nvidia/LocateAnything-3B`](https://huggingface.co/nvidia/LocateAnything-3B) weights at `c32291ca5e996f5a7a485845b4f57a233936bba0` (into your HF cache; they are not in the image). `serve` starts the model's own HTTP server on port 20000 (or the next free port, if that one is busy); the first start compiles kernels for your device, which takes several minutes, and the server is ready when it logs `Application startup complete`.
|
|
|
|
| 27 |
|
| 28 |
### Run with tt-cli
|
| 29 |
|
|
|
|
| 43 |
{"query": "car", "width": 1920, "height": 1080, "canonical_size": [616, 336], "grid_hw": [24, 44],
|
| 44 |
"raw_text": "<ref>car</ref><box><282><414><606><794></box><|im_end|>",
|
| 45 |
"detections": [{"label": "car", "box": [541.44, 447.12, 1163.52, 857.52], "box_norm": [282, 414, 606, 794]}],
|
| 46 |
+
"points": [], "num_generated_tokens": 10, "stopped_on_eos": true, "decode_mode": "ar_greedy_trace_device_sampling",
|
| 47 |
+
"timing_ms": {"vision": 1.4, "prefill": 86.3, "decode": 202.1, "total": 303.9, "decode_tok_s": 44.53}}
|
| 48 |
```
|
| 49 |
|
| 50 |
- `box` is `[x1, y1, x2, y2]` in original image pixels; `box_norm` is the model's own 0..1000 output over the squashed `canonical_size` view. `points` holds 2-coordinate outputs the same way.
|
|
|
|
| 60 |
|
| 61 |
| Metric | Value |
|
| 62 |
|---|---:|
|
| 63 |
+
| Full on-device logits PCC vs torch-CPU reference (vision → LLM) | 0.9919 (gate ≥ 0.99; vision projector 0.9924, LLM prefill 0.9915) — measured 2026-09-13 on the p150a against goldens regenerated with the port's torch 2.7.1 / transformers 4.53.0; identical with `TT_FUSED=0` (the fused default keeps the vision numerics bit for bit) |
|
| 64 |
+
| Decoded box string on the demo image | `<ref>car</ref><box><282><414><606><794></box>`, unchanged from the 2026-09-12 package (the HF torch-CPU reference generated with the port's torch 2.7.1 / transformers 4.53.0 gives `<282><414><607><797>`, IoU 0.989) |
|
| 65 |
+
| `/predict` served over HTTP (warm, batch 1, `car`, 10 tokens; median of 100 requests, 2026-09-13) | **~305 ms** server-side (304–306; vision-trace submit 2 · prefill incl. the vision wait 86 · decode 202 ms, ~44.5 tok/s) · ~0.34 s wall. `TT_FUSED=0` (the 2026-09-12 graph): ~357 ms (351–365; vision 48 · prefill 62 · decode 232 ms, ~39 tok/s) · ~0.40 s wall |
|
| 66 |
|
| 67 |
### Caveats
|
| 68 |
|
| 69 |
- One image + one query per request, batch 1, requests are serialized. Every image is squash-resized onto a fixed 24×44-patch grid (616×336, 16:9; `LA_IN_TOKEN_LIMIT=1024`, upstream default 25600): non-16:9 images are distorted before the model sees them, boxes still map back to original pixels.
|
| 70 |
+
- bf16 vision, BF16 attention + BFP8 MLP LLM; the package ships an `mlp.py` overlay (`code/models/tt_transformers/tt/mlp.py`, decode `w1`/`w3` spilled to DRAM) so the LLM fits L1 on one p150a. Fused device paths (MoonViT as one metal trace with the patch merger on device, device vision→LLM merge, traced prefill, one-row first token, on-device greedy argmax) are on by default since 2026-09-13; `TT_FUSED=0` restores the 2026-09-12 graph, and the vision numerics are unchanged bit for bit either way. Only greedy AR decode is served; the experimental Parallel Box Decoding (MTP) is not.
|
| 71 |
+
- Weights are public and ungated but under NVIDIA's own license (not OSI); ~7.7 GB download, and the first boot extracts a 6.8 GB Qwen2.5-3B checkpoint, converts it to BFP8 and JIT-compiles (~100 s on the very first boot, ~50 s with cached weights but an empty kernel cache, ~17 s warm; measured 2026-09-13).
|
| 72 |
- Not an OpenAI-compatible API; `GET /v1/models` is a stub so the tt-model ready card does not 404.
|
| 73 |
- Validated on tt-metal `v0.78.0-dev20260820` (main `8b98410e730`), single p150a only.
|
| 74 |
|
|
|
|
| 84 |
| component | built from |
|
| 85 |
| --- | --- |
|
| 86 |
| tt-metal | [`8b98410e730bb504fea43a88609756e34821d91d`](https://github.com/tenstorrent/tt-metal/commit/8b98410e730bb504fea43a88609756e34821d91d) |
|
| 87 |
+
| `code/` digest | `27dc2b154aa86da9` (sha256, first 16 hex digits) |
|
| 88 |
+
| built | 2026-09-13T15:59:45+00:00 by tt-model 0.1.0 |
|
| 89 |
|
image/blobs/sha256/03a03c657d140c673b74285b00fa0b49846c4f4ab8f25ad71781c8d7ec3aacce
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"25465aec26ceac67f6cf6a8e78257238aea8d10f889c9c29f5c1d53494940600","parent":"0b7bde5a12ad68f5036d852d60212b9e9cabe19af669b980e799f3939edbe96c","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/04662eaf946f1006d940a11624ef1490fb36f56b80e84d84ca903f628e667853
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"86608ccc1550261b0c26b9a5ad2532117cb08f3cff41c6bf8334f01bf3fbfbb7","parent":"9ac70b3334c27b898dacf909bf849ad169772449ffde96c92830e17b6d43ee7c","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09
ADDED
|
Binary file (39.9 kB). View file
|
|
|
image/blobs/sha256/42d454fc9fbb57cf9860893b2e6883b9526b5c815f859d4894684160590ebc48
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"3c7c00c4d8e6007e15dad36f6db6d31601663c78e9bd065b11a697aae91ef961","parent":"ac7b453ee72dfd874986e09538ac79700fee2dbd53a76e3f029e4117e380d95e","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/6c0ff52f63318e7e1ae01aa3435b03772a7070a02430c242ca0a375b2c356e74
ADDED
|
Binary file (4.1 kB). View file
|
|
|
image/blobs/sha256/744f391096d88b3238e0b6acaf2b6b962c35bdee1a9ec9608b556e1629cb9855
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"9ac70b3334c27b898dacf909bf849ad169772449ffde96c92830e17b6d43ee7c","parent":"c9ec5a76a8950cba41ae9fab5058f9f7687da7fad13085cdc1cb10655baa1d1b","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/8be33dbea74265a3e07f3d0156c03e546450e21e8fbf31fa832593fdfb19b894
ADDED
|
Binary file (4.61 kB). View file
|
|
|
image/blobs/sha256/91653b093d3f14a0d03e0de4351e4d1d41aa2ae128dcf09c5e55db54bea0b730
ADDED
|
Binary file (23 kB). View file
|
|
|
image/blobs/sha256/98f824d3fc7ff8f30eee1efe56f822e08654d651e7ebfed460dc12d39bd97e7e
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"0b7bde5a12ad68f5036d852d60212b9e9cabe19af669b980e799f3939edbe96c","parent":"08066bcc5f1c0eefdd3b1ef38184b1a0ff3d56ebb5aa97754667d68a838490f7","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/a0f23b09994be06990c1cdc69f852358ded9a3bb35b453761568780bfc09eb3d
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"c9ec5a76a8950cba41ae9fab5058f9f7687da7fad13085cdc1cb10655baa1d1b","parent":"ca890b2580fccac25824a659c076fbf41a16e32c337e3231a4125fc56ef8ed70","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/a86e06feb2528357ae80734e28108c475cb9862a4971f6e76bb6ba7d178c18e1
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"171d18231d0f88b3d11b0f80fa724645c3abe9c31d3639710c614b22bb08893a","parent":"3ea92f08340c850a72cd4171a081688015c954f6338a9dc3a45bf2ff2448d5ee","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/af73675e1f9cbcdac1b35d8c7f87f2c934ab38fcd3daa940b4780624c42b597a
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"3ea92f08340c850a72cd4171a081688015c954f6338a9dc3a45bf2ff2448d5ee","parent":"86608ccc1550261b0c26b9a5ad2532117cb08f3cff41c6bf8334f01bf3fbfbb7","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/c15603a48fac1a2f0d1b1964cc4c1501e765c049ff932b56d18bf611d6661d87
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"id":"ca890b2580fccac25824a659c076fbf41a16e32c337e3231a4125fc56ef8ed70","parent":"48b6597c7c44793612968b9dea1cd786f496ff91b58f9d6bd1f09c58645c67b1","created":"1970-01-01T09:00:00+09:00","container_config":{"Hostname":"","Domainname":"","User":"","AttachStdin":false,"AttachStdout":false,"AttachStderr":false,"Tty":false,"OpenStdin":false,"StdinOnce":false,"Env":null,"Cmd":null,"Image":"","Volumes":null,"WorkingDir":"","Entrypoint":null,"OnBuild":null,"Labels":null},"os":"linux"}
|
image/blobs/sha256/f6b1152615cdfca4fdd198d135b37264fb4dea4f5ec9d292db4abcfa69c0d3c7
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"schemaVersion":2,"mediaType":"application/vnd.oci.image.manifest.v1+json","config":{"mediaType":"application/vnd.oci.image.config.v1+json","digest":"sha256:164e85a72e70874bf01daafd355ec5b506fe6f5774d13c97488ab492f38ffee9","size":14536},"layers":[{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:ea16cace89338c84eb6bcb91a7efdfcae6838fff359efe951858227436486c34","size":80641024},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:cc52d628a5345695451671ffa5ed136466bc5942c913fa896dfab52fe53feb85","size":204086784},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:93ad115eef54c24c0752c5d346c2b10111fc3bbe74b57c263ffa347177b5e023","size":352256},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:93630d8f1a2156c9b0cee9e598a8b9d78544dfbad2a868338208a4fb1cd60f8d","size":33464832},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:99758597d12605beb6476a563fc04c4d2285969e7de66249b38d3f348ceb7fc4","size":454126592},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:6a8a0ce1162bd94e55628471e694d86a520b9a7e8494c21831665105f5697679","size":187652608},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:8d38dc2a0d96f6d252a91361d79c1494143cf1f19714cc4a94ef79ca3ea9568d","size":1099616768},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:3b517fd7278aa415b2f487a45fc6aeb90e7b311af83e2f3feba7bd5fb4d5ce6d","size":2048},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:b23995b889b49f983f248dbb56185f01fc195b7a98d82534dee9bb4369733a10","size":454599168},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:97fd10c9f4b964b6bda09fc6df6ac807b56d208353944d10146ba91f80bb96a7","size":130853888},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:2878f764823c731034272e226d856d6a2bdd19e8287d2c678698d6e2024266be","size":130853888},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:7298d4eac00676d2dd6e0c99dca1cd1b7bd5f387aa1ae5ddfb018f8f129a88c0","size":191707136},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:4ae07eb51547d9a8a18533b1ebcf9b65522dc8e33b03c08b5c2b8f755fdb2e13","size":65327616},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:510178675ca9d7f838e62444998d7cb0fb911c96c8495a72315cda0e7946da5d","size":4678144},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:91653b093d3f14a0d03e0de4351e4d1d41aa2ae128dcf09c5e55db54bea0b730","size":23040},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:d90c09a7778753d6bcb3cff86183f5a3759584f89f823fdd5e07d472235c08c7","size":8977408},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:98745d4654a5ab42cb4f4d1a241888fc872e8ecacade0836217b55b15f804f86","size":4608},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:8be33dbea74265a3e07f3d0156c03e546450e21e8fbf31fa832593fdfb19b894","size":4608},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef","size":1024},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:6c0ff52f63318e7e1ae01aa3435b03772a7070a02430c242ca0a375b2c356e74","size":4096},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:f90185636c00ae2f9243d21c9a3a187da1cbb7c39cec790a8390c75f7b448425","size":1232896},{"mediaType":"application/vnd.oci.image.layer.v1.tar","digest":"sha256:155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09","size":39936}]}
|
image/manifest.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
[{"Config":"blobs/sha256/
|
|
|
|
| 1 |
+
[{"Config":"blobs/sha256/164e85a72e70874bf01daafd355ec5b506fe6f5774d13c97488ab492f38ffee9","RepoTags":["tt-model/locate-anything-3b-p150:164e85a72e70"],"Layers":["blobs/sha256/ea16cace89338c84eb6bcb91a7efdfcae6838fff359efe951858227436486c34","blobs/sha256/cc52d628a5345695451671ffa5ed136466bc5942c913fa896dfab52fe53feb85","blobs/sha256/93ad115eef54c24c0752c5d346c2b10111fc3bbe74b57c263ffa347177b5e023","blobs/sha256/93630d8f1a2156c9b0cee9e598a8b9d78544dfbad2a868338208a4fb1cd60f8d","blobs/sha256/99758597d12605beb6476a563fc04c4d2285969e7de66249b38d3f348ceb7fc4","blobs/sha256/6a8a0ce1162bd94e55628471e694d86a520b9a7e8494c21831665105f5697679","blobs/sha256/8d38dc2a0d96f6d252a91361d79c1494143cf1f19714cc4a94ef79ca3ea9568d","blobs/sha256/3b517fd7278aa415b2f487a45fc6aeb90e7b311af83e2f3feba7bd5fb4d5ce6d","blobs/sha256/b23995b889b49f983f248dbb56185f01fc195b7a98d82534dee9bb4369733a10","blobs/sha256/97fd10c9f4b964b6bda09fc6df6ac807b56d208353944d10146ba91f80bb96a7","blobs/sha256/2878f764823c731034272e226d856d6a2bdd19e8287d2c678698d6e2024266be","blobs/sha256/7298d4eac00676d2dd6e0c99dca1cd1b7bd5f387aa1ae5ddfb018f8f129a88c0","blobs/sha256/4ae07eb51547d9a8a18533b1ebcf9b65522dc8e33b03c08b5c2b8f755fdb2e13","blobs/sha256/510178675ca9d7f838e62444998d7cb0fb911c96c8495a72315cda0e7946da5d","blobs/sha256/91653b093d3f14a0d03e0de4351e4d1d41aa2ae128dcf09c5e55db54bea0b730","blobs/sha256/d90c09a7778753d6bcb3cff86183f5a3759584f89f823fdd5e07d472235c08c7","blobs/sha256/98745d4654a5ab42cb4f4d1a241888fc872e8ecacade0836217b55b15f804f86","blobs/sha256/8be33dbea74265a3e07f3d0156c03e546450e21e8fbf31fa832593fdfb19b894","blobs/sha256/5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef","blobs/sha256/6c0ff52f63318e7e1ae01aa3435b03772a7070a02430c242ca0a375b2c356e74","blobs/sha256/f90185636c00ae2f9243d21c9a3a187da1cbb7c39cec790a8390c75f7b448425","blobs/sha256/155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09"],"LayerSources":{"sha256:155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":39936,"digest":"sha256:155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09"},"sha256:2878f764823c731034272e226d856d6a2bdd19e8287d2c678698d6e2024266be":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":130853888,"digest":"sha256:2878f764823c731034272e226d856d6a2bdd19e8287d2c678698d6e2024266be"},"sha256:3b517fd7278aa415b2f487a45fc6aeb90e7b311af83e2f3feba7bd5fb4d5ce6d":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":2048,"digest":"sha256:3b517fd7278aa415b2f487a45fc6aeb90e7b311af83e2f3feba7bd5fb4d5ce6d"},"sha256:4ae07eb51547d9a8a18533b1ebcf9b65522dc8e33b03c08b5c2b8f755fdb2e13":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":65327616,"digest":"sha256:4ae07eb51547d9a8a18533b1ebcf9b65522dc8e33b03c08b5c2b8f755fdb2e13"},"sha256:510178675ca9d7f838e62444998d7cb0fb911c96c8495a72315cda0e7946da5d":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":4678144,"digest":"sha256:510178675ca9d7f838e62444998d7cb0fb911c96c8495a72315cda0e7946da5d"},"sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":1024,"digest":"sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef"},"sha256:6a8a0ce1162bd94e55628471e694d86a520b9a7e8494c21831665105f5697679":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":187652608,"digest":"sha256:6a8a0ce1162bd94e55628471e694d86a520b9a7e8494c21831665105f5697679"},"sha256:6c0ff52f63318e7e1ae01aa3435b03772a7070a02430c242ca0a375b2c356e74":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":4096,"digest":"sha256:6c0ff52f63318e7e1ae01aa3435b03772a7070a02430c242ca0a375b2c356e74"},"sha256:7298d4eac00676d2dd6e0c99dca1cd1b7bd5f387aa1ae5ddfb018f8f129a88c0":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":191707136,"digest":"sha256:7298d4eac00676d2dd6e0c99dca1cd1b7bd5f387aa1ae5ddfb018f8f129a88c0"},"sha256:8be33dbea74265a3e07f3d0156c03e546450e21e8fbf31fa832593fdfb19b894":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":4608,"digest":"sha256:8be33dbea74265a3e07f3d0156c03e546450e21e8fbf31fa832593fdfb19b894"},"sha256:8d38dc2a0d96f6d252a91361d79c1494143cf1f19714cc4a94ef79ca3ea9568d":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":1099616768,"digest":"sha256:8d38dc2a0d96f6d252a91361d79c1494143cf1f19714cc4a94ef79ca3ea9568d"},"sha256:91653b093d3f14a0d03e0de4351e4d1d41aa2ae128dcf09c5e55db54bea0b730":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":23040,"digest":"sha256:91653b093d3f14a0d03e0de4351e4d1d41aa2ae128dcf09c5e55db54bea0b730"},"sha256:93630d8f1a2156c9b0cee9e598a8b9d78544dfbad2a868338208a4fb1cd60f8d":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":33464832,"digest":"sha256:93630d8f1a2156c9b0cee9e598a8b9d78544dfbad2a868338208a4fb1cd60f8d"},"sha256:93ad115eef54c24c0752c5d346c2b10111fc3bbe74b57c263ffa347177b5e023":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":352256,"digest":"sha256:93ad115eef54c24c0752c5d346c2b10111fc3bbe74b57c263ffa347177b5e023"},"sha256:97fd10c9f4b964b6bda09fc6df6ac807b56d208353944d10146ba91f80bb96a7":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":130853888,"digest":"sha256:97fd10c9f4b964b6bda09fc6df6ac807b56d208353944d10146ba91f80bb96a7"},"sha256:98745d4654a5ab42cb4f4d1a241888fc872e8ecacade0836217b55b15f804f86":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":4608,"digest":"sha256:98745d4654a5ab42cb4f4d1a241888fc872e8ecacade0836217b55b15f804f86"},"sha256:99758597d12605beb6476a563fc04c4d2285969e7de66249b38d3f348ceb7fc4":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":454126592,"digest":"sha256:99758597d12605beb6476a563fc04c4d2285969e7de66249b38d3f348ceb7fc4"},"sha256:b23995b889b49f983f248dbb56185f01fc195b7a98d82534dee9bb4369733a10":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":454599168,"digest":"sha256:b23995b889b49f983f248dbb56185f01fc195b7a98d82534dee9bb4369733a10"},"sha256:cc52d628a5345695451671ffa5ed136466bc5942c913fa896dfab52fe53feb85":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":204086784,"digest":"sha256:cc52d628a5345695451671ffa5ed136466bc5942c913fa896dfab52fe53feb85"},"sha256:d90c09a7778753d6bcb3cff86183f5a3759584f89f823fdd5e07d472235c08c7":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":8977408,"digest":"sha256:d90c09a7778753d6bcb3cff86183f5a3759584f89f823fdd5e07d472235c08c7"},"sha256:ea16cace89338c84eb6bcb91a7efdfcae6838fff359efe951858227436486c34":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":80641024,"digest":"sha256:ea16cace89338c84eb6bcb91a7efdfcae6838fff359efe951858227436486c34"},"sha256:f90185636c00ae2f9243d21c9a3a187da1cbb7c39cec790a8390c75f7b448425":{"mediaType":"application/vnd.oci.image.layer.v1.tar","size":1232896,"digest":"sha256:f90185636c00ae2f9243d21c9a3a187da1cbb7c39cec790a8390c75f7b448425"}}}]
|
image/repositories
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"tt-model/locate-anything-3b-p150":{"
|
|
|
|
| 1 |
+
{"tt-model/locate-anything-3b-p150":{"164e85a72e70":"155456a8f571909b4c6becc20d788a2df67a07f15243a66f0aeed3ab7ffd7e09"}}
|
tt_kernel_manifest.json
CHANGED
|
@@ -6,7 +6,7 @@
|
|
| 6 |
"device_count": 1,
|
| 7 |
"producer": {
|
| 8 |
"tt_kernel_version": "0.1.0",
|
| 9 |
-
"created_at": "2026-09-
|
| 10 |
"hostname": "deepgadget"
|
| 11 |
},
|
| 12 |
"weights": {
|
|
@@ -30,8 +30,8 @@
|
|
| 30 |
"image": {
|
| 31 |
"registry": "hf",
|
| 32 |
"repository": "locate-anything-3b-p150",
|
| 33 |
-
"tag": "tt-model/locate-anything-3b-p150:
|
| 34 |
-
"digest": "sha256:
|
| 35 |
},
|
| 36 |
"kind": "tt-dit-server",
|
| 37 |
"runtime": {
|
|
@@ -66,7 +66,8 @@
|
|
| 66 |
"LA_IN_TOKEN_LIMIT": "1024",
|
| 67 |
"LA_PREC": "accuracy",
|
| 68 |
"LA_TRACE": "1",
|
| 69 |
-
"LA_WARMUP_RUNS": "2"
|
|
|
|
| 70 |
}
|
| 71 |
},
|
| 72 |
"serve_profiles": [
|
|
@@ -99,10 +100,10 @@
|
|
| 99 |
"from pathlib import Path; assert 'spill_ff1_3' in Path('/opt/tt-metal/models/tt_transformers/tt/mlp.py').read_text(), 'mlp.py overlay (decode w1/w3 DRAM spill) missing'"
|
| 100 |
],
|
| 101 |
"built": {
|
| 102 |
-
"image": "tt-model/locate-anything-3b-p150:
|
| 103 |
"repo": "changh95/locate-anything-3b-p150",
|
| 104 |
"tt_model_version": "0.1.0",
|
| 105 |
-
"created_at": "2026-09-
|
| 106 |
"tt_metal": {
|
| 107 |
"sha": "8b98410e730bb504fea43a88609756e34821d91d",
|
| 108 |
"describe": "v0.78.0-dev20260820-25-g8b98410e73",
|
|
@@ -113,8 +114,8 @@
|
|
| 113 |
"branch": "main",
|
| 114 |
"pushed": true
|
| 115 |
},
|
| 116 |
-
"code_sha256": "
|
| 117 |
-
"image_digest": "sha256:
|
| 118 |
}
|
| 119 |
}
|
| 120 |
}
|
|
|
|
| 6 |
"device_count": 1,
|
| 7 |
"producer": {
|
| 8 |
"tt_kernel_version": "0.1.0",
|
| 9 |
+
"created_at": "2026-09-13T16:02:53.683674+00:00",
|
| 10 |
"hostname": "deepgadget"
|
| 11 |
},
|
| 12 |
"weights": {
|
|
|
|
| 30 |
"image": {
|
| 31 |
"registry": "hf",
|
| 32 |
"repository": "locate-anything-3b-p150",
|
| 33 |
+
"tag": "tt-model/locate-anything-3b-p150:164e85a72e70",
|
| 34 |
+
"digest": "sha256:164e85a72e70874bf01daafd355ec5b506fe6f5774d13c97488ab492f38ffee9"
|
| 35 |
},
|
| 36 |
"kind": "tt-dit-server",
|
| 37 |
"runtime": {
|
|
|
|
| 66 |
"LA_IN_TOKEN_LIMIT": "1024",
|
| 67 |
"LA_PREC": "accuracy",
|
| 68 |
"LA_TRACE": "1",
|
| 69 |
+
"LA_WARMUP_RUNS": "2",
|
| 70 |
+
"TT_FUSED": "1"
|
| 71 |
}
|
| 72 |
},
|
| 73 |
"serve_profiles": [
|
|
|
|
| 100 |
"from pathlib import Path; assert 'spill_ff1_3' in Path('/opt/tt-metal/models/tt_transformers/tt/mlp.py').read_text(), 'mlp.py overlay (decode w1/w3 DRAM spill) missing'"
|
| 101 |
],
|
| 102 |
"built": {
|
| 103 |
+
"image": "tt-model/locate-anything-3b-p150:164e85a72e70",
|
| 104 |
"repo": "changh95/locate-anything-3b-p150",
|
| 105 |
"tt_model_version": "0.1.0",
|
| 106 |
+
"created_at": "2026-09-13T15:59:45+00:00",
|
| 107 |
"tt_metal": {
|
| 108 |
"sha": "8b98410e730bb504fea43a88609756e34821d91d",
|
| 109 |
"describe": "v0.78.0-dev20260820-25-g8b98410e73",
|
|
|
|
| 114 |
"branch": "main",
|
| 115 |
"pushed": true
|
| 116 |
},
|
| 117 |
+
"code_sha256": "27dc2b154aa86da9d0b5c303c649e0b8dc6f321a137d41b81bc3ca4c041d1f89",
|
| 118 |
+
"image_digest": "sha256:164e85a72e70874bf01daafd355ec5b506fe6f5774d13c97488ab492f38ffee9"
|
| 119 |
}
|
| 120 |
}
|
| 121 |
}
|