Add verified Raspberry Pi 5 edge performance measurements

Record actual 16 GB Pi 5 latency, RAM and correctness with frozen evaluation inputs, raw per-call measurements, runtime hashes and reproducible settings. Preserve weights and existing training data.

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+edge_benchmarks/rpi5-2026-09-26/temperature_latency.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,287 +1,305 @@
----
-license: apache-2.0
-language:
-- en
-- hi
-pipeline_tag: text-generation
-tags:
-- text-to-json
-- home-automation
-- robotics
-- hinglish
-- tiny-model
-- from-scratch
-- edge-ai
-- numpy
-- raspberry-pi
-- conditional-rules
-- experimental
-datasets:
-- sraivante/home-commands-json-v3
-metrics:
-- exact_match
-model-index:
-- name: superfast-tiny-home-robotics-json-1m-v3
-  results:
-  - task:
-      type: text-generation
-      name: instruction to JSON device command
-    dataset:
-      type: sraivante/home-commands-json-v3
-      name: home-commands-json-v3 (1,500 held-out rows, greedy decode)
-    metrics:
-    - type: exact_match
-      value: 96.73
-      name: exact match (all)
-      verified: false
-    - type: exact_match
-      value: 96.89
-      name: exact match (plain commands, n=900)
-      verified: false
-    - type: exact_match
-      value: 96.50
-      name: exact match (conditional rules, n=600)
-      verified: false
----
-
-# Superfast Tiny Home Robotics JSON 1M v3
-
-A **1,143,328-parameter character-level transformer, trained from scratch**, that
-turns an English or Hinglish sentence into one JSON device command, including
-**conditional rules** ("if temperature goes above 42...", "roz shaam 7 baje...").
-Weights are **2.1 MB (fp16)**. Inference is **numpy only**: no PyTorch, no
-tokenizer library, no internet, no GPU.
-
-```text
-"bhai bedroom ka pankha high pe chala do"
-  -> {"activity":"air","subject":"bedroom_ceiling_fan","action":"HIGH"}
-
-"agar room ka temperature 42 se upar jaye to bedroom ka heater band kar do"
-  -> {"activity":"heating","subject":"bedroom_room_heater","action":"OFF",
-      "when":{"metric":"temperature","op":">","value":42}}
-
-"roz shaam 7 baje garden ki batti chala do"
-  -> {"activity":"light","subject":"garden_light","action":"ON",
-      "when":{"metric":"time","op":"==","value":"19:00"}}
-
-"when soil moisture drops below 20 start the garden sprinkler"
-  -> {"activity":"garden","subject":"garden_sprinkler","action":"ON",
-      "when":{"metric":"soil_moisture","op":"<","value":20}}
-```
-
-This is the v3 of the series. Compared with
-[v1](https://huggingface.co/sraivante/superfast-tiny-home-robotics-json-1m-v1)
-(30 commands, 10 device types, transformers runtime) it covers **1,004 devices,
-12 actions, 7 sensor metrics for rules**, and ships with a numpy engine plus a
-web UI and Docker image.
-
-| Release | Value |
-| --- | --- |
-| Publisher | sraivante |
-| Release date | 2026-09-26 |
-| Version | v3.0.0 |
-| Training data | [home-commands-json-v3](https://huggingface.co/datasets/sraivante/home-commands-json-v3) (synthetic, templated) |
-| Architecture | GPT-style causal decoder, char-level vocab (78 symbols), d=160, 4 layers, 4 heads, FFN 512, context 360 |
-| Parameters | 1,143,328 |
-| Weights | `model/model_v3_fp16.npz`, 2,146,783 bytes |
-| Runtime deps | `numpy` (plus `flask` for the optional server) |
-| License | Apache-2.0 |
-
-## Why a tiny model and not an LLM
-
-A home robot or a Raspberry Pi behind a microphone does not need to know the
-capital of France. It needs to turn "pankha tez kar do" into a command in a few
-milliseconds, offline, on a CPU that is also doing wake-word detection. This
-model is that one component: the **parser** between speech-to-text and the
-actuator. Everything else (safety, permissions, device state) stays in
-deterministic code you control.
-
-Measured on this release, single request, Python 3.13, numpy 2.3, Intel
-Core i7-1360P, default threads:
-
-| Input | Latency |
-| --- | ---: |
-| plain command (about 30 chars) | 70 to 90 ms |
-| conditional rule (about 70 chars) | 130 to 150 ms |
-| process RSS, engine loaded + warm (Python + numpy included) | 73 MB |
-
-Latency is dominated by Python overhead per generated character, not by
-FLOPs. Raspberry Pi 5 and Jetson Orin Nano numbers are not yet measured;
-treat the table as desktop numbers.
-
-## Quick start
-
-```bash
-pip install numpy
-git clone https://huggingface.co/sraivante/superfast-tiny-home-robotics-json-1m-v3
-cd superfast-tiny-home-robotics-json-1m-v3
-python engine.py "kitchen ki light band kar do"
-# {"activity":"light","subject":"kitchen_light","action":"OFF"}
-```
-
-In Python:
-
-```python
-import engine
-engine.init("model")                        # loads the npz once
-raw, confidence = engine.parse_scored("turn off the porch light")
-# raw        -> '{"activity":"light","subject":"porch_light","action":"OFF"}'
-# confidence -> avg log-prob per generated char; near 0.0 = in-domain
-```
-
-Web UI + REST API (Docker, no GPU):
-
-```bash
-docker compose up --build         # open http://localhost:8080
-curl -s localhost:8080/api/parse -H 'Content-Type: application/json' \
-     -d '{"text":"if aqi goes above 250 set the bedroom air purifier on high"}'
-```
-
-The API returns the command, `valid_json`, catalog `issues`, `confidence`,
-`latency_ms` and a single `ok` flag. **Act only on `ok: true`.**
-
-## How it is meant to be used (examples/)
-
-The model is a parser. `model/devices-catalog.json` is the law. Every example
-below runs the output through catalog validation before anything moves.
-
-| Example | What it shows |
-| --- | --- |
-| `examples/quickstart.py` | text in, validated command out, off-domain input rejected |
-| `examples/rule_engine.py` | what to do with the `when` clause: store it, watch sensors, fire once per crossing |
-| `examples/mqtt_bridge.py` | publish to `home/<subject>/set` for ESP32 / Tasmota / Zigbee2MQTT devices |
-| `examples/home_assistant.py` | map subjects to Home Assistant entities and call services locally |
-
-Run any of them from the repo root, all have a `--dry-run` or simulated mode:
-
-```bash
-python examples/quickstart.py
-python examples/rule_engine.py
-python examples/mqtt_bridge.py --dry-run "bedroom ka pankha high pe chala do"
-python examples/home_assistant.py --dry-run "garden ki light band kar do"
-```
-
-### The pipeline this slots into
-
-```text
-mic -> wake word -> Whisper/Vosk (Hindi+English) -> THIS MODEL -> catalog check -> actuator
-                                                      ~100 ms        ~0 ms       GPIO / MQTT / ROS
-```
-
-Plain commands (no `when`) go straight to the actuator. Conditional commands are
-stored as rules and evaluated on every sensor tick. `rule_engine.py` output on a
-simulated day:
-
-```text
-"agar temperature 35 se upar jaye to bedroom ka ac high kar do"
-  RULE stored: bedroom_ac -> HIGH when temperature > 35
-"roz subah 6 baje garden sprinkler chalu kar do"
-  RULE stored: garden_sprinkler -> ON when time == 06:00
-
-[sensor] temperature = 36
-  ACTUATE bedroom_ac                   HIGH    (temperature=36 > 35)
-[sensor] time = 06:00
-  ACTUATE garden_sprinkler             ON      (time=06:00 == 06:00)
-```
-
-### Robotics use
-
-For a mobile robot or a robotic arm the same pattern applies: swap the device
-catalog for your robot's capabilities (`arm_gripper: OPEN/CLOSE`,
-`base_motor: START/STOP/LOW/MEDIUM/HIGH`, `head_camera: ON/OFF/STATUS`),
-regenerate the data with the scripts in the dataset repo, retrain for about an
-hour on two CPU cores, and you have a command parser that fits in the L2 cache.
-The `when` clause maps directly to sensor-gated behaviours
-("agar battery 15 se neeche jaye to charging dock pe jao").
-
-## Output schema
-
-```json
-{"activity": "...", "subject": "...", "action": "...",
- "when": {"metric": "...", "op": ">|<|==", "value": 42}}
-```
-
-- **1,004 subjects** in `model/devices-catalog.json`, each with its `activity`
-  (18 of them: light, power, air, access, security, air_quality, cooling,
-  heating, entertainment, music, garden, kitchen, office, network, water,
-  laundry, cleaning, aquarium) and its allowed actions.
-- **12 actions**: ON, OFF, START, STOP, LOW, MEDIUM, HIGH, OPEN, CLOSE, LOCK,
-  UNLOCK, STATUS.
-- **7 metrics** for `when`: temperature, humidity, aqi, battery, water_level,
-  soil_moisture, time (value `"HH:MM"`, op `==`).
-- `when` is optional. Rules in the training data are sensible by construction:
-  high temperature turns cooling ON or heating OFF, never the reverse.
-
-## Confidence guard
-
-`parse_scored` returns the mean log-probability of the generated characters.
-In-domain commands decode at about 0.0; gibberish or off-domain sentences
-score clearly lower and the server flags them (default threshold -0.006, env
-`HCAI_CONF_THRESHOLD`). Example: "what is the capital of france" scores -0.022
-and is rejected. This is a useful guard, not a guarantee: command-shaped
-off-domain input can still slip through.
-
-## Evaluation
-
-1,500 held-out rows from the same generator (900 plain, 600 conditional),
-greedy decode, exact string match on the JSON:
-
-| Metric | Value |
-| --- | ---: |
-| exact match, all | 96.73 % |
-| exact match, plain | 96.89 % |
-| exact match, conditional | 96.50 % |
-| valid JSON | 100 % |
-
-Full numbers and 12 sample failures are in `model/metrics_v3.json`. The
-held-out rows themselves were not preserved in this release; the dataset repo
-ships the generators and the deterministic `prep_mix.py` (seed 108) that
-produced the train/eval split.
-
-## Honest limitations
-
-- **Synthetic, templated training data.** The accuracy above measures
-  interpolation inside the template space, not the wild. Novel or indirect
-  phrasing ("andhera kar do", "thoda tez") fails.
-- **Observed misses that pass validation.** "kitchen ki chimney high pe karo"
-  returned `STATUS` in our tests, and that is an allowed action for the
-  chimney, so the catalog check passed it. Treat STATUS on an imperative
-  sentence with suspicion in your own guard.
-- **Char-level spelling errors** in subjects happen (see sample failures);
-  the catalog check exists exactly for that. Reject anything with issues.
-- **No negation, no reject class.** "fan mat chalao" can become `ON`.
-- **One instruction, one command.** No multi-intent, no context or pronouns.
-- Time rules are one-shot `==` triggers; recurrence ("roz") is not encoded
-  separately, your scheduler decides that.
-- Romanised Hindi only. Devanagari input is not in the vocabulary and is
-  silently dropped by the tokenizer.
-
-## Adapting to your devices
-
-1. Edit the device tables in `generators/generate_dataset_v2.py` and the rule
-   tables in `generators/generate_dataset_v3_conditional.py` (dataset repo).
-2. Regenerate and mix: `python generate_dataset_v2.py && python generate_dataset_v3_conditional.py && python prep_mix.py`
-3. Retrain (needs torch; about 80 minutes on two CPU cores, minutes on a GPU):
-   `python training/train_v3.py train --seconds 4200 && python training/train_v3.py export`
-4. Drop `model_v3_fp16.npz`, `model_v3_config.json` and the new
-   `devices-catalog.json` into `model/`.
-
-## Files
-
-| Path | What |
-| --- | --- |
-| `model/model_v3_fp16.npz` | weights, fp16, 2.1 MB |
-| `model/model_v3_config.json` | vocab (`itos`) + architecture config |
-| `model/devices-catalog.json` | the 1,004 subjects with allowed actions |
-| `model/metrics_v3.json` | eval numbers and sample failures |
-| `engine.py` | numpy inference, kv-cached greedy decode |
-| `server.py`, `static/index.html` | Flask API + offline web UI |
-| `examples/` | quickstart, rule engine, MQTT bridge, Home Assistant bridge |
-| `training/train_v3.py` | full PyTorch training and export source |
-| `Dockerfile`, `docker-compose.yml` | 150 MB image, healthcheck included |
-
-## License
-
-Apache-2.0 for the weights, code and catalog. The training data is fully
-synthetic and released under the same license in the dataset repo. No
-warranty: this model suggests commands, your code decides whether to obey.
+---
+license: apache-2.0
+language:
+- en
+- hi
+pipeline_tag: text-generation
+tags:
+- text-to-json
+- home-automation
+- robotics
+- hinglish
+- tiny-model
+- from-scratch
+- edge-ai
+- numpy
+- raspberry-pi
+- conditional-rules
+- experimental
+datasets:
+- sraivante/home-commands-json-v3
+metrics:
+- exact_match
+model-index:
+- name: superfast-tiny-home-robotics-json-1m-v3
+  results:
+  - task:
+      type: text-generation
+      name: instruction to JSON device command
+    dataset:
+      type: sraivante/home-commands-json-v3
+      name: home-commands-json-v3 (1,500 held-out rows, greedy decode)
+    metrics:
+    - type: exact_match
+      value: 96.73
+      name: exact match (all)
+      verified: false
+    - type: exact_match
+      value: 96.89
+      name: exact match (plain commands, n=900)
+      verified: false
+    - type: exact_match
+      value: 96.50
+      name: exact match (conditional rules, n=600)
+      verified: false
+---
+
+# Superfast Tiny Home Robotics JSON 1M v3
+
+A **1,143,328-parameter character-level transformer, trained from scratch**, that
+turns an English or Hinglish sentence into one JSON device command, including
+**conditional rules** ("if temperature goes above 42...", "roz shaam 7 baje...").
+Weights are **2.1 MB (fp16)**. Inference is **numpy only**: no PyTorch, no
+tokenizer library, no internet, no GPU.
+
+```text
+"bhai bedroom ka pankha high pe chala do"
+  -> {"activity":"air","subject":"bedroom_ceiling_fan","action":"HIGH"}
+
+"agar room ka temperature 42 se upar jaye to bedroom ka heater band kar do"
+  -> {"activity":"heating","subject":"bedroom_room_heater","action":"OFF",
+      "when":{"metric":"temperature","op":">","value":42}}
+
+"roz shaam 7 baje garden ki batti chala do"
+  -> {"activity":"light","subject":"garden_light","action":"ON",
+      "when":{"metric":"time","op":"==","value":"19:00"}}
+
+"when soil moisture drops below 20 start the garden sprinkler"
+  -> {"activity":"garden","subject":"garden_sprinkler","action":"ON",
+      "when":{"metric":"soil_moisture","op":"<","value":20}}
+```
+
+This is the v3 of the series. Compared with
+[v1](https://huggingface.co/sraivante/superfast-tiny-home-robotics-json-1m-v1)
+(30 commands, 10 device types, transformers runtime) it covers **1,004 devices,
+12 actions, 7 sensor metrics for rules**, and ships with a numpy engine plus a
+web UI and Docker image.
+
+| Release | Value |
+| --- | --- |
+| Publisher | sraivante |
+| Release date | 2026-09-26 |
+| Version | v3.0.0 |
+| Training data | [home-commands-json-v3](https://huggingface.co/datasets/sraivante/home-commands-json-v3) (synthetic, templated) |
+| Architecture | GPT-style causal decoder, char-level vocab (78 symbols), d=160, 4 layers, 4 heads, FFN 512, context 360 |
+| Parameters | 1,143,328 |
+| Weights | `model/model_v3_fp16.npz`, 2,146,783 bytes |
+| Runtime deps | `numpy` (plus `flask` for the optional server) |
+| License | Apache-2.0 |
+
+<!-- rpi5-measurements -->
+## Raspberry Pi 5 edge-device performance
+
+Measured **2026-09-26** on a **Raspberry Pi 5 Model B, 16 GB RAM**, Debian 13.2/aarch64, Python 3.13.5. Measurement update: `edge-rpi5-20260926`; weights and training data are unchanged.
+
+| Threads | Median ms | p95 ms | p99 ms | Serial requests/s | Process RSS MiB | CPU °C min–mean–max | Timed correct |
+| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
+| 1 | 410.38 | 553.20 | 558.65 | 2.53 | 43.77 | 59.0–60.9–63.4 | 500/500 |
+| 4 | 393.10 | 550.26 | 553.48 | 2.55 | 44.67 | 60.0–62.0–64.5 | 500/500 |
+
+Batch 1; 20 warmups and 500 timed calls per row, cycling over 10 frozen model-specific inputs. **Each timed reading has a matching CPU-temperature sample**, captured immediately afterward outside the latency timer; the table shows min–mean–max temperature. RSS includes Python/runtime overhead. Timings include local text-to-output inference and exclude loading, SSH/HTTP, speech recognition and actuation. Throughput is serial reciprocal mean. Runs used one and four CPU/BLAS threads sequentially. These synthetic workloads do not establish cross-model superiority or robot-control reliability.
+
+On-device quality check: **192/200** on training-set diagnostic, NOT held-out accuracy. For v3 this is explicitly a training-set diagnostic, not held-out accuracy; the earlier 96.73% result was not rerun.
+
+[Full Pi methodology, temperature plot and reproduction](edge_benchmarks/rpi5-2026-09-26/REPORT.md) · [Every latency/temperature reading](edge_benchmarks/rpi5-2026-09-26/readings.csv) · [Raw measurements](edge_benchmarks/rpi5-2026-09-26/results) · [Versioned evaluation data](https://huggingface.co/datasets/sraivante/home-commands-json-v3/tree/edge-rpi5-20260926/edge_benchmarks/rpi5-2026-09-26).
+<!-- /rpi5-measurements -->
+
+## Why a tiny model and not an LLM
+
+A home robot or a Raspberry Pi behind a microphone does not need to know the
+capital of France. It needs to turn "pankha tez kar do" into a command in a few
+milliseconds, offline, on a CPU that is also doing wake-word detection. This
+model is that one component: the **parser** between speech-to-text and the
+actuator. Everything else (safety, permissions, device state) stays in
+deterministic code you control.
+
+Measured on this release, single request, Python 3.13, numpy 2.3, Intel
+Core i7-1360P, default threads:
+
+| Input | Latency |
+| --- | ---: |
+| plain command (about 30 chars) | 70 to 90 ms |
+| conditional rule (about 70 chars) | 130 to 150 ms |
+| process RSS, engine loaded + warm (Python + numpy included) | 73 MB |
+
+Latency is dominated by Python overhead per generated character, not by
+FLOPs. Raspberry Pi 5 measurements are now recorded above; Jetson Orin Nano remains unmeasured. The table here retains the earlier desktop measurements.
+
+## Quick start
+
+```bash
+pip install numpy
+git clone https://huggingface.co/sraivante/superfast-tiny-home-robotics-json-1m-v3
+cd superfast-tiny-home-robotics-json-1m-v3
+python engine.py "kitchen ki light band kar do"
+# {"activity":"light","subject":"kitchen_light","action":"OFF"}
+```
+
+In Python:
+
+```python
+import engine
+engine.init("model")                        # loads the npz once
+raw, confidence = engine.parse_scored("turn off the porch light")
+# raw        -> '{"activity":"light","subject":"porch_light","action":"OFF"}'
+# confidence -> avg log-prob per generated char; near 0.0 = in-domain
+```
+
+Web UI + REST API (Docker, no GPU):
+
+```bash
+docker compose up --build         # open http://localhost:8080
+curl -s localhost:8080/api/parse -H 'Content-Type: application/json' \
+     -d '{"text":"if aqi goes above 250 set the bedroom air purifier on high"}'
+```
+
+The API returns the command, `valid_json`, catalog `issues`, `confidence`,
+`latency_ms` and a single `ok` flag. **Act only on `ok: true`.**
+
+## How it is meant to be used (examples/)
+
+The model is a parser. `model/devices-catalog.json` is the law. Every example
+below runs the output through catalog validation before anything moves.
+
+| Example | What it shows |
+| --- | --- |
+| `examples/quickstart.py` | text in, validated command out, off-domain input rejected |
+| `examples/rule_engine.py` | what to do with the `when` clause: store it, watch sensors, fire once per crossing |
+| `examples/mqtt_bridge.py` | publish to `home/<subject>/set` for ESP32 / Tasmota / Zigbee2MQTT devices |
+| `examples/home_assistant.py` | map subjects to Home Assistant entities and call services locally |
+
+Run any of them from the repo root, all have a `--dry-run` or simulated mode:
+
+```bash
+python examples/quickstart.py
+python examples/rule_engine.py
+python examples/mqtt_bridge.py --dry-run "bedroom ka pankha high pe chala do"
+python examples/home_assistant.py --dry-run "garden ki light band kar do"
+```
+
+### The pipeline this slots into
+
+```text
+mic -> wake word -> Whisper/Vosk (Hindi+English) -> THIS MODEL -> catalog check -> actuator
+                                                      ~100 ms        ~0 ms       GPIO / MQTT / ROS
+```
+
+Plain commands (no `when`) go straight to the actuator. Conditional commands are
+stored as rules and evaluated on every sensor tick. `rule_engine.py` output on a
+simulated day:
+
+```text
+"agar temperature 35 se upar jaye to bedroom ka ac high kar do"
+  RULE stored: bedroom_ac -> HIGH when temperature > 35
+"roz subah 6 baje garden sprinkler chalu kar do"
+  RULE stored: garden_sprinkler -> ON when time == 06:00
+
+[sensor] temperature = 36
+  ACTUATE bedroom_ac                   HIGH    (temperature=36 > 35)
+[sensor] time = 06:00
+  ACTUATE garden_sprinkler             ON      (time=06:00 == 06:00)
+```
+
+### Robotics use
+
+For a mobile robot or a robotic arm the same pattern applies: swap the device
+catalog for your robot's capabilities (`arm_gripper: OPEN/CLOSE`,
+`base_motor: START/STOP/LOW/MEDIUM/HIGH`, `head_camera: ON/OFF/STATUS`),
+regenerate the data with the scripts in the dataset repo, retrain for about an
+hour on two CPU cores, and you have a command parser that fits in the L2 cache.
+The `when` clause maps directly to sensor-gated behaviours
+("agar battery 15 se neeche jaye to charging dock pe jao").
+
+## Output schema
+
+```json
+{"activity": "...", "subject": "...", "action": "...",
+ "when": {"metric": "...", "op": ">|<|==", "value": 42}}
+```
+
+- **1,004 subjects** in `model/devices-catalog.json`, each with its `activity`
+  (18 of them: light, power, air, access, security, air_quality, cooling,
+  heating, entertainment, music, garden, kitchen, office, network, water,
+  laundry, cleaning, aquarium) and its allowed actions.
+- **12 actions**: ON, OFF, START, STOP, LOW, MEDIUM, HIGH, OPEN, CLOSE, LOCK,
+  UNLOCK, STATUS.
+- **7 metrics** for `when`: temperature, humidity, aqi, battery, water_level,
+  soil_moisture, time (value `"HH:MM"`, op `==`).
+- `when` is optional. Rules in the training data are sensible by construction:
+  high temperature turns cooling ON or heating OFF, never the reverse.
+
+## Confidence guard
+
+`parse_scored` returns the mean log-probability of the generated characters.
+In-domain commands decode at about 0.0; gibberish or off-domain sentences
+score clearly lower and the server flags them (default threshold -0.006, env
+`HCAI_CONF_THRESHOLD`). Example: "what is the capital of france" scores -0.022
+and is rejected. This is a useful guard, not a guarantee: command-shaped
+off-domain input can still slip through.
+
+## Evaluation
+
+1,500 held-out rows from the same generator (900 plain, 600 conditional),
+greedy decode, exact string match on the JSON:
+
+| Metric | Value |
+| --- | ---: |
+| exact match, all | 96.73 % |
+| exact match, plain | 96.89 % |
+| exact match, conditional | 96.50 % |
+| valid JSON | 100 % |
+
+Full numbers and 12 sample failures are in `model/metrics_v3.json`. The
+held-out rows themselves were not preserved in this release; the dataset repo
+ships the generators and the deterministic `prep_mix.py` (seed 108) that
+describes the train/eval construction. The preserved 340,000-row training mix differs from the shipped script's configured counts; exact reconstruction of the missing historical evaluation split is unverified. The new Pi diagnostic uses a frozen sample from the preserved training mix and does not re-estimate the historical held-out score.
+
+## Honest limitations
+
+- **Synthetic, templated training data.** The accuracy above measures
+  interpolation inside the template space, not the wild. Novel or indirect
+  phrasing ("andhera kar do", "thoda tez") fails.
+- **Observed misses that pass validation.** "kitchen ki chimney high pe karo"
+  returned `STATUS` in our tests, and that is an allowed action for the
+  chimney, so the catalog check passed it. Treat STATUS on an imperative
+  sentence with suspicion in your own guard.
+- **Char-level spelling errors** in subjects happen (see sample failures);
+  the catalog check exists exactly for that. Reject anything with issues.
+- **No negation, no reject class.** "fan mat chalao" can become `ON`.
+- **One instruction, one command.** No multi-intent, no context or pronouns.
+- Time rules are one-shot `==` triggers; recurrence ("roz") is not encoded
+  separately, your scheduler decides that.
+- Romanised Hindi only. Devanagari input is not in the vocabulary and is
+  silently dropped by the tokenizer.
+
+## Adapting to your devices
+
+1. Edit the device tables in `generators/generate_dataset_v2.py` and the rule
+   tables in `generators/generate_dataset_v3_conditional.py` (dataset repo).
+2. Regenerate and mix: `python generate_dataset_v2.py && python generate_dataset_v3_conditional.py && python prep_mix.py`
+3. Retrain (needs torch; about 80 minutes on two CPU cores, minutes on a GPU):
+   `python training/train_v3.py train --seconds 4200 && python training/train_v3.py export`
+4. Drop `model_v3_fp16.npz`, `model_v3_config.json` and the new
+   `devices-catalog.json` into `model/`.
+
+## Files
+
+| Path | What |
+| --- | --- |
+| `model/model_v3_fp16.npz` | weights, fp16, 2.1 MB |
+| `model/model_v3_config.json` | vocab (`itos`) + architecture config |
+| `model/devices-catalog.json` | the 1,004 subjects with allowed actions |
+| `model/metrics_v3.json` | eval numbers and sample failures |
+| `engine.py` | numpy inference, kv-cached greedy decode |
+| `server.py`, `static/index.html` | Flask API + offline web UI |
+| `examples/` | quickstart, rule engine, MQTT bridge, Home Assistant bridge |
+| `training/train_v3.py` | full PyTorch training and export source |
+| `Dockerfile`, `docker-compose.yml` | 150 MB image, healthcheck included |
+
+## License
+
+Apache-2.0 for the weights, code and catalog. The training data is fully
+synthetic and released under the same license in the dataset repo. No
+warranty: this model suggests commands, your code decides whether to obey.
+
+Copyright (c) 2026 sraivante applies only to original material and selection/arrangement contributed by the user; third-party ownership and licenses remain unchanged.

edge_benchmarks/rpi5-2026-09-26/REPORT.md

@@ -0,0 +1,61 @@
+# Raspberry Pi 5 measurements — Tiny Home Robotics JSON 1M v3
+
+Measured on 2026-09-26; measurement revision `edge-rpi5-20260926`. The model weights and training data were not changed.
+
+Hardware: **Raspberry Pi 5 Model B Rev 1.1**, 15.84 GiB OS-visible RAM (16 GB model), four CPU cores, aarch64, Debian 13.2, kernel `6.12.47+rpt-rpi-2712`. Python 3.13.5. The device's governor and library versions are recorded in each JSON result. Cooling and power-supply model were not inspected.
+
+## Measured performance
+
+| Threads | Median ms | p95 ms | p99 ms | Serial requests/s | Process RSS MiB | CPU °C min–mean–max | Timed correct |
+| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
+| 1 | 410.38 | 553.20 | 558.65 | 2.53 | 43.77 | 59.0–60.9–63.4 | 500/500 |
+| 4 | 393.10 | 550.26 | 553.48 | 2.55 | 44.67 | 60.0–62.0–64.5 | 500/500 |
+
+Each row is a separate sequential process: batch 1, 20 warmups, 500 timed requests cycling over 10 frozen synthetic inputs. Timing covers the adapter's complete local text-to-output call; it excludes model loading, SSH/network transfer, HTTP/UI, speech recognition, and actuation. RSS includes Python and runtime overhead. Peak RSS is Linux VmHWM sampled after the timed loop and includes imports/initialization. Serial requests/s is 1000 divided by mean latency; it is not concurrent-serving throughput. These model-specific input sets do not establish a controlled cross-model speed ranking.
+
+Runtime: FP16 NPZ storage expanded to FP32 NumPy; KV-cached greedy character generation, max_new=170; JSON parsing included, catalog validation excluded.
+
+Thread counts set PyTorch/BLAS intra-op limits; PyTorch inter-op is one. No CPU affinity or power mode was changed. Actual loaded thread-pool metadata is in the raw results.
+
+The benchmark runs left existing host services running. CPU temperature is read immediately after **every timed inference**, outside the latency timer, with per-call UTC timestamps. Sensor reads add a small gap between requests. The table reports the minimum, mean and maximum of those 500 matched temperature readings per row. The sensor types are recorded in each JSON. Thread configurations ran one then four without a controlled cooldown; temperatures depend on run order and background load. Start/end snapshots ranged from 60.0 to 64.5 °C; observed firmware flags: `throttled=0x0`. This short run is not a power or long-duration stability measurement.
+
+![Latency and CPU temperature for each reading](temperature_latency.png)
+
+[Download all matched latency/temperature readings](readings.csv). Mean latency, import/load times and peak RSS are in the raw result JSON.
+
+## Command correctness on this device
+
+| Diagnostic group | Correct / cases |
+| --- | ---: |
+| training_plain | 95/100 |
+| training_conditional | 97/100 |
+
+training-set diagnostic, NOT held-out accuracy. Historical 1500-row evaluation file is absent locally and from the published dataset. This diagnostic does not reproduce or replace the historical 96.73% result. The shipped prep_mix.py has different training-count settings from the published 340000-row snapshot.
+
+Timed-correct counts above describe the repeated ten-input latency set, not an independent accuracy estimate. Recorded inference errors: 0 across the timed runs. No model retraining, output correction, host action or device actuation was performed.
+
+## Artifact and dataset identity
+
+- Published model tested: [`sraivante/superfast-tiny-home-robotics-json-1m-v3@2b2e71d37ea9fa0fe6ab247b6a74e8db774fb6f2`](https://huggingface.co/sraivante/superfast-tiny-home-robotics-json-1m-v3/tree/2b2e71d37ea9fa0fe6ab247b6a74e8db774fb6f2). All tested runtime assets were checked against this revision.
+- Learned weight SHA-256: `fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b` (2,146,783 bytes).
+- Associated preserved training dataset: [`sraivante/home-commands-json-v3@da10aca352a34cb2834a049867f6f2e9fcc30e3e`](https://huggingface.co/datasets/sraivante/home-commands-json-v3/tree/da10aca352a34cb2834a049867f6f2e9fcc30e3e). Existing source/split hashes and historical provenance remain in that snapshot. No fine-tuning was performed for this measurement update.
+- The [versioned evaluation inputs and Pi predictions](https://huggingface.co/datasets/sraivante/home-commands-json-v3/tree/edge-rpi5-20260926/edge_benchmarks/rpi5-2026-09-26) record the new diagnostic snapshot. `provenance.json` records its hashes, counts, source revisions, and historical identity limitations.
+- [Runtime identity check](runtime_identity.json); [raw per-call records](results); [exact environment](environment.lock.txt).
+
+## Reproduce
+
+Use a 64-bit Raspberry Pi in an isolated environment. Download this model repository at `edge-rpi5-20260926`, then run:
+
+```bash
+python3 -m venv .venv
+. .venv/bin/activate
+python -m pip install -r edge_benchmarks/rpi5-2026-09-26/environment.lock.txt
+python edge_benchmarks/rpi5-2026-09-26/reproduce.py --threads 1
+python edge_benchmarks/rpi5-2026-09-26/reproduce.py --threads 4
+```
+
+The helper downloads the pinned runtime files above, checks SHA-256, stages the exact case files, and invokes the included `benchmark.py`. It refuses to report a non-Pi host as a Pi result. Downloading requires network access; timed inference runs offline. The original run's full bundle hash differs from the per-model reproduction manifest; the original hash is retained inside each result.
+
+## License and limitations
+
+Copyright (c) 2026 sraivante for original benchmark code, evaluation material and selection/arrangement, under Apache License 2.0. Third-party ownership and licenses remain unchanged. Synthetic/regression diagnostics do not establish real-user or robot-control reliability. Existing model-specific limitations still apply; latency is not a safety or end-to-end performance guarantee.

edge_benchmarks/rpi5-2026-09-26/benchmark.py

@@ -0,0 +1,268 @@
+"""Batch-one inference benchmark for five frozen workspace projects.
+
+No executor, host adapter, server, MQTT, or GPIO code is imported or called.
+Copyright (c) 2026 sraivante. Licensed under Apache License 2.0.
+"""
+from __future__ import annotations
+
+import argparse
+from collections import defaultdict
+from datetime import datetime, timezone
+import hashlib
+import importlib.metadata
+import json
+import os
+from pathlib import Path
+import platform
+import statistics
+import subprocess
+import sys
+import time
+
+HERE = Path(__file__).resolve().parent
+
+
+def digest(path):
+    with Path(path).open("rb") as stream:
+        return hashlib.file_digest(stream, "sha256").hexdigest()
+
+
+def read_text(path):
+    try:
+        return Path(path).read_text().strip("\x00\n")
+    except OSError:
+        return None
+
+
+def host_state():
+    import psutil
+    throttled = None
+    try:
+        throttled = subprocess.check_output(["vcgencmd", "get_throttled"], text=True, timeout=5).strip()
+    except (OSError, subprocess.SubprocessError):
+        pass
+    return {
+        "load_average": list(os.getloadavg()) if hasattr(os, "getloadavg") else None,
+        "available_ram_bytes": psutil.virtual_memory().available,
+        "temperature_c": {p.parent.name: float(p.read_text()) / 1000
+                          for p in Path("/sys/class/thermal").glob("thermal_zone*/temp")},
+        "cpu_frequency_khz": {p.parent.parent.name: int(p.read_text())
+                              for p in Path("/sys/devices/system/cpu").glob("cpu*/cpufreq/scaling_cur_freq")},
+        "throttled": throttled,
+    }
+
+
+def hardware():
+    import psutil
+    return {"raspberry_pi_model": read_text("/proc/device-tree/model"),
+            "system": platform.system(), "kernel": platform.release(),
+            "architecture": platform.machine(), "os_release": read_text("/etc/os-release"),
+            "logical_cpus": psutil.cpu_count(), "physical_cpus": psutil.cpu_count(logical=False),
+            "ram_bytes": psutil.virtual_memory().total,
+            "temperature_sensor_types": {p.parent.name: p.read_text().strip()
+                                         for p in Path("/sys/class/thermal").glob("thermal_zone*/type")},
+            "governors": {p.parent.parent.name: p.read_text().strip()
+                          for p in Path("/sys/devices/system/cpu").glob("cpu*/cpufreq/scaling_governor")}}
+
+
+def memory():
+    import psutil
+    info = psutil.Process().memory_info()._asdict()
+    status = read_text("/proc/self/status") or ""
+    for line in status.splitlines():
+        if line.startswith("VmHWM:"):
+            info["peak_rss"] = int(line.split()[1]) * 1024
+    return info
+
+
+def temperature():
+    return {p.parent.name: float(p.read_text()) / 1000
+            for p in Path("/sys/class/thermal").glob("thermal_zone*/temp")}
+
+
+def summary(values):
+    ordered = sorted(values)
+    def quantile(q):
+        rank = (len(ordered) - 1) * q
+        lo = int(rank)
+        hi = min(lo + 1, len(ordered) - 1)
+        return ordered[lo] + (ordered[hi] - ordered[lo]) * (rank - lo)
+    return {"n": len(values), "mean": statistics.mean(values), "p50": quantile(.5),
+            "p95": quantile(.95), "p99": quantile(.99), "min": min(values), "max": max(values)}
+
+
+def load_adapter(key, root, threads):
+    start = time.perf_counter()
+    if key == "poc1":
+        sys.path.insert(0, str(root))
+        import torch
+        from tiny_json_llm.infer import JsonCommandModel
+        torch.set_num_threads(threads)
+        torch.set_num_interop_threads(1)
+        imports = time.perf_counter() - start
+        start = time.perf_counter()
+        model = JsonCommandModel(root / "best_model", device="cpu")
+        predict = lambda row: model.predict(row["text"])
+        params = sum(p.numel() for p in model.model.parameters())
+        mode = "FP32 PyTorch; greedy generation constrained to the 30 training-observed JSON commands"
+    elif key == "poc2":
+        sys.path.insert(0, str(root))
+        import engine
+        imports = time.perf_counter() - start
+        start = time.perf_counter()
+        engine.init(str(root / "model"))
+        predict = lambda row: json.loads(engine.parse_scored(row["text"])[0])
+        params = sum(p.size for p in engine._W.values())
+        mode = "FP16 NPZ storage expanded to FP32 NumPy; KV-cached greedy character generation, max_new=170; JSON parsing included, catalog validation excluded"
+    elif key == "poc3":
+        sys.path.insert(0, str(root))
+        from edge_command import Interpreter
+        imports = time.perf_counter() - start
+        start = time.perf_counter()
+        model = Interpreter(str(root))
+        predict = lambda row: model.parse(row["text"])
+        params = None
+        mode = "Standard-library action classifier with rules and read-only SQLite catalog; not an autoregressive LLM"
+    elif key == "agent_claude":
+        sys.path.insert(0, str(root / "model"))
+        from runtime import CommandModel
+        imports = time.perf_counter() - start
+        start = time.perf_counter()
+        model = CommandModel(str(root / "artifacts/final"))
+        def predict(row):
+            value = model.predict(row["text"])
+            return {k: v for k, v in value.items() if k != "_meta"}
+        params = sum(p.size for p in model.W.values())
+        mode = "NumPy encoder/decoder transformer with grammar constraints; FP32 runtime; includes normalization and JSON conversion"
+    elif key == "agent_codex":
+        sys.path.insert(0, str(root / "app"))
+        from inference import local_model, predict as infer
+        imports = time.perf_counter() - start
+        start = time.perf_counter()
+        local_model()
+        predict = lambda row: infer(row["text"], platform=row.get("platform", "pi"), engine="local")
+        params = None
+        mode = "scikit-learn intent classifier with policy and argument parsing; not an autoregressive LLM; no host execution"
+    else:
+        raise ValueError(key)
+    return predict, params, mode, imports, time.perf_counter() - start
+
+
+def outcome(row, value, error):
+    if row.get("match") == "rejection":
+        return bool(error or (isinstance(value, dict) and ("error" in value or value.get("action") in {"unknown", "REJECT", "NOOP", "CLARIFY", "ABSTAIN"})))
+    if error:
+        return False
+    if row.get("match") == "subset":
+        return isinstance(value, dict) and all(value.get(k) == v for k, v in row["expected"].items())
+    return value == row["expected"]
+
+
+def call(predict, row):
+    started = time.perf_counter_ns()
+    try:
+        value, error = predict(row), None
+    except (ValueError, KeyError, IndexError) as exc:
+        value, error = None, f"{type(exc).__name__}: {exc}"
+    elapsed = (time.perf_counter_ns() - started) / 1e6
+    return value, error, elapsed
+
+
+def main():
+    parser = argparse.ArgumentParser(description=__doc__)
+    parser.add_argument("--model", required=True)
+    parser.add_argument("--threads", type=int, default=1, choices=(1, 4))
+    parser.add_argument("--repeats", type=int, default=500)
+    parser.add_argument("--warmup", type=int, default=20)
+    parser.add_argument("--quality", action="store_true")
+    parser.add_argument("--allow-nonpi", action="store_true", help="Development checks only, recorded as non-Pi")
+    parser.add_argument("--out", type=Path, required=True)
+    args = parser.parse_args()
+    assert args.repeats >= 20 and args.warmup >= 0
+    for name in ("OMP_NUM_THREADS", "OPENBLAS_NUM_THREADS", "MKL_NUM_THREADS", "BLIS_NUM_THREADS", "VECLIB_MAXIMUM_THREADS", "NUMEXPR_NUM_THREADS"):
+        os.environ[name] = str(args.threads)
+    os.environ["TOKENIZERS_PARALLELISM"] = "false"
+    os.environ["HF_HUB_OFFLINE"] = "1"
+    host = hardware()
+    is_pi = bool(host["raspberry_pi_model"] and "Raspberry Pi" in host["raspberry_pi_model"])
+    assert is_pi or args.allow_nonpi, "This run must execute on real Raspberry Pi hardware"
+    manifest = json.loads((HERE / "bundle_manifest.json").read_text())
+    spec = manifest["models"][args.model]
+    # Verify the full runtime and evaluation input before importing any model code.
+    for rel, entry in spec["files"].items():
+        assert digest(HERE / rel) == entry["sha256"], f"Frozen input differs: {rel}"
+    latency_cases = json.loads((HERE / "cases" / f"{args.model}_latency.json").read_text())
+    before = host_state()
+    memory_before = memory()
+    predict, params, mode, import_s, load_s = load_adapter(args.model, HERE / "projects" / args.model, args.threads)
+    memory_loaded = memory()
+    for i in range(args.warmup):
+        call(predict, latency_cases[i % len(latency_cases)])
+    samples = []
+    for i in range(args.repeats):
+        row = latency_cases[i % len(latency_cases)]
+        started_utc = datetime.now(timezone.utc).isoformat()
+        value, error, elapsed = call(predict, row)
+        samples.append({"case_id": row["id"], "elapsed_ms": elapsed,
+                        "started_utc": started_utc, "temperature_c": temperature(),
+                        "temperature_sampled_utc": datetime.now(timezone.utc).isoformat(),
+                        "correct": outcome(row, value, error), "output": value, "error": error})
+        if (i + 1) % 100 == 0:
+            print(f"{args.model} threads={args.threads}: latency {i + 1}/{args.repeats}", flush=True)
+    memory_after_latency, after_latency = memory(), host_state()
+    lat = summary([s["elapsed_ms"] for s in samples])
+    result = {"created_utc": datetime.now(timezone.utc).isoformat(), "model": args.model,
+              "is_raspberry_pi": is_pi, "hardware": host, "environment_before": before,
+              "environment_after_latency": after_latency,
+              "bundle_manifest_sha256": digest(HERE / "bundle_manifest.json"),
+              "benchmark_script_sha256": digest(Path(__file__)), "model_spec": spec,
+              "settings": {"threads_requested": args.threads, "batch_size": 1,
+                           "warmup_requests": args.warmup, "timed_requests": args.repeats,
+                           "unique_latency_cases": len(latency_cases), "mode": mode,
+                           "cpu_pinning": False, "power_mode_changed": False},
+              "parameters": params, "import_seconds": import_s, "load_seconds_after_import": load_s,
+              "latency_ms": lat, "serial_requests_per_second": 1000 / lat["mean"],
+              "timed_correct": sum(s["correct"] for s in samples),
+              "timed_errors": sum(s["error"] is not None for s in samples),
+              "memory_bytes": {"before_runtime_import": memory_before, "after_model_load": memory_loaded,
+                               "after_latency": memory_after_latency},
+              "latency_samples": samples,
+              "temperature_measurement": "Linux thermal-zone CPU temperature read immediately after every timed inference, outside the latency timer; start and temperature-read UTC timestamps are retained per call. Sensor reads add a small gap between requests. These samples do not establish power consumption or a long-duration thermal limit.",
+              "measurement_scope": "Warm local Python process, full text-to-structured-output call through the specified adapter, serial batch one. Timing excludes SSH, HTTP/UI, model loading, speech recognition, actuation and per-call correctness checks. Small repeated synthetic input set with warm OS/model caches; throughput is reciprocal mean, not concurrent serving. Other host services were left running. No power meter or sustained thermal test; cooling and power-supply model were not inspected."}
+    result["software"] = {"python": platform.python_version(), "sqlite": __import__("sqlite3").sqlite_version}
+    for package in ("torch", "transformers", "tokenizers", "safetensors", "numpy", "scipy", "scikit-learn", "joblib", "threadpoolctl", "psutil"):
+        try:
+            result["software"][package] = importlib.metadata.version(package)
+        except importlib.metadata.PackageNotFoundError:
+            pass
+    try:
+        from threadpoolctl import threadpool_info
+        result["thread_pools"] = [{k: v for k, v in p.items() if k != "filepath"} for p in threadpool_info()]
+    except ImportError:
+        result["thread_pools"] = []
+    if args.quality:
+        rows = json.loads((HERE / "cases" / f"{args.model}_quality.json").read_text())
+        predictions, groups = [], defaultdict(list)
+        for i, row in enumerate(rows):
+            value, error, elapsed = call(predict, row)
+            ok = outcome(row, value, error)
+            predictions.append({**row, "output": value, "error": error, "correct": ok, "elapsed_ms": elapsed,
+                                "temperature_c": temperature(), "temperature_sampled_utc": datetime.now(timezone.utc).isoformat()})
+            groups[row["category"]].append(ok)
+            if (i + 1) % 100 == 0:
+                print(f"{args.model}: quality {i + 1}/{len(rows)}", flush=True)
+        result["quality"] = {"cases": len(rows), "correct": sum(p["correct"] for p in predictions),
+                             "by_category": {k: {"n": len(v), "correct": sum(v)} for k, v in groups.items()},
+                             "provenance": spec["quality_provenance"], "predictions": predictions}
+        result["environment_after_quality"] = host_state()
+    args.out.parent.mkdir(parents=True, exist_ok=True)
+    temporary = args.out.with_suffix(".partial.json")
+    temporary.write_text(json.dumps(result, indent=2, ensure_ascii=False) + "\n", encoding="utf-8")
+    temporary.replace(args.out)
+    print(json.dumps({"model": args.model, "threads": args.threads, "latency_ms": lat,
+                      "rss_mib": memory_after_latency["rss"] / 1024**2,
+                      "timed_correct": result["timed_correct"], "result": str(args.out)}), flush=True)
+
+
+if __name__ == "__main__":
+    main()

edge_benchmarks/rpi5-2026-09-26/bundle_manifest.json

@@ -0,0 +1,229 @@
+{
+  "models": {
+    "poc2": {
+      "workspace_project": "POC-2-claude/home-command-ai",
+      "weight_sha256": "fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b",
+      "weight_bytes": 2146783,
+      "files": {
+        "projects/poc2/engine.py": {
+          "bytes": 3775,
+          "sha256": "bbc051221dae5c7238e7a76dae4872584c03f3db366a78980f0ea0cf5caaa18e",
+          "workspace_source": "POC-2-claude/home-command-ai/engine.py"
+        },
+        "projects/poc2/model/devices-catalog.json": {
+          "bytes": 136537,
+          "sha256": "473e5850e6f9d05abf4a7806121bb42464f760fed2de589fa58accebeef72af4",
+          "workspace_source": "POC-2-claude/home-command-ai/model/devices-catalog.json"
+        },
+        "projects/poc2/model/metrics_v3.json": {
+          "bytes": 2587,
+          "sha256": "884ba39090267af42bd6b4d4092ef3905b2674aa1f6f540b7e77e731d951ce8b",
+          "workspace_source": "POC-2-claude/home-command-ai/model/metrics_v3.json"
+        },
+        "projects/poc2/model/model_v3_config.json": {
+          "bytes": 520,
+          "sha256": "11b221bcf0e5b8c512ead8df19b9d4db6ee5fa2182efd6f66a9c1729eabad004",
+          "workspace_source": "POC-2-claude/home-command-ai/model/model_v3_config.json"
+        },
+        "projects/poc2/model/model_v3_fp16.npz": {
+          "bytes": 2146783,
+          "sha256": "fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b",
+          "workspace_source": "POC-2-claude/home-command-ai/model/model_v3_fp16.npz"
+        },
+        "cases/poc2_quality.json": {
+          "bytes": 76322,
+          "sha256": "e61640a601ca3e354a74be3dcb6506ba24171a343c290b96fa53f7deee899232"
+        },
+        "cases/poc2_latency.json": {
+          "bytes": 3852,
+          "sha256": "77930a99ff035b3774bf65b261a302b7a5bff7608c5a4ae99241847164be2cff"
+        }
+      },
+      "quality_provenance": {
+        "kind": "training-set diagnostic, NOT held-out accuracy",
+        "source": "POC-2-claude\\home-command-ai\\data\\train_mix.jsonl.xz",
+        "sha256": "c8851122dc01787e9674532c5cfb1cf7260212c52c9800e37622b28167bb9838",
+        "sampling": "stratified reservoir, 100 plain + 100 conditional; seed 20260926",
+        "source_counts": {
+          "plain": 140000,
+          "conditional": 200000
+        },
+        "notes": "Historical 1500-row evaluation file is absent locally and from the published dataset. This diagnostic does not reproduce or replace the historical 96.73% result. The shipped prep_mix.py has different training-count settings from the published 340000-row snapshot."
+      },
+      "hf": {
+        "model": "sraivante/superfast-tiny-home-robotics-json-1m-v3",
+        "dataset": "sraivante/home-commands-json-v3",
+        "local_weight": "POC-2-claude/home-command-ai/model/model_v3_fp16.npz",
+        "weight_name": "model_v3_fp16.npz",
+        "repositories": {
+          "model": {
+            "repo_id": "sraivante/superfast-tiny-home-robotics-json-1m-v3",
+            "commit": "2b2e71d37ea9fa0fe6ab247b6a74e8db774fb6f2",
+            "files": [
+              {
+                "path": ".gitattributes",
+                "bytes": 1519,
+                "sha256": null
+              },
+              {
+                "path": "Dockerfile",
+                "bytes": 441,
+                "sha256": null
+              },
+              {
+                "path": "LICENSE",
+                "bytes": 11358,
+                "sha256": null
+              },
+              {
+                "path": "README.md",
+                "bytes": 11417,
+                "sha256": null
+              },
+              {
+                "path": "docker-compose.yml",
+                "bytes": 329,
+                "sha256": null
+              },
+              {
+                "path": "engine.py",
+                "bytes": 3775,
+                "sha256": null
+              },
+              {
+                "path": "examples/hcai_client.py",
+                "bytes": 3249,
+                "sha256": null
+              },
+              {
+                "path": "examples/home_assistant.py",
+                "bytes": 3442,
+                "sha256": null
+              },
+              {
+                "path": "examples/mqtt_bridge.py",
+                "bytes": 1459,
+                "sha256": null
+              },
+              {
+                "path": "examples/quickstart.py",
+                "bytes": 937,
+                "sha256": null
+              },
+              {
+                "path": "examples/rule_engine.py",
+                "bytes": 2832,
+                "sha256": null
+              },
+              {
+                "path": "model/devices-catalog.json",
+                "bytes": 136537,
+                "sha256": null
+              },
+              {
+                "path": "model/metrics_v3.json",
+                "bytes": 2587,
+                "sha256": null
+              },
+              {
+                "path": "model/model_v3_config.json",
+                "bytes": 520,
+                "sha256": null
+              },
+              {
+                "path": "model/model_v3_fp16.npz",
+                "bytes": 2146783,
+                "sha256": "fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b"
+              },
+              {
+                "path": "requirements.txt",
+                "bytes": 23,
+                "sha256": null
+              },
+              {
+                "path": "server.py",
+                "bytes": 3786,
+                "sha256": null
+              },
+              {
+                "path": "static/index.html",
+                "bytes": 9594,
+                "sha256": null
+              },
+              {
+                "path": "training/train_v3.py",
+                "bytes": 11519,
+                "sha256": null
+              }
+            ]
+          },
+          "dataset": {
+            "repo_id": "sraivante/home-commands-json-v3",
+            "commit": "da10aca352a34cb2834a049867f6f2e9fcc30e3e",
+            "files": [
+              {
+                "path": ".gitattributes",
+                "bytes": 2504,
+                "sha256": null
+              },
+              {
+                "path": "LICENSE",
+                "bytes": 11358,
+                "sha256": null
+              },
+              {
+                "path": "README.md",
+                "bytes": 5926,
+                "sha256": null
+              },
+              {
+                "path": "data/conditional_source.jsonl.gz",
+                "bytes": 6279490,
+                "sha256": "d5b6739202a0caa73b8a12452387651fa844566d47565e3876c5a3ce7ad6193e"
+              },
+              {
+                "path": "data/train.jsonl.gz",
+                "bytes": 13302264,
+                "sha256": "d8afeacfed666784b446cef68f1e8aeb12d9ebbe4032424dec2c0db9f664e79b"
+              },
+              {
+                "path": "generators/generate_dataset_v2.py",
+                "bytes": 29188,
+                "sha256": null
+              },
+              {
+                "path": "generators/generate_dataset_v3_conditional.py",
+                "bytes": 10612,
+                "sha256": null
+              },
+              {
+                "path": "generators/prep_mix.py",
+                "bytes": 1278,
+                "sha256": null
+              },
+              {
+                "path": "metadata/devices-catalog.json",
+                "bytes": 136537,
+                "sha256": null
+              },
+              {
+                "path": "source/dataset_v3_conditional.jsonl.xz",
+                "bytes": 4245312,
+                "sha256": "f5b997f808688c535cf0abd195390a8ba20deb6cfe3a4b8b2262624242552b86"
+              },
+              {
+                "path": "source/train_mix.jsonl.xz",
+                "bytes": 4951908,
+                "sha256": "c8851122dc01787e9674532c5cfb1cf7260212c52c9800e37622b28167bb9838"
+              }
+            ]
+          }
+        },
+        "remote_weight_path": "model/model_v3_fp16.npz",
+        "verified_weight_sha256": "fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b"
+      },
+      "publication": "existing model and dataset repositories"
+    }
+  },
+  "scope": "Per-model reproduction projection; the original run manifest hash is preserved in raw results."
+}

edge_benchmarks/rpi5-2026-09-26/cases/poc2_latency.json

@@ -0,0 +1,147 @@
+[
+  {
+    "id": "poc2-0000",
+    "text": "quickly open drawing room windows quickly",
+    "expected": {
+      "activity": "access",
+      "subject": "drawing_room_window",
+      "action": "OPEN"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 82695
+  },
+  {
+    "id": "poc2-0001",
+    "text": "SWITCH ON THE FIRST FLOOR KITCHEN TUBE LIGHT RIGHT NOW PLEASE!",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_kitchen_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 132876
+  },
+  {
+    "id": "poc2-0002",
+    "text": "start dining room switch!",
+    "expected": {
+      "activity": "power",
+      "subject": "dining_room_smart_switch",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 242353
+  },
+  {
+    "id": "poc2-0003",
+    "text": "Hey, the exhaust in the washroom status?",
+    "expected": {
+      "activity": "air",
+      "subject": "washroom_exhaust_fan",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 27043
+  },
+  {
+    "id": "poc2-0004",
+    "text": "hi, power off the second floor balcony light please.",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_balcony_light",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 160596
+  },
+  {
+    "id": "poc2-0100",
+    "text": "run the ceiling fan in the helper's room on max when room temperature goes over 37",
+    "expected": {
+      "activity": "air",
+      "subject": "servant_room_ceiling_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 37
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 172928
+  },
+  {
+    "id": "poc2-0101",
+    "text": "POWER OFF THE FIRST FLOOR GUEST ROOM CEILING FAN WHEN ROOM TEMPERATURE IS LESS THAN 37.",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_guest_room_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 37
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 322745
+  },
+  {
+    "id": "poc2-0102",
+    "text": "yaar roz savere 8:30 baje master bedroom wala cooler start karo.",
+    "expected": {
+      "activity": "cooling",
+      "subject": "master_bedroom_cooler",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "08:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 104438
+  },
+  {
+    "id": "poc2-0103",
+    "text": "yaar temp 35 se kam ho to first floor kitchen ka ceiling fan rok do!",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_kitchen_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 35
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 266202
+  },
+  {
+    "id": "poc2-0104",
+    "text": "suno ground floor kitchen ki tube light off karo savere 10 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_kitchen_tube_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "10:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 128504
+  }
+]

edge_benchmarks/rpi5-2026-09-26/cases/poc2_quality.json

@@ -0,0 +1,2902 @@
+[
+  {
+    "id": "poc2-0000",
+    "text": "quickly open drawing room windows quickly",
+    "expected": {
+      "activity": "access",
+      "subject": "drawing_room_window",
+      "action": "OPEN"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 82695
+  },
+  {
+    "id": "poc2-0001",
+    "text": "SWITCH ON THE FIRST FLOOR KITCHEN TUBE LIGHT RIGHT NOW PLEASE!",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_kitchen_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 132876
+  },
+  {
+    "id": "poc2-0002",
+    "text": "start dining room switch!",
+    "expected": {
+      "activity": "power",
+      "subject": "dining_room_smart_switch",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 242353
+  },
+  {
+    "id": "poc2-0003",
+    "text": "Hey, the exhaust in the washroom status?",
+    "expected": {
+      "activity": "air",
+      "subject": "washroom_exhaust_fan",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 27043
+  },
+  {
+    "id": "poc2-0004",
+    "text": "hi, power off the second floor balcony light please.",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_balcony_light",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 160596
+  },
+  {
+    "id": "poc2-0005",
+    "text": "please corridor wali tube light chalu karo please",
+    "expected": {
+      "activity": "light",
+      "subject": "corridor_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 338212
+  },
+  {
+    "id": "poc2-0006",
+    "text": "yaar mummy papa ke kamre ka speaker band hai kya?",
+    "expected": {
+      "activity": "music",
+      "subject": "parents_room_speaker",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 12413
+  },
+  {
+    "id": "poc2-0007",
+    "text": "bhai pooja ghar wala socket chala do fatafat na!",
+    "expected": {
+      "activity": "power",
+      "subject": "pooja_room_socket",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 71659
+  },
+  {
+    "id": "poc2-0008",
+    "text": "could you please stop the first floor store room tube light now please!",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_store_room_tube_light",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 201839
+  },
+  {
+    "id": "poc2-0009",
+    "text": "Ek kaam karo, first floor lobby wala ceiling fan off kar do abhi",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_lobby_ceiling_fan",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 96564
+  },
+  {
+    "id": "poc2-0010",
+    "text": "hi, power on living room humidifier for me",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "living_room_humidifier",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 131870
+  },
+  {
+    "id": "poc2-0011",
+    "text": "can you turn the fan in the first floor guest room to low asap please",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_guest_room_ceiling_fan",
+      "action": "LOW"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 116821
+  },
+  {
+    "id": "poc2-0012",
+    "text": "zara balcony wala smart bulb on karo turant please!",
+    "expected": {
+      "activity": "light",
+      "subject": "balcony_smart_bulb",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 264094
+  },
+  {
+    "id": "poc2-0013",
+    "text": "Quickly check second floor bedroom air conditioner",
+    "expected": {
+      "activity": "cooling",
+      "subject": "second_floor_bedroom_ac",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 318314
+  },
+  {
+    "id": "poc2-0014",
+    "text": "sun, hall wala blower band kardo please!",
+    "expected": {
+      "activity": "heating",
+      "subject": "hall_blower",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 54294
+  },
+  {
+    "id": "poc2-0015",
+    "text": "acha first floor study room ka plug ka status batao?",
+    "expected": {
+      "activity": "power",
+      "subject": "first_floor_study_room_smart_plug",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 187127
+  },
+  {
+    "id": "poc2-0016",
+    "text": "Sun, living room wali wall light off kar do turant na.",
+    "expected": {
+      "activity": "light",
+      "subject": "living_room_wall_light",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 87051
+  },
+  {
+    "id": "poc2-0017",
+    "text": "Listen, shut off lobby ceiling fan right now!",
+    "expected": {
+      "activity": "air",
+      "subject": "lobby_ceiling_fan",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 70056
+  },
+  {
+    "id": "poc2-0018",
+    "text": "GO AHEAD AND SHUT OFF THE AROMA DIFFUSER IN THE HALL RIGHT AWAY",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "hall_diffuser",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 168698
+  },
+  {
+    "id": "poc2-0019",
+    "text": "kindly put on basement tube light for me please.",
+    "expected": {
+      "activity": "light",
+      "subject": "basement_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 63250
+  },
+  {
+    "id": "poc2-0020",
+    "text": "Listen, shut down the hall sound bar quickly",
+    "expected": {
+      "activity": "music",
+      "subject": "hall_soundbar",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 138461
+  },
+  {
+    "id": "poc2-0021",
+    "text": "Set the first floor children's room air conditioner to slow now please!",
+    "expected": {
+      "activity": "cooling",
+      "subject": "first_floor_kids_room_ac",
+      "action": "LOW"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 90265
+  },
+  {
+    "id": "poc2-0022",
+    "text": "Acha kya baramde ka cooler chal raha hai?",
+    "expected": {
+      "activity": "cooling",
+      "subject": "veranda_cooler",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 157939
+  },
+  {
+    "id": "poc2-0023",
+    "text": "EK KAAM KARO, MUMMY PAPA KE KAMRE WALA SMART BULB CHALA DO FATAFAT NA!",
+    "expected": {
+      "activity": "light",
+      "subject": "parents_room_smart_bulb",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 244138
+  },
+  {
+    "id": "poc2-0024",
+    "text": "ARRE LIVING ROOM WALA TABLE FAN CHALU KARO YAAR NA",
+    "expected": {
+      "activity": "air",
+      "subject": "living_room_table_fan",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 275747
+  },
+  {
+    "id": "poc2-0025",
+    "text": "bhai drawing room wali window close kar do zara",
+    "expected": {
+      "activity": "access",
+      "subject": "drawing_room_window",
+      "action": "CLOSE"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 214734
+  },
+  {
+    "id": "poc2-0026",
+    "text": "hey set the pedestal fan in the parents' room to slow immediately please.",
+    "expected": {
+      "activity": "air",
+      "subject": "parents_room_pedestal_fan",
+      "action": "LOW"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 27902
+  },
+  {
+    "id": "poc2-0027",
+    "text": "jara living room ka speaker full mode pe daal do",
+    "expected": {
+      "activity": "music",
+      "subject": "living_room_speaker",
+      "action": "HIGH"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 299173
+  },
+  {
+    "id": "poc2-0028",
+    "text": "ground floor lobby wali tube light chala do abhi na.",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_lobby_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 15448
+  },
+  {
+    "id": "poc2-0029",
+    "text": "Are borewell bandh kar do zara!",
+    "expected": {
+      "activity": "water",
+      "subject": "borewell_pump",
+      "action": "STOP"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 218617
+  },
+  {
+    "id": "poc2-0030",
+    "text": "tell me is the speaker in the study on",
+    "expected": {
+      "activity": "music",
+      "subject": "study_room_speaker",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 159774
+  },
+  {
+    "id": "poc2-0031",
+    "text": "Can you turn off the ceiling fan in the children's room right away!",
+    "expected": {
+      "activity": "air",
+      "subject": "kids_room_ceiling_fan",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 116230
+  },
+  {
+    "id": "poc2-0032",
+    "text": "Second floor store room wali tube light start karo turant!",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_store_room_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 318502
+  },
+  {
+    "id": "poc2-0033",
+    "text": "Yaar office room wala bulb start kar do turant na!",
+    "expected": {
+      "activity": "light",
+      "subject": "home_office_bulb",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 119866
+  },
+  {
+    "id": "poc2-0034",
+    "text": "hi, power on the servant room water heater immediately",
+    "expected": {
+      "activity": "heating",
+      "subject": "servant_room_geyser",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 6325
+  },
+  {
+    "id": "poc2-0035",
+    "text": "CAN YOU SECOND FLOOR KITCHEN WINDOWS STATUS",
+    "expected": {
+      "activity": "access",
+      "subject": "second_floor_kitchen_window",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 276690
+  },
+  {
+    "id": "poc2-0036",
+    "text": "listen, turn off pantry power socket right now!",
+    "expected": {
+      "activity": "power",
+      "subject": "pantry_socket",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 90822
+  },
+  {
+    "id": "poc2-0037",
+    "text": "Could you run the purifier in the home office at medium speed immediately please!",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "home_office_air_purifier",
+      "action": "MEDIUM"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 284863
+  },
+  {
+    "id": "poc2-0038",
+    "text": "SECOND FLOOR KIDS ROOM KA CEILING FAN SHURU KARO PLEASE!",
+    "expected": {
+      "activity": "air",
+      "subject": "second_floor_kids_room_ceiling_fan",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 165290
+  },
+  {
+    "id": "poc2-0039",
+    "text": "ek kaam karo, second floor hall ka ac ko medium pe rakho fatafat na",
+    "expected": {
+      "activity": "cooling",
+      "subject": "second_floor_hall_ac",
+      "action": "MEDIUM"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 118219
+  },
+  {
+    "id": "poc2-0040",
+    "text": "Jara master bedroom ka smart bulb chalu kar do turant please!",
+    "expected": {
+      "activity": "light",
+      "subject": "master_bedroom_smart_bulb",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 52755
+  },
+  {
+    "id": "poc2-0041",
+    "text": "can you please put the bedroom dehumidifier on low now please!",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "bedroom_dehumidifier",
+      "action": "LOW"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 262549
+  },
+  {
+    "id": "poc2-0042",
+    "text": "Could you stop bedroom air purifier right now",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "bedroom_air_purifier",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 254346
+  },
+  {
+    "id": "poc2-0043",
+    "text": "bhai aangan wala fountain start karo abhi please!",
+    "expected": {
+      "activity": "garden",
+      "subject": "courtyard_fountain",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 36308
+  },
+  {
+    "id": "poc2-0044",
+    "text": "please close first floor balcony curtain right now",
+    "expected": {
+      "activity": "access",
+      "subject": "first_floor_balcony_curtains",
+      "action": "CLOSE"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 121956
+  },
+  {
+    "id": "poc2-0045",
+    "text": "can you what's the status of the power socket in the first floor kids room?",
+    "expected": {
+      "activity": "power",
+      "subject": "first_floor_kids_room_socket",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 203594
+  },
+  {
+    "id": "poc2-0046",
+    "text": "please master bedroom ka curtains open kar do",
+    "expected": {
+      "activity": "access",
+      "subject": "master_bedroom_curtains",
+      "action": "OPEN"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 202426
+  },
+  {
+    "id": "poc2-0047",
+    "text": "Kindly start the cctv camera in the stairs please!",
+    "expected": {
+      "activity": "security",
+      "subject": "staircase_camera",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 250657
+  },
+  {
+    "id": "poc2-0048",
+    "text": "Suno bathroom wala smart bulb band karo fatafat na!",
+    "expected": {
+      "activity": "light",
+      "subject": "bathroom_smart_bulb",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 80993
+  },
+  {
+    "id": "poc2-0049",
+    "text": "bhaiya second floor study room ka socket start karo yaar",
+    "expected": {
+      "activity": "power",
+      "subject": "second_floor_study_room_socket",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 113767
+  },
+  {
+    "id": "poc2-0050",
+    "text": "COULD YOU PLEASE SHUT OFF THE LIVING ROOM SOUNDBAR RIGHT AWAY!",
+    "expected": {
+      "activity": "music",
+      "subject": "living_room_soundbar",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 193126
+  },
+  {
+    "id": "poc2-0051",
+    "text": "can you start the camera in the roof now please",
+    "expected": {
+      "activity": "security",
+      "subject": "roof_camera",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 229583
+  },
+  {
+    "id": "poc2-0052",
+    "text": "Would you switch on the printer quickly!",
+    "expected": {
+      "activity": "office",
+      "subject": "printer",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 20988
+  },
+  {
+    "id": "poc2-0053",
+    "text": "Plug number 1 chalao turant please!",
+    "expected": {
+      "activity": "power",
+      "subject": "smart_plug_1",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 319663
+  },
+  {
+    "id": "poc2-0054",
+    "text": "hey slide open the first floor kitchen window right now!",
+    "expected": {
+      "activity": "access",
+      "subject": "first_floor_kitchen_window",
+      "action": "OPEN"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 140862
+  },
+  {
+    "id": "poc2-0055",
+    "text": "hey run parents room air conditioner on high now please.",
+    "expected": {
+      "activity": "cooling",
+      "subject": "parents_room_ac",
+      "action": "HIGH"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 231629
+  },
+  {
+    "id": "poc2-0056",
+    "text": "Zara first floor study room wala switch on hai kya",
+    "expected": {
+      "activity": "power",
+      "subject": "first_floor_study_room_smart_switch",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 25845
+  },
+  {
+    "id": "poc2-0057",
+    "text": "hey switch off ground floor bedroom light for me!",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_bedroom_light",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 224303
+  },
+  {
+    "id": "poc2-0058",
+    "text": "please ground floor lobby ka CCTV shuru kar do yaar na.",
+    "expected": {
+      "activity": "security",
+      "subject": "ground_floor_lobby_camera",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 160516
+  },
+  {
+    "id": "poc2-0059",
+    "text": "ACHA COURTYARD KA BULB BANDH KAR DO FATAFAT PLEASE",
+    "expected": {
+      "activity": "light",
+      "subject": "courtyard_bulb",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 309166
+  },
+  {
+    "id": "poc2-0060",
+    "text": "just check is the garden water sprinkler running",
+    "expected": {
+      "activity": "garden",
+      "subject": "garden_sprinkler",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 130828
+  },
+  {
+    "id": "poc2-0061",
+    "text": "Boss ground floor washroom wali batti band kardo abhi please!",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_washroom_light",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 245314
+  },
+  {
+    "id": "poc2-0062",
+    "text": "COULD YOU SET FIRST FLOOR KITCHEN FAN TO LOW SPEED QUICKLY.",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_kitchen_ceiling_fan",
+      "action": "LOW"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 145385
+  },
+  {
+    "id": "poc2-0063",
+    "text": "Hey, put on the camera 8 quickly!",
+    "expected": {
+      "activity": "security",
+      "subject": "camera_8",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 114642
+  },
+  {
+    "id": "poc2-0064",
+    "text": "could you please run the lobby fan on max asap",
+    "expected": {
+      "activity": "air",
+      "subject": "lobby_ceiling_fan",
+      "action": "HIGH"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 310560
+  },
+  {
+    "id": "poc2-0065",
+    "text": "Please dining room ki tv chalao fatafat please.",
+    "expected": {
+      "activity": "entertainment",
+      "subject": "dining_room_tv",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 218850
+  },
+  {
+    "id": "poc2-0066",
+    "text": "could you switch on bedroom light quickly please.",
+    "expected": {
+      "activity": "light",
+      "subject": "bedroom_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 294477
+  },
+  {
+    "id": "poc2-0067",
+    "text": "could you please turn on the rice cooker for me please!",
+    "expected": {
+      "activity": "kitchen",
+      "subject": "rice_cooker",
+      "action": "START"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 236296
+  },
+  {
+    "id": "poc2-0068",
+    "text": "quickly start second floor bedroom power socket immediately please",
+    "expected": {
+      "activity": "power",
+      "subject": "second_floor_bedroom_socket",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 134805
+  },
+  {
+    "id": "poc2-0069",
+    "text": "would you turn off the bulb in the second floor lobby for me please.",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_lobby_bulb",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 163037
+  },
+  {
+    "id": "poc2-0070",
+    "text": "please second floor corridor wala bulb bandh kar do fatafat",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_corridor_bulb",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 213537
+  },
+  {
+    "id": "poc2-0071",
+    "text": "jara bedroom ka speaker band kar do jaldi please",
+    "expected": {
+      "activity": "music",
+      "subject": "bedroom_speaker",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 81674
+  },
+  {
+    "id": "poc2-0072",
+    "text": "Is office room range extender running",
+    "expected": {
+      "activity": "network",
+      "subject": "home_office_wifi_extender",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 101767
+  },
+  {
+    "id": "poc2-0073",
+    "text": "could you set the master bedroom dehumidifier to max please.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "master_bedroom_dehumidifier",
+      "action": "HIGH"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 296645
+  },
+  {
+    "id": "poc2-0074",
+    "text": "Please hall wala smart plug band kardo yaar!",
+    "expected": {
+      "activity": "power",
+      "subject": "hall_smart_plug",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 143453
+  },
+  {
+    "id": "poc2-0075",
+    "text": "arre master bedroom wali machhar wali machine bandh kar do abhi na.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "master_bedroom_mosquito_machine",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 89607
+  },
+  {
+    "id": "poc2-0076",
+    "text": "Would you shut off the smart plug 7 right away please",
+    "expected": {
+      "activity": "power",
+      "subject": "smart_plug_7",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 82662
+  },
+  {
+    "id": "poc2-0077",
+    "text": "WOULD YOU START LIVING ROOM HUMIDIFIER RIGHT NOW!",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "living_room_humidifier",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 309872
+  },
+  {
+    "id": "poc2-0078",
+    "text": "YAAR GUEST ROOM WALA SPEAKER ON KAR DO FATAFAT.",
+    "expected": {
+      "activity": "music",
+      "subject": "guest_room_speaker",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 139923
+  },
+  {
+    "id": "poc2-0079",
+    "text": "just check the lobby light status?",
+    "expected": {
+      "activity": "light",
+      "subject": "lobby_light",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 316062
+  },
+  {
+    "id": "poc2-0080",
+    "text": "Hey run the cupboard light in the master bedroom asap",
+    "expected": {
+      "activity": "light",
+      "subject": "master_bedroom_cabinet_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 132607
+  },
+  {
+    "id": "poc2-0081",
+    "text": "power on the air conditioner in the office room for me",
+    "expected": {
+      "activity": "cooling",
+      "subject": "home_office_ac",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 236821
+  },
+  {
+    "id": "poc2-0082",
+    "text": "hey, shut down the air purifier in the kids room asap please!",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "kids_room_air_purifier",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 136530
+  },
+  {
+    "id": "poc2-0083",
+    "text": "COURTYARD KA CAMERA ROK DO YAAR PLEASE",
+    "expected": {
+      "activity": "security",
+      "subject": "courtyard_camera",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 260005
+  },
+  {
+    "id": "poc2-0084",
+    "text": "hey, switch off the led strip in the dining room right away please.",
+    "expected": {
+      "activity": "light",
+      "subject": "dining_room_led_strip",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 286393
+  },
+  {
+    "id": "poc2-0085",
+    "text": "Switch on the tube light in the second floor guest room asap.",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_guest_room_tube_light",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 267039
+  },
+  {
+    "id": "poc2-0086",
+    "text": "Study room ka switch laga do jaldi.",
+    "expected": {
+      "activity": "power",
+      "subject": "study_room_smart_switch",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 128979
+  },
+  {
+    "id": "poc2-0087",
+    "text": "would you power on the spot light in the veranda immediately",
+    "expected": {
+      "activity": "light",
+      "subject": "veranda_spotlight",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 266723
+  },
+  {
+    "id": "poc2-0088",
+    "text": "WOULD YOU SWITCH OFF GROUND FLOOR HALL CEILING FAN FOR ME.",
+    "expected": {
+      "activity": "air",
+      "subject": "ground_floor_hall_ceiling_fan",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 227590
+  },
+  {
+    "id": "poc2-0089",
+    "text": "boss pull open the curtains in the guest room now",
+    "expected": {
+      "activity": "access",
+      "subject": "guest_room_curtains",
+      "action": "OPEN"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 107485
+  },
+  {
+    "id": "poc2-0090",
+    "text": "could you switch on the bathroom exhaust fan immediately please.",
+    "expected": {
+      "activity": "air",
+      "subject": "bathroom_exhaust_fan",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 208947
+  },
+  {
+    "id": "poc2-0091",
+    "text": "Go ahead and put on first floor washroom socket immediately.",
+    "expected": {
+      "activity": "power",
+      "subject": "first_floor_washroom_socket",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 280596
+  },
+  {
+    "id": "poc2-0092",
+    "text": "yaar backyard wali drip irrigation off karo turant.",
+    "expected": {
+      "activity": "garden",
+      "subject": "backyard_drip_irrigation",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 41290
+  },
+  {
+    "id": "poc2-0093",
+    "text": "hey run the switch in the ground floor bedroom asap please!",
+    "expected": {
+      "activity": "power",
+      "subject": "ground_floor_bedroom_smart_switch",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 234919
+  },
+  {
+    "id": "poc2-0094",
+    "text": "Bhai aangan wala smart plug band hai kya?",
+    "expected": {
+      "activity": "power",
+      "subject": "courtyard_smart_plug",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 89094
+  },
+  {
+    "id": "poc2-0095",
+    "text": "hey, is the tower fan in the hall running?",
+    "expected": {
+      "activity": "air",
+      "subject": "hall_tower_fan",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 133485
+  },
+  {
+    "id": "poc2-0096",
+    "text": "Hey put on the pedestal fan in the living room quickly",
+    "expected": {
+      "activity": "air",
+      "subject": "living_room_pedestal_fan",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 184768
+  },
+  {
+    "id": "poc2-0097",
+    "text": "ek kaam karo, pooja room ka purifier bandh kar do!",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "pooja_room_air_purifier",
+      "action": "OFF"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 38327
+  },
+  {
+    "id": "poc2-0098",
+    "text": "Boss put on parents room night lamp.",
+    "expected": {
+      "activity": "light",
+      "subject": "parents_room_night_lamp",
+      "action": "ON"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 224847
+  },
+  {
+    "id": "poc2-0099",
+    "text": "bhai ground floor balcony ki tube light ka status batao?",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_balcony_tube_light",
+      "action": "STATUS"
+    },
+    "match": "exact",
+    "category": "training_plain",
+    "source_row_zero_based": 330450
+  },
+  {
+    "id": "poc2-0100",
+    "text": "run the ceiling fan in the helper's room on max when room temperature goes over 37",
+    "expected": {
+      "activity": "air",
+      "subject": "servant_room_ceiling_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 37
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 172928
+  },
+  {
+    "id": "poc2-0101",
+    "text": "POWER OFF THE FIRST FLOOR GUEST ROOM CEILING FAN WHEN ROOM TEMPERATURE IS LESS THAN 37.",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_guest_room_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 37
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 322745
+  },
+  {
+    "id": "poc2-0102",
+    "text": "yaar roz savere 8:30 baje master bedroom wala cooler start karo.",
+    "expected": {
+      "activity": "cooling",
+      "subject": "master_bedroom_cooler",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "08:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 104438
+  },
+  {
+    "id": "poc2-0103",
+    "text": "yaar temp 35 se kam ho to first floor kitchen ka ceiling fan rok do!",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_kitchen_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 35
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 266202
+  },
+  {
+    "id": "poc2-0104",
+    "text": "suno ground floor kitchen ki tube light off karo savere 10 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_kitchen_tube_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "10:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 128504
+  },
+  {
+    "id": "poc2-0105",
+    "text": "bathroom ki batti off karo roz dopahar ko 1 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "bathroom_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "13:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 82666
+  },
+  {
+    "id": "poc2-0106",
+    "text": "yaar zone 6 ka sprinkler chalao savere 5 baje",
+    "expected": {
+      "activity": "garden",
+      "subject": "sprinkler_zone_6",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "05:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 21380
+  },
+  {
+    "id": "poc2-0107",
+    "text": "every day at 1 pm switch off bedroom mirror light!",
+    "expected": {
+      "activity": "light",
+      "subject": "bedroom_mirror_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "13:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 219654
+  },
+  {
+    "id": "poc2-0108",
+    "text": "yaar roof ka smart bulb off karo har roz raat ko 9 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "roof_smart_bulb",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "21:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 111680
+  },
+  {
+    "id": "poc2-0109",
+    "text": "Suno roz subah 6 baje hall ka air purifier off kar do.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "hall_air_purifier",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "06:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 81840
+  },
+  {
+    "id": "poc2-0110",
+    "text": "yaar savere 9 baje first floor balcony wala parde khol do!",
+    "expected": {
+      "activity": "access",
+      "subject": "first_floor_balcony_curtains",
+      "action": "OPEN",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "09:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 26360
+  },
+  {
+    "id": "poc2-0111",
+    "text": "shut down the air conditioner in the ground floor bedroom when room temperature gets under 29!",
+    "expected": {
+      "activity": "cooling",
+      "subject": "ground_floor_bedroom_ac",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 29
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 322325
+  },
+  {
+    "id": "poc2-0112",
+    "text": "acha store room wali cabinet light chalu karo har roz subah 5 baje.",
+    "expected": {
+      "activity": "light",
+      "subject": "store_room_cabinet_light",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "05:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 151114
+  },
+  {
+    "id": "poc2-0113",
+    "text": "at 11:30 am run drawing room wall fan!",
+    "expected": {
+      "activity": "air",
+      "subject": "drawing_room_wall_fan",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "11:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 161810
+  },
+  {
+    "id": "poc2-0114",
+    "text": "at 4:30 pm sharp run the ceiling fan in the kids room.",
+    "expected": {
+      "activity": "air",
+      "subject": "kids_room_ceiling_fan",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "16:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 144159
+  },
+  {
+    "id": "poc2-0115",
+    "text": "bhai jab humidity 40 se niche chala jaye tab guest room ka dehumidifier slow pe karo",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "guest_room_dehumidifier",
+      "action": "LOW",
+      "when": {
+        "metric": "humidity",
+        "op": "<",
+        "value": 40
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 30875
+  },
+  {
+    "id": "poc2-0116",
+    "text": "bhai first floor balcony wala bulb on karo subah 11 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_balcony_bulb",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "11:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 290671
+  },
+  {
+    "id": "poc2-0117",
+    "text": "acha roz dopahar 2 baje second floor study room wali light off kar do.",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_study_room_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "14:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 8389
+  },
+  {
+    "id": "poc2-0118",
+    "text": "at 12:30 pm run the store room cabinet light",
+    "expected": {
+      "activity": "light",
+      "subject": "store_room_cabinet_light",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "12:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 69859
+  },
+  {
+    "id": "poc2-0119",
+    "text": "yaar car charger band karo agar battery 70 cross kare.",
+    "expected": {
+      "activity": "power",
+      "subject": "ev_charger",
+      "action": "OFF",
+      "when": {
+        "metric": "battery",
+        "op": ">",
+        "value": 70
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 191073
+  },
+  {
+    "id": "poc2-0120",
+    "text": "please run the water heater in the ground floor washroom whenever temperature falls below 17",
+    "expected": {
+      "activity": "heating",
+      "subject": "ground_floor_washroom_geyser",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 17
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 299999
+  },
+  {
+    "id": "poc2-0121",
+    "text": "please mitti ki nami 10 se niche chala jaye to entrance wala fountain start kar do",
+    "expected": {
+      "activity": "garden",
+      "subject": "entrance_fountain",
+      "action": "ON",
+      "when": {
+        "metric": "soil_moisture",
+        "op": "<",
+        "value": 10
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 242917
+  },
+  {
+    "id": "poc2-0122",
+    "text": "PLEASE BARAMDE KA FAN KI SPEED TEZ KARO AGAR ROOM KA TEMPERATURE 38 CROSS KARE",
+    "expected": {
+      "activity": "air",
+      "subject": "veranda_ceiling_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 38
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 482
+  },
+  {
+    "id": "poc2-0123",
+    "text": "acha har roz shaam 5 baje drawing room ki ceiling light laga do",
+    "expected": {
+      "activity": "light",
+      "subject": "drawing_room_ceiling_light",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "17:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 231627
+  },
+  {
+    "id": "poc2-0124",
+    "text": "Yaar veranda wali spotlight rok do roz savere 8:30 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "veranda_spotlight",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "08:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 206922
+  },
+  {
+    "id": "poc2-0125",
+    "text": "Switch off lobby tube light daily at 1:30 pm.",
+    "expected": {
+      "activity": "light",
+      "subject": "lobby_tube_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "13:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 187000
+  },
+  {
+    "id": "poc2-0126",
+    "text": "BHAI TANKI KA PUMP LAGA DO JAB TANKI KA LEVEL 55 SE NICHE CHALA JAYE",
+    "expected": {
+      "activity": "water",
+      "subject": "water_motor",
+      "action": "ON",
+      "when": {
+        "metric": "water_level",
+        "op": "<",
+        "value": 55
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 274032
+  },
+  {
+    "id": "poc2-0127",
+    "text": "Second floor kitchen ka pankha max mode pe daal do jab kamre ka temperature 19 cross kare",
+    "expected": {
+      "activity": "air",
+      "subject": "second_floor_kitchen_ceiling_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 19
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 210389
+  },
+  {
+    "id": "poc2-0128",
+    "text": "Turn off balcony tubelight daily at 4 pm!",
+    "expected": {
+      "activity": "light",
+      "subject": "balcony_tube_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "16:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 263773
+  },
+  {
+    "id": "poc2-0129",
+    "text": "Hey switch off the first floor hall air conditioner whenever temperature is less than 37.",
+    "expected": {
+      "activity": "cooling",
+      "subject": "first_floor_hall_ac",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 37
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 210724
+  },
+  {
+    "id": "poc2-0130",
+    "text": "YAAR BEDROOM WALA AIR PURIFIER SLOW MODE PE DAAL DO JAB AIR QUALITY 125 SE NEECHE JAYE.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "bedroom_air_purifier",
+      "action": "LOW",
+      "when": {
+        "metric": "aqi",
+        "op": "<",
+        "value": 125
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 161714
+  },
+  {
+    "id": "poc2-0131",
+    "text": "please jaise hi kamre ka temperature 19 se neeche jaye to first floor kitchen ka geyser shuru kar do",
+    "expected": {
+      "activity": "heating",
+      "subject": "first_floor_kitchen_geyser",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 19
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 277932
+  },
+  {
+    "id": "poc2-0132",
+    "text": "Yaar har roz shaam 6:30 baje ground floor balcony wala curtains bandh kar do!",
+    "expected": {
+      "activity": "access",
+      "subject": "ground_floor_balcony_curtains",
+      "action": "CLOSE",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "18:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 299610
+  },
+  {
+    "id": "poc2-0133",
+    "text": "pull open the first floor bathroom window daily at 11 am",
+    "expected": {
+      "activity": "access",
+      "subject": "first_floor_bathroom_window",
+      "action": "OPEN",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "11:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 76101
+  },
+  {
+    "id": "poc2-0134",
+    "text": "yaar har roz raat ko 8 baje first floor washroom wala socket off karo",
+    "expected": {
+      "activity": "power",
+      "subject": "first_floor_washroom_socket",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "20:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 223338
+  },
+  {
+    "id": "poc2-0135",
+    "text": "In case room temperature gets under 35, turn off the ceiling fan in the kitchen!",
+    "expected": {
+      "activity": "air",
+      "subject": "kitchen_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 35
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 332510
+  },
+  {
+    "id": "poc2-0136",
+    "text": "Please courtyard ki fairy lights shuru karo roz savere 9 baje.",
+    "expected": {
+      "activity": "light",
+      "subject": "courtyard_fairy_lights",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "09:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 22443
+  },
+  {
+    "id": "poc2-0137",
+    "text": "switch kitchen table fan to high whenever temperature is more than 43.",
+    "expected": {
+      "activity": "air",
+      "subject": "kitchen_table_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 43
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 71589
+  },
+  {
+    "id": "poc2-0138",
+    "text": "shut off the first floor kitchen fan once temp drops below 26",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_kitchen_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 26
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 123420
+  },
+  {
+    "id": "poc2-0139",
+    "text": "please roz shaam 7 baje first floor kitchen wala bulb bandh kar do.",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_kitchen_bulb",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "19:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 166128
+  },
+  {
+    "id": "poc2-0140",
+    "text": "STOP THE SECOND FLOOR BATHROOM WATER HEATER IF TEMP IS MORE THAN 41.",
+    "expected": {
+      "activity": "heating",
+      "subject": "second_floor_bathroom_geyser",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 41
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 69771
+  },
+  {
+    "id": "poc2-0141",
+    "text": "yaar jab hawa me nami 70 cross kare tab workshop ka exhaust chalao",
+    "expected": {
+      "activity": "air",
+      "subject": "workshop_exhaust_fan",
+      "action": "ON",
+      "when": {
+        "metric": "humidity",
+        "op": ">",
+        "value": 70
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 23503
+  },
+  {
+    "id": "poc2-0142",
+    "text": "start balcony smart bulb daily at 8 pm",
+    "expected": {
+      "activity": "light",
+      "subject": "balcony_smart_bulb",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "20:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 134514
+  },
+  {
+    "id": "poc2-0143",
+    "text": "yaar first floor corridor wala bulb laga do roz raat 8:30 baje",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_corridor_bulb",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "20:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 31359
+  },
+  {
+    "id": "poc2-0144",
+    "text": "if room temperature falls below 18 then power off kids room wall fan.",
+    "expected": {
+      "activity": "air",
+      "subject": "kids_room_wall_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 18
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 1604
+  },
+  {
+    "id": "poc2-0145",
+    "text": "Shut down the blower in the bedroom when room temperature is more than 21!",
+    "expected": {
+      "activity": "heating",
+      "subject": "bedroom_blower",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 21
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 258885
+  },
+  {
+    "id": "poc2-0146",
+    "text": "start the fan in the first floor study room if room temperature rises above 48.",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_study_room_ceiling_fan",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 48
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 35393
+  },
+  {
+    "id": "poc2-0147",
+    "text": "if room temperature falls below 31 then turn off ground floor kitchen fan",
+    "expected": {
+      "activity": "air",
+      "subject": "ground_floor_kitchen_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 31
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 36984
+  },
+  {
+    "id": "poc2-0148",
+    "text": "in case room temperature goes over 34 then stop the parents room room heater!",
+    "expected": {
+      "activity": "heating",
+      "subject": "parents_room_room_heater",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 34
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 29243
+  },
+  {
+    "id": "poc2-0149",
+    "text": "backyard ki batti on karo roz shaam 5:30 baje!",
+    "expected": {
+      "activity": "light",
+      "subject": "backyard_light",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "17:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 187166
+  },
+  {
+    "id": "poc2-0150",
+    "text": "at 3 pm sharp turn off camera 3",
+    "expected": {
+      "activity": "security",
+      "subject": "camera_3",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "15:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 247516
+  },
+  {
+    "id": "poc2-0151",
+    "text": "BHAI AGAR TEMP 39 KE UPAR CHALA JAYE TAB SECOND FLOOR GUEST ROOM WALA AIR CONDITIONER KO TEZ PE RAKHO",
+    "expected": {
+      "activity": "cooling",
+      "subject": "second_floor_guest_room_ac",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 39
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 245084
+  },
+  {
+    "id": "poc2-0152",
+    "text": "yaar humidity 80 se neeche jaye to master bedroom ka humidifier chala do",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "master_bedroom_humidifier",
+      "action": "ON",
+      "when": {
+        "metric": "humidity",
+        "op": "<",
+        "value": 80
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 69761
+  },
+  {
+    "id": "poc2-0153",
+    "text": "please temperature 20 paar kare to washroom wala geyser off kardo",
+    "expected": {
+      "activity": "heating",
+      "subject": "washroom_geyser",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 20
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 171102
+  },
+  {
+    "id": "poc2-0154",
+    "text": "at 6 pm sharp power on the hall table fan!",
+    "expected": {
+      "activity": "air",
+      "subject": "hall_table_fan",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "18:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 33339
+  },
+  {
+    "id": "poc2-0155",
+    "text": "ACHA HAR ROZ RAAT 10 BAJE SECOND FLOOR GUEST ROOM KA SMART SWITCH BANDH KAR DO!",
+    "expected": {
+      "activity": "power",
+      "subject": "second_floor_guest_room_smart_switch",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "22:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 319545
+  },
+  {
+    "id": "poc2-0156",
+    "text": "IN CASE TEMP RISES ABOVE 44 SET THE MASTER BEDROOM PEDESTAL FAN TO HIGH.",
+    "expected": {
+      "activity": "air",
+      "subject": "master_bedroom_pedestal_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 44
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 282553
+  },
+  {
+    "id": "poc2-0157",
+    "text": "please set the first floor kitchen fan on high whenever room temperature crosses 22",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_kitchen_ceiling_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 22
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 110183
+  },
+  {
+    "id": "poc2-0158",
+    "text": "Start up office room heater whenever temperature goes below 43",
+    "expected": {
+      "activity": "heating",
+      "subject": "home_office_room_heater",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 43
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 50998
+  },
+  {
+    "id": "poc2-0159",
+    "text": "in case temp drops below 16 put on the geyser in the washroom!",
+    "expected": {
+      "activity": "heating",
+      "subject": "washroom_geyser",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 16
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 151474
+  },
+  {
+    "id": "poc2-0160",
+    "text": "suno study room wala speaker band karo har roz subah 7 baje.",
+    "expected": {
+      "activity": "music",
+      "subject": "study_room_speaker",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "07:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 124876
+  },
+  {
+    "id": "poc2-0161",
+    "text": "at 2 pm sharp power off coffee maker",
+    "expected": {
+      "activity": "kitchen",
+      "subject": "coffee_machine",
+      "action": "STOP",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "14:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 307435
+  },
+  {
+    "id": "poc2-0162",
+    "text": "once temp falls below 24, power off the second floor lobby fan",
+    "expected": {
+      "activity": "air",
+      "subject": "second_floor_lobby_ceiling_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 24
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 219831
+  },
+  {
+    "id": "poc2-0163",
+    "text": "POWER ON KIDS ROOM MIRROR LIGHT AT 4 PM",
+    "expected": {
+      "activity": "light",
+      "subject": "kids_room_mirror_light",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "16:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 232118
+  },
+  {
+    "id": "poc2-0164",
+    "text": "SUNO JAISE HI TEMP 25 CROSS KARE TOH FIRST FLOOR STUDY ROOM WALA CEILING FAN START KARO",
+    "expected": {
+      "activity": "air",
+      "subject": "first_floor_study_room_ceiling_fan",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 25
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 64948
+  },
+  {
+    "id": "poc2-0165",
+    "text": "yaar har roz raat 11 baje study room wala dehumidifier chala do!",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "study_room_dehumidifier",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "23:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 45370
+  },
+  {
+    "id": "poc2-0166",
+    "text": "set the home office purifier on low when air quality index falls below 100",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "home_office_air_purifier",
+      "action": "LOW",
+      "when": {
+        "metric": "aqi",
+        "op": "<",
+        "value": 100
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 113425
+  },
+  {
+    "id": "poc2-0167",
+    "text": "yaar agar kamre ka temperature 41 se zyada ho jaye toh drawing room wala table fan chalao",
+    "expected": {
+      "activity": "air",
+      "subject": "drawing_room_table_fan",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 41
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 201542
+  },
+  {
+    "id": "poc2-0168",
+    "text": "PLEASE ROZ SAVERE 8 BAJE PARENTS ROOM KI MACHHAR WALI MACHINE START KARO.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "parents_room_mosquito_machine",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "08:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 158053
+  },
+  {
+    "id": "poc2-0169",
+    "text": "bhai living room ka wall fan rok do jab room ka temperature 23 se niche chala jaye.",
+    "expected": {
+      "activity": "air",
+      "subject": "living_room_wall_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 23
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 150640
+  },
+  {
+    "id": "poc2-0170",
+    "text": "yaar temp 39 paar kare to home office wala table fan tez pe chalao.",
+    "expected": {
+      "activity": "air",
+      "subject": "home_office_table_fan",
+      "action": "HIGH",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 39
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 305390
+  },
+  {
+    "id": "poc2-0171",
+    "text": "yaar first floor lobby wala bulb off karo har roz shaam 7 baje!",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_lobby_bulb",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "19:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 148959
+  },
+  {
+    "id": "poc2-0172",
+    "text": "put on the heat blower in the hall at 7 am",
+    "expected": {
+      "activity": "heating",
+      "subject": "hall_blower",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "07:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 297582
+  },
+  {
+    "id": "poc2-0173",
+    "text": "yaar living room wala purifier chalu karo agar aqi 300 paar kare.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "living_room_air_purifier",
+      "action": "ON",
+      "when": {
+        "metric": "aqi",
+        "op": ">",
+        "value": 300
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 301156
+  },
+  {
+    "id": "poc2-0174",
+    "text": "YAAR BASEMENT KA DEHUMIDIFIER OFF KARDO AGAR HAWA ME NAMI 75 SE NEECHE JAYE.",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "basement_dehumidifier",
+      "action": "OFF",
+      "when": {
+        "metric": "humidity",
+        "op": "<",
+        "value": 75
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 203287
+  },
+  {
+    "id": "poc2-0175",
+    "text": "power off the kitchen ceiling light daily at 8 am!",
+    "expected": {
+      "activity": "light",
+      "subject": "kitchen_ceiling_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "08:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 153280
+  },
+  {
+    "id": "poc2-0176",
+    "text": "acha basement ka exhaust band karo raat ko 9 baje",
+    "expected": {
+      "activity": "air",
+      "subject": "basement_exhaust_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "21:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 201599
+  },
+  {
+    "id": "poc2-0177",
+    "text": "when temperature is more than 23 run the tower fan in the master bedroom!",
+    "expected": {
+      "activity": "air",
+      "subject": "master_bedroom_tower_fan",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 23
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 67846
+  },
+  {
+    "id": "poc2-0178",
+    "text": "please bachchon ke kamre wala wall fan laga do agar kamre ka temperature 16 se upar jaye",
+    "expected": {
+      "activity": "air",
+      "subject": "kids_room_wall_fan",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": ">",
+        "value": 16
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 259643
+  },
+  {
+    "id": "poc2-0179",
+    "text": "drawing room wala socket off karo roz savere 8 baje",
+    "expected": {
+      "activity": "power",
+      "subject": "drawing_room_socket",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "08:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 185234
+  },
+  {
+    "id": "poc2-0180",
+    "text": "bhai ground floor bathroom ka geyser on kar do agar kamre ka temperature 26 se niche chala jaye.",
+    "expected": {
+      "activity": "heating",
+      "subject": "ground_floor_bathroom_geyser",
+      "action": "ON",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 26
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 7943
+  },
+  {
+    "id": "poc2-0181",
+    "text": "in case temperature drops below 23 turn off the dining room wall mounted fan",
+    "expected": {
+      "activity": "air",
+      "subject": "dining_room_wall_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 23
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 310605
+  },
+  {
+    "id": "poc2-0182",
+    "text": "Every day at 9 am switch off the night lamp in the bedroom",
+    "expected": {
+      "activity": "light",
+      "subject": "bedroom_night_lamp",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "09:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 3053
+  },
+  {
+    "id": "poc2-0183",
+    "text": "acha roz raat ko 9:30 baje dining ka curtains band kar do!",
+    "expected": {
+      "activity": "access",
+      "subject": "dining_room_curtains",
+      "action": "CLOSE",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "21:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 135294
+  },
+  {
+    "id": "poc2-0184",
+    "text": "at 7 pm sharp switch off the second floor bedroom smart plug!",
+    "expected": {
+      "activity": "power",
+      "subject": "second_floor_bedroom_smart_plug",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "19:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 30600
+  },
+  {
+    "id": "poc2-0185",
+    "text": "daily at 6 am power off second floor balcony bulb",
+    "expected": {
+      "activity": "light",
+      "subject": "second_floor_balcony_bulb",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "06:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 126919
+  },
+  {
+    "id": "poc2-0186",
+    "text": "if moisture in the air exceeds 45 power on the bedroom dehumidifier",
+    "expected": {
+      "activity": "air_quality",
+      "subject": "bedroom_dehumidifier",
+      "action": "ON",
+      "when": {
+        "metric": "humidity",
+        "op": ">",
+        "value": 45
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 277615
+  },
+  {
+    "id": "poc2-0187",
+    "text": "acha living room ka projector band karo har roz savere 11 baje!",
+    "expected": {
+      "activity": "entertainment",
+      "subject": "living_room_projector",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "11:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 339612
+  },
+  {
+    "id": "poc2-0188",
+    "text": "at 10 am sharp turn off the plug 5",
+    "expected": {
+      "activity": "power",
+      "subject": "smart_plug_5",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "10:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 226145
+  },
+  {
+    "id": "poc2-0189",
+    "text": "Daily at 9 am switch on the ground floor study bulb",
+    "expected": {
+      "activity": "light",
+      "subject": "ground_floor_study_room_bulb",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "09:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 116081
+  },
+  {
+    "id": "poc2-0190",
+    "text": "please mummy papa ke kamre wala wall fan rok do jab kamre ka temperature 41 se neeche jaye",
+    "expected": {
+      "activity": "air",
+      "subject": "parents_room_wall_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 41
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 83638
+  },
+  {
+    "id": "poc2-0191",
+    "text": "bhai roz dopahar ko 4:30 baje bathroom ka bulb start karo!",
+    "expected": {
+      "activity": "light",
+      "subject": "bathroom_bulb",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "16:30"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 336818
+  },
+  {
+    "id": "poc2-0192",
+    "text": "Acha shaam 5 baje servant room ka bulb off kar do.",
+    "expected": {
+      "activity": "light",
+      "subject": "servant_room_bulb",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "17:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 337602
+  },
+  {
+    "id": "poc2-0193",
+    "text": "at 7 pm sharp stop the switch in the children's room",
+    "expected": {
+      "activity": "power",
+      "subject": "kids_room_smart_switch",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "19:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 100558
+  },
+  {
+    "id": "poc2-0194",
+    "text": "suno jab temp 39 se kam ho toh veranda ka wall fan rok do!",
+    "expected": {
+      "activity": "air",
+      "subject": "veranda_wall_fan",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 39
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 202552
+  },
+  {
+    "id": "poc2-0195",
+    "text": "If room temperature gets under 42 then stop the second floor study air conditioner",
+    "expected": {
+      "activity": "cooling",
+      "subject": "second_floor_study_room_ac",
+      "action": "OFF",
+      "when": {
+        "metric": "temperature",
+        "op": "<",
+        "value": 42
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 230321
+  },
+  {
+    "id": "poc2-0196",
+    "text": "Please mixie band karo har roz raat ko 9 baje.",
+    "expected": {
+      "activity": "kitchen",
+      "subject": "mixer_grinder",
+      "action": "STOP",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "21:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 203416
+  },
+  {
+    "id": "poc2-0197",
+    "text": "When moisture in the air rises above 35 then start the store room exhaust fan.",
+    "expected": {
+      "activity": "air",
+      "subject": "store_room_exhaust_fan",
+      "action": "ON",
+      "when": {
+        "metric": "humidity",
+        "op": ">",
+        "value": 35
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 32686
+  },
+  {
+    "id": "poc2-0198",
+    "text": "suno har roz savere 6 baje first floor kitchen wali tube light rok do!",
+    "expected": {
+      "activity": "light",
+      "subject": "first_floor_kitchen_tube_light",
+      "action": "OFF",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "06:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 145141
+  },
+  {
+    "id": "poc2-0199",
+    "text": "acha har roz raat ko 9 baje second floor kitchen ka fan shuru kar do",
+    "expected": {
+      "activity": "air",
+      "subject": "second_floor_kitchen_ceiling_fan",
+      "action": "ON",
+      "when": {
+        "metric": "time",
+        "op": "==",
+        "value": "21:00"
+      }
+    },
+    "match": "exact",
+    "category": "training_conditional",
+    "source_row_zero_based": 224924
+  }
+]

edge_benchmarks/rpi5-2026-09-26/environment.lock.txt

@@ -0,0 +1,30 @@
+certifi==2026.7.22
+charset-normalizer==3.5.1
+filelock==4.0.3
+fsspec==2026.9.0
+hf-xet==1.6.0
+huggingface_hub==0.36.2
+idna==3.20
+Jinja2==3.1.6
+joblib==1.5.3
+MarkupSafe==3.0.3
+mpmath==1.3.0
+networkx==3.7
+numpy==2.3.5
+packaging==26.3
+psutil==7.2.2
+PyYAML==6.0.3
+regex==2026.9.10
+requests==2.34.2
+safetensors==0.8.0
+scikit-learn==1.8.0
+scipy==1.17.0
+setuptools==84.0.0
+sympy==1.14.0
+threadpoolctl==3.7.0
+tokenizers==0.22.1
+torch==2.8.0
+tqdm==4.70.1
+transformers==4.56.2
+typing_extensions==4.16.0
+urllib3==2.8.0

edge_benchmarks/rpi5-2026-09-26/provenance.json

@@ -0,0 +1,125 @@
+{
+  "measurement_revision": "edge-rpi5-20260926",
+  "model": {
+    "repo_id": "sraivante/superfast-tiny-home-robotics-json-1m-v3",
+    "revision": "2b2e71d37ea9fa0fe6ab247b6a74e8db774fb6f2",
+    "files": [
+      {
+        "bundle_path": "projects/poc2/engine.py",
+        "repo_path": "engine.py",
+        "sha256": "bbc051221dae5c7238e7a76dae4872584c03f3db366a78980f0ea0cf5caaa18e",
+        "bytes": 3775,
+        "workspace_source": "rpi_measurements/bundle/projects/poc2/engine.py"
+      },
+      {
+        "bundle_path": "projects/poc2/model/devices-catalog.json",
+        "repo_path": "model/devices-catalog.json",
+        "sha256": "473e5850e6f9d05abf4a7806121bb42464f760fed2de589fa58accebeef72af4",
+        "bytes": 136537,
+        "workspace_source": "rpi_measurements/bundle/projects/poc2/model/devices-catalog.json"
+      },
+      {
+        "bundle_path": "projects/poc2/model/metrics_v3.json",
+        "repo_path": "model/metrics_v3.json",
+        "sha256": "884ba39090267af42bd6b4d4092ef3905b2674aa1f6f540b7e77e731d951ce8b",
+        "bytes": 2587,
+        "workspace_source": "rpi_measurements/bundle/projects/poc2/model/metrics_v3.json"
+      },
+      {
+        "bundle_path": "projects/poc2/model/model_v3_config.json",
+        "repo_path": "model/model_v3_config.json",
+        "sha256": "11b221bcf0e5b8c512ead8df19b9d4db6ee5fa2182efd6f66a9c1729eabad004",
+        "bytes": 520,
+        "workspace_source": "rpi_measurements/bundle/projects/poc2/model/model_v3_config.json"
+      },
+      {
+        "bundle_path": "projects/poc2/model/model_v3_fp16.npz",
+        "repo_path": "model/model_v3_fp16.npz",
+        "sha256": "fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b",
+        "bytes": 2146783,
+        "workspace_source": "rpi_measurements/bundle/projects/poc2/model/model_v3_fp16.npz"
+      }
+    ],
+    "all_match": true
+  },
+  "training_dataset_snapshot": {
+    "repo_id": "sraivante/home-commands-json-v3",
+    "commit": "da10aca352a34cb2834a049867f6f2e9fcc30e3e",
+    "files": [
+      {
+        "path": ".gitattributes",
+        "bytes": 2504,
+        "sha256": null
+      },
+      {
+        "path": "LICENSE",
+        "bytes": 11358,
+        "sha256": null
+      },
+      {
+        "path": "README.md",
+        "bytes": 5926,
+        "sha256": null
+      },
+      {
+        "path": "data/conditional_source.jsonl.gz",
+        "bytes": 6279490,
+        "sha256": "d5b6739202a0caa73b8a12452387651fa844566d47565e3876c5a3ce7ad6193e"
+      },
+      {
+        "path": "data/train.jsonl.gz",
+        "bytes": 13302264,
+        "sha256": "d8afeacfed666784b446cef68f1e8aeb12d9ebbe4032424dec2c0db9f664e79b"
+      },
+      {
+        "path": "generators/generate_dataset_v2.py",
+        "bytes": 29188,
+        "sha256": null
+      },
+      {
+        "path": "generators/generate_dataset_v3_conditional.py",
+        "bytes": 10612,
+        "sha256": null
+      },
+      {
+        "path": "generators/prep_mix.py",
+        "bytes": 1278,
+        "sha256": null
+      },
+      {
+        "path": "metadata/devices-catalog.json",
+        "bytes": 136537,
+        "sha256": null
+      },
+      {
+        "path": "source/dataset_v3_conditional.jsonl.xz",
+        "bytes": 4245312,
+        "sha256": "f5b997f808688c535cf0abd195390a8ba20deb6cfe3a4b8b2262624242552b86"
+      },
+      {
+        "path": "source/train_mix.jsonl.xz",
+        "bytes": 4951908,
+        "sha256": "c8851122dc01787e9674532c5cfb1cf7260212c52c9800e37622b28167bb9838"
+      }
+    ]
+  },
+  "evaluation": {
+    "kind": "training-set diagnostic, NOT held-out accuracy",
+    "source": "POC-2-claude\\home-command-ai\\data\\train_mix.jsonl.xz",
+    "sha256": "c8851122dc01787e9674532c5cfb1cf7260212c52c9800e37622b28167bb9838",
+    "sampling": "stratified reservoir, 100 plain + 100 conditional; seed 20260926",
+    "source_counts": {
+      "plain": 140000,
+      "conditional": 200000
+    },
+    "notes": "Historical 1500-row evaluation file is absent locally and from the published dataset. This diagnostic does not reproduce or replace the historical 96.73% result. The shipped prep_mix.py has different training-count settings from the published 340000-row snapshot."
+  },
+  "quality_case_count": 200,
+  "latency_case_count": 10,
+  "case_file_sha256": {
+    "poc2_latency.json": "77930a99ff035b3774bf65b261a302b7a5bff7608c5a4ae99241847164be2cff",
+    "poc2_quality.json": "e61640a601ca3e354a74be3dcb6506ba24171a343c290b96fa53f7deee899232"
+  },
+  "no_training_or_fine_tuning": true,
+  "copyright": "Copyright (c) 2026 sraivante for original material and selection/arrangement only; Apache License 2.0; third-party terms unchanged."
+}

edge_benchmarks/rpi5-2026-09-26/reproduce.py

@@ -0,0 +1,21 @@
+"""Reproduce this pinned model's Pi benchmark without changing model weights."""
+import argparse, hashlib, json, shutil, subprocess, sys
+from pathlib import Path
+from huggingface_hub import hf_hub_download
+HERE=Path(__file__).resolve().parent
+ap=argparse.ArgumentParser(); ap.add_argument('--threads',type=int,choices=(1,4),default=1); args=ap.parse_args()
+identity=json.loads((HERE/'runtime_identity.json').read_text())
+manifest=json.loads((HERE/'bundle_manifest.json').read_text()); key=next(iter(manifest['models']))
+if key=='poc3' and args.threads!=1: ap.error('This interpreter is single-threaded')
+target=Path.cwd()/('rpi-reproduction-'+key); target.mkdir(exist_ok=True)
+for item in identity['files']:
+    source=Path(hf_hub_download(identity['repo_id'],item['repo_path'],revision=identity['revision']))
+    assert hashlib.sha256(source.read_bytes()).hexdigest()==item['sha256']
+    dest=target/item['bundle_path']; dest.parent.mkdir(parents=True,exist_ok=True); shutil.copyfile(source,dest)
+for name in ('benchmark.py','bundle_manifest.json'):
+    shutil.copyfile(HERE/name,target/name)
+for source in (HERE/'cases').glob('*.json'):
+    dest=target/'cases'/source.name; dest.parent.mkdir(exist_ok=True); shutil.copyfile(source,dest)
+command=[sys.executable,'-u',str(target/'benchmark.py'),'--model',key,'--threads',str(args.threads),'--out',str(target/('result_t'+str(args.threads)+'.json'))]
+if args.threads==1: command.append('--quality')
+subprocess.run(command,check=True)

edge_benchmarks/rpi5-2026-09-26/runtime_identity.json

@@ -0,0 +1,42 @@
+{
+  "repo_id": "sraivante/superfast-tiny-home-robotics-json-1m-v3",
+  "revision": "2b2e71d37ea9fa0fe6ab247b6a74e8db774fb6f2",
+  "files": [
+    {
+      "bundle_path": "projects/poc2/engine.py",
+      "repo_path": "engine.py",
+      "sha256": "bbc051221dae5c7238e7a76dae4872584c03f3db366a78980f0ea0cf5caaa18e",
+      "bytes": 3775,
+      "workspace_source": "rpi_measurements/bundle/projects/poc2/engine.py"
+    },
+    {
+      "bundle_path": "projects/poc2/model/devices-catalog.json",
+      "repo_path": "model/devices-catalog.json",
+      "sha256": "473e5850e6f9d05abf4a7806121bb42464f760fed2de589fa58accebeef72af4",
+      "bytes": 136537,
+      "workspace_source": "rpi_measurements/bundle/projects/poc2/model/devices-catalog.json"
+    },
+    {
+      "bundle_path": "projects/poc2/model/metrics_v3.json",
+      "repo_path": "model/metrics_v3.json",
+      "sha256": "884ba39090267af42bd6b4d4092ef3905b2674aa1f6f540b7e77e731d951ce8b",
+      "bytes": 2587,
+      "workspace_source": "rpi_measurements/bundle/projects/poc2/model/metrics_v3.json"
+    },
+    {
+      "bundle_path": "projects/poc2/model/model_v3_config.json",
+      "repo_path": "model/model_v3_config.json",
+      "sha256": "11b221bcf0e5b8c512ead8df19b9d4db6ee5fa2182efd6f66a9c1729eabad004",
+      "bytes": 520,
+      "workspace_source": "rpi_measurements/bundle/projects/poc2/model/model_v3_config.json"
+    },
+    {
+      "bundle_path": "projects/poc2/model/model_v3_fp16.npz",
+      "repo_path": "model/model_v3_fp16.npz",
+      "sha256": "fc749ecd89c1ae30a159d6d701036298b5583645b7fbf114311e006929c8778b",
+      "bytes": 2146783,
+      "workspace_source": "rpi_measurements/bundle/projects/poc2/model/model_v3_fp16.npz"
+    }
+  ],
+  "all_match": true
+}