Orionfold commited on
Commit
8b2485b
·
verified ·
1 Parent(s): 5622498

H5 vertical-router harness profile

Browse files
Files changed (4) hide show
  1. .env.example +3 -0
  2. README.md +198 -0
  3. hermes.yaml +4 -0
  4. router.yaml +105 -0
.env.example ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ HERMES_STREAM_READ_TIMEOUT=1800
2
+ OPENAI_API_KEY=local
3
+ OPENAI_BASE_URL=http://127.0.0.1:8080/v1
README.md ADDED
@@ -0,0 +1,198 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: hermes-agent
4
+ tags:
5
+ - agent-harness
6
+ - hermes
7
+ - dgx-spark
8
+ - orionfold
9
+ - router
10
+ - vertical
11
+ - multi-domain
12
+ - orionfold
13
+ - llama-cpp
14
+ - qwen3
15
+ ---
16
+ # Spark Hermes Vertical Router — 5 specialists + 1 default brain
17
+
18
+ A deterministic keyword-classifier router for the NVIDIA DGX Spark (GB10, 128 GB unified memory): dispatch each Hermes prompt to one of five Orionfold vertical GGUFs — patent / legal / finance / cyber / medical — served one-at-a-time, with a strong default brain (Qwen3-30B-A3B MoE Q4_K_M) catching everything else.
19
+
20
+ ## What this harness is
21
+
22
+ **One always-on brain, five specialists, zero LLM-classifier overhead.**
23
+
24
+ A Spark holds one strong model warm at a time. The pinned MoE is excellent at general agentic work but is not your domain expert. The five Orionfold vertical GGUFs are domain experts but compete for the same 128 GB envelope. A router picks per prompt: keyword-matched prompts get the right specialist (warm on demand, ~5–10 s), everything else stays with the brain.
25
+
26
+ Good for:
27
+
28
+ - Route a Hermes agent prompt to a vertical specialist by keyword
29
+ - Reproduce the 30-prompt router-accuracy + per-vertical quality bench
30
+ - Embed a deterministic, auditable router into a Hermes config
31
+
32
+ _For: DGX Spark power users running a local, no-API-key agent harness across multiple domains._
33
+
34
+ ## Serving lanes
35
+
36
+ | Lane | Provider | Model | tok/s | Sustained (min) | Format-error | Clean-run |
37
+ |---|---|---|---|---|---|---|
38
+ | Patent prosecution | llama-server | Orionfold/patent-strategist-v3-nemo-GGUF Q5_K_M | — | — | — | 80.0% |
39
+ | Legal reasoning | llama-server | Orionfold/Saul-7B-Instruct-v1-GGUF Q5_K_M | — | — | — | 80.0% |
40
+ | Financial analysis | llama-server | Orionfold/finance-chat-GGUF Q5_K_M | — | — | — | 100.0% |
41
+ | Defensive cyber | llama-server | Orionfold/SecurityLLM-GGUF Q5_K_M | — | — | — | 100.0% |
42
+ | Clinical reasoning | llama-server | Orionfold/II-Medical-8B-GGUF Q5_K_M | — | — | — | 100.0% |
43
+ | Default brain (MoE) ⭐ | llama-server | Qwen/Qwen3-30B-A3B-Q4_K_M | — | — | — | 80.0% |
44
+
45
+ Tool-call **format-error rate** is the agent-critical number: a lane that can't emit well-formed tool calls is disqualified regardless of speed.
46
+
47
+ ## Configuration
48
+
49
+ `~/.hermes/config.yaml` (model block):
50
+
51
+ ```yaml
52
+ model:
53
+ provider: custom
54
+ base_url: "http://127.0.0.1:8080/v1"
55
+ default: Qwen3-30B-A3B-Q4_K_M.gguf
56
+ ```
57
+
58
+ `~/.hermes/.env`:
59
+
60
+ ```ini
61
+ HERMES_STREAM_READ_TIMEOUT=1800
62
+ OPENAI_API_KEY=local
63
+ OPENAI_BASE_URL=http://127.0.0.1:8080/v1
64
+ ```
65
+
66
+ `router.yaml`:
67
+
68
+ ```yaml
69
+ router:
70
+ kind: vertical
71
+ default:
72
+ name: brain
73
+ hf_repo: Qwen/Qwen3-30B-A3B-Q4_K_M
74
+ variant: Q4_K_M
75
+ description: "Qwen3-30B-A3B MoE Q4_K_M — the Step-2 pinned default brain (8/8 quality, 83.5 tok/s, 31.8 GB; the always-warm fallback that picks up any prompt no vertical claims). Always served on 127.0.0.1:8080 via llama.cpp."
76
+ routes:
77
+ - name: patent
78
+ hf_repo: Orionfold/patent-strategist-v3-nemo-GGUF
79
+ variant: Q5_K_M
80
+ keywords:
81
+ - patent
82
+ - claim
83
+ - prior art
84
+ - uspto
85
+ - mpep
86
+ - prosecution
87
+ - §102
88
+ - §103
89
+ - provisional
90
+ - patentability
91
+ - patentable
92
+ - infring
93
+ description: "Offline patent-prosecution reasoning (claims, prosecution, MPEP)."
94
+ - name: legal
95
+ hf_repo: Orionfold/Saul-7B-Instruct-v1-GGUF
96
+ variant: Q5_K_M
97
+ keywords:
98
+ - lawsuit
99
+ - contract
100
+ - tort
101
+ - statute
102
+ - plaintiff
103
+ - defendant
104
+ - breach
105
+ - negligence
106
+ - estoppel
107
+ - doctrine
108
+ - res ipsa
109
+ - limitations
110
+ - repose
111
+ - promissory
112
+ - sue
113
+ description: "Legal reasoning over contracts, torts, and statutes (Saul-7B-Instruct)."
114
+ - name: finance
115
+ hf_repo: Orionfold/finance-chat-GGUF
116
+ variant: Q5_K_M
117
+ keywords:
118
+ - portfolio
119
+ - 10-k
120
+ - ebitda
121
+ - dividend
122
+ - fed
123
+ - yield curve
124
+ - sharpe
125
+ - moat
126
+ - valuation
127
+ - earnings
128
+ - p/e
129
+ - stock
130
+ - shareholder
131
+ - balance sheet
132
+ - cash flow
133
+ description: "Financial analysis, 10-K reading, valuation primitives."
134
+ - name: cyber
135
+ hf_repo: Orionfold/SecurityLLM-GGUF
136
+ variant: Q5_K_M
137
+ keywords:
138
+ - cve
139
+ - exploit
140
+ - malware
141
+ - rce
142
+ - owasp
143
+ - siem
144
+ - vulnerab
145
+ - phishing
146
+ - ransomware
147
+ - lpe
148
+ - privilege escalation
149
+ - infection
150
+ - intrusion
151
+ - ddos
152
+ description: "Defensive cybersecurity: CVE triage, OWASP, incident response."
153
+ - name: medical
154
+ hf_repo: Orionfold/II-Medical-8B-GGUF
155
+ variant: Q5_K_M
156
+ keywords:
157
+ - symptom
158
+ - diagnosis
159
+ - icd-10
160
+ - pathology
161
+ - dose
162
+ - mg/kg
163
+ - amoxicillin
164
+ - d-dimer
165
+ - differential
166
+ - infarct
167
+ - ed patient
168
+ - embolism
169
+ - thromb
170
+ - presents with
171
+ - mg/dl
172
+ - myocardial
173
+ description: "Clinical reasoning: differentials, dosing, ICD-10, ED workups."
174
+ ```
175
+
176
+ ## Doctor checklist
177
+
178
+ - [ ] Router accuracy ≥ 100% on the 30-prompt bench
179
+ - [ ] Overall vertical pass-rate ≥ 90%
180
+ - [ ] Default brain warm on :8080 (always-on)
181
+ - [ ] Vertical port :8090 free between verticals
182
+ - [ ] All 5 vertical GGUFs cached at /home/nvidia/data/quants/
183
+
184
+ ## Methods
185
+
186
+ Measured and documented in [The Hermes vertical router on a DGX Spark](https://ainative.business/field-notes/hermes-vertical-router-on-spark/).
187
+
188
+ ## Known drift
189
+
190
+ - **Router-accuracy sample size** — router classification measured over 30 prompts (5 per vertical + 5 default-brain) — not a large-N guarantee.
191
+ - **Keyword-set tuning** — vertical keywords were tuned against the bench prompts; out-of-distribution prompts may misroute.
192
+ - **Per-vertical pass-rate basis** — 5 prompts per vertical; deterministic substring/regex rubrics — open-ended answers (haiku, drafted claims) marked vibe.
193
+ - **One-at-a-time vertical serving** — verticals are served on demand on :8090 (~5–10s warm); the default brain stays warm on :8080 (always-on, ~32 GB).
194
+
195
+ ---
196
+
197
+ Published by **Orionfold LLC** · [orionfold.com](https://orionfold.com) · Methods documented at [ainative.business/field-notes](https://ainative.business/field-notes/).
198
+
hermes.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ model:
2
+ provider: custom
3
+ base_url: "http://127.0.0.1:8080/v1"
4
+ default: Qwen3-30B-A3B-Q4_K_M.gguf
router.yaml ADDED
@@ -0,0 +1,105 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ router:
2
+ kind: vertical
3
+ default:
4
+ name: brain
5
+ hf_repo: Qwen/Qwen3-30B-A3B-Q4_K_M
6
+ variant: Q4_K_M
7
+ description: "Qwen3-30B-A3B MoE Q4_K_M — the Step-2 pinned default brain (8/8 quality, 83.5 tok/s, 31.8 GB; the always-warm fallback that picks up any prompt no vertical claims). Always served on 127.0.0.1:8080 via llama.cpp."
8
+ routes:
9
+ - name: patent
10
+ hf_repo: Orionfold/patent-strategist-v3-nemo-GGUF
11
+ variant: Q5_K_M
12
+ keywords:
13
+ - patent
14
+ - claim
15
+ - prior art
16
+ - uspto
17
+ - mpep
18
+ - prosecution
19
+ - §102
20
+ - §103
21
+ - provisional
22
+ - patentability
23
+ - patentable
24
+ - infring
25
+ description: "Offline patent-prosecution reasoning (claims, prosecution, MPEP)."
26
+ - name: legal
27
+ hf_repo: Orionfold/Saul-7B-Instruct-v1-GGUF
28
+ variant: Q5_K_M
29
+ keywords:
30
+ - lawsuit
31
+ - contract
32
+ - tort
33
+ - statute
34
+ - plaintiff
35
+ - defendant
36
+ - breach
37
+ - negligence
38
+ - estoppel
39
+ - doctrine
40
+ - res ipsa
41
+ - limitations
42
+ - repose
43
+ - promissory
44
+ - sue
45
+ description: "Legal reasoning over contracts, torts, and statutes (Saul-7B-Instruct)."
46
+ - name: finance
47
+ hf_repo: Orionfold/finance-chat-GGUF
48
+ variant: Q5_K_M
49
+ keywords:
50
+ - portfolio
51
+ - 10-k
52
+ - ebitda
53
+ - dividend
54
+ - fed
55
+ - yield curve
56
+ - sharpe
57
+ - moat
58
+ - valuation
59
+ - earnings
60
+ - p/e
61
+ - stock
62
+ - shareholder
63
+ - balance sheet
64
+ - cash flow
65
+ description: "Financial analysis, 10-K reading, valuation primitives."
66
+ - name: cyber
67
+ hf_repo: Orionfold/SecurityLLM-GGUF
68
+ variant: Q5_K_M
69
+ keywords:
70
+ - cve
71
+ - exploit
72
+ - malware
73
+ - rce
74
+ - owasp
75
+ - siem
76
+ - vulnerab
77
+ - phishing
78
+ - ransomware
79
+ - lpe
80
+ - privilege escalation
81
+ - infection
82
+ - intrusion
83
+ - ddos
84
+ description: "Defensive cybersecurity: CVE triage, OWASP, incident response."
85
+ - name: medical
86
+ hf_repo: Orionfold/II-Medical-8B-GGUF
87
+ variant: Q5_K_M
88
+ keywords:
89
+ - symptom
90
+ - diagnosis
91
+ - icd-10
92
+ - pathology
93
+ - dose
94
+ - mg/kg
95
+ - amoxicillin
96
+ - d-dimer
97
+ - differential
98
+ - infarct
99
+ - ed patient
100
+ - embolism
101
+ - thromb
102
+ - presents with
103
+ - mg/dl
104
+ - myocardial
105
+ description: "Clinical reasoning: differentials, dosing, ICD-10, ED workups."