lmcfarlin commited on
Commit
b36c69d
·
1 Parent(s): 2a30eaa

Promote derisk_energy checkpoint_epoch=099 (staged, not pushed)

Browse files

train-repo: Artificial-Humanity/Sonora, MLflow run nimble-duck-437
gate verdict in derisk_energy_gate: all 4 sweep groups pass north-star §7
thresholds (energy rho ~1.000, WER delta <= 0.042, leakage <= 0.091) with
real margin. Sweep renders human-audited 2026-07-16, energy/loudness change
judged clearly discernible and natural.

Staged locally only -- same open question as vocoder-24k-hifigan/: this is
ONE VAT channel (energy), not the full directable actor, so whether a
partial-VAT checkpoint belongs in the public HF repo is a deliberate call,
not a default push. No auto-queued follow-on training this time either --
next steps are scope decisions (full-VAT corpus question, export-harness
adaptation), not mechanical continuations.

Files changed (25) hide show
  1. derisk-energy-24k/README.md +64 -0
  2. derisk-energy-24k/checkpoint_epoch=099.ckpt +3 -0
  3. derisk-energy-24k/eval_report.json +408 -0
  4. derisk-energy-24k/gate_history.jsonl +2 -0
  5. derisk-energy-24k/render_meta.json +22 -0
  6. derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy+0.00.wav +3 -0
  7. derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy+0.50.wav +3 -0
  8. derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy+1.00.wav +3 -0
  9. derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy-0.50.wav +3 -0
  10. derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy-1.00.wav +3 -0
  11. derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy+0.00.wav +3 -0
  12. derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy+0.50.wav +3 -0
  13. derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy+1.00.wav +3 -0
  14. derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy-0.50.wav +3 -0
  15. derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy-1.00.wav +3 -0
  16. derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy+0.00.wav +3 -0
  17. derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy+0.50.wav +3 -0
  18. derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy+1.00.wav +3 -0
  19. derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy-0.50.wav +3 -0
  20. derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy-1.00.wav +3 -0
  21. derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy+0.00.wav +3 -0
  22. derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy+0.50.wav +3 -0
  23. derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy+1.00.wav +3 -0
  24. derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy-0.50.wav +3 -0
  25. derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy-1.00.wav +3 -0
derisk-energy-24k/README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # §7 de-risk: energy channel, 24 kHz, multi-speaker (promoted, NOT yet public)
2
+
3
+ **Status:** staged locally per chore #7's canonical artifact flow (train → logs (transient) →
4
+ promote → Registry → push HF). **Not yet pushed to the public `artificial-humanity/Sonora` HF
5
+ repo** — same open question as `vocoder-24k-hifigan/`: this validates ONE VAT channel
6
+ (energy/arousal; valence and tension are hardwired to 0 in the v0 corpus labels), not the full
7
+ directable actor. Whether a partial-VAT checkpoint belongs in the public registry, and how it
8
+ should be described if so, is worth a deliberate call rather than a default push.
9
+
10
+ ## What this is
11
+
12
+ The north-star §7 de-risk experiment (`configs/experiment/derisk_energy.yaml`): one trained FiLM
13
+ channel through the VAT conditioning plumbing, multi-speaker (247 spk, LibriTTS-R train-clean-100),
14
+ native 24 kHz, warm-started from the multi-speaker VCTK checkpoint. Its entire purpose was to prove
15
+ the VAT/FiLM plumbing works end-to-end and is worth the investment of full 3-channel training
16
+ (which needs valence/tension-labeled data the current corpus doesn't have) before committing to
17
+ that larger effort.
18
+
19
+ ## Provenance
20
+
21
+ * **Training:** `sonora_training` container on `ai-lab-0`, MLflow run `nimble-duck-437`
22
+ (experiment `lightning_logs`), launched 2026-07-15, warm-started from
23
+ `derisk_energy_init.ckpt` (`scripts/make_warmstart.py` off `matcha_vctk.ckpt`).
24
+ * **Stopped:** 2026-07-16, at `checkpoint_epoch=099.ckpt`, on a CONVERGED verdict from the
25
+ automated eval-harness gate (see [training-operations.md
26
+ §Stop signal](../../../Notes/Sonora/training-operations.md)). Training continued to epoch 106
27
+ before being stopped (the watcher never auto-stops); epoch 099 is the audited, gated checkpoint
28
+ promoted here, not the latest one.
29
+ * **Convergence criterion (north star §7, pre-registered):** every sweep group passes
30
+ Spearman |ρ| ≥ 0.9 (controllability), ECAPA leakage ≤ 0.2 (identity), WER Δ ≤ +0.10 (guardrail).
31
+ At epoch 099, across 4 speaker/clip groups: **energy ρ ≈ 1.000 in all four** (perfectly
32
+ monotonic), WER Δ 0.000–0.042, leakage 0.051–0.091 — every group clears its threshold with real
33
+ margin, not a borderline pass. Full numbers in `eval_report.json`; history in
34
+ `gate_history.jsonl`.
35
+ * **Sweep samples:** `sweep_samples/` — 20 renders (5 energy values × 4 speaker/clips, energy ∈
36
+ {−1, −0.5, 0, +0.5, +1}), vocoded with the promoted 24k HiFi-GAN (`../vocoder-24k-hifigan/`).
37
+ Human-audited 2026-07-16: energy/loudness change judged clearly discernible and natural-sounding
38
+ across the sweep. `render_meta.json` records the exact render settings (seed, n_timesteps,
39
+ temperature, length_scale).
40
+ * **License:** LibriTTS-R only (CC-BY-4.0) — **clean, not NC-tainted** (no Expresso). Promotable
41
+ under the same terms as Phase 0.
42
+
43
+ ## Files
44
+
45
+ | File | What |
46
+ |---|---|
47
+ | `checkpoint_epoch=099.ckpt` | Full Lightning checkpoint (weights + optimizer state — resumable, unlike the vocoder's inference-only promotion). |
48
+ | `gate_history.jsonl` | Full convergence-watcher history for this run (includes the plumbing-test entry against the zero-init warmstart). |
49
+ | `sweep_samples/` | The 20 energy-sweep renders evaluated at the promoted checkpoint. |
50
+ | `eval_report.json` | Per-group controllability/identity/WER numbers from `scripts/eval_harness.py`. |
51
+ | `render_meta.json` | Exact render settings for reproducibility. |
52
+
53
+ ## Open questions before this goes further
54
+
55
+ 1. **Public HF push** — same call as the vocoder: hold or push as a documented partial-VAT
56
+ milestone? See [model-size-target-decision.md](../../../Notes/Sonora/model-size-target-decision.md)
57
+ for the surrounding size/quality target discussion this checkpoint feeds into.
58
+ 2. **No auto-queued follow-on training this time.** Unlike vocoder → derisk_energy, there is no
59
+ preset "next run" waiting behind this one. The real next steps are scope decisions, not
60
+ mechanical ones: (a) formalize the §7 write-up, (b) decide on the valence/tension corpus
61
+ question before attempting full 3-channel VAT (Expresso is NC-tainted; a clean labeled
62
+ alternative doesn't yet exist), (c) begin export-harness adaptation
63
+ (`/data/toolchain/litert-conversion/` is still hardcoded to the 22.05 kHz v1-ljspeech
64
+ model + generator_v1 and doesn't cover this checkpoint's 24 kHz/multi-speaker/VAT shape as-is).
derisk-energy-24k/checkpoint_epoch=099.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c70a316413829c73e18dfaa58e450f82136a48aa8ca530119a5f2ed7cf24141
3
+ size 271379859
derisk-energy-24k/eval_report.json ADDED
@@ -0,0 +1,408 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "groups": {
3
+ "1355_39947_000026_000004": {
4
+ "n": 5,
5
+ "controllability": {
6
+ "energy": {
7
+ "spearman_rho": 0.9999999999999999,
8
+ "produced_range": [
9
+ -30.42681682748094,
10
+ -24.584105856460084
11
+ ],
12
+ "pass": true
13
+ }
14
+ },
15
+ "wer": {
16
+ "baseline": 0.0,
17
+ "worst": 0.0,
18
+ "delta": 0.0,
19
+ "pass": true
20
+ },
21
+ "identity": {
22
+ "max_drift": 0.06697968596768544,
23
+ "leakage_ratio": 0.06899657363670944,
24
+ "pass": true
25
+ }
26
+ },
27
+ "229_130880_000036_000000": {
28
+ "n": 5,
29
+ "controllability": {
30
+ "energy": {
31
+ "spearman_rho": 0.9999999999999999,
32
+ "produced_range": [
33
+ -30.511969970211005,
34
+ -24.891463229728853
35
+ ],
36
+ "pass": true
37
+ }
38
+ },
39
+ "wer": {
40
+ "baseline": 0.043478260869565216,
41
+ "worst": 0.043478260869565216,
42
+ "delta": 0.0,
43
+ "pass": true
44
+ },
45
+ "identity": {
46
+ "max_drift": 0.05600704421474867,
47
+ "leakage_ratio": 0.05769352445458894,
48
+ "pass": true
49
+ }
50
+ },
51
+ "2416_152137_000049_000000": {
52
+ "n": 5,
53
+ "controllability": {
54
+ "energy": {
55
+ "spearman_rho": 0.9999999999999999,
56
+ "produced_range": [
57
+ -32.16860392691916,
58
+ -25.059800199516754
59
+ ],
60
+ "pass": true
61
+ }
62
+ },
63
+ "wer": {
64
+ "baseline": 0.15384615384615385,
65
+ "worst": 0.15384615384615385,
66
+ "delta": 0.0,
67
+ "pass": true
68
+ },
69
+ "identity": {
70
+ "max_drift": 0.08803583032641371,
71
+ "leakage_ratio": 0.09068675915733262,
72
+ "pass": true
73
+ }
74
+ },
75
+ "2836_5354_000007_000005": {
76
+ "n": 5,
77
+ "controllability": {
78
+ "energy": {
79
+ "spearman_rho": 0.9999999999999999,
80
+ "produced_range": [
81
+ -26.13071111212592,
82
+ -21.988775841583085
83
+ ],
84
+ "pass": true
85
+ }
86
+ },
87
+ "wer": {
88
+ "baseline": 0.20833333333333334,
89
+ "worst": 0.25,
90
+ "delta": 0.04166666666666666,
91
+ "pass": true
92
+ },
93
+ "identity": {
94
+ "max_drift": 0.049407182580950115,
95
+ "leakage_ratio": 0.05089492824396817,
96
+ "pass": true
97
+ }
98
+ }
99
+ },
100
+ "inter_speaker_gap": 0.9707682923554495,
101
+ "thresholds": {
102
+ "rho_min": 0.9,
103
+ "leakage_max": 0.2,
104
+ "wer_delta_max": 0.1
105
+ },
106
+ "rows": [
107
+ {
108
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2836_5354_000007_000005_energy-1.00.wav",
109
+ "text": "Lady Isabel remonstrated; she wished to go farther on, where they might get quicker news from England; but her will now was as nothing.",
110
+ "group": "2836_5354_000007_000005",
111
+ "requested": {
112
+ "energy": -1.0
113
+ },
114
+ "baseline": false,
115
+ "_measures": {
116
+ "loudness_lufs": -26.13071111212592,
117
+ "seconds": 7.978666666666666
118
+ },
119
+ "_wer": 0.20833333333333334,
120
+ "_transcript": "Lady Isabelle remnants traded. She wished to go farther on where they might get quicker news from England. But her well now was his nothing."
121
+ },
122
+ {
123
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2836_5354_000007_000005_energy-0.50.wav",
124
+ "text": "Lady Isabel remonstrated; she wished to go farther on, where they might get quicker news from England; but her will now was as nothing.",
125
+ "group": "2836_5354_000007_000005",
126
+ "requested": {
127
+ "energy": -0.5
128
+ },
129
+ "baseline": false,
130
+ "_measures": {
131
+ "loudness_lufs": -24.681363363509956,
132
+ "seconds": 8.0
133
+ },
134
+ "_wer": 0.25,
135
+ "_transcript": "Lady Isabelle remnants traded. She wished to go farther on where they might get quicker news from England. But her well-not was his nothing."
136
+ },
137
+ {
138
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2836_5354_000007_000005_energy+0.00.wav",
139
+ "text": "Lady Isabel remonstrated; she wished to go farther on, where they might get quicker news from England; but her will now was as nothing.",
140
+ "group": "2836_5354_000007_000005",
141
+ "requested": {
142
+ "energy": 0.0
143
+ },
144
+ "baseline": true,
145
+ "_measures": {
146
+ "loudness_lufs": -23.566366876485123,
147
+ "seconds": 8.0
148
+ },
149
+ "_wer": 0.20833333333333334,
150
+ "_transcript": "Lady Isabelle remnants traded. She wished to go farther on where they might get quicker news from England, but her well-not was as nothing."
151
+ },
152
+ {
153
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2836_5354_000007_000005_energy+0.50.wav",
154
+ "text": "Lady Isabel remonstrated; she wished to go farther on, where they might get quicker news from England; but her will now was as nothing.",
155
+ "group": "2836_5354_000007_000005",
156
+ "requested": {
157
+ "energy": 0.5
158
+ },
159
+ "baseline": false,
160
+ "_measures": {
161
+ "loudness_lufs": -22.707726456723588,
162
+ "seconds": 7.968
163
+ },
164
+ "_wer": 0.125,
165
+ "_transcript": "Lady Isabelle remonstrated, she wished to go farther on where they might get quicker news from England, but her well now was his nothing."
166
+ },
167
+ {
168
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2836_5354_000007_000005_energy+1.00.wav",
169
+ "text": "Lady Isabel remonstrated; she wished to go farther on, where they might get quicker news from England; but her will now was as nothing.",
170
+ "group": "2836_5354_000007_000005",
171
+ "requested": {
172
+ "energy": 1.0
173
+ },
174
+ "baseline": false,
175
+ "_measures": {
176
+ "loudness_lufs": -21.988775841583085,
177
+ "seconds": 7.914666666666666
178
+ },
179
+ "_wer": 0.16666666666666666,
180
+ "_transcript": "Lady Isabelle remonstrated, she wished to go farther on where they might get quicker news from England, but her well now is nothing."
181
+ },
182
+ {
183
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/1355_39947_000026_000004_energy-1.00.wav",
184
+ "text": "Nothing seems more unfit to give a deeper meaning to life and a higher value.",
185
+ "group": "1355_39947_000026_000004",
186
+ "requested": {
187
+ "energy": -1.0
188
+ },
189
+ "baseline": false,
190
+ "_measures": {
191
+ "loudness_lufs": -30.42681682748094,
192
+ "seconds": 4.352
193
+ },
194
+ "_wer": 0.0,
195
+ "_transcript": "Nothing seems more unfit to give a deeper meaning to life and a higher value."
196
+ },
197
+ {
198
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/1355_39947_000026_000004_energy-0.50.wav",
199
+ "text": "Nothing seems more unfit to give a deeper meaning to life and a higher value.",
200
+ "group": "1355_39947_000026_000004",
201
+ "requested": {
202
+ "energy": -0.5
203
+ },
204
+ "baseline": false,
205
+ "_measures": {
206
+ "loudness_lufs": -28.188398663502763,
207
+ "seconds": 4.362666666666667
208
+ },
209
+ "_wer": 0.0,
210
+ "_transcript": "Nothing seems more unfit to give a deeper meaning to life and a higher value."
211
+ },
212
+ {
213
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/1355_39947_000026_000004_energy+0.00.wav",
214
+ "text": "Nothing seems more unfit to give a deeper meaning to life and a higher value.",
215
+ "group": "1355_39947_000026_000004",
216
+ "requested": {
217
+ "energy": 0.0
218
+ },
219
+ "baseline": true,
220
+ "_measures": {
221
+ "loudness_lufs": -27.07912263198353,
222
+ "seconds": 4.373333333333333
223
+ },
224
+ "_wer": 0.0,
225
+ "_transcript": "Nothing seems more unfit to give a deeper meaning to life and a higher value."
226
+ },
227
+ {
228
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/1355_39947_000026_000004_energy+0.50.wav",
229
+ "text": "Nothing seems more unfit to give a deeper meaning to life and a higher value.",
230
+ "group": "1355_39947_000026_000004",
231
+ "requested": {
232
+ "energy": 0.5
233
+ },
234
+ "baseline": false,
235
+ "_measures": {
236
+ "loudness_lufs": -25.777505271589877,
237
+ "seconds": 4.330666666666667
238
+ },
239
+ "_wer": 0.0,
240
+ "_transcript": "Nothing seems more unfit to give a deeper meaning to life and a higher value."
241
+ },
242
+ {
243
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/1355_39947_000026_000004_energy+1.00.wav",
244
+ "text": "Nothing seems more unfit to give a deeper meaning to life and a higher value.",
245
+ "group": "1355_39947_000026_000004",
246
+ "requested": {
247
+ "energy": 1.0
248
+ },
249
+ "baseline": false,
250
+ "_measures": {
251
+ "loudness_lufs": -24.584105856460084,
252
+ "seconds": 4.330666666666667
253
+ },
254
+ "_wer": 0.0,
255
+ "_transcript": "Nothing seems more unfit to give a deeper meaning to life and a higher value."
256
+ },
257
+ {
258
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2416_152137_000049_000000_energy-1.00.wav",
259
+ "text": "Jimmie Dale nodded, grinned back, emptied his glass, and dug for a coin.",
260
+ "group": "2416_152137_000049_000000",
261
+ "requested": {
262
+ "energy": -1.0
263
+ },
264
+ "baseline": false,
265
+ "_measures": {
266
+ "loudness_lufs": -32.16860392691916,
267
+ "seconds": 4.469333333333333
268
+ },
269
+ "_wer": 0.07692307692307693,
270
+ "_transcript": "Jimmy Dale nodded, grinned back, emptied his glass, and dug for a coin."
271
+ },
272
+ {
273
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2416_152137_000049_000000_energy-0.50.wav",
274
+ "text": "Jimmie Dale nodded, grinned back, emptied his glass, and dug for a coin.",
275
+ "group": "2416_152137_000049_000000",
276
+ "requested": {
277
+ "energy": -0.5
278
+ },
279
+ "baseline": false,
280
+ "_measures": {
281
+ "loudness_lufs": -29.79683874930907,
282
+ "seconds": 4.437333333333333
283
+ },
284
+ "_wer": 0.15384615384615385,
285
+ "_transcript": "Jimmy Dale nodded, grinned back, emptied his class, and dug for a coin."
286
+ },
287
+ {
288
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2416_152137_000049_000000_energy+0.00.wav",
289
+ "text": "Jimmie Dale nodded, grinned back, emptied his glass, and dug for a coin.",
290
+ "group": "2416_152137_000049_000000",
291
+ "requested": {
292
+ "energy": 0.0
293
+ },
294
+ "baseline": true,
295
+ "_measures": {
296
+ "loudness_lufs": -28.61113407931438,
297
+ "seconds": 4.426666666666667
298
+ },
299
+ "_wer": 0.15384615384615385,
300
+ "_transcript": "Jimmy Dale nodded, grinned back, emptied his glass and dug for coin."
301
+ },
302
+ {
303
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2416_152137_000049_000000_energy+0.50.wav",
304
+ "text": "Jimmie Dale nodded, grinned back, emptied his glass, and dug for a coin.",
305
+ "group": "2416_152137_000049_000000",
306
+ "requested": {
307
+ "energy": 0.5
308
+ },
309
+ "baseline": false,
310
+ "_measures": {
311
+ "loudness_lufs": -26.574553895271247,
312
+ "seconds": 4.416
313
+ },
314
+ "_wer": 0.15384615384615385,
315
+ "_transcript": "Jimmy Dale nodded, grinned back, emptied his class and dug for a coin."
316
+ },
317
+ {
318
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/2416_152137_000049_000000_energy+1.00.wav",
319
+ "text": "Jimmie Dale nodded, grinned back, emptied his glass, and dug for a coin.",
320
+ "group": "2416_152137_000049_000000",
321
+ "requested": {
322
+ "energy": 1.0
323
+ },
324
+ "baseline": false,
325
+ "_measures": {
326
+ "loudness_lufs": -25.059800199516754,
327
+ "seconds": 4.426666666666667
328
+ },
329
+ "_wer": 0.07692307692307693,
330
+ "_transcript": "Jimmy Dale nodded, grinned back, emptied his glass and dug for a coin."
331
+ },
332
+ {
333
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/229_130880_000036_000000_energy-1.00.wav",
334
+ "text": "I went back to reading Sirr's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws.",
335
+ "group": "229_130880_000036_000000",
336
+ "requested": {
337
+ "energy": -1.0
338
+ },
339
+ "baseline": false,
340
+ "_measures": {
341
+ "loudness_lufs": -30.511969970211005,
342
+ "seconds": 7.8613333333333335
343
+ },
344
+ "_wer": 0.043478260869565216,
345
+ "_transcript": "I went back to reading Sir's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide-open jaws."
346
+ },
347
+ {
348
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/229_130880_000036_000000_energy-0.50.wav",
349
+ "text": "I went back to reading Sirr's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws.",
350
+ "group": "229_130880_000036_000000",
351
+ "requested": {
352
+ "energy": -0.5
353
+ },
354
+ "baseline": false,
355
+ "_measures": {
356
+ "loudness_lufs": -28.42813339270484,
357
+ "seconds": 7.872
358
+ },
359
+ "_wer": 0.043478260869565216,
360
+ "_transcript": "I went back to reading Sir's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws."
361
+ },
362
+ {
363
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/229_130880_000036_000000_energy+0.00.wav",
364
+ "text": "I went back to reading Sirr's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws.",
365
+ "group": "229_130880_000036_000000",
366
+ "requested": {
367
+ "energy": 0.0
368
+ },
369
+ "baseline": true,
370
+ "_measures": {
371
+ "loudness_lufs": -27.25318841166259,
372
+ "seconds": 7.8613333333333335
373
+ },
374
+ "_wer": 0.043478260869565216,
375
+ "_transcript": "I went back to reading Sir's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws."
376
+ },
377
+ {
378
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/229_130880_000036_000000_energy+0.50.wav",
379
+ "text": "I went back to reading Sirr's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws.",
380
+ "group": "229_130880_000036_000000",
381
+ "requested": {
382
+ "energy": 0.5
383
+ },
384
+ "baseline": false,
385
+ "_measures": {
386
+ "loudness_lufs": -26.1972440295459,
387
+ "seconds": 7.850666666666666
388
+ },
389
+ "_wer": 0.043478260869565216,
390
+ "_transcript": "I went back to reading Sir's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws."
391
+ },
392
+ {
393
+ "wav": "/data/model-training/sonora/derisk_eval/2026-07-15_00-20-31_epoch099/229_130880_000036_000000_energy+1.00.wav",
394
+ "text": "I went back to reading Sirr's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide open jaws.",
395
+ "group": "229_130880_000036_000000",
396
+ "requested": {
397
+ "energy": 1.0
398
+ },
399
+ "baseline": false,
400
+ "_measures": {
401
+ "loudness_lufs": -24.891463229728853,
402
+ "seconds": 7.850666666666666
403
+ },
404
+ "_wer": 0.043478260869565216,
405
+ "_transcript": "I went back to reading Sir's book, but I leafed through it mechanically. Between the lines I kept seeing fearsome, wide-open jaws."
406
+ }
407
+ ]
408
+ }
derisk-energy-24k/gate_history.jsonl ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ {"time": "2026-07-15T00:41:54+00:00", "epoch": null, "checkpoint": "/data/model-training/sonora/warmstart/derisk_energy_init.ckpt", "n_groups": 2, "rho_min_abs": null, "leakage_max": -1.2279891153654292e-07, "wer_delta_max": 0.0, "converged": false, "fails": ["1355_39947_000026_000004:energy rho=nan", "2836_5354_000007_000005:energy rho=nan"], "thresholds": {"rho_min": 0.9, "leakage_max": 0.2, "wer_delta_max": 0.1}}
2
+ {"time": "2026-07-16T11:11:46+00:00", "epoch": 99, "checkpoint": "/data/model-training/sonora/logs/train/derisk_energy/runs/2026-07-15_00-20-31/checkpoints/checkpoint_epoch=099.ckpt", "n_groups": 4, "rho_min_abs": 0.9999999999999999, "leakage_max": 0.09068675915733262, "wer_delta_max": 0.04166666666666666, "converged": true, "fails": [], "thresholds": {"rho_min": 0.9, "leakage_max": 0.2, "wer_delta_max": 0.1}}
derisk-energy-24k/render_meta.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "checkpoint": "/data/model-training/sonora/logs/train/derisk_energy/runs/2026-07-15_00-20-31/checkpoints/checkpoint_epoch=099.ckpt",
3
+ "vocoder": "/data/model-training/vocoder/cp_hifigan_24k/g_02510000",
4
+ "channel": "energy",
5
+ "values": [
6
+ -1.0,
7
+ -0.5,
8
+ 0.0,
9
+ 0.5,
10
+ 1.0
11
+ ],
12
+ "clips": [
13
+ "/data/model-training/datasets/LibriTTS_R/train-clean-100/2836/5354/2836_5354_000007_000005.wav",
14
+ "/data/model-training/datasets/LibriTTS_R/train-clean-100/1355/39947/1355_39947_000026_000004.wav",
15
+ "/data/model-training/datasets/LibriTTS_R/train-clean-100/2416/152137/2416_152137_000049_000000.wav",
16
+ "/data/model-training/datasets/LibriTTS_R/train-clean-100/229/130880/229_130880_000036_000000.wav"
17
+ ],
18
+ "n_timesteps": 10,
19
+ "temperature": 0.667,
20
+ "length_scale": 1.0,
21
+ "seed": 1234
22
+ }
derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy+0.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3b18dbec23d7594cde7fd55b7382fd197aec97fac4d48e7784e37bececc0b79
3
+ size 209964
derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy+0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46c1cf8100fcfc6b4837055758d20de21225f19da249d3081764ac334da30b44
3
+ size 207916
derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy+1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1389dd3812aea1aecbc975e45ccf7feecd07fb9805b4b8cfdbeee6a4d08c1a9c
3
+ size 207916
derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy-0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b671fd77ab86dcc7c2fa738469b2c70573f614289f089bd4989ca2a118aec091
3
+ size 209452
derisk-energy-24k/sweep_samples/1355_39947_000026_000004_energy-1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5037b3b161062cfa57ca9d2c4d41d4e8ac7663321d576bab18a81fba999449c2
3
+ size 208940
derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy+0.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:815c5f255beaa04369528cc66e38e01d2052660d5b71d6ef98e7a3d4d2a8a3bb
3
+ size 377388
derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy+0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3d1a60700388b534b11c419e335326c9d7be4c7a278fc8e3249a86e4d20e62c
3
+ size 376876
derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy+1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40e1817e5acc04d648fde00cbd3f0762fb7a2408b7643be193e776102ab7071f
3
+ size 376876
derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy-0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07cdabf4d377089179005bc086d5770b8f3ddcc57cc66d7bc62ee9246b378fbe
3
+ size 377900
derisk-energy-24k/sweep_samples/229_130880_000036_000000_energy-1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2594a815fb31a476e24557878ffeb76b22b1f0a81a2d394b0c00ae1db9e98164
3
+ size 377388
derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy+0.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:413d64136c9d4d4d24a8bd9d2dfe9d5a399facde638a8f9e8f6099ac14c69c56
3
+ size 212524
derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy+0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26610d245cfaa59420d5bfcc59ce8315187a4ad104aebf0ce0f2447396488fcd
3
+ size 212012
derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy+1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac2dcb930f097503dcd76f4a65a4f9b128d9f219c912801f8ab61a83f477f452
3
+ size 212524
derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy-0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dbb2fab8f252df2a2028f16bd9e5bf8c4b1c5d3aa40f9e7641146e97dd4d3e9
3
+ size 213036
derisk-energy-24k/sweep_samples/2416_152137_000049_000000_energy-1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74e6dc986ceb9308010d98cfa735c51718574a053cc95723b088421ece405524
3
+ size 214572
derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy+0.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f25f69e39d4b539818fc330108d90223a4d0a130659cf3ecc8df767d18653b0
3
+ size 384044
derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy+0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42d805b02d18006042df13f312994072405bbfda5cbcd5fccda424eba7251022
3
+ size 382508
derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy+1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e22d8f93b0b618d79ee3e4e4af313d93e3fa28da9808adf8189fc0eb39becda
3
+ size 379948
derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy-0.50.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcf259d049de139feb37c5d04ea43af6b56a9cb6a08daad3ba47e790c3025071
3
+ size 384044
derisk-energy-24k/sweep_samples/2836_5354_000007_000005_energy-1.00.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61d0da98f0b6b3869bb17c37f740b844aee124b280141ca206602e4ea8bbee61
3
+ size 383020