docs+code: decode surgery I window-64 anti-copy 2026-08-28
Browse files- docs/EVOLUTION.md +11 -0
docs/EVOLUTION.md
CHANGED
|
@@ -107,3 +107,14 @@ Full log: `docs/2026-08-28-NIGHT-SS-X8.md`.
|
|
| 107 |
- All 8 live checkpoints + hourly HF push to `thefinalboss/fractus-cte/checkpoints/x8run/`.
|
| 108 |
- B=4 + SS_RATE=1.0 live: ~27 GB, ~990 tok/s/GPU, ~40M tokens/GPU on 430M phase-2 shards.
|
| 109 |
- Speech not claimed. SS is the training-side fix; PREFIX unique@40 is the gate.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 107 |
- All 8 live checkpoints + hourly HF push to `thefinalboss/fractus-cte/checkpoints/x8run/`.
|
| 108 |
- B=4 + SS_RATE=1.0 live: ~27 GB, ~990 tok/s/GPU, ~40M tokens/GPU on 430M phase-2 shards.
|
| 109 |
- Speech not claimed. SS is the training-side fix; PREFIX unique@40 is the gate.
|
| 110 |
+
|
| 111 |
+
## 2026-08-28 16:35 PDT — Decode surgery I
|
| 112 |
+
|
| 113 |
+
Space output `Retail×32` proved the length-1 carry decode is an attractor, not a sentence.
|
| 114 |
+
|
| 115 |
+
`fractus/generate_aligned.py` now decodes with a 64-token causal window and masks the previous token. Trainers not stopped.
|
| 116 |
+
|
| 117 |
+
unique@32 after: 16 / 14 / 27 / 12. Short cycles left. Gate still PREFIX unique@40.
|
| 118 |
+
|
| 119 |
+
`docs/2026-08-28-DECODE-WINDOW.md`
|
| 120 |
+
|