File size: 699 Bytes
767d007 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 | # Stage2 Fine Phase — Loss Recalibration
**Date:** 2026-08-16 22:53 UTC
## Why
At CE ~2.0 the cumulative average log was no longer a good control signal.
Generation quality is still noisy (expected ~200M tokens) — keep digesting.
Recalibrate **metrics + LR**, not weights.
## Changes
| Item | Before | Fine phase |
|------|--------|------------|
| LR | 1e-3 | **5e-4** |
| Logged CE | cumulative mean from resume | **batch CE + EMA (beta=0.98)** |
| tok/s | absolute position / session time (inflated) | **session tokens / elapsed** |
| Objective | dense CE + 0.02*lb | unchanged |
| Weights | — | **kept**, resume exact token offset |
## Resume offsets (at switch)
See .
## Script
|