# Pod state live — 2026-08-17T23:50:38.680454+00:00

## Training
- Phase: **phase2** (raw HF dataset tokenized)
- 8x RTX 5090, BATCH=2, SEQ=128, LR=7e-4, SS_RATE=0.25
- Shard: `data/shard_phase2_gpu{0-7}.npy` (~430M tokens each, memmap)
- Total phase2 corpus: **3,439,171,703** tokens
- Weights continuous from phase1 (~11M tokens on 1.52B .pt corpus)

## Anti re-ingest
- Phase1 stream (1.52B pt) separate from phase2 (raw jsonl/gz)
- RESUME_MANIFEST_8GPU.json tracks offsets
- PHASE_SWITCH.json records switch timestamp

## Artifacts on HF
- Model repo `thefinalboss/fractus-cte`: checkpoints, scripts, docs
- Dataset repo `thefinalboss/fractus-datasets`: original + phase2 tokenized npy shards

## Do not destroy pod