Upload docs/FROZEN_STATE.md with huggingface_hub
Browse files- docs/FROZEN_STATE.md +15 -0
docs/FROZEN_STATE.md
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Fractus training FROZEN
|
| 2 |
+
**Frozen at:** 2026-08-18T04:18:24.322592+00:00
|
| 3 |
+
|
| 4 |
+
| GPU | tokens | ema_tf |
|
| 5 |
+
|-----|--------|--------|
|
| 6 |
+
| 0 | 15,585,280 | 8.226 |
|
| 7 |
+
| 1 | 15,984,640 | 9.44 |
|
| 8 |
+
| 2 | 15,708,160 | 9.404 |
|
| 9 |
+
| 3 | 17,315,840 | 13.671 |
|
| 10 |
+
| 4 | 15,769,600 | 39.887 |
|
| 11 |
+
| 5 | 15,872,000 | 23.703 |
|
| 12 |
+
| 6 | 16,087,040 | 23.52 |
|
| 13 |
+
| 7 | 17,408,000 | 26.869 |
|
| 14 |
+
|
| 15 |
+
Resume from FROZEN_RESUME_MANIFEST.json START_TOKEN per GPU. Phase2 shards on HF dataset.
|