Spaces:

Papajams
/

repro-grokking-ca-local-rules

Running

App Files Files Community

Papajams commited on Aug 16

Commit

902f0ca

·

verified ·

1 Parent(s): 326232f

Update logbook: Repro: jmlr-22-1228-ca-grokking

Files changed (9) hide show

logbook.json +4 -4
pages/claim-c1-critical-exponent-in-1d-exponential-model/page.md +0 -0
pages/claim-c2-critical-exponent-in-d-dimensional-uniform-ball-model/page.md +0 -0
pages/claim-c3-grokking-probability-increases-with-l1-regularisation/page.md +0 -0
pages/claim-c4-grokking-probability-decreases-with-dimension-d/page.md +0 -0
pages/claim-c5-rule-30-ca-learning-exhibits-grokking/page.md +0 -0
pages/claim-c6-grokking-time-distribution-bimodality/page.md +0 -0
pages/conclusion/page.md +1 -10
pages/executive-summary/page.md +2 -21

logbook.json CHANGED Viewed

@@ -5,7 +5,7 @@
   "space_id": "Papajams/repro-grokking-ca-local-rules",
   "paper": null,
   "tags": [],
-  "updated_at": "2026-08-16T13:42:12+00:00",
   "root": {
     "slug": "index",
     "title": "Repro: jmlr-22-1228-ca-grokking",
@@ -68,10 +68,10 @@
     "total_size": 0,
     "bucket_id": null
   },
-  "agent_view_tokens": 12713,
-  "trace_view_tokens": 1725,
   "workspace_view_tokens": 8,
-  "revision": "da1960ca1982d5e184a4",
   "traces_ref": {
     "repo_id": "Papajams/repro-grokking-ca-local-rules-traces",
     "repo_type": "dataset",

   "space_id": "Papajams/repro-grokking-ca-local-rules",
   "paper": null,
   "tags": [],
+  "updated_at": "2026-08-16T13:47:38+00:00",
   "root": {
     "slug": "index",
     "title": "Repro: jmlr-22-1228-ca-grokking",
     "total_size": 0,
     "bucket_id": null
   },
+  "agent_view_tokens": 6640,
+  "trace_view_tokens": 1969,
   "workspace_view_tokens": 8,
+  "revision": "895f03a680e181bf4ed4",
   "traces_ref": {
     "repo_id": "Papajams/repro-grokking-ca-local-rules-traces",
     "repo_type": "dataset",

pages/claim-c1-critical-exponent-in-1d-exponential-model/page.md CHANGED Viewed

The diff for this file is too large to render. See raw diff

pages/claim-c2-critical-exponent-in-d-dimensional-uniform-ball-model/page.md CHANGED Viewed

The diff for this file is too large to render. See raw diff

pages/claim-c3-grokking-probability-increases-with-l1-regularisation/page.md CHANGED Viewed

The diff for this file is too large to render. See raw diff

pages/claim-c4-grokking-probability-decreases-with-dimension-d/page.md CHANGED Viewed

The diff for this file is too large to render. See raw diff

pages/claim-c5-rule-30-ca-learning-exhibits-grokking/page.md CHANGED Viewed

The diff for this file is too large to render. See raw diff

pages/claim-c6-grokking-time-distribution-bimodality/page.md CHANGED Viewed

The diff for this file is too large to render. See raw diff

pages/conclusion/page.md CHANGED Viewed

@@ -3,16 +3,7 @@
 ---
 <!-- trackio-cell
-{"type": "markdown", "id": "cell_371ca1b8f261", "created_at": "2026-08-16T13:41:12+00:00", "title": "Conclusion"}
--->
-Of 6 claims: **5 supported**, **0 falsified**, **1 inconclusive or not audited**.
-All attempts (including failed runs) are preserved in the attached trace. Falsified or inconclusive outcomes are reported as results, not patched.
----
-<!-- trackio-cell
-{"type": "markdown", "id": "cell_f8ddb7c4c75f", "created_at": "2026-08-16T13:41:48+00:00", "title": "Conclusion"}
 -->
 Of 6 claims: **5 supported**, **0 falsified**, **1 inconclusive or not audited**.

 ---
 <!-- trackio-cell
+{"type": "markdown", "id": "cell_ca4268d2cfd6", "created_at": "2026-08-16T13:47:25+00:00", "title": "Conclusion"}
 -->
 Of 6 claims: **5 supported**, **0 falsified**, **1 inconclusive or not audited**.

pages/executive-summary/page.md CHANGED Viewed

@@ -3,32 +3,13 @@
 ---
 <!-- trackio-cell
-{"type": "markdown", "id": "cell_fd34006b0362", "created_at": "2026-08-16T13:40:53+00:00", "title": "Executive summary"}
 -->
 **Verdict so far:** 5 supported, 0 falsified, 1 inconclusive/not audited of 6 extracted claims.
 Paper: jmlr-22-1228-ca-grokking
-Pipeline run: `20260816-144051-jmlr-22-1228-ca-grokking` — extract → audit → evidence → judge. 31 LLM calls, 65 tool runs, wall 0.0 min. Model: moonshotai/Kimi-K3.
-## Scope & cost
-| | This audit | Full replication |
-|---|---|---|
-| Compute | CPU-only, ≈0.0 min | paper's full training budget |
-| Claims checked | 6 of 6 | all |
-| Evidence | numerical audits + figures + trace | paper's own experiments |
----
-<!-- trackio-cell
-{"type": "markdown", "id": "cell_27f1a4ec330f", "created_at": "2026-08-16T13:41:28+00:00", "title": "Executive summary"}
--->
-**Verdict so far:** 5 supported, 0 falsified, 1 inconclusive/not audited of 6 extracted claims.
-Paper: jmlr-22-1228-ca-grokking
-Pipeline run: `20260816-144127-jmlr-22-1228-ca-grokking` — extract → audit → evidence → judge. 31 LLM calls, 109 tool runs, wall 0.0 min. Model: moonshotai/Kimi-K3.
 ## Scope & cost

 ---
 <!-- trackio-cell
+{"type": "markdown", "id": "cell_7a96eabd4cc9", "created_at": "2026-08-16T13:47:07+00:00", "title": "Executive summary"}
 -->
 **Verdict so far:** 5 supported, 0 falsified, 1 inconclusive/not audited of 6 extracted claims.
 Paper: jmlr-22-1228-ca-grokking
+Pipeline run: `20260816-144705-jmlr-22-1228-ca-grokking` — extract → audit → evidence → judge. 31 LLM calls, 154 tool runs, wall 0.0 min. Model: moonshotai/Kimi-K3.
 ## Scope & cost