Stage 7: the randomised-graph control has been run
Browse files
README.md
CHANGED
|
@@ -67,8 +67,10 @@ Both retained selectors land on update 16,600 here, so `min-ce.safetensors` and
|
|
| 67 |
The comparison against the released reference is **not** controlled — its training
|
| 68 |
stories and trainer are unknown. The controlled finding is that constraining the readout
|
| 69 |
rank acts as a regularizer against overfitting 1,000 short stories; it says nothing about
|
| 70 |
-
whether the fly's wiring is a good prior for language.
|
| 71 |
-
|
|
|
|
|
|
|
| 72 |
|
| 73 |
The connectome is not duplicated here; it lives in
|
| 74 |
[fly-connectome-49k](https://huggingface.co/datasets/fernandofernandes/fly-connectome-49k),
|
|
|
|
| 67 |
The comparison against the released reference is **not** controlled — its training
|
| 68 |
stories and trainer are unknown. The controlled finding is that constraining the readout
|
| 69 |
rank acts as a regularizer against overfitting 1,000 short stories; it says nothing about
|
| 70 |
+
whether the fly's wiring is a good prior for language. A randomised-graph control has since
|
| 71 |
+
measured that directly: rewiring the connectome at random, with every degree and weight
|
| 72 |
+
preserved, costs **0.0100 nats [+0.0026, +0.0175]** — about 1% of this architecture's margin
|
| 73 |
+
over the reference. The wiring contributes something, and very little of it.
|
| 74 |
|
| 75 |
The connectome is not duplicated here; it lives in
|
| 76 |
[fly-connectome-49k](https://huggingface.co/datasets/fernandofernandes/fly-connectome-49k),
|