Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,58 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
datasets:
|
| 4 |
+
- interstellarninja/hermes_reasoning_tool_use
|
| 5 |
+
- crownelius/Opus-4.6-Reasoning-2100x-formatted
|
| 6 |
+
- ronantakizawa/github-top-code
|
| 7 |
+
base_model:
|
| 8 |
+
- nvidia/Cosmos-Reason2-2B
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
|
| 12 |
+
|
| 13 |
+
# Karla C1: The Adaptive Brain for Physical AI
|
| 14 |
+
|
| 15 |
+
**Karla C1** is a novel, continuous-learning architecture designed for Physical AI and embodied agents. Built on top of **NVIDIA Cosmos-Reason2-2B**, it solves the problem of catastrophic forgetting in robotics by implementing a **Nested Learning Architecture** [1] with *Surprise-Based Plasticity*.
|
| 16 |
+
|
| 17 |
+
## The Vision: Physical AI on the Edge
|
| 18 |
+
|
| 19 |
+
Robots in the real world encounter new tools and constraints daily. Karla allows an agent to learn a new physical tool or API *on the fly* during inference, modifying its own weights in seconds on consumer hardware (e.g., RTX 4060 Ti), without ever forgetting its foundational knowledge.
|
| 20 |
+
|
| 21 |
+
## Architecture: Nested Learning
|
| 22 |
+
|
| 23 |
+
Instead of a standard transformer pipeline, Karla acts as a multi-frequency brain based on the Nested Learning (NL) paradigm [1]:
|
| 24 |
+
|
| 25 |
+
1. **L0 (The Subconscious): NVIDIA Cosmos-Reason2-2B (Frozen).** Provides world-class reasoning, semantic understanding, and syntax. Loaded in 4-bit to save VRAM.
|
| 26 |
+
2. **L1 (The RAM): Dynamic Knowledge MoE (64 Experts).** A fast, GPU-based Mixture of Experts. It updates *live during inference* using Delta Gradient Descent [1], memorizing new facts and tool syntaxes instantly.
|
| 27 |
+
3. **L2 (The Frontal Lobe): Continuous Thought Machine (CTM).** Based on Sakana AI's research [2], this is a parallel sequence-level reasoning module. It takes Cosmos's hidden states + L1 knowledge and "thinks" for $T$ internal ticks before outputting an action plan.
|
| 28 |
+
|
| 29 |
+
> [!WARNING]
|
| 30 |
+
> The L2 module currently faces stability issues where the CTM's internal dynamics can lead to token repetition during long reasoning chains.
|
| 31 |
+
|
| 32 |
+
## Quickstart
|
| 33 |
+
|
| 34 |
+
```bash
|
| 35 |
+
pip install torch transformers datasets pandas accelerate bitsandbytes
|
| 36 |
+
cd Karla
|
| 37 |
+
python chat.py
|
| 38 |
+
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
## TODO
|
| 42 |
+
|
| 43 |
+
* [ ] Train Longer
|
| 44 |
+
* [ ] Make L1 Inference Learning Intensity variable
|
| 45 |
+
* [ ] Give the model control over itself
|
| 46 |
+
* [ ] Fix stuttering
|
| 47 |
+
|
| 48 |
+
## Datasets Used
|
| 49 |
+
|
| 50 |
+
* `interstellarninja/hermes_reasoning_tool_use`
|
| 51 |
+
* `crownelius/Opus-4.6-Reasoning-2100x-formatted`
|
| 52 |
+
* `ronantakizawa/github-top-code`
|
| 53 |
+
|
| 54 |
+
## References
|
| 55 |
+
|
| 56 |
+
[1] Behrouz, A., Razaviyayn, M., Zhong, P., & Mirrokni, V. (2025). **Nested Learning: The Illusion of Deep Learning Architecture**. *Google Research*. [arXiv:2512.24695](https://arxiv.org/abs/2512.24695)
|
| 57 |
+
|
| 58 |
+
[2] Darlow, L., Regan, C., Risi, S., Seely, J., & Jones, L. (2025). **Continuous Thought Machines**. *Sakana AI*. [arXiv:2505.05522](https://arxiv.org/abs/2505.05522)
|