GurkeBaui commited on
Commit
cf8159d
·
verified ·
1 Parent(s): 311ea54

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -3
README.md CHANGED
@@ -1,3 +1,58 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - interstellarninja/hermes_reasoning_tool_use
5
+ - crownelius/Opus-4.6-Reasoning-2100x-formatted
6
+ - ronantakizawa/github-top-code
7
+ base_model:
8
+ - nvidia/Cosmos-Reason2-2B
9
+ ---
10
+
11
+
12
+
13
+ # Karla C1: The Adaptive Brain for Physical AI
14
+
15
+ **Karla C1** is a novel, continuous-learning architecture designed for Physical AI and embodied agents. Built on top of **NVIDIA Cosmos-Reason2-2B**, it solves the problem of catastrophic forgetting in robotics by implementing a **Nested Learning Architecture** [1] with *Surprise-Based Plasticity*.
16
+
17
+ ## The Vision: Physical AI on the Edge
18
+
19
+ Robots in the real world encounter new tools and constraints daily. Karla allows an agent to learn a new physical tool or API *on the fly* during inference, modifying its own weights in seconds on consumer hardware (e.g., RTX 4060 Ti), without ever forgetting its foundational knowledge.
20
+
21
+ ## Architecture: Nested Learning
22
+
23
+ Instead of a standard transformer pipeline, Karla acts as a multi-frequency brain based on the Nested Learning (NL) paradigm [1]:
24
+
25
+ 1. **L0 (The Subconscious): NVIDIA Cosmos-Reason2-2B (Frozen).** Provides world-class reasoning, semantic understanding, and syntax. Loaded in 4-bit to save VRAM.
26
+ 2. **L1 (The RAM): Dynamic Knowledge MoE (64 Experts).** A fast, GPU-based Mixture of Experts. It updates *live during inference* using Delta Gradient Descent [1], memorizing new facts and tool syntaxes instantly.
27
+ 3. **L2 (The Frontal Lobe): Continuous Thought Machine (CTM).** Based on Sakana AI's research [2], this is a parallel sequence-level reasoning module. It takes Cosmos's hidden states + L1 knowledge and "thinks" for $T$ internal ticks before outputting an action plan.
28
+
29
+ > [!WARNING]
30
+ > The L2 module currently faces stability issues where the CTM's internal dynamics can lead to token repetition during long reasoning chains.
31
+
32
+ ## Quickstart
33
+
34
+ ```bash
35
+ pip install torch transformers datasets pandas accelerate bitsandbytes
36
+ cd Karla
37
+ python chat.py
38
+
39
+ ```
40
+
41
+ ## TODO
42
+
43
+ * [ ] Train Longer
44
+ * [ ] Make L1 Inference Learning Intensity variable
45
+ * [ ] Give the model control over itself
46
+ * [ ] Fix stuttering
47
+
48
+ ## Datasets Used
49
+
50
+ * `interstellarninja/hermes_reasoning_tool_use`
51
+ * `crownelius/Opus-4.6-Reasoning-2100x-formatted`
52
+ * `ronantakizawa/github-top-code`
53
+
54
+ ## References
55
+
56
+ [1] Behrouz, A., Razaviyayn, M., Zhong, P., & Mirrokni, V. (2025). **Nested Learning: The Illusion of Deep Learning Architecture**. *Google Research*. [arXiv:2512.24695](https://arxiv.org/abs/2512.24695)
57
+
58
+ [2] Darlow, L., Regan, C., Risi, S., Seely, J., & Jones, L. (2025). **Continuous Thought Machines**. *Sakana AI*. [arXiv:2505.05522](https://arxiv.org/abs/2505.05522)