chirpchirp commited on
Commit
7c0acf9
·
verified ·
1 Parent(s): aadd203

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -12
README.md CHANGED
@@ -16,12 +16,12 @@ pipeline_tag: text-generation
16
 
17
  Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
18
 
19
- Highlights:
20
 
21
- - **End-to-End Self-Improvement**: Ornith-1.5 extends the self-scaffolding framework introduced in Ornith-1.0 into a complete self-improvement loop: the model proposes new tasks, generates task-specific scaffolds, and produces solution rollouts for reinforcement learning, continuously creating new learning experiences from which it can improve. Task generation, scaffold construction, and solution rollouts are all optimized jointly with GRPO, so the model continually expands its own curriculum and adapts its problem-solving strategies.
22
- - **State-of-the-Art General Intelligence**: Designed for strong general-purpose intelligence across reasoning, agentic, and coding tasks, Ornith-1.5 achieves state-of-the-art performance among open-source models of comparable size across a broad range of benchmarks.
23
- - **Edge-Deployable 9B**: Ornith-1.5-9B achieves 47.0 on Terminal-Bench 2.1 (Claude Code) and 70.6 on SWE-Bench Verified matching or exceeding much larger models such as Gemma 4-31B and Qwen 3.6-35B. With its quantized **Ornith-1.5-9B-Mobile** version, it can be readily deployed on iPhone and Android devices.
24
- - **Licence**: MIT licensed, globally accessible, and free from regional limitations.
 
25
 
26
  <img style="width: 100%; max-width: 900px;" src="assets/ornith_9b_eval.png" alt="Ornith 1.5 9B Benchmark Results" title="Ornith 1.5 9B Benchmark Results">
27
 
@@ -193,13 +193,6 @@ This model card documents **Ornith-1.5-9B**, the most lightweight member of the
193
 
194
  </div>
195
 
196
- ## Self-Improvement through Self-Generated Tasks, Harnesses, and Solutions
197
-
198
- Ornith-1.5 extends Ornith-1.0 by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning.
199
-
200
- Each training cycle proceeds in three stages. Given an environment or codebase, high-level instructions about the task type, and access to the model's previous task-solving history, the system proposes progressively harder tasks that go beyond what the model has already solved. For each task, the model then generates or refines a task-specific scaffold — the instructions, tools, decomposition strategy, and orchestration used to approach the problem. Conditioned on the task and scaffold, the policy produces a solution rollout. Reward from the rollout is propagated across all three stages, so the system learns not only to produce better solutions, but also to generate more useful training tasks and construct more effective scaffolds.
201
-
202
- Repeated over training, this creates a closed self-improvement loop in which stronger policies enable the generation of harder and more informative tasks, evolving scaffolds discover better ways to elicit the model's capabilities, and higher-quality rollouts provide increasingly effective learning signals. For more details on the task, harness, and rollout reward design, please refer to our [blog](https://deep-reinforce.com/ornith.html).
203
 
204
  ## Quickstart
205
 
 
16
 
17
  Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
18
 
 
19
 
20
+ Ornith-1.5 extends Ornith-1.0 by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning.
21
+
22
+ Each training cycle proceeds in three stages. Given an environment or codebase, high-level instructions about the task type, and access to the model's previous task-solving history, the system proposes progressively harder tasks that go beyond what the model has already solved. For each task, the model then generates or refines a task-specific scaffold — the instructions, tools, decomposition strategy, and orchestration used to approach the problem. Conditioned on the task and scaffold, the policy produces a solution rollout. Reward from the rollout is propagated across all three stages, so the system learns not only to produce better solutions, but also to generate more useful training tasks and construct more effective scaffolds.
23
+
24
+ Repeated over training, this creates a closed self-improvement loop in which stronger policies enable the generation of harder and more informative tasks, evolving scaffolds discover better ways to elicit the model's capabilities, and higher-quality rollouts provide increasingly effective learning signals. For more details on the task, harness, and rollout reward design, please refer to our [blog](https://deep-reinforce.com/ornith.html).
25
 
26
  <img style="width: 100%; max-width: 900px;" src="assets/ornith_9b_eval.png" alt="Ornith 1.5 9B Benchmark Results" title="Ornith 1.5 9B Benchmark Results">
27
 
 
193
 
194
  </div>
195
 
 
 
 
 
 
 
 
196
 
197
  ## Quickstart
198