Instructions to use ornith-ai/Ornith-1.5-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ornith-ai/Ornith-1.5-9B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ornith-ai/Ornith-1.5-9B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("ornith-ai/Ornith-1.5-9B") model = AutoModelForMultimodalLM.from_pretrained("ornith-ai/Ornith-1.5-9B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ornith-ai/Ornith-1.5-9B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ornith-ai/Ornith-1.5-9B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ornith-ai/Ornith-1.5-9B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/ornith-ai/Ornith-1.5-9B
- SGLang
How to use ornith-ai/Ornith-1.5-9B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ornith-ai/Ornith-1.5-9B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ornith-ai/Ornith-1.5-9B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ornith-ai/Ornith-1.5-9B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ornith-ai/Ornith-1.5-9B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use ornith-ai/Ornith-1.5-9B with Docker Model Runner:
docker model run hf.co/ornith-ai/Ornith-1.5-9B
Update README.md
Browse files
README.md
CHANGED
|
@@ -16,12 +16,12 @@ pipeline_tag: text-generation
|
|
| 16 |
|
| 17 |
Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
|
| 18 |
|
| 19 |
-
Highlights:
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
|
|
|
| 25 |
|
| 26 |
<img style="width: 100%; max-width: 900px;" src="assets/ornith_9b_eval.png" alt="Ornith 1.5 9B Benchmark Results" title="Ornith 1.5 9B Benchmark Results">
|
| 27 |
|
|
@@ -193,13 +193,6 @@ This model card documents **Ornith-1.5-9B**, the most lightweight member of the
|
|
| 193 |
|
| 194 |
</div>
|
| 195 |
|
| 196 |
-
## Self-Improvement through Self-Generated Tasks, Harnesses, and Solutions
|
| 197 |
-
|
| 198 |
-
Ornith-1.5 extends Ornith-1.0 by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning.
|
| 199 |
-
|
| 200 |
-
Each training cycle proceeds in three stages. Given an environment or codebase, high-level instructions about the task type, and access to the model's previous task-solving history, the system proposes progressively harder tasks that go beyond what the model has already solved. For each task, the model then generates or refines a task-specific scaffold — the instructions, tools, decomposition strategy, and orchestration used to approach the problem. Conditioned on the task and scaffold, the policy produces a solution rollout. Reward from the rollout is propagated across all three stages, so the system learns not only to produce better solutions, but also to generate more useful training tasks and construct more effective scaffolds.
|
| 201 |
-
|
| 202 |
-
Repeated over training, this creates a closed self-improvement loop in which stronger policies enable the generation of harder and more informative tasks, evolving scaffolds discover better ways to elicit the model's capabilities, and higher-quality rollouts provide increasingly effective learning signals. For more details on the task, harness, and rollout reward design, please refer to our [blog](https://deep-reinforce.com/ornith.html).
|
| 203 |
|
| 204 |
## Quickstart
|
| 205 |
|
|
|
|
| 16 |
|
| 17 |
Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
|
| 18 |
|
|
|
|
| 19 |
|
| 20 |
+
Ornith-1.5 extends Ornith-1.0 by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning.
|
| 21 |
+
|
| 22 |
+
Each training cycle proceeds in three stages. Given an environment or codebase, high-level instructions about the task type, and access to the model's previous task-solving history, the system proposes progressively harder tasks that go beyond what the model has already solved. For each task, the model then generates or refines a task-specific scaffold — the instructions, tools, decomposition strategy, and orchestration used to approach the problem. Conditioned on the task and scaffold, the policy produces a solution rollout. Reward from the rollout is propagated across all three stages, so the system learns not only to produce better solutions, but also to generate more useful training tasks and construct more effective scaffolds.
|
| 23 |
+
|
| 24 |
+
Repeated over training, this creates a closed self-improvement loop in which stronger policies enable the generation of harder and more informative tasks, evolving scaffolds discover better ways to elicit the model's capabilities, and higher-quality rollouts provide increasingly effective learning signals. For more details on the task, harness, and rollout reward design, please refer to our [blog](https://deep-reinforce.com/ornith.html).
|
| 25 |
|
| 26 |
<img style="width: 100%; max-width: 900px;" src="assets/ornith_9b_eval.png" alt="Ornith 1.5 9B Benchmark Results" title="Ornith 1.5 9B Benchmark Results">
|
| 27 |
|
|
|
|
| 193 |
|
| 194 |
</div>
|
| 195 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 196 |
|
| 197 |
## Quickstart
|
| 198 |
|