File size: 1,472 Bytes
f4bd388
a17953d
d2b5c1f
a17953d
 
d2b5c1f
 
 
 
f4bd388
 
d2b5c1f
a17953d
d2b5c1f
a17953d
d2b5c1f
a17953d
d2b5c1f
a17953d
d2b5c1f
 
 
 
a17953d
d2b5c1f
a17953d
d2b5c1f
a17953d
d2b5c1f
 
 
a17953d
d2b5c1f
 
a17953d
d2b5c1f
 
 
a17953d
d2b5c1f
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
library_name: peft
base_model: Qwen/Qwen2.5-1.5B-Instruct
tags:
- lora
- reasoning
- chain-of-thought
- general-purpose
- atlas-labs
---

# Mini-Fable-5-Qwen

This is a general-purpose reasoning model fine-tuned by **Atlas Labs**. It is designed to handle a wide array of tasks—from coding and mathematics to creative writing and world knowledge—using a structured **Chain-of-Thought (CoT)** approach.

## Model Description

Mini-Fable-5-Qwen leverages the power of the Qwen-2.5-1.5B base and has been enhanced with high-quality synthetic reasoning traces. It utilizes a `<thought>` tag to internalize complex logic before providing a final answer, ensuring accuracy across diverse domains.

### Key Features
- **General Purpose:** Trained on instructions covering logic, science, coding, and general world knowledge.
- **Reasoning First:** Native support for step-by-step thinking.
- **Efficiency:** Optimized for fast local CPU inference while maintaining high-tier intelligence.

## How to Use

This is a LoRA adapter. You can load it using the `peft` library with the `Qwen/Qwen2.5-1.5B-Instruct` base model.

```python
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM, AutoTokenizer

base_model_id = "Qwen/Qwen2.5-1.5B-Instruct"
adapter_id = "Atlas-labs/mini-fable-5-qwen"

model = AutoModelForCausalLM.from_pretrained(base_model_id)
model = PeftModel.from_pretrained(model, adapter_id)
```

## Developed By
**Atlas Labs**