File size: 1,500 Bytes
c006a0a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | ---
language:
- en
- zh
license: mit
base_model: Qwen/Qwen2.5-3B-Instruct
tags:
- sophia-agi
- provenance
- source-discipline
- lora
---
# Sophia-3B (Sophia AGI LoRA adapter)
**Wisdom before intelligence.** LoRA adapter for provenance-aware instruction on `Qwen/Qwen2.5-3B-Instruct`.
- **Project:** [github.com/tomyimkc/sophia-agi](https://github.com/tomyimkc/sophia-agi)
- **Dataset:** [tomyimkc/sophia-agi-corpus](https://huggingface.co/datasets/tomyimkc/sophia-agi-corpus)
- **Version:** 0.5.4
- **Train split:** 436 examples (benchmark cases held out)
- **Benchmark total:** 23 held-out cases
## Load adapter
```python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = "Qwen/Qwen2.5-3B-Instruct"
adapter = "tomyimkc/sophia-agi-lora-v1"
tokenizer = AutoTokenizer.from_pretrained(adapter)
model = AutoModelForCausalLM.from_pretrained(base, device_map="auto", torch_dtype="auto")
model = PeftModel.from_pretrained(model, adapter)
```
## Usage
Train locally:
```bash
pip install -r requirements-lora.txt
python tools/prepare_lora_dataset.py
python tools/train_lora.py --4bit --epochs 3
```
Evaluate:
```bash
python tools/eval_local_model.py --adapter training/lora/checkpoints/sophia-v1 --with-gate
```
Ollama:
```bash
ollama create sophia-7b -f models/ollama/Modelfile
```
## Always pair with runtime gate
`sophia_gate_check` (MCP) or `agent/gate.py` — weights alone do not guarantee trap safety.
|