File size: 1,586 Bytes
8ef02e7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
---
tags:
- creativityneuro
- llm-creativity
- mechanistic-interpretability
base_model: meta-llama/Llama-3.1-8B-Instruct
license: apache-2.0
---

# llama-3.1-8b-instruct-cn-dat-kr0.01-a1.0-creative

This is a **CreativityNeuro (CN)** modified version of [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct).

## Model Details

- **Base Model**: meta-llama/Llama-3.1-8B-Instruct
- **Modification**: CreativityNeuro weight scaling
- **Prompt Set**: dat
- **Keep Ratio**: 0.01 (top 1.0% of task-specific weights)
- **Alpha**: 1.0 (scaling strength)
- **Mode**: creative

## What is CreativityNeuro?

CreativityNeuro identifies task-specific neurons using Wanda-style importance scoring and selectively
upscales weights associated with creative thinking. The modification formula is:

```
W_new = W × (1 + α × mask)
```

Where `mask` identifies weights important for creative tasks but not for routine/associative tasks.

## Usage

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("priorcomputers/llama-3.1-8b-instruct-cn-dat-kr0.01-a1.0-creative")
tokenizer = AutoTokenizer.from_pretrained("priorcomputers/llama-3.1-8b-instruct-cn-dat-kr0.01-a1.0-creative")

# Use like any other model
outputs = model.generate(...)
```

## Citation

If you use this model, please cite:

```bibtex
@misc{creativityneuro2025,
  title={CreativityNeuro: Mechanistic Interpretability for LLM Creativity},
  author={Prior Computers},
  year={2025},
  url={https://huggingface.co/priorcomputers}
}
```