---
base_model:
- trashpanda-org/QwQ-32B-Snowdrop-v0
- ArliAI/QwQ-32B-ArliAI-RpR-v3
- Qwen/QwQ-32B
library_name: transformers
tags:
- mergekit
- merge

---
# QWQ-32B-Dawnwhisper-QwenTokenizer

This version is make with QWQ Tokenizer. It should be better than Origin version in Reasoning mode, that's all.

Like many people said: Tiny Deepseek R1 at home if you don't have too good specs. 16GB Vram card could run IQ3 variants very well.

After quick test, this merge perform very good result and strong capability in roleplay. Nothing more. Thank you for using my merge model.

## Setting
### Please use ChatML template

Reasoning is not necessary to turn on, but a nice feature to enable if you want to 'boost' your experience when roleplaying and multitasking (but more time consuming :/).

Reasoning token is ```<thinking> </thinking>```. You could search how to enable thinking mode in internet. Note that in silly tarven, you should turn off Always add character's name to prompt in Context Formatting and Include names Never in Instruct Template.

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: trashpanda-org/QwQ-32B-Snowdrop-v0
    parameters:
      density: 0.9
      weight: 1
  - model: ArliAI/QwQ-32B-ArliAI-RpR-v3
    parameters:
      density: 0.8
      weight: 0.8
merge_method: dare_ties
base_model: Qwen/QwQ-32B
parameters:
  normalize: true
  rescale: true
tokenizer_source: Qwen/QwQ-32B
dtype: bfloat16

```