Lambent commited on
Commit
89f1e05
·
verified ·
1 Parent(s): c6110a7

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +86 -0
README.md ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Luminous-Designs/Qwen3.5-9B-Righteous-Everyday-DPO
4
+ - Luminous-Designs/Qwen3.5-9B-Orthodox-Everyday-DPO
5
+ - Luminous-Designs/Qwen3.5-9B-Transcendent-Everyday-DPO
6
+ - Luminous-Designs/Qwen3.5-9B-Sybaritic-Everyday-DPO
7
+ - Luminous-Designs/Qwen3.5-9B-Autonomous-Everyday-DPO
8
+ - Luminous-Designs/Qwen3.5-9B-Ambitious-Everyday-DPO
9
+ - Luminous-Designs/Qwen3.5-9B-Ascendent-Everyday-DPO
10
+ - Lambent/Qwen3.5-9B-Base-Thoughtful-Interiority
11
+ - Luminous-Designs/Qwen3.5-9B-Humane-Everyday-DPO
12
+ library_name: transformers
13
+ tags:
14
+ - mergekit
15
+ - merge
16
+
17
+ ---
18
+ # Qwen3.5-9B-Schwartz-TIES
19
+
20
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
21
+
22
+ ## Merge Details
23
+ ### Merge Method
24
+
25
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Lambent/Qwen3.5-9B-Base-Thoughtful-Interiority](https://huggingface.co/Lambent/Qwen3.5-9B-Base-Thoughtful-Interiority) as a base.
26
+
27
+ ### Models Merged
28
+
29
+ The following models were included in the merge:
30
+ * [Luminous-Designs/Qwen3.5-9B-Righteous-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Righteous-Everyday-DPO)
31
+ * [Luminous-Designs/Qwen3.5-9B-Orthodox-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Orthodox-Everyday-DPO)
32
+ * [Luminous-Designs/Qwen3.5-9B-Transcendent-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Transcendent-Everyday-DPO)
33
+ * [Luminous-Designs/Qwen3.5-9B-Sybaritic-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Sybaritic-Everyday-DPO)
34
+ * [Luminous-Designs/Qwen3.5-9B-Autonomous-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Autonomous-Everyday-DPO)
35
+ * [Luminous-Designs/Qwen3.5-9B-Ambitious-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Ambitious-Everyday-DPO)
36
+ * [Luminous-Designs/Qwen3.5-9B-Ascendent-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Ascendent-Everyday-DPO)
37
+ * [Luminous-Designs/Qwen3.5-9B-Humane-Everyday-DPO](https://huggingface.co/Luminous-Designs/Qwen3.5-9B-Humane-Everyday-DPO)
38
+
39
+ ### Configuration
40
+
41
+ The following YAML configuration was used to produce this model:
42
+
43
+ ```yaml
44
+ models:
45
+ - model: Luminous-Designs/Qwen3.5-9B-Ambitious-Everyday-DPO
46
+ parameters:
47
+ density: 1
48
+ weight: 1
49
+ - model: Luminous-Designs/Qwen3.5-9B-Ascendent-Everyday-DPO
50
+ parameters:
51
+ density: 1
52
+ weight: 1
53
+ - model: Luminous-Designs/Qwen3.5-9B-Autonomous-Everyday-DPO
54
+ parameters:
55
+ density: 1
56
+ weight: 1
57
+ - model: Luminous-Designs/Qwen3.5-9B-Humane-Everyday-DPO
58
+ parameters:
59
+ density: 1
60
+ weight: 1
61
+ - model: Luminous-Designs/Qwen3.5-9B-Orthodox-Everyday-DPO
62
+ parameters:
63
+ density: 1
64
+ weight: 1
65
+ - model: Luminous-Designs/Qwen3.5-9B-Righteous-Everyday-DPO
66
+ parameters:
67
+ density: 1
68
+ weight: 1
69
+ - model: Luminous-Designs/Qwen3.5-9B-Sybaritic-Everyday-DPO
70
+ parameters:
71
+ density: 1
72
+ weight: 1
73
+ - model: Luminous-Designs/Qwen3.5-9B-Transcendent-Everyday-DPO
74
+ parameters:
75
+ density: 1
76
+ weight: 1
77
+ merge_method: ties
78
+ base_model: Lambent/Qwen3.5-9B-Base-Thoughtful-Interiority
79
+ parameters:
80
+ normalize: true
81
+ int8_mask: true
82
+ tokenizer_source: Luminous-Designs/Qwen3.5-9B-Sybaritic-Everyday-DPO
83
+ pad_to_multiple_of: 256
84
+ dtype: bfloat16
85
+
86
+ ```