Marcjoni commited on
Commit
b2745dc
·
verified ·
1 Parent(s): 3833ef4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -6
README.md CHANGED
@@ -4,6 +4,7 @@ base_model:
4
  - ohyeah1/Violet-Lyra-Gutenberg-v2
5
  - redrix/patricide-12B-Unslop-Mell-v2
6
  - yamatazen/EtherealAurora-12B-v3
 
7
  tags:
8
  - merge
9
  - mergekit
@@ -12,15 +13,34 @@ tags:
12
  - ohyeah1/Violet-Lyra-Gutenberg-v2
13
  - redrix/patricide-12B-Unslop-Mell-v2
14
  - yamatazen/EtherealAurora-12B-v3
 
15
  ---
16
 
 
 
17
  # QuasiStarSynth-12B
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  QuasiStarSynth-12B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
20
- * [DreadPoor/Irix-12B-Model_Stock](https://huggingface.co/DreadPoor/Irix-12B-Model_Stock)
21
- * [ohyeah1/Violet-Lyra-Gutenberg-v2](https://huggingface.co/ohyeah1/Violet-Lyra-Gutenberg-v2)
22
- * [redrix/patricide-12B-Unslop-Mell-v2](https://huggingface.co/redrix/patricide-12B-Unslop-Mell-v2)
23
- * [yamatazen/EtherealAurora-12B-v3](https://huggingface.co/yamatazen/EtherealAurora-12B-v3)
24
 
25
  ## 🧩 Configuration
26
 
@@ -85,7 +105,7 @@ from transformers import AutoTokenizer
85
  import transformers
86
  import torch
87
 
88
- model = "Marcjoni/QuasiStarSynth-12B"
89
  messages = [{"role": "user", "content": "What is a large language model?"}]
90
 
91
  tokenizer = AutoTokenizer.from_pretrained(model)
@@ -97,6 +117,6 @@ pipeline = transformers.pipeline(
97
  device_map="auto",
98
  )
99
 
100
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
101
  print(outputs[0]["generated_text"])
102
  ```
 
4
  - ohyeah1/Violet-Lyra-Gutenberg-v2
5
  - redrix/patricide-12B-Unslop-Mell-v2
6
  - yamatazen/EtherealAurora-12B-v3
7
+ - yamatazen/EtherealAurora-12B-v2
8
  tags:
9
  - merge
10
  - mergekit
 
13
  - ohyeah1/Violet-Lyra-Gutenberg-v2
14
  - redrix/patricide-12B-Unslop-Mell-v2
15
  - yamatazen/EtherealAurora-12B-v3
16
+ - yamatazen/EtherealAurora-12B-v2
17
  ---
18
 
19
+ <img src="./QuasiStarSynth.png" alt="Model Image"/>
20
+
21
  # QuasiStarSynth-12B
22
 
23
+ <b><i>From a time before galaxies settled and stars knew their limits, something titanic burned.
24
+ <br> Its light was golden, but inside darkness bloomed.
25
+ <br> A black heart beating beneath layers of radiant fire, devouring slowly, unseen.
26
+ <br> Neither star nor singularity, this was a monument to scale, a paradox wrapped in brilliance.</i></b>
27
+
28
+ ## 🔧 Recommended Sampling Settings:</b>
29
+ ```yaml
30
+ Temperature: 0.75 to 1.25
31
+ Min P: 0.035
32
+ Context Length: Stable at 12k tokens, with possible support for extended contexts
33
+ ```
34
+ ## 💬 Prompt Format
35
+ Supports ChatML style messages. Example:
36
+ ```yaml
37
+ <|im_start|>user
38
+ Your question here.
39
+ <|im_end|>
40
+ <|im_start|>assistant
41
+ ```
42
+
43
  QuasiStarSynth-12B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
 
 
 
 
44
 
45
  ## 🧩 Configuration
46
 
 
105
  import transformers
106
  import torch
107
 
108
+ model = "Marcjoni/AbyssSynth-12B-12B"
109
  messages = [{"role": "user", "content": "What is a large language model?"}]
110
 
111
  tokenizer = AutoTokenizer.from_pretrained(model)
 
117
  device_map="auto",
118
  )
119
 
120
+ outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=1, top_k=0, top_p=1)
121
  print(outputs[0]["generated_text"])
122
  ```