hoborific commited on
Commit
2e8d4c3
·
verified ·
1 Parent(s): a42d2ab

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -521
README.md CHANGED
@@ -1,533 +1,42 @@
1
  ---
2
- license: apache-2.0
3
- base_model:
4
- - google/gemma-4-31B-it
5
- - MRockatansky/Gemma-4-31B-storymaxxed
6
- - MRockatansky/Gemma-4-31B-storymaxxed2
7
- - LatitudeGames/Equinox-31B
8
- - sophosympatheia/Mero-Artemis-31B-v0.3.1
9
- - AuriAetherwiing/G4-31B-Musica-v1
10
- - llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
11
- - Jackrong/Gemopus-4-31B-it
12
- - p-e-r-e-g-r-i-n-e/Sprinkle-Gemma-4-31B
13
  tags:
14
- - merge
15
- - mergekit
16
- - reasoning
17
- - non-reasoning
18
- - creative writing
19
- - roleplay
20
- - uncensored
21
- - nsfw
22
- - 31B
23
- - gemma-4
24
  ---
25
 
26
- <style>
27
- .blume-wrapper {
28
- background-color: #050806;
29
- background-image: radial-gradient(circle at 10% 10%, rgba(168, 85, 247, 0.08) 0%, transparent 40%), radial-gradient(circle at 90% 90%, rgba(34, 197, 94, 0.06) 0%, transparent 40%);
30
- color: #cbd5e1;
31
- font-family: 'Segoe UI', Roboto, Helvetica, Arial, sans-serif;
32
- padding: 40px;
33
- border-radius: 25px;
34
- border: 1px solid #14532d;
35
- line-height: 1.7;
36
- position: relative;
37
- overflow: hidden;
38
- box-shadow: inset 0 0 100px rgba(0,0,0,0.8), 0 20px 50px rgba(0,0,0,0.6);
39
- }
40
- .toxic-header { text-align: center; padding-bottom: 30px; position: relative; z-index: 10; }
41
- .toxic-title {
42
- font-size: 3.8rem;
43
- font-weight: 800;
44
- margin: 15px 0 5px 0;
45
- background: linear-gradient(90deg, #c522af, #c6f755, #c522af);
46
- -webkit-background-clip: text;
47
- -webkit-text-fill-color: transparent;
48
- filter: drop-shadow(0 0 15px rgba(34, 197, 94, 0.4));
49
- letter-spacing: -2px;
50
- }
51
- .subtitle {
52
- color: #c522af;
53
- text-transform: uppercase;
54
- letter-spacing: 6px;
55
- font-size: 0.9rem;
56
- text-shadow: 0 0 10px rgba(168, 85, 247, 0.5);
57
- }
58
- .flora-card {
59
- background: linear-gradient(145deg, rgba(13, 23, 15, 0.8), rgba(8, 12, 9, 0.95));
60
- border: 1px solid #14532d;
61
- border-left: 5px solid #22c55e;
62
- padding: 30px;
63
- margin: 25px 0;
64
- border-radius: 8px 20px 20px 8px;
65
- box-shadow: inset 0 -2px 10px rgba(34, 197, 94, 0.05), 0 10px 30px rgba(0,0,0,0.5);
66
- position: relative;
67
- z-index: 5;
68
- }
69
- .violet-card {
70
- border-left-color: #c6f755;
71
- border-color: #c6f755;
72
- background: linear-gradient(145deg, rgba(23, 10, 33, 0.6), rgba(12, 5, 18, 0.9));
73
- }
74
- .brown-card {
75
- border-left-color: #78350f;
76
- border-color: #451a03;
77
- background: linear-gradient(145deg, rgba(35, 18, 9, 0.7), rgba(15, 8, 4, 0.95));
78
- }
79
- .flora-card h3 { color: #22c55e; margin-top: 0; }
80
- .violet-card h3 { color: #c6f755; }
81
- .brown-card h3 { color: #d97706; }
82
- hr.vine {
83
- border: 0;
84
- height: 1px;
85
- background-image: linear-gradient(to right, rgba(0,0,0,0), #22c55e, rgba(0,0,0,0));
86
- margin: 20px 0;
87
- }
88
- hr.vine-violet {
89
- background-image: linear-gradient(to right, rgba(0,0,0,0), #c6f755, rgba(0,0,0,0));
90
- }
91
- .samplers-section { display: flex; gap: 30px; flex-wrap: wrap; margin-top: 40px; }
92
- .samplers-item { flex: 1; min-width: 280px; }
93
- .toxic-table {
94
- width: 100%;
95
- border-collapse: collapse;
96
- background: rgba(0,0,0,0.3);
97
- border-radius: 12px;
98
- overflow: hidden;
99
- border: 1px solid rgba(34, 197, 94, 0.15);
100
- }
101
- .toxic-table td, .toxic-table th {
102
- padding: 12px 15px;
103
- border-bottom: 1px solid rgba(34, 197, 94, 0.1);
104
- font-size: 0.9rem;
105
- }
106
- .toxic-table th { text-align: left; background: rgba(0,0,0,0.4); border-bottom: 2px solid #14532d; }
107
- .toxic-table tr:last-child td { border-bottom: none; }
108
- .toxic-table td:first-child { color: #94a3b8; font-weight: 500; }
109
- .toxic-table td:last-child { text-align: right; color: #22c55e; font-family: monospace; font-size: 1.1em;}
110
- .violet-table { border-color: rgba(168, 85, 247, 0.2); }
111
- .violet-table td, .violet-table th { border-bottom-color: rgba(168, 85, 247, 0.1); }
112
- .violet-table th { border-bottom-color: #c6f755; color: #c6f755; }
113
- .violet-table td:first-child { color: #22c55e; font-family: monospace; }
114
- .violet-table td:last-child { text-align: left; }
115
- .violet-table a { color: #f5e872; text-decoration: none; font-weight: bold; }
116
- .violet-table a:hover { color: #22c55e; }
117
- .violet-table tr:hover { background: rgba(168, 85, 247, 0.05); }
118
- .stat-grid { display: grid; grid-template-columns: repeat(auto-fit, minmax(160px, 1fr)); gap: 18px; margin: 30px 0; }
119
- .stat-item {
120
- text-align: center;
121
- padding: 18px;
122
- background: linear-gradient(180deg, #0a140d 0%, #050a06 100%);
123
- border: 1px solid #14532d;
124
- border-radius: 12px;
125
- box-shadow: inset 0 2px 10px rgba(34, 197, 94, 0.03), 0 8px 20px rgba(0,0,0,0.4);
126
- }
127
- .stat-value { display: block; font-size: 1.3rem; font-weight: bold; color: #22c55e; text-shadow: 0 0 10px rgba(34, 197, 94, 0.3); }
128
- .blume-credits ul { list-style: none; padding-left: 0; }
129
- .blume-credits li { margin-bottom: 12px; position: relative; padding-left: 25px; color: #cbd5e1; }
130
- .blume-credits li::before {
131
- content: '🌱';
132
- color: #c6f755;
133
- position: absolute;
134
- left: 0; top: 0;
135
- font-size: 0.9em;
136
- filter: drop-shadow(0 0 5px rgba(168, 85, 247, 0.6));
137
- }
138
- .blume-credits a { color: #f5e872; text-decoration: none; border-bottom: 1px dotted #f5e872; }
139
- .blume-credits a:hover { color: #22c55e; border-color: #22c55e; }
140
- </style>
141
 
142
- <div class="blume-wrapper">
143
- <div style="font-size: 0.9rem; color: #94a3b8; margin-bottom: 15px; text-align: center;">by Nimbz</div>
144
- <div class="toxic-header">
145
- <img src="giftige-blume-31b-title.png" width="100%" style="border-radius: 15px; border: 1px solid #14532d; box-shadow: 0 15px 40px rgba(0,0,0,0.6); margin-bottom: 15px;">
146
- <h1 class="toxic-title"> 🌺 Giftige-Blume-31B-v1 🌻 </h1>
147
- <div class="subtitle">Beautiful in Prose • Rich in Variance</div>
148
- </div>
149
 
150
- <div class="stat-grid">
151
- <div class="stat-item">
152
- <span class="stat-value">AUTHENTIC</span>
153
- </div>
154
- <div class="stat-item">
155
- <span class="stat-value" style="color: #c6f755; text-shadow: 0 0 10px rgba(168, 85, 247, 0.4);">TOXIC</span>
156
- </div>
157
- <div class="stat-item">
158
- <span class="stat-value">CREATIVE</span>
159
- </div>
160
- </div>
161
 
162
- <div class="flora-card">
163
- <h3>🌿 About The Model</h3>
164
- <div style="margin-bottom: 15px;">
 
165
 
166
- With the model Giftige-Blume-31B, the idea was to create something that truly catches and portrays a character's persona genuinely. A character should act stubborn if they are stubborn, or refuse situations that *the character* doesn't seem fit. The Gemma-4-31B-it base and a lot of fine-tunes have a steep user adherence, which is usually great for assistant tasks, but not really fitting for immersive roleplay. </div>
167
- <hr class="vine">
168
- <div style="margin-bottom: 15px;">While Giftige-Blume-31B-v2 aims to be more logical and prompt adherent, Giftige-Blume-31B-v1 brings in a lot of mixed roleplay-centered models as it's knowledge core to provide rich and diverse roleplay scenarios, carrying over the genuine character portrayal, diverse prose and writing styles with each swipe.</div>
169
- <hr class="vine">
170
- <div>This model is made for a wide range of roleplay scenarios, with the goal to impersonate characters as they are described and not how the user wants them to be mid-chat. Expect uncensored roleplay without the deep-fried agreeability that is often associated with abliteration or similar techniques.</div>
171
- </div>
172
 
173
- <div class="samplers-section">
174
- <div class="samplers-item">
175
- <h2 style="color: #cbd5e1; border-bottom: 1px solid #14532d; padding-bottom: 10px; margin-top: 0;">🧪 Samplers</h2>
176
- <table class="toxic-table">
177
- <tr><td>Temperature</td><td>0.8 - 1.2</td></tr>
178
- <tr><td>Top-K</td><td>0</td></tr>
179
- <tr><td>Top-P</td><td>0.95</td></tr>
180
- <tr><td>Min-P</td><td>0.1 - 0.2</td></tr>
181
- <tr><td>Adaptive-P Target</td><td style="color: #c6f755;">0.6</td></tr>
182
- <tr><td>Adaptive-P Decay</td><td style="color: #c6f755;">0.5</td></tr>
183
- </table>
184
- </div>
185
- <div class="samplers-item">
186
- <div class="flora-card violet-card" style="margin: 0;">
187
- <h3>🪻 GGUF Quants</h3>
188
- <div style="font-size: 0.9rem; color: #94a3b8; margin-bottom: 15px;">Select your vintage below.</div>
189
- <table class="toxic-table violet-table">
190
- <thead>
191
- <tr><th>Quant</th><th style="color: #cbd5e1;">Size</th><th>Link</th></tr>
192
- </thead>
193
- <tbody>
194
- <tr><td>Q4_K_S</td><td style="color: #94a3b8; font-family: monospace; text-align: right;">17.8 GB</td><td><a href="https://huggingface.co/Nimbz/Gemma-4-Giftige-Blume-31B-GGUF/blob/main/Giftige-Blume-31B-v1-Q4_K_S.gguf">Download</a></td></tr>
195
- <tr><td>Q4_K_M</td><td style="color: #94a3b8; font-family: monospace; text-align: right;">18.7 GB</td><td><a href="https://huggingface.co/Nimbz/Gemma-4-Giftige-Blume-31B-v1-GGUF/blob/main/Giftige-Blume-31B-v1-Q4_K_M.gguf">Download</a></td></tr>
196
- <tr><td>Q5_K_S</td><td style="color: #94a3b8; font-family: monospace; text-align: right;">21.3 GB</td><td><a href="https://huggingface.co/Nimbz/Gemma-4-Giftige-Blume-31B-v1-GGUF/blob/main/Giftige-Blume-31B-v1-Q5_K_S.gguf">Download</a></td></tr>
197
- <tr><td>Q5_K_M</td><td style="color: #94a3b8; font-family: monospace; text-align: right;">21.8 GB</td><td><a href="https://huggingface.co/Nimbz/Gemma-4-Giftige-Blume-31B-v1-GGUF/blob/main/Giftige-Blume-31B-v1-Q5_K_M.gguf">Download</a></td></tr>
198
- <tr><td>Q6_K</td><td style="color: #94a3b8; font-family: monospace; text-align: right;">25.2 GB</td><td><a href="https://huggingface.co/Nimbz/Gemma-4-Giftige-Blume-31B-v1-GGUF/blob/main/Giftige-Blume-31B-v1-Q6_K.gguf">Download</a></td></tr>
199
- <tr><td>Q8_0</td><td style="color: #94a3b8; font-family: monospace; text-align: right;">32.6 GB</td><td><a href="https://huggingface.co/Nimbz/Gemma-4-Giftige-Blume-31B-v1-GGUF/blob/main/Giftige-Blume-31B-v1-Q8_0.gguf">Download</a></td></tr>
200
- </tbody>
201
- </table>
202
- </div>
203
- </div>
204
- </div>
205
-
206
- <div class="flora-card violet-card" style="margin-top: 35px;">
207
- <h3>📜 Prompt Format</h3>
208
- <div style="margin-bottom: 15px;"><a href="https://huggingface.co/google/gemma-4-31B-it#2-thinking-mode-configuration" style="color: #f5e872; font-weight: bold; text-decoration: none; border-bottom: 1px dashed #f5e872;">Please refer to the original google/gemma-4-31b-it for the correct chat template.</a></div>
209
- <div style="color: #cbd5e1;">Let your frontend handle the chat template if possible (e.g., Chat Completion in SillyTavern).</div>
210
- <div style="background: rgba(0,0,0,0.5); padding: 15px; border-radius: 8px; border-left: 3px solid #c6f755; margin-top: 15px;">
211
- <strong style="color: #22c55e;">For Reasoning:</strong> Add <code>&lt;|think|&gt;</code> at the very beginning of the system prompt. Thinking happens between <code>&lt;|channel&gt;thought\n</code> and <code>&lt;channel|&gt;</code> tags.
212
- </div>
213
- </div>
214
 
215
- <div style="position: relative; z-index: 5; margin-top: 40px;">
216
- <h2 style="color: #cbd5e1; border-bottom: 1px solid #14532d; padding-bottom: 10px;">🧬 Merge Details</h2>
217
- <div style="font-size: 0.95rem; color: #94a3b8; line-height: 1.8; margin-bottom: 15px;">This model was merged in three distinct phases:</div>
218
- <div style="background: rgba(0,0,0,0.3); border: 1px dashed #451a03; padding: 15px; border-radius: 10px; color: #c6f755; text-align: left;">
219
 
220
- <div class="flora-card">
221
- <h3>🏵️ 1. Phase</h3>
222
- <div style="margin-bottom: 15px;"><details>
223
- <summary>Broad RP Scenario: model_stock</summary>
224
 
225
- ```
226
- merge_method: model_stock
227
- base_model: ./LatitudeGames/G4-Equinox-31B
228
- tokenizer_source: base
229
- dtype: bfloat16
230
- parameters:
231
- normalize: true
232
- models:
233
- - model: ./LatitudeGames/G4-Equinox-31B
234
- - model: ./MRockatansky/G4-Gemma-4-31B-storymaxxed
235
- - model: ./MRockatansky/G4-Gemma-4-31B-storymaxxed2
236
- - model: ./AuriAetherwiing/G4-31B-Musica-v1
237
- ```
238
-
239
- </details></p>
240
- </div>
241
- </div>
242
- <div class="flora-card">
243
- <h3>💐 2. Phase</h3>
244
- <div style="margin-bottom: 15px;"><details>
245
- <summary>Heretic RP Engine: breadcrumbs_ties</summary>
246
-
247
- ```
248
- merge_method: breadcrumbs_ties
249
- base_model: ./Broad-RP-Scenario-model_stock_phase1
250
- tokenizer_source: base
251
- dtype: bfloat16
252
-
253
- modules:
254
- text_decoder:
255
-
256
- slices:
257
- - sources:
258
- - model: ./Broad-RP-Scenario-model_stock_phase1
259
- layer_range: [0, 12]
260
- parameters:
261
- weight: 0.90
262
- - model: ./llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
263
- layer_range: [0, 12]
264
- parameters:
265
- density: 0.35
266
- weight: 0.30
267
-
268
- - sources:
269
- - model: ./Broad-RP-Scenario-model_stock_phase1
270
- layer_range: [12, 24]
271
- parameters:
272
- weight: 0.85
273
- - model: ./llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
274
- layer_range: [12, 24]
275
- parameters:
276
- density: 0.15
277
- weight: 0.15
278
- - model: /media/nimbz/cold_storage/LLM/WEIGHTS/G4-Mero-Artemis-31B-v0.3.1
279
- layer_range: [12, 24]
280
- parameters:
281
- density: 0.50
282
- weight: 0.60
283
-
284
- - sources:
285
- - model: ./Broad-RP-Scenario-model_stock_phase1
286
- layer_range: [24, 42]
287
- parameters:
288
- weight: 0.80
289
- - model: ./llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
290
- layer_range: [24, 42]
291
- parameters:
292
- density: 0.30
293
- weight: 0.35
294
- - model: /media/nimbz/cold_storage/LLM/WEIGHTS/G4-Mero-Artemis-31B-v0.3.1
295
- layer_range: [24, 42]
296
- parameters:
297
- density: 0.70
298
- weight: 0.80
299
-
300
- - sources:
301
- - model: ./Broad-RP-Scenario-model_stock_phase1
302
- layer_range: [42, 54]
303
- parameters:
304
- weight: 0.80
305
- - model: ./llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
306
- layer_range: [42, 54]
307
- parameters:
308
- density: 0.65
309
- weight: 0.70
310
- - model: /media/nimbz/cold_storage/LLM/WEIGHTS/G4-Mero-Artemis-31B-v0.3.1
311
- layer_range: [42, 54]
312
- parameters:
313
- density: 0.40
314
- weight: 0.45
315
-
316
- - sources:
317
- - model: ./Broad-RP-Scenario-model_stock_phase1
318
- layer_range: [54, 60]
319
- parameters:
320
- weight: 0.85
321
- - model: ./llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
322
- layer_range: [54, 60]
323
- parameters:
324
- density: 0.75
325
- weight: 0.85
326
-
327
- vision_tower:
328
- models:
329
- - model: ./Broad-RP-Scenario-model_stock_phase1
330
- ```
331
-
332
- </details></p>
333
- </div>
334
- </div>
335
- <div class="flora-card">
336
- <h3>🌳 3. Phase</h3>
337
- <div style="margin-bottom: 15px;"><details>
338
- <summary>Logical RP Melting: della_linear</summary>
339
-
340
- ```
341
- merge_method: della_linear
342
- base_model: ./google/gemma-4-31B-it
343
- tokenizer_source: base
344
- dtype: bfloat16
345
- parameters:
346
- epsilon: 0.05
347
- lambda: 1.0
348
- normalize: true
349
- int8_mask: true
350
-
351
- modules:
352
- text_decoder:
353
- slices:
354
- - sources:
355
- - model: ./google/gemma-4-31B-it
356
- layer_range: [0, 12]
357
- parameters:
358
- weight: 0.75
359
- - model: ./p-e-r-e-g-r-i-n-e/Sprinkle-Gemma-4-31B
360
- layer_range: [0, 12]
361
- parameters:
362
- density: 0.15
363
- weight:
364
- - filter: embed_tokens
365
- value: 0.0
366
- - filter: lm_head
367
- value: 0.0
368
- - value: 0.20
369
- - model: ./Jackrong/Gemopus-4-31B-it
370
- layer_range: [0, 12]
371
- parameters:
372
- density: 0.25
373
- weight:
374
- - filter: embed_tokens
375
- value: 0.0
376
- - filter: lm_head
377
- value: 0.0
378
- - value: 0.25
379
- - model: ./Heretic-RP-Engine_breadcrumbs_ties
380
- layer_range: [0, 12]
381
- parameters:
382
- density: 0.40
383
- weight:
384
- - filter: embed_tokens
385
- value: 0.0
386
- - filter: lm_head
387
- value: 0.0
388
- - value: 0.50
389
-
390
- - sources:
391
- - model: ./google/gemma-4-31B-it
392
- layer_range: [12, 24]
393
- parameters:
394
- weight: 0.75
395
- - model: ./p-e-r-e-g-r-i-n-e/Sprinkle-Gemma-4-31B
396
- layer_range: [12, 24]
397
- parameters:
398
- density: 0.20
399
- weight:
400
- - filter: embed_tokens
401
- value: 0.0
402
- - filter: lm_head
403
- value: 0.0
404
- - value: 0.25
405
- - model: ./Jackrong/Gemopus-4-31B-it
406
- layer_range: [12, 24]
407
- parameters:
408
- density: 0.35
409
- weight:
410
- - filter: embed_tokens
411
- value: 0.0
412
- - filter: lm_head
413
- value: 0.0
414
- - value: 0.50
415
- - model: ./Heretic-RP-Engine_breadcrumbs_ties
416
- layer_range: [12, 24]
417
- parameters:
418
- density: 0.50
419
- weight:
420
- - filter: embed_tokens
421
- value: 0.0
422
- - filter: lm_head
423
- value: 0.0
424
- - value: 0.60
425
-
426
- - sources:
427
- - model: ./google/gemma-4-31B-it
428
- layer_range: [24, 42]
429
- parameters:
430
- weight: 0.75
431
- - model: ./p-e-r-e-g-r-i-n-e/Sprinkle-Gemma-4-31B
432
- layer_range: [24, 42]
433
- parameters:
434
- density: 0.30
435
- weight:
436
- - filter: embed_tokens
437
- value: 0.0
438
- - filter: lm_head
439
- value: 0.0
440
- - value: 0.20
441
- - model: ./Jackrong/Gemopus-4-31B-it
442
- layer_range: [24, 42]
443
- parameters:
444
- density: 0.65
445
- weight:
446
- - filter: embed_tokens
447
- value: 0.0
448
- - filter: lm_head
449
- value: 0.0
450
- - value: 0.65
451
- - model: ./Heretic-RP-Engine_breadcrumbs_ties
452
- layer_range: [24, 42]
453
- parameters:
454
- density: 0.85
455
- weight:
456
- - filter: embed_tokens
457
- value: 0.0
458
- - filter: lm_head
459
- value: 0.0
460
- - value: 0.75
461
-
462
- - sources:
463
- - model: ./google/gemma-4-31B-it
464
- layer_range: [42, 54]
465
- parameters:
466
- weight: 0.75
467
- - model: ./p-e-r-e-g-r-i-n-e/Sprinkle-Gemma-4-31B
468
- layer_range: [42, 54]
469
- parameters:
470
- density: 0.25
471
- weight:
472
- - filter: embed_tokens
473
- value: 0.0
474
- - filter: lm_head
475
- value: 0.0
476
- - value: 0.45
477
- - model: ./Heretic-RP-Engine_breadcrumbs_ties
478
- layer_range: [42, 54]
479
- parameters:
480
- density: 0.40
481
- weight:
482
- - filter: embed_tokens
483
- value: 0.0
484
- - filter: lm_head
485
- value: 0.0
486
- - value: 0.75
487
-
488
- - sources:
489
- - model: ./google/gemma-4-31B-it
490
- layer_range: [54, 60]
491
- parameters:
492
- weight: 0.70
493
- - model: ./p-e-r-e-g-r-i-n-e/Sprinkle-Gemma-4-31B
494
- layer_range: [54, 60]
495
- parameters:
496
- density: 0.25
497
- weight:
498
- - filter: embed_tokens
499
- value: 0.0
500
- - filter: lm_head
501
- value: 0.0
502
- - value: 0.50
503
- - model: ./Heretic-RP-Engine_breadcrumbs_ties
504
- layer_range: [54, 60]
505
- parameters:
506
- density: 0.35
507
- weight:
508
- - filter: embed_tokens
509
- value: 0.0
510
- - filter: lm_head
511
- value: 0.0
512
- - value: 0.65
513
-
514
- vision_tower:
515
- models:
516
- - model: ./google/gemma-4-31B-it
517
- ```
518
-
519
- </details></p>
520
- </div>
521
- </div>
522
- </div>
523
- <div style="position: relative; z-index: 5; margin-top: 40px;">
524
- <h2 style="color: #c6f755; border-bottom: 1px solid #14532d; padding-bottom: 10px;">🌸 Credits & Honors</h2>
525
- <div class="flora-card brown-card blume-credits" style="margin-top: 40px;">
526
- <ul>
527
- <li><b style="color: #22c55e;">Google DeepMind & The Open-Source Community:</b> For providing the brilliant base model, merges and fine-tunes that made this merge possible.</li>
528
- <li><b style="color: #22c55e;"><a href="https://www.reddit.com/r/BeaverAI/">The BeaverAI Community</a>:</b> Great people, always supportive, a really nice place to hang around.</li>
529
- <li><b style="color: #22c55e;">Mergekit:</b> Thank you arcee-ai for the mergekit, thank you zerofata for actually providing Gemma-4 support!</li>
530
- <li><b style="color: #22c55e;"><a href="https://huggingface.co/Ateron">Ateron</a>:</b> This guy.</li>
531
- <li><b style="color: #22c55e;">Google Gemini:</b> For hallucinating when I needed it the most.</li>
532
- </ul>
533
- </div>
 
1
  ---
2
+ base_model: Blazed-Forge/Gemma-4-Giftige-Blume-31B-v1
3
+ library_name: transformers
 
 
 
 
 
 
 
 
 
4
  tags:
5
+ - quantized
6
+ - w8a16
7
+ - fp8
 
 
 
 
 
 
 
8
  ---
9
 
10
+ # Gemma-4-Giftige-Blume-31B-v1-W8A16-FP8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
 
12
+ Quantized version of [Blazed-Forge/Gemma-4-Giftige-Blume-31B-v1](https://huggingface.co/Blazed-Forge/Gemma-4-Giftige-Blume-31B-v1).
 
 
 
 
 
 
13
 
14
+ ## Format
 
 
 
 
 
 
 
 
 
 
15
 
16
+ Offline-quantized **W8A16 FP8** in the
17
+ [compressed-tensors](https://github.com/neuralmagic/compressed-tensors)
18
+ `float-quantized` format: weights in `float8_e4m3fn` with per-output-channel
19
+ symmetric scales, activations kept in bf16/fp16.
20
 
21
+ ## How it was quantized
 
 
 
 
 
22
 
23
+ For each linear layer, every output row gets its own scale starting from
24
+ `amax / 448`, refined by an MSE clip search over ~9 clip fractions
25
+ (0.8–1.0× amax) picking the lowest-error scale per row. Weights are then
26
+ quantized `q = e4m3(w / scale)` with round-to-nearest and saturation. This
27
+ per-channel + clipping scheme gives better SNR than vLLM's online per-tensor
28
+ `--quantization fp8` path.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
+ Only 2D linear projection weights are quantized (attention q/k/v/o, MLP
31
+ gate/up/down). Embeddings, norms, lm_head, routers/experts, and the vision
32
+ tower stay in bf16 and are listed in the checkpoint's `ignore` list, so vLLM
33
+ leaves them untouched.
34
 
35
+ ## Supported vLLM platforms
 
 
 
36
 
37
+ - **Intel XPU** — `XPUW8A16FP8LinearKernel` (the intended target).
38
+ - **NVIDIA CUDA** (SM75+, i.e. Turing and newer) —
39
+ `HummingFP8ScaledMMLinearKernel` when the `humming` package is installed,
40
+ otherwise `MarlinFP8ScaledMMLinearKernel`.
41
+ - **Not supported**: ROCm, CPU, TPU — vLLM has no W8A16-FP8 kernel for these
42
+ backends yet, so loading will fail with a "no kernel" error.