--- license: apache-2.0 base_model: - llmfan46/Gemma-4-Gembrain-31B-it-uncensored-heretic tags: - merge - mergekit - reasoning - non-reasoning - creative writing - roleplay - uncensored - 31B - gemma-4 - heretic - uncensored - decensored - abliterated - ara - nvfp4 --- # pekkAi/Gemma-4-Gembrain-31B-it-uncensored-heretic-NVFP4 This model [pekkAi/Gemma-4-Gembrain-31B-it-uncensored-heretic-NVFP4](https://huggingface.co/pekkAi/Gemma-4-Gembrain-31B-it-uncensored-heretic-NVFP4) was quantized to NVFP4 format from [llmfan46/Gemma-4-Gembrain-31B-it-uncensored-heretic](https://huggingface.co/llmfan46/Gemma-4-Gembrain-31B-it-uncensored-heretic) using [Model-Optimizer](https://github.com/NVIDIA/Model-Optimizer). ## Serving (RTX 5090, 32GB) 65k context (might not be optimal, just an example that works): ```sh export VLLM_NVFP4_GEMM_BACKEND=flashinfer-cutlass export VLLM_USE_FLASHINFER_MOE_FP4=1 export VLLM_USE_FLASHINFER_SAMPLER=1 export PYTORCH_CUDA_ALLOC_CONF="expandable_segments:True" export VLLM_API_KEY=${VLLM_API_KEY} vllm serve Gemma-4-Gembrain-31B-it-uncensored-heretic-NVFP4 \ --host 0.0.0.0 \ --port 8008 \ --max-model-len 65536 \ --gpu-memory-utilization 0.89 \ --kv-cache-dtype fp8 \ --quantization modelopt \ --max-num-seqs 1 \ --reasoning-parser gemma4 \ --enable-auto-tool-choice \ --max-num-batched-tokens 8192 \ --enable-prefix-caching \ --trust-remote-code \ --tool-call-parser gemma4 \ --default-chat-template-kwargs '{"enable_thinking": false}' OR '{"enable_thinking": true}' \ --async-scheduling ``` # Original Model Card
I can no longer upload new models unless I can cover the cost of additional storage.
I host 70+ free models as an independent contributor and this work is unpaid.
Without your support, no more new models can be uploaded.
๐ Patreon (Monthly) | โ Ko-fi (One-time)
Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.
Gembrain-31B is a synthesis of several models, including Gemsicle-31B as important ingredient. The goal of this release was to stabilize and improve the initial Gemsicle-31B, but also to enhance its logical and lateral thinking, both with and without reasoning.
***It's build to create the most unhinged narratives and construct image prompts about anything accordingly to a given structure with high precision.
***Expect creative swipe variance, unique and non-robotic prose, and sharper instruction adherence.
| Temperature | 1.0 |
| Top-K | 0 |
| Top-P | 0.95 |
| Min-P | 0.03 |
| DRY Multiplier | 0.8 |
| DRY Base | 1.75 |
| DRY Allowed Length | 10 |
| Optional: Adaptive-P Target | 0.6 |
| Optional: Adaptive-P Decay | 0.5 |
This model was systematically created through a five-stage process of priming models for their given purpose and merging the results:
Gemopus X MeroMero
```
models:
- model: ./G4-MeroMero-31B
- model: ./G4-Gemopus-4-31B-it
merge_method: breadcrumbs_ties
base_model: ./G4-31B-it
parameters:
density: 0.85
weight: 0.5
int8_mask: true
dtype: bfloat16
```
GarnetV2 X Musica-v1
```
models:
- model: ./G4-Gemma4-GarnetV2-31B
- model: ./G4-31B-Musica-v1
merge_method: slerp
base_model: ./G4-Gemma4-GarnetV2-31B
parameters:
t:
- value: 0.6
dtype: bfloat16
```
Gemsicle X Gemma-4-31B-it-heretic-ara
```
models:
- model: ./Gemsicle-31B
parameters:
weight: 1.0
- model: ./G4-gemma-4-31b-it-heretic-ara
parameters:
weight: 0.75
density: 0.65
merge_method: della_linear
base_model: ./G4-31B-it
parameters:
weight: 1.0
normalize: false
epsilon: 0.05
lambda: 1.0
dtype: bfloat16
```
Phase 01 X Phase 02 X Phase 03
```
models:
- model: ./phase01_breadcrumbs_ties
- model: ./phase02_slerp
merge_method: model_stock
base_model: ./phase03_della_linear
dtype: bfloat16
tokenizer_source: "base"
```
Gemsicle X Phase 04
```
models:
- model: ./Gemsicle-31B
- model: ./phase04_model_stock
merge_method: arcee_fusion
base_model: ./Gemsicle-31B
dtype: bfloat16
tokenizer_source: "base"
```