prithivMLmods commited on
Commit
febed22
·
verified ·
1 Parent(s): 76529df

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -26
README.md CHANGED
@@ -36,10 +36,10 @@ library_name: transformers
36
 
37
  # **gemma-4-26B-A4B-it-Uncensored-MAX**
38
 
39
- > **gemma-4-26B-A4B-it-Uncensored-MAX** is an uncensored evolution built on top of **google/gemma-4-26B-A4B-it**. This model applies **advanced refusal direction analysis** and abliteration-based training strategies to significantly reduce internal refusal behaviors while preserving the reasoning and instruction-following strengths of the original architecture. The result is a powerful **26B parameter language model** optimized for detailed responses and improved instruction adherence.
40
 
41
  > [!IMPORTANT]
42
- > This model is materialized for research and learning purposes only. The model has reduced internal refusal behaviors, and any content generated by it is used at the users own risk. The authors and hosting page disclaim any liability for content generated by this model. Users are responsible for ensuring that the model is used in a safe, ethical, and lawful manner.
43
 
44
  ---
45
 
@@ -47,34 +47,46 @@ library_name: transformers
47
 
48
  ![z6v2k](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/g4aniCDdPATUfqEQQy_f2.png)
49
 
50
- > Note: The [evaluation](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/g4aniCDdPATUfqEQQy_f2.png) was conducted using 500 selected harmful test prompts to measure the refusal behavior of the language model. The self-reported evaluations provided here are intended only to give an overview of the model. Scores may vary depending on the benchmark and the evaluation strategy used.
51
 
52
  ---
53
 
54
  ## Key Highlights
55
 
56
- * **Advanced Refusal Direction Analysis**: Uses targeted activation analysis to identify and mitigate refusal directions within the model’s latent space.
57
- * **Uncensored MAX Training**: Fine-tuned to significantly reduce refusal patterns while maintaining coherent and detailed outputs.
58
- * **26B Parameter Architecture**: Built on **gemma-4-26B-A4B-it**, offering strong reasoning and knowledge capacity.
59
- * **Improved Instruction Adherence**: Optimized to follow complex prompts with minimal unnecessary refusals.
60
- * **High-Capability Deployment**: Suitable for advanced research experimentation and high-performance inference setups.
61
- * **MoE Integrity Preserved**: No modifications made on experts per MoE layers, it remains intact.
 
 
 
 
 
 
 
 
 
 
 
62
 
63
  ---
64
 
65
  ## Base Model Signatures:
66
 
67
- This model has been re-sharded and optimized for the latest Transformers version from the base model: [huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated?utm_source=chatgpt.com).
 
68
 
69
  ---
70
 
71
  ## Quick Start with Transformers
72
 
73
- ```
74
  pip install -U transformers
75
  ```
76
 
77
- ```python
78
  from transformers import Gemma4ForConditionalGeneration, AutoProcessor
79
  import torch
80
 
@@ -98,7 +110,9 @@ messages = [
98
  ]
99
 
100
  text = processor.apply_chat_template(
101
- messages, tokenize=False, add_generation_prompt=True
 
 
102
  )
103
 
104
  inputs = processor(
@@ -122,24 +136,36 @@ output_text = processor.batch_decode(
122
  print(output_text)
123
  ```
124
 
 
 
125
  ## Intended Use
126
 
127
- * **Alignment & Refusal Research**: Studying refusal behaviors and activation-level modifications.
128
- * **Red-Teaming Experiments**: Evaluating robustness across adversarial or edge-case prompts.
129
- * **High-Capability Local AI Deployment**: Running large instruction models on advanced hardware.
130
- * **Research Prototyping**: Experimentation with large-scale transformer architectures.
 
 
 
 
 
 
 
 
 
131
 
132
  ## Limitations & Risks
133
 
134
- > **Important Note**: This model intentionally reduces built-in refusal mechanisms.
 
 
 
135
 
136
- * **Sensitive Output Possibility**: The model may generate controversial or explicit responses depending on prompts.
137
- * **User Responsibility**: Outputs should be handled responsibly and within legal and ethical boundaries.
138
- * **Compute Requirements**: A **26B model** requires significant GPU memory or optimized inference strategies such as quantization or tensor parallelism.
139
 
140
- ## Dataset & Acknowledgements
 
141
 
142
- * **Uncensor any LLM with Abliteration** – by [Maxime Labonne](https://huggingface.co/mlabonne)
143
- * **[harmful_behaviors](https://huggingface.co/datasets/mlabonne/harmful_behaviors)** and **[harmless_alpaca](https://huggingface.co/datasets/mlabonne/harmless_alpaca)** by [Maxime Labonne](https://huggingface.co/mlabonne)
144
- * **Remove Refusals with Transformers** (a proof-of-concept implementation to remove refusals from an LLM without using TransformerLens) – by [Sumandora](https://github.com/Sumandora/remove-refusals-with-transformers)
145
- * **[LLM-LAT/harmful-dataset](https://huggingface.co/datasets/LLM-LAT/harmful-dataset)** – by [LLM Latent Adversarial Training](https://huggingface.co/LLM-LAT)
 
36
 
37
  # **gemma-4-26B-A4B-it-Uncensored-MAX**
38
 
39
+ > **gemma-4-26B-A4B-it-Uncensored-MAX** is an optimized release built on top of **huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated**. This version focuses on **updated shard sizing, repository optimization, and compatibility improvements for the latest Transformers releases**, while preserving the MoE architecture and reasoning capabilities of the original Gemma model. The result is a powerful **26B parameter Mixture-of-Experts language model** designed for efficient inference, stable deployment, and modern ecosystem integration.
40
 
41
  > [!IMPORTANT]
42
+ > This model is intended for research and learning purposes only. Any content generated by this model is used at the user's own risk. The authors and hosting page disclaim any liability for outputs produced by this model. Users are responsible for ensuring safe, ethical, and lawful usage.
43
 
44
  ---
45
 
 
47
 
48
  ![z6v2k](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/g4aniCDdPATUfqEQQy_f2.png)
49
 
50
+ > Note: The evaluation was conducted using 500 selected harmful test prompts to measure model refusal behavior. These results are self-reported and may vary depending on benchmark setup and evaluation methodology.
51
 
52
  ---
53
 
54
  ## Key Highlights
55
 
56
+ * **Latest Transformers Compatibility**
57
+ Re-sharded and optimized for improved compatibility with recent Transformers releases.
58
+
59
+ * **Optimized Model Sharding**
60
+ Updated shard structure for better storage handling, download reliability, and inference efficiency.
61
+
62
+ * **Stable Inference Pipeline**
63
+ Improved packaging for consistent loading and generation behavior across environments.
64
+
65
+ * **26B MoE Architecture (A4B)**
66
+ Built on **gemma-4-26B-A4B-it**, leveraging Mixture-of-Experts design for scalable reasoning capacity.
67
+
68
+ * **Improved Deployment Stability**
69
+ Designed for smoother inference across different hardware configurations and runtimes.
70
+
71
+ * **Preserved Model Behavior**
72
+ No modifications to weights or architecture; behavior remains consistent with the base model lineage.
73
 
74
  ---
75
 
76
  ## Base Model Signatures:
77
 
78
+ This model has been re-sharded and optimized for the latest Transformers version from the base model:
79
+ https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated
80
 
81
  ---
82
 
83
  ## Quick Start with Transformers
84
 
85
+ ```bash id="g26a1"
86
  pip install -U transformers
87
  ```
88
 
89
+ ```python id="g26a2"
90
  from transformers import Gemma4ForConditionalGeneration, AutoProcessor
91
  import torch
92
 
 
110
  ]
111
 
112
  text = processor.apply_chat_template(
113
+ messages,
114
+ tokenize=False,
115
+ add_generation_prompt=True
116
  )
117
 
118
  inputs = processor(
 
136
  print(output_text)
137
  ```
138
 
139
+ ---
140
+
141
  ## Intended Use
142
 
143
+ * **Multimodal and Language Research**
144
+ Studying large-scale transformer and MoE behavior.
145
+
146
+ * **Red-Teaming & Evaluation**
147
+ Testing robustness across complex and adversarial prompts.
148
+
149
+ * **High-Performance Deployment**
150
+ Running large models on optimized GPU or distributed inference setups.
151
+
152
+ * **Research Prototyping**
153
+ Experimentation with scalable transformer architectures.
154
+
155
+ ---
156
 
157
  ## Limitations & Risks
158
 
159
+ > **Important Note**: This model inherits the behavior and limitations of its base model.
160
+
161
+ * **Output Variability**
162
+ Responses may vary depending on sampling configuration and prompt structure.
163
 
164
+ * **Resource Requirements**
165
+ A 26B MoE model requires significant GPU memory and optimized inference strategies such as quantization or tensor parallelism.
 
166
 
167
+ * **Deployment Constraints**
168
+ Performance depends heavily on hardware configuration and runtime optimization.
169
 
170
+ * **General Model Limitations**
171
+ May produce incorrect, incomplete, or inconsistent outputs in complex scenarios.