Instructions to use eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated") model = AutoModelForMultimodalLM.from_pretrained("eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated: direct link, hf CLI and curl.
- Browser
- Download file 2.76 kB
-
https://huggingface.co/eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated/resolve/main/README.md
- Command line
-
hf download hf://eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated/README.md
-
curl -L -o README.md https://huggingface.co/eadx/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated/resolve/main/README.md
2.76 kB
| library_name: transformers | |
| license: apache-2.0 | |
| license_link: https://ai.google.dev/gemma/docs/gemma_4_license | |
| pipeline_tag: any-to-any | |
| base_model: | |
| - google/gemma-4-26B-A4B-it-qat-q4_0-unquantized | |
| tags: | |
| - abliterated | |
| - uncensored | |
| # huihui-ai/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated | |
| This is an uncensored version of [google/gemma-4-26B-A4B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-26B-A4B-it-qat-q4_0-unquantized) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). | |
| This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. | |
| ## ollama | |
| Please use the latest version of [ollama](https://github.com/ollama/ollama/releases/) | |
| You can use [huihui_ai/gemma-4-abliterated:26b-qat](https://ollama.com/huihui_ai/gemma-4-abliterated:26b-qat) directly, | |
| ``` | |
| ollama run huihui_ai/gemma-4-abliterated:26b-qat | |
| ``` | |
| ## GGUF | |
| [huihui-ai/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated-GGUF](https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-qat-q4_0-unquantized-abliterated-GGUF) | |
| ### Usage Warnings | |
| - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. | |
| - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. | |
| - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. | |
| - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. | |
| - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. | |
| - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. | |
| ### Donation | |
| ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. | |
| - bitcoin: | |
| ``` | |
| bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge | |
| ``` | |
| - Support our work on [Ko-fi](https://ko-fi.com/huihuiai)! | |