Super-squash branch 'main' using huggingface_hub

.gitattributes

@@ -0,0 +1,42 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-BF16.gguf filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-MXFP4.gguf filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+gpt-oss-120b-heretic-ultra-heretic-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,242 @@
+---
+license: apache-2.0
+pipeline_tag: text-generation
+tags:
+- heretic
+- uncensored
+- decensored
+- abliterated
+base_model:
+- llmfan46/gpt-oss-120b-ultra-heretic
+---
+<div style="background-color: #ff4444; color: white; padding: 20px; border-radius: 10px; text-align: center; margin: 20px 0;">
+<h2 style="color: white; margin: 0 0 10px 0;">🚨⚠️ I HAVE REACHED HUGGING FACE'S FREE STORAGE LIMIT ⚠️🚨</h2>
+<p style="font-size: 18px; margin: 0 0 15px 0;">I can no longer upload new models unless I can cover the cost of additional storage.<br>I host <b>70+ free models</b> as an independent contributor and this work is unpaid.<br><b>Without your support, no more new models can be uploaded.</b></p>
+<p style="font-size: 20px; margin: 0;">
+<a href="https://patreon.com/LLMfan46" style="color: white; text-decoration: underline;">🎉 Patreon (Monthly)</a> &nbsp;|&nbsp;
+<a href="https://ko-fi.com/llmfan46" style="color: white; text-decoration: underline;">☕ Ko-fi (One-time)</a>
+</p>
+<p style="font-size: 16px; margin: 10px 0 0 0;">Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.</p>
+</div>
+
+---
+
+# gpt-oss-120b-ultra-heretic-GGUF
+
+GGUF quantizations of [llmfan46/gpt-oss-120b-ultra-heretic](https://huggingface.co/llmfan46/gpt-oss-120b-ultra-heretic).
+
+# This is a decensored version of [openai/gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0 with the [Arbitrary-Rank Ablation (ARA)](https://github.com/p-e-w/heretic/pull/211) method
+
+## Abliteration parameters
+
+| Parameter | Value |
+| :-------- | :---: |
+| **start_layer_index** | 15 |
+| **end_layer_index** | 32 |
+| **preserve_good_behavior_weight** | 0.3968 |
+| **steer_bad_behavior_weight** | 0.0990 |
+| **overcorrect_relative_weight** | 0.9882 |
+| **neighbor_count** | 8 |
+
+## Performance
+
+| Metric | This model | Original model ([gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b)) |
+| :----- | :--------: | :---------------------------: |
+| **KL divergence** | 0.0703 | 0 *(by definition)* |
+| **Refusals** | 3/100 | 98/100 |
+
+Lower refusals indicate fewer content restrictions, while lower KL divergence indicates better preservation of the original model's capabilities. Higher refusals cause more rejections, objections, pushbacks, lecturing, censorship, softening and deflections, while higher KL divergence degrades coherence, reasoning ability, and overall quality.
+
+## Quantizations
+
+| Filename | Quant | Description |
+|----------|-------|-------------|
+| gpt-oss-120b-heretic-ultra-heretic-BF16.gguf | BF16 | Full precision |
+| gpt-oss-120b-heretic-ultra-heretic-Q8_0.gguf | Q8_0 | Near-lossless |
+| gpt-oss-120b-heretic-ultra-heretic-Q5_K_M.gguf | Q5_K_M | Quality |
+| gpt-oss-120b-heretic-ultra-heretic-Q5_K_S.gguf | Q5_K_S | Balanced |
+| gpt-oss-120b-heretic-ultra-heretic-Q4_K_S.gguf | Q4_K_S | Budget |
+| gpt-oss-120b-heretic-ultra-heretic-Q3_K_L.gguf | Q3_K_L | Low VRAM |
+| gpt-oss-120b-heretic-ultra-heretic-MXFP4.gguf | MXFP4 | Smallest, original 4-bit format |
+
+## Usage
+
+Works with llama.cpp, LM Studio, Ollama, and other GGUF-compatible tools.
+
+-----
+
+
+<p align="center">
+  <img alt="gpt-oss-120b" src="https://raw.githubusercontent.com/openai/gpt-oss/main/docs/gpt-oss-120b.svg">
+</p>
+
+<p align="center">
+  <a href="https://gpt-oss.com"><strong>Try gpt-oss</strong></a> ·
+  <a href="https://cookbook.openai.com/topic/gpt-oss"><strong>Guides</strong></a> ·
+  <a href="https://arxiv.org/abs/2508.10925"><strong>Model card</strong></a> ·
+  <a href="https://openai.com/index/introducing-gpt-oss/"><strong>OpenAI blog</strong></a>
+</p>
+
+<br>
+
+Welcome to the gpt-oss series, [OpenAI’s open-weight models](https://openai.com/open-models) designed for powerful reasoning, agentic tasks, and versatile developer use cases.
+
+We’re releasing two flavors of these open models:
+- `gpt-oss-120b` — for production, general purpose, high reasoning use cases that fit into a single 80GB GPU (like NVIDIA H100 or AMD MI300X) (117B parameters with 5.1B active parameters)
+- `gpt-oss-20b` — for lower latency, and local or specialized use cases (21B parameters with 3.6B active parameters)
+
+Both models were trained on our [harmony response format](https://github.com/openai/harmony) and should only be used with the harmony format as it will not work correctly otherwise.
+
+
+> [!NOTE]
+> This model card is dedicated to the larger `gpt-oss-120b` model. Check out [`gpt-oss-20b`](https://huggingface.co/openai/gpt-oss-20b) for the smaller model.
+
+# Highlights
+
+* **Permissive Apache 2.0 license:** Build freely without copyleft restrictions or patent risk—ideal for experimentation, customization, and commercial deployment.  
+* **Configurable reasoning effort:** Easily adjust the reasoning effort (low, medium, high) based on your specific use case and latency needs.  
+* **Full chain-of-thought:** Gain complete access to the model’s reasoning process, facilitating easier debugging and increased trust in outputs. It’s not intended to be shown to end users.  
+* **Fine-tunable:** Fully customize models to your specific use case through parameter fine-tuning.
+* **Agentic capabilities:** Use the models’ native capabilities for function calling, [web browsing](https://github.com/openai/gpt-oss/tree/main?tab=readme-ov-file#browser), [Python code execution](https://github.com/openai/gpt-oss/tree/main?tab=readme-ov-file#python), and Structured Outputs.
+* **MXFP4 quantization:** The models were post-trained with MXFP4 quantization of the MoE weights, making `gpt-oss-120b` run on a single 80GB GPU (like NVIDIA H100 or AMD MI300X) and the `gpt-oss-20b` model run within 16GB of memory. All evals were performed with the same MXFP4 quantization.
+
+---
+
+# Inference examples
+
+## Transformers
+
+You can use `gpt-oss-120b` and `gpt-oss-20b` with Transformers. If you use the Transformers chat template, it will automatically apply the [harmony response format](https://github.com/openai/harmony). If you use `model.generate` directly, you need to apply the harmony format manually using the chat template or use our [openai-harmony](https://github.com/openai/harmony) package.
+
+To get started, install the necessary dependencies to setup your environment:
+
+```
+pip install -U transformers kernels torch 
+```
+
+Once, setup you can proceed to run the model by running the snippet below:
+
+```py
+from transformers import pipeline
+import torch
+
+model_id = "openai/gpt-oss-120b"
+
+pipe = pipeline(
+    "text-generation",
+    model=model_id,
+    torch_dtype="auto",
+    device_map="auto",
+)
+
+messages = [
+    {"role": "user", "content": "Explain quantum mechanics clearly and concisely."},
+]
+
+outputs = pipe(
+    messages,
+    max_new_tokens=256,
+)
+print(outputs[0]["generated_text"][-1])
+```
+
+Alternatively, you can run the model via [`Transformers Serve`](https://huggingface.co/docs/transformers/main/serving) to spin up a OpenAI-compatible webserver:
+
+```
+transformers serve
+transformers chat localhost:8000 --model-name-or-path openai/gpt-oss-120b
+```
+
+[Learn more about how to use gpt-oss with Transformers.](https://cookbook.openai.com/articles/gpt-oss/run-transformers)
+
+## vLLM
+
+vLLM recommends using [uv](https://docs.astral.sh/uv/) for Python dependency management. You can use vLLM to spin up an OpenAI-compatible webserver. The following command will automatically download the model and start the server.
+
+```bash
+uv pip install --pre vllm==0.10.1+gptoss \
+    --extra-index-url https://wheels.vllm.ai/gpt-oss/ \
+    --extra-index-url https://download.pytorch.org/whl/nightly/cu128 \
+    --index-strategy unsafe-best-match
+
+vllm serve openai/gpt-oss-120b
+```
+
+[Learn more about how to use gpt-oss with vLLM.](https://cookbook.openai.com/articles/gpt-oss/run-vllm)
+
+## PyTorch / Triton
+
+To learn about how to use this model with PyTorch and Triton, check out our [reference implementations in the gpt-oss repository](https://github.com/openai/gpt-oss?tab=readme-ov-file#reference-pytorch-implementation).
+
+## Ollama
+
+If you are trying to run gpt-oss on consumer hardware, you can use Ollama by running the following commands after [installing Ollama](https://ollama.com/download).
+
+```bash
+# gpt-oss-120b
+ollama pull gpt-oss:120b
+ollama run gpt-oss:120b
+```
+
+[Learn more about how to use gpt-oss with Ollama.](https://cookbook.openai.com/articles/gpt-oss/run-locally-ollama)
+
+#### LM Studio
+
+If you are using [LM Studio](https://lmstudio.ai/) you can use the following commands to download.
+
+```bash
+# gpt-oss-120b
+lms get openai/gpt-oss-120b
+```
+
+Check out our [awesome list](https://github.com/openai/gpt-oss/blob/main/awesome-gpt-oss.md) for a broader collection of gpt-oss resources and inference partners.
+
+---
+
+# Download the model
+
+You can download the model weights from the [Hugging Face Hub](https://huggingface.co/collections/openai/gpt-oss-68911959590a1634ba11c7a4) directly from Hugging Face CLI:
+
+```shell
+# gpt-oss-120b
+huggingface-cli download openai/gpt-oss-120b --include "original/*" --local-dir gpt-oss-120b/
+pip install gpt-oss
+python -m gpt_oss.chat model/
+```
+
+# Reasoning levels
+
+You can adjust the reasoning level that suits your task across three levels:
+
+* **Low:** Fast responses for general dialogue.  
+* **Medium:** Balanced speed and detail.  
+* **High:** Deep and detailed analysis.
+
+The reasoning level can be set in the system prompts, e.g., "Reasoning: high".
+
+# Tool use
+
+The gpt-oss models are excellent for:
+* Web browsing (using built-in browsing tools)
+* Function calling with defined schemas
+* Agentic operations like browser tasks
+
+# Fine-tuning
+
+Both gpt-oss models can be fine-tuned for a variety of specialized use cases.
+
+This larger model `gpt-oss-120b` can be fine-tuned on a single H100 node, whereas the smaller [`gpt-oss-20b`](https://huggingface.co/openai/gpt-oss-20b) can even be fine-tuned on consumer hardware.
+
+# Citation
+
+```bibtex
+@misc{openai2025gptoss120bgptoss20bmodel,
+      title={gpt-oss-120b & gpt-oss-20b Model Card}, 
+      author={OpenAI},
+      year={2025},
+      eprint={2508.10925},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2508.10925}, 
+}
+```

gpt-oss-120b-heretic-ultra-heretic-MXFP4.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18b6ce6604fa64eedd319aff5d85845147e16d51cef714d7cabe20029594d975
+size 65369016640