jackson-barding commited on
Commit
f76adfa
·
verified ·
1 Parent(s): 55b3e99

README: add context framing, reword related work

Browse files
Files changed (1) hide show
  1. README.md +25 -7
README.md CHANGED
@@ -36,6 +36,25 @@ qwen3_8_27b_huihui_abliterated_nvfp4.ninfer
36
  identity qwen3.8-27b / nvfp4 container v2 1124 objects
37
  ```
38
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  ## What it is, precisely
40
 
41
  **Format conversion only.** No fine-tuning, no re-abliteration, no behavioural editing was performed.
@@ -203,8 +222,8 @@ and builds in a single command with no external quantizer, no calibration data a
203
 
204
  ## Related work — other NInfer abliterated artifacts
205
 
206
- Several people published abliterated Qwen3.8-27B NInfer artifacts before this one. If one of these
207
- fits your needs better, use it — this list is here so you can find them.
208
 
209
  | Repo | Source checkpoint | Published |
210
  |---|---|---|
@@ -216,12 +235,11 @@ fits your needs better, use it — this list is here so you can find them.
216
  | [DogOnKeyboard/Qwen3.8-27B-Uncensored-NInfer](https://huggingface.co/DogOnKeyboard/Qwen3.8-27B-Uncensored-NInfer) | JonathanColetti | 2026-08-30 |
217
  | [jfking/qwen38_27b_huahuacs_uncensored_ninfer_nvfp4](https://huggingface.co/jfking/qwen38_27b_huahuacs_uncensored_ninfer_nvfp4) | untagged | 2026-09-02 |
218
 
219
- Three are built on [`orcarouter/Qwen3.8-27B-Uncensored`](https://huggingface.co/orcarouter/Qwen3.8-27B-Uncensored),
220
- a source not covered here — worth a look if you want a different ablation.
 
221
 
222
- What this repo adds is the **reproducible procedure** — `AGENT.md`, `SUPPORTED.md` and `scripts/`,
223
- so you can convert a compatible checkpoint yourself rather than depending on anyone's upload. As far
224
- as I can tell none of the above ship a conversion recipe.
225
 
226
  ## Licence
227
 
 
36
  identity qwen3.8-27b / nvfp4 container v2 1124 objects
37
  ```
38
 
39
+ ## Why this exists
40
+
41
+ Qwen3.8-27B is the king of the local models right now, and the great work Neroued has done with the
42
+ [NInfer](https://github.com/Neroued/ninfer) engine runs it extremely quickly on Blackwell. There has
43
+ also been a lot of work on obliterating and otherwise liberating models, including
44
+ [Pliny](https://pliny.gg)'s OBLITERATUS suite.
45
+
46
+ Some abliterated models have been "ninferized" already — see [Related work](#related-work--other-ninfer-abliterated-artifacts)
47
+ below. Two things I hadn't seen:
48
+
49
+ - the walkthrough/recipe to do it yourself
50
+ - Pliny's OBLITERATUS Qwen3.8-27B, ninferized
51
+
52
+ Both are offered here. The recipe is in `AGENT.md`, `SUPPORTED.md` and `scripts/` — a triage script
53
+ that tells you in seconds whether a checkpoint is convertible, ten documented failure modes with the
54
+ measurement behind each, and nine scripts proven by running the pipeline end to end on a second
55
+ checkpoint. **Under $5 of RunPod time** converts a compatible checkpoint; measured runs came in at
56
+ **$1.69** and **$3.30**.
57
+
58
  ## What it is, precisely
59
 
60
  **Format conversion only.** No fine-tuning, no re-abliteration, no behavioural editing was performed.
 
222
 
223
  ## Related work — other NInfer abliterated artifacts
224
 
225
+ Other people got here first, and their artifacts are also good. Use whichever fits — this list is
226
+ here so you can find them.
227
 
228
  | Repo | Source checkpoint | Published |
229
  |---|---|---|
 
235
  | [DogOnKeyboard/Qwen3.8-27B-Uncensored-NInfer](https://huggingface.co/DogOnKeyboard/Qwen3.8-27B-Uncensored-NInfer) | JonathanColetti | 2026-08-30 |
236
  | [jfking/qwen38_27b_huahuacs_uncensored_ninfer_nvfp4](https://huggingface.co/jfking/qwen38_27b_huahuacs_uncensored_ninfer_nvfp4) | untagged | 2026-09-02 |
237
 
238
+ Worth noting three are built on
239
+ [`orcarouter/Qwen3.8-27B-Uncensored`](https://huggingface.co/orcarouter/Qwen3.8-27B-Uncensored),
240
+ which is **gated**.
241
 
242
+ As far as I can tell, none of the above ship a conversion recipe. That is what this repo adds.
 
 
243
 
244
  ## Licence
245