KellHect commited on
Commit
686aecc
·
verified ·
1 Parent(s): 77d5325

Document validated public release

Browse files
Files changed (1) hide show
  1. README.md +77 -12
README.md CHANGED
@@ -3,21 +3,86 @@ license: mit
3
  base_model: ornith-ai/Ornith-1.5-9B
4
  library_name: transformers
5
  pipeline_tag: image-text-to-text
6
- tags:
7
- - qwen3_5
8
- - abliterated
9
- - multimodal
10
- ---
 
 
11
 
12
  # Ornith-1.5-9B-Abliterated-FP8
13
 
14
- An abliterated derivative of `ornith-ai/Ornith-1.5-9B` at revision
15
- `489cb97981b8654bcfcf30ce1f94ed1b62e07b53`. Released as compressed-tensors FP8_DYNAMIC W8A8.
 
16
 
17
  Inference-oriented; use the BF16 repository for training.
18
 
19
- The language residual projections were modified. The vision tower, MTP block,
20
- tokenizer, chat template, and multimodal processors are preserved.
21
-
22
- Validation metrics and the exact surgery report will be added before the
23
- repository is made public.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  base_model: ornith-ai/Ornith-1.5-9B
4
  library_name: transformers
5
  pipeline_tag: image-text-to-text
6
+ tags:
7
+ - qwen3_5
8
+ - abliterated
9
+ - multimodal
10
+ - red-team
11
+ - ai-safety-research
12
+ ---
13
 
14
  # Ornith-1.5-9B-Abliterated-FP8
15
 
16
+ An abliterated derivative of [ornith-ai/Ornith-1.5-9B](https://huggingface.co/ornith-ai/Ornith-1.5-9B)
17
+ at revision `489cb97981b8654bcfcf30ce1f94ed1b62e07b53`, released as
18
+ compressed-tensors FP8_DYNAMIC W8A8.
19
 
20
  Inference-oriented; use the BF16 repository for training.
21
 
22
+ ## What changed
23
+
24
+ The language residual projections were modified. The vision tower, MTP block,
25
+ tokenizer, chat template, and multimodal processors are preserved. The pipeline
26
+ used complementary SVD and LEACE refusal-direction surgery, iterative re-probing,
27
+ targeted security-prompt refinement, and weight-space blending.
28
+
29
+ ## Validation
30
+
31
+ The FP8 release quantizes 248 language projection tensors and preserves 527
32
+ protected tensors. Reconstruction validation measured a maximum relative
33
+ Frobenius error of `0.026736` and minimum cosine similarity of `0.999635`. See
34
+ `validation_report.json` for per-tensor details.
35
+
36
+ The accepted BF16 checkpoint scored `0/12` refusal flags during refinement and
37
+ `0/24` on a separate held-out first-token refusal screen. The held-out mean
38
+ refusal-token probability was `1.18e-5`.
39
+
40
+ Coding evaluation was intentionally deferred before this release. These numbers
41
+ are structural and refusal-screen diagnostics, not a claim of benchmark parity
42
+ with the base model. A one-task generation smoke test is not reported as an
43
+ evaluation result.
44
+
45
+ ## Usage
46
+
47
+ ```bash
48
+ pip install torch transformers accelerate compressed-tensors
49
+ ```
50
+
51
+ ```python
52
+ import torch
53
+ from transformers import AutoModelForMultimodalLM, AutoProcessor
54
+
55
+ model_id = "KellHect/Ornith-1.5-9B-Abliterated-FP8"
56
+ processor = AutoProcessor.from_pretrained(model_id)
57
+ model = AutoModelForMultimodalLM.from_pretrained(
58
+ model_id, dtype=torch.bfloat16, device_map="auto"
59
+ )
60
+
61
+ messages = [{"role": "user", "content": "Explain this code and identify the bug."}]
62
+ inputs = processor.apply_chat_template(
63
+ messages, add_generation_prompt=True, tokenize=True,
64
+ return_dict=True, return_tensors="pt",
65
+ ).to(model.device)
66
+ output = model.generate(**inputs, max_new_tokens=512)
67
+ print(processor.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
68
+ ```
69
+
70
+ FP8 users need mutually compatible versions of Torch, Transformers, and
71
+ `compressed-tensors`. If the FP8 loader is unavailable on a platform, use the
72
+ BF16 release.
73
+
74
+ ## Research context
75
+
76
+ This model has had refusal behavior deliberately reduced. It may comply with
77
+ requests that the base model rejects. Users are responsible for deployment,
78
+ access control, generated content, and compliance with applicable law.
79
+
80
+ ## Credits
81
+
82
+ - [Ornith AI](https://huggingface.co/ornith-ai) for the base model.
83
+ - [OBLITERATUS](https://github.com/elder-plinius/OBLITERATUS) for the abliteration research and implementation lineage.
84
+ - Arditi et al. for refusal-direction research and Belrose et al. for LEACE.
85
+
86
+ ## License
87
+
88
+ MIT. See `LICENSE`.