stevorob commited on
Commit
9554af6
·
verified ·
1 Parent(s): 5e2556a

Org card: 27B is our first DENSE model (not first single-card), link the showcase Space

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -13,7 +13,8 @@ pinned: false
13
 
14
  **A self-funded solo AI research lab. Local-first. Models forged and run daily on hardware we own.**
15
 
16
- [![Build log](https://img.shields.io/badge/robinsonlabs.ai-build_log-F59E0B?style=flat-square)](https://robinsonlabs.ai)
 
17
  [![War stories](https://img.shields.io/badge/writing-war_stories-F59E0B?style=flat-square)](https://robinsonlabs.ai/writing/)
18
  [![Requests](https://img.shields.io/badge/requests-ask_for_a_model-F59E0B?style=flat-square)](https://huggingface.co/RobinsonLabs/requests/discussions)
19
 
@@ -41,11 +42,13 @@ The models here are not drive-by uploads. They are built, quantized, and run dai
41
 
42
  ## The models
43
 
44
- Newest first. Every model ships as a pair: the bf16 safetensors base you can re-quantize or fine-tune from, and the GGUF ladder you can actually run.
 
 
45
 
46
  | Family | bf16 base | GGUF ladder | Architecture |
47
  |---|---|---|---|
48
- | Qwen3.8-27B abliterated, **vision** | [base](https://huggingface.co/RobinsonLabs/Qwen3.8-27B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.8-27B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.8-27B-abliterated) |
49
  | Qwen3.5-REAP-262B-A17B abliterated | [base](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated) |
50
  | Qwen3.5-REAP-212B-A17B abliterated | [base](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated) |
51
  | Qwen3.6-35B-A3B abliterated | [base](https://huggingface.co/RobinsonLabs/Qwen3.6-35B-A3B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.6-35B-A3B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.6-35B-A3B-abliterated) |
@@ -55,7 +58,9 @@ Newest first. Every model ships as a pair: the bf16 safetensors base you can re-
55
 
56
  ### New: Qwen3.8-27B abliterated
57
 
58
- Our first vision model, and the first one here that a single consumer card can hold. Seven rungs from Q8_0 at 29.05 GB down to IQ3_XS at 12.26 GB, so it fits anything from a 12 GB card upward, with Q4_K_M at 16.84 GB as the volume rung. The f16 `mmproj` ships beside them: download it alongside whichever rung you pick, pass it with `--mmproj`, and you get the image path back. Without it you have a capable text model and no vision.
 
 
59
 
60
  Two things we did not cut corners on. The vision tower survives abliteration intact. And the MTP block is pinned at or above q5_K on every single rung, never an I-quant, because no importance matrix covers the MTP head. An imatrix is collected during a forward pass that never runs the draft head, so there are no statistics for it, and a low-bit mixture applied blindly there produces garbage. If you re-quantize this model yourself, that is the caveat worth reading first.
61
 
 
13
 
14
  **A self-funded solo AI research lab. Local-first. Models forged and run daily on hardware we own.**
15
 
16
+ [![Catalog](https://img.shields.io/badge/browse-the_full_catalog-F59E0B?style=flat-square)](https://huggingface.co/spaces/RobinsonLabs/showcase)
17
+ [![Build log](https://img.shields.io/badge/robinsonlabs.ai-build_log-5A5F68?style=flat-square)](https://robinsonlabs.ai)
18
  [![War stories](https://img.shields.io/badge/writing-war_stories-F59E0B?style=flat-square)](https://robinsonlabs.ai/writing/)
19
  [![Requests](https://img.shields.io/badge/requests-ask_for_a_model-F59E0B?style=flat-square)](https://huggingface.co/RobinsonLabs/requests/discussions)
20
 
 
42
 
43
  ## The models
44
 
45
+ Newest first. Every model ships as a pair: the bf16 safetensors base you can re-quantize or fine-tune from, and the GGUF ladder you can actually run. If you are working on a single card, the 35B-A3B goes smallest: 11.2 GB at IQ2_XS, with 3B active per token.
46
+
47
+ Every published rung, plotted against size and bits per weight, lives on the [catalog page](https://huggingface.co/spaces/RobinsonLabs/showcase). It is generated from the same build database that produced the files, so it cannot drift from what we actually shipped.
48
 
49
  | Family | bf16 base | GGUF ladder | Architecture |
50
  |---|---|---|---|
51
+ | Qwen3.8-27B abliterated, **dense + vision** | [base](https://huggingface.co/RobinsonLabs/Qwen3.8-27B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.8-27B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.8-27B-abliterated) |
52
  | Qwen3.5-REAP-262B-A17B abliterated | [base](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.5-REAP-262B-A17B-abliterated) |
53
  | Qwen3.5-REAP-212B-A17B abliterated | [base](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.5-REAP-212B-A17B-abliterated) |
54
  | Qwen3.6-35B-A3B abliterated | [base](https://huggingface.co/RobinsonLabs/Qwen3.6-35B-A3B-abliterated) | [quants](https://huggingface.co/RobinsonLabs/Qwen3.6-35B-A3B-abliterated-GGUF) | [view graph](https://hfviewer.com/RobinsonLabs/Qwen3.6-35B-A3B-abliterated) |
 
58
 
59
  ### New: Qwen3.8-27B abliterated
60
 
61
+ Our first pass at a dense model. Everything else in this catalog is a mixture of experts that runs a fraction of its weights on any given token. This one runs all 27 billion every time, which makes it a different tradeoff rather than a smaller box: considerably more compute per token, and a different feel for it. It is also our first with vision.
62
+
63
+ Seven rungs, from Q8_0 at 29.05 GB down to IQ3_XS at 12.26 GB, with Q4_K_M at 16.84 GB as the volume rung. The f16 `mmproj` ships beside them: download it alongside whichever rung you pick, pass it with `--mmproj`, and you get the image path back. Without it you have a capable text model and no vision.
64
 
65
  Two things we did not cut corners on. The vision tower survives abliteration intact. And the MTP block is pinned at or above q5_K on every single rung, never an I-quant, because no importance matrix covers the MTP head. An imatrix is collected during a forward pass that never runs the draft head, so there are no statistics for it, and a low-bit mixture applied blindly there produces garbage. If you re-quantize this model yourself, that is the caveat worth reading first.
66