SofiTesfay2010's picture
Upload folder using huggingface_hub
3178cd1 verified
|
Raw
History Blame
480 Bytes
metadata
license: apache-2.0
base_model: orcarouter/Qwen3.8-27B-Uncensored
tags:
  - quantization
  - sherry
  - 1.25bpw
  - extreme-compression

SofiTesfay2010/Qwen3.8-27B-Uncensored-Compressed

1.25 bits per weight (Sherry 3:4) compressed version of orcarouter/Qwen3.8-27B-Uncensored.

Specs

  • Method: Sherry 3:4 Sparse Ternary Quantization ($C(4,3) \times 2^3 = 32 = 2^5$)
  • Size: ~4.3 GB (down from ~55.6 GB)
  • Memory Footprint: Runs comfortably in <5 GB RAM / VRAM