gearwave00001/Huihui-Qwen3.8-27B-Quark-AWQ-MXFP4

The repository contains huihui-ai/Huihui-Qwen3.8-27B-abliterated converted to the AMD Quark MXFP4 format using the AMD specified 28 calibration samples @ 512 sequences.

The process was driven on a system with 128GB DDR4, 5900x, and 2x R9700 gpus. The last 3 layers had to be offloaded to cpu but it's not yet determined if that affected quality. PPL was slightly higher than the AMD reference model. My testing and any PPL hit the original BF16 model took from uncensoring are suspected factors. Initial testing feels ok with good results.

https://github.com/amd/Quark

Reference model: https://huggingface.co/amd/Qwen3.8-27B-Quark-AWQ-MXFP4

License Apache 2.0, inherited from Qwen/Qwen3.8-27B.