qwen3.8-27b-aeon-ultimate-uncensored-mxfp8-vision-mlx

Independent MXFP8 MLX conversion of AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16, pinned at a6775a9a8ebb65cab3f707b4ab087fc7aa698634. This is a community conversion, not an official AEON-7 or Qwen release.

Format

  • Language quantization: MXFP8, 8-bit, group size 32
  • Vision: 333 source BF16 tensors preserved; patch embedding converted to MLX axes
  • Indexed artifact size: 26.71 GiB
  • Architecture: dense Qwen3.5-family hybrid attention/GDN, 64 language layers
  • Configured context: 262,144 tokens (not exhaustively qualified here)
  • Tokenizer, chat template, processor metadata, and Apache-2.0 lineage preserved

This standard MLX artifact deliberately contains no MTP sidecar or active MTP metadata.

Qualification and limitations

  • Pinned source metadata and all safetensors headers were checked.
  • Quantization used the fixture-matched Qwen3.5 streaming adapter from MLX-LM 0.31.3.
  • MXFP4 and MXFP8 were each produced directly from the same BF16 parent.
  • Structural inspection and strict local load are required release gates.

This is an experimental quantization of an abliterated, intentionally unaligned checkpoint. Quantization does not restore safety alignment. The source publisher warns that the model can produce unsafe or illegal material and places downstream safety and legal responsibility on operators. Review the source model card before use and add access controls, logging, moderation, and human review appropriate to your deployment.

Basic use

python -m mlx_vlm.generate --model <repo-or-path> --image image.jpg --prompt "Describe this image." --max-tokens 256
Downloads last month
829
Safetensors
Model size
27B params
Tensor type
U32
·
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Shiftedx/qwen3.8-27b-aeon-ultimate-uncensored-mxfp8-vision-mlx

Base model

Qwen/Qwen3.8-27B
Quantized
(29)
this model

Collection including Shiftedx/qwen3.8-27b-aeon-ultimate-uncensored-mxfp8-vision-mlx