--- library_name: mlx license: apache-2.0 base_model: apus-ailab/APUS-Reflex-35B-A3B base_model_relation: quantized pipeline_tag: text-generation language: - en - zh tags: - apus-reflex - decision-model - mlx - apple-silicon --- # APUS Reflex 35B-A3B-MLX-8bit > **Branding note:** This model family is now **APUS Reflex**. Some weight filenames, script/module names, served-model aliases, and the separate evaluation dataset ID retain their historical identifiers for download and runtime compatibility; these do not indicate different model versions. [English](README.md) | [中文](README.zh-CN.md) · [Source model](https://huggingface.co/apus-ailab/APUS-Reflex-35B-A3B) · [Collection](https://huggingface.co/collections/apus-ailab/apus-reflex-6ab1ee888eb002fcdd3a2825) · [GGUF collection](https://huggingface.co/collections/apus-ailab/apus-reflex-gguf-6ab39d5e724c4d8a1021198f) · [MLX collection](https://huggingface.co/collections/apus-ailab/apus-reflex-mlx-6ab39d5fc988a1b1cb89dfc8) · [MLX-4bit](https://huggingface.co/apus-ailab/APUS-Reflex-35B-A3B-MLX-4bit) · [GGUF / Ollama](https://huggingface.co/apus-ailab/APUS-Reflex-35B-A3B-GGUF) MLX weights (8-bit affine, group size 64) of [APUS-Reflex-35B-A3B](https://huggingface.co/apus-ailab/APUS-Reflex-35B-A3B) for **Apple Silicon Macs** (mlx-lm, LM Studio). APUS Reflex is a **decision model**: each request supplies a state, an instruction and 2–16 candidates, and the model scores candidate labels A–P. It is not a chat model. ## Quick start ```bash pip install mlx-lm hf download apus-ailab/APUS-Reflex-35B-A3B-MLX-8bit --local-dir ./apus-reflex python ./apus-reflex/examples/openjev_mlx.py --model ./apus-reflex ``` `examples/openjev_mlx.py` renders prompts with [openjev_contracts.py](openjev_contracts.py) (the training contract) and returns the exact candidate distribution. ## Parity Frozen80 with identical prompt tokens, compared with the HF BF16 release (full depth, **71/80 · 88.75%**): | Run / 运行 | Backend / 后端 | Frozen80 | = HF BF16 | Max Δp | |---|---|---:|---:|---:| | NVIDIA RTX PRO 6000 (CUDA) | mlx 0.32.2 on Linux x86_64 (Device(gpu, 0)) | 71/80 · 88.75% | 80/80 | 0.1931 | Converted and scored with MLX on Linux (CUDA); the files are platform-independent and load unchanged on Apple Silicon (for 4B, the same kind of file gave identical decisions on CUDA and Metal). Peak memory on Frozen80 was 38.66 GB; plan for a Mac with at least 64 GB of unified memory. Frozen80 is a reused development panel, not a blind benchmark. Per-question rows (candidate probabilities, choice, correctness; join with Frozen80 by `panel_index`): [evaluation/per-question/](evaluation/per-question/). ## Conversion - mlx-lm `0.31.3` / mlx `0.32.2`; 8-bit affine, group size 64. - GDN `A_log` and `linear_attn.norm.weight` keep their source precision (FP32 in the 35B release). - Full depth only, text only, probabilities **not calibrated**. ## License Apache-2.0, inherited from the source model; see [LICENSE](LICENSE). Base model: [Qwen/Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B). **Authors:** gumpcheng ([xDAN2099](https://huggingface.co/xDAN2099)), zhangxu, [APUS AI-LAB](https://github.com/APUS-AI-Lab).