Instructions to use t0rr3sp3dr0/Qwen3.5-9B-MLX-MTP-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use t0rr3sp3dr0/Qwen3.5-9B-MLX-MTP-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen3.5-9B-MLX-MTP-8bit t0rr3sp3dr0/Qwen3.5-9B-MLX-MTP-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 429 Bytes
81f86d5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | {
"arch_id": "qwen3-next-mtp",
"mlx_lm_extra_tensors": {
"mtp_file": "mtp/weights.safetensors"
},
"mtp_contract": {
"base_hidden_variant": "post_norm",
"concat_order": "embedding_hidden",
"hidden_variant": "post_norm",
"mtp_position_mode": "local",
"mtp_quant_group_size": 64,
"mtp_quant_mode": "affine"
},
"mtp_depth_max": 3,
"mtp_norm_encoding": "delta",
"mtp_sidecar": "quantized"
} |