Instructions to use t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen3.5-2B-MLX-MTP-6bit t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download mtplx_runtime.json from t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit: direct link, hf CLI and curl.
- Browser
- Download file 397 Bytes
-
https://huggingface.co/t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit/resolve/0e67843fc86da6c8ce44cdbb341207dde7f02057/mtplx_runtime.json
- Command line
-
hf download hf://t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit@0e67843fc86da6c8ce44cdbb341207dde7f02057/mtplx_runtime.json
-
curl -L -o mtplx_runtime.json https://huggingface.co/t0rr3sp3dr0/Qwen3.5-2B-MLX-MTP-6bit/resolve/0e67843fc86da6c8ce44cdbb341207dde7f02057/mtplx_runtime.json
397 Bytes
| { | |
| "arch_id": "qwen3-next-mtp", | |
| "mlx_lm_extra_tensors": { | |
| "mtp_file": "mtp/weights.safetensors" | |
| }, | |
| "mtp_contract": { | |
| "base_hidden_variant": "post_norm", | |
| "concat_order": "embedding_hidden", | |
| "hidden_variant": "post_norm", | |
| "mtp_position_mode": "local", | |
| "mtp_quant_group_size": 64, | |
| "mtp_quant_mode": "affine" | |
| }, | |
| "mtp_depth_max": 3, | |
| "mtp_sidecar": "quantized" | |
| } |