Instructions to use t0rr3sp3dr0/Qwen3.5-4B-MLX-MTP-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use t0rr3sp3dr0/Qwen3.5-4B-MLX-MTP-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen3.5-4B-MLX-MTP-6bit t0rr3sp3dr0/Qwen3.5-4B-MLX-MTP-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
| { | |
| "arch_id": "qwen3-next-mtp", | |
| "mlx_lm_extra_tensors": { | |
| "mtp_file": "mtp/weights.safetensors" | |
| }, | |
| "mtp_contract": { | |
| "base_hidden_variant": "post_norm", | |
| "concat_order": "embedding_hidden", | |
| "hidden_variant": "post_norm", | |
| "mtp_position_mode": "local", | |
| "mtp_quant_group_size": 64, | |
| "mtp_quant_mode": "affine" | |
| }, | |
| "mtp_depth_max": 3, | |
| "mtp_sidecar": "quantized" | |
| } |