--- license: mit pipeline_tag: text-generation library_name: mlx base_model: microsoft/Phi-4-mini-instruct base_model_relation: quantized quantized_by: Outlier-Ai tags: - 4-bit - 4bit - apple-silicon - chat - conversational - edge-ai - efficient - fast - function-calling - instruct - local-llm - m1 - m2 - m3 - m4 - mac - mac-mini - mac-studio - macbook-air - macbook-pro - macos - metal - microsoft - mlx - mlx-community - mlx-lm - no-cloud - offline - on-device - outlier - outlier-app - phi - phi-4 - phi4 - private - private-ai - quantized - safetensors - small-llm - text-generation - tool-use language: - en - de - fr - es - it - pt - nl - pl widget: - example_title: Quick answer messages: - role: user content: What is the capital of France? - example_title: Short definition messages: - role: user content: Define 'mixture of experts' in one sentence. - example_title: Quick list messages: - role: user content: Name three reasons to run a local LLM. --- > **Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=phi_4_mini_instruct_mlx_4bit)** — a free macOS app for local MLX inference. # Phi-4-mini-instruct (MLX 4-bit) MLX 4-bit conversion of [`microsoft/Phi-4-mini-instruct`](https://huggingface.co/microsoft/Phi-4-mini-instruct). License and base-model fields inherit from the original — see YAML frontmatter above. ## Load with mlx-lm ```bash pip install mlx-lm python -m mlx_lm.generate --model Outlier-Ai/Phi-4-mini-instruct-MLX-4bit --prompt "Hello" --max-tokens 256 ``` ## What is Outlier? A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps. ➡ **[outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=phi_4_mini_instruct_mlx_4bit)** ## Other Outlier conversions - [DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-7B-MLX-4bit) - [Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)](https://huggingface.co/Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit) - [Qwen2.5-Coder-7B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,450 downloads)](https://huggingface.co/Outlier-Ai/Qwen2.5-Coder-7B-Instruct-MLX-4bit) - [Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit) - [Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit) ## License Inherits from upstream (`mit`). See base model card.