README.md

---
license: mit
pipeline_tag: text-generation
library_name: mlx
base_model: microsoft/Phi-4-mini-instruct
base_model_relation: quantized
quantized_by: Outlier-Ai
tags:
- 4-bit
- 4bit
- apple-silicon
- chat
- conversational
- edge-ai
- efficient
- fast
- function-calling
- instruct
- local-llm
- m1
- m2
- m3
- m4
- mac
- mac-mini
- mac-studio
- macbook-air
- macbook-pro
- macos
- metal
- microsoft
- mlx
- mlx-community
- mlx-lm
- no-cloud
- offline
- on-device
- outlier
- outlier-app
- phi
- phi-4
- phi4
- private
- private-ai
- quantized
- safetensors
- small-llm
- text-generation
- tool-use
language:
- en
- de
- fr
- es
- it
- pt
- nl
- pl
widget:
- example_title: Quick answer
  messages:
  - role: user
    content: What is the capital of France?
- example_title: Short definition
  messages:
  - role: user
    content: Define 'mixture of experts' in one sentence.
- example_title: Quick list
  messages:
  - role: user
    content: Name three reasons to run a local LLM.
---
> **Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=phi_4_mini_instruct_mlx_4bit)** — a free macOS app for local MLX inference.

# Phi-4-mini-instruct (MLX 4-bit)

MLX 4-bit conversion of [`microsoft/Phi-4-mini-instruct`](https://huggingface.co/microsoft/Phi-4-mini-instruct). License and base-model fields inherit from the original — see YAML frontmatter above.

## Load with mlx-lm

```bash
pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/Phi-4-mini-instruct-MLX-4bit --prompt "Hello" --max-tokens 256
```

## What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ **[outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=phi_4_mini_instruct_mlx_4bit)**

## Other Outlier conversions

- [DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-7B-MLX-4bit)
- [Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)](https://huggingface.co/Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit)
- [Qwen2.5-Coder-7B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,450 downloads)](https://huggingface.co/Outlier-Ai/Qwen2.5-Coder-7B-Instruct-MLX-4bit)
- [Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit)
- [Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit)

## License

Inherits from upstream (`mit`). See base model card.