README.md

metadata

license: mit
pipeline_tag: text-generation
library_name: mlx
base_model: microsoft/Phi-4-mini-instruct
base_model_relation: quantized
quantized_by: Outlier-Ai
tags:
  - 4-bit
  - 4bit
  - apple-silicon
  - chat
  - conversational
  - edge-ai
  - efficient
  - fast
  - function-calling
  - instruct
  - local-llm
  - m1
  - m2
  - m3
  - m4
  - mac
  - mac-mini
  - mac-studio
  - macbook-air
  - macbook-pro
  - macos
  - metal
  - microsoft
  - mlx
  - mlx-community
  - mlx-lm
  - no-cloud
  - offline
  - on-device
  - outlier
  - outlier-app
  - phi
  - phi-4
  - phi4
  - private
  - private-ai
  - quantized
  - safetensors
  - small-llm
  - text-generation
  - tool-use
language:
  - en
  - de
  - fr
  - es
  - it
  - pt
  - nl
  - pl
widget:
  - example_title: Quick answer
    messages:
      - role: user
        content: What is the capital of France?
  - example_title: Short definition
    messages:
      - role: user
        content: Define 'mixture of experts' in one sentence.
  - example_title: Quick list
    messages:
      - role: user
        content: Name three reasons to run a local LLM.

Run this on your Mac with Outlier — a free macOS app for local MLX inference.

Phi-4-mini-instruct (MLX 4-bit)

MLX 4-bit conversion of microsoft/Phi-4-mini-instruct. License and base-model fields inherit from the original — see YAML frontmatter above.

Load with mlx-lm

pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/Phi-4-mini-instruct-MLX-4bit --prompt "Hello" --max-tokens 256

What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ outlier.host

Other Outlier conversions

• DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)
• Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)
• Qwen2.5-Coder-7B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,450 downloads)
• Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)
• Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)

License

Inherits from upstream (mit). See base model card.