---
license: apache-2.0
language:
- en
- zh
base_model:
- openbmb/MiniCPM5-2B
base_model_relation: quantized
quantized_by: Atomic-Germ
pipeline_tag: text-generation
tags:
- transformers
- safetensors
- llama
- text-generation
- minicpm
- minicpm5
- long-context
- tool-calling
- on-device
- edge-ai
- conversational
- en
- zh
- dataset:openbmb/Ultra-FineWeb
- dataset:openbmb/UltraX-Preview
- dataset:openbmb/Ultra-FineWeb-L3
- dataset:openbmb/UltraData-Math
- dataset:openbmb/UltraData-Code
- dataset:openbmb/UltraData-SFT-2605
- dataset:openbmb/UltraData-SFT-Agent-2609
- dataset:openbmb/UltraData-RL-2609
- arxiv:2506.07900
- arxiv:2602.09003
- license:apache-2.0
- text-generation-inference
- endpoints_compatible
- region:us
---
# MiniCPM5-2B-OpenNPU2-NPU2

**OpenFlowLM Q4NX conversion of [`openbmb/MiniCPM5-2B`](https://huggingface.co/openbmb/MiniCPM5-2B)** for AMD XDNA NPU inference.

This repository contains a quantized **Q4NX** port of the model, compiled for the OpenFlowLM (OFLM) runtime. It is **not** a GGUF file.

| Item | Value |
|------|-------|
| Source model | [`openbmb/MiniCPM5-2B`](https://huggingface.co/openbmb/MiniCPM5-2B) |
| Source GGUF | `MiniCPM5-2B.i1-Q4_1.gguf` |
| Weights | `model.q4nx` (1.81 GB) |
| Modality | language |
| OFLM version | `0.1.0` |
| Converted | 2026-09-14 |

## Install and run

This repository works with `oflm-add`, a small installer that copies the model
into the OpenFlowLM user directory and registers the tag. It never
modifies the system OpenFlowLM install.

`pip install oflm-add` or `uv tool install oflm-add`

```bash
uv tool install oflm-add
oflm-add Atomic-Germ/MiniCPM5-2B-OpenNPU2-NPU2 --family qwen3.5 --xclbin-from MiniCPM5-2B-OpenNPU2-NPU2
OFLM_CONFIG_PATH="$HOME/.config/oflm/model_list.json" OFLM_XCLBIN_PATH="$HOME/.config/oflm" oflm run MiniCPM5-2B-OpenNPU2-NPU2
```

## Files

| File | Description |
|------|-------------|
| `model.q4nx` | Quantized weights (Q8_0 / Q4_1 / BF16) |
| `config.json` | OFLM runtime configuration |
| `tokenizer.json` | Tokenizer vocabulary |
| `tokenizer_config.json` | Tokenizer configuration |
| `chat_template.jinja` | Chat template |


---

## Source model card

See the original model card: [openbmb/MiniCPM5-2B](https://huggingface.co/openbmb/MiniCPM5-2B)