Text Generation
PEFT
Safetensors
English
minicpm
minicpm5
minicpm5-1b
tool-calling
function-calling
tool-use
agentic
agentic-ai
ai-agent
xml-tool-calling
json-function-calling
lora
qlora
grpo
reinforcement-learning
rlhf
unsloth
trl
openbmb
conversational
small-language-model
slm
edge-ai
on-device
local-llm
efficient-llm
Eval Results (legacy)
Instructions to use ewin-reg/MiniCPM5-1B-Agentic-Tooluse-QLoRA-v3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ewin-reg/MiniCPM5-1B-Agentic-Tooluse-QLoRA-v3 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("openbmb/MiniCPM5-1B") model = PeftModel.from_pretrained(base_model, "ewin-reg/MiniCPM5-1B-Agentic-Tooluse-QLoRA-v3") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
yyy commited on
SEO/GEO: rewrite intro with keyword-rich quotable authoritative content
Browse files
README.md
CHANGED
|
@@ -72,12 +72,21 @@ pipeline_tag: text-generation
|
|
| 72 |
|
| 73 |
---
|
| 74 |
|
| 75 |
-
# MiniCPM5-1B-Agentic-Tooluse-QLoRA-v3
|
| 76 |
|
| 77 |
-
**
|
| 78 |
|
| 79 |
-
If you
|
| 80 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 81 |
## Why MiniCPM5-1B-Agentic-Tooluse?
|
| 82 |
|
| 83 |
- **Tiny footprint, real accuracy.** 1B parameters total, LoRA adapter itself is under 100MB — deployable anywhere a 7B+ model can't go: mobile apps, browser extensions, IoT/embedded agents, offline assistants, cost-sensitive high-throughput API backends.
|
|
|
|
| 72 |
|
| 73 |
---
|
| 74 |
|
| 75 |
+
# MiniCPM5-1B-Agentic-Tooluse-QLoRA-v3 — Small Function-Calling LoRA Adapter (GRPO + QLoRA)
|
| 76 |
|
| 77 |
+
**MiniCPM5-1B-Agentic-Tooluse-QLoRA-v3** is a **LoRA adapter for MiniCPM5-1B** that turns a 1-billion-parameter base model into a reliable function-calling / tool-calling agent. Under 100 MB download. Load it with PEFT on top of [openbmb/MiniCPM5-1B](https://huggingface.co/openbmb/MiniCPM5-1B) and run it on a consumer GPU, a laptop, or any edge device.
|
| 78 |
|
| 79 |
+
If you are looking for a **small LLM for function calling**, a **lightweight tool-use LoRA adapter**, a **local AI agent backbone under 100MB**, a **cheap fast alternative to GPT-4o / Claude function calling**, or a **GRPO-trained structured-output model**, this adapter is built exactly for that.
|
| 80 |
|
| 81 |
+
> **74.67% exact-argument accuracy** on a held-out 300-example benchmark — trained with QLoRA supervised fine-tuning followed by GRPO reinforcement learning, rewarding exact function-name and argument-value correctness. The adapter itself is under 100 MB.
|
| 82 |
+
|
| 83 |
+
## Why MiniCPM5-1B-Agentic-Tooluse?
|
| 84 |
+
|
| 85 |
+
- **Tiny footprint, real accuracy.** 1B parameters, adapter under 100 MB — deployable anywhere a 7B+ model can't go: mobile apps, browser extensions, IoT/embedded agents, offline assistants, cost-sensitive high-throughput API backends.
|
| 86 |
+
- **Purpose-built for agentic tool use.** Trained specifically to parse a tool/function schema plus a natural-language user request and emit a correctly-named, correctly-structured, correctly-valued function call — the core skill every LLM agent framework (LangChain, LlamaIndex, AutoGen, CrewAI, custom ReAct loops, MCP servers) depends on.
|
| 87 |
+
- **Two-stage training: QLoRA SFT + GRPO reinforcement learning.** Most open tool-calling fine-tunes stop at supervised fine-tuning. This adapter adds GRPO (Group Relative Policy Optimization) RL on top, specifically rewarding exact function-name selection and exact argument-value correctness — the two hardest, most failure-prone parts of tool calling for small models.
|
| 88 |
+
- **Honestly measured, not marketing numbers.** Every metric comes from one evaluation harness run end-to-end on a locked, held-out 300-example test split — same parser, same grader, same slice for the base model, the SFT model, and this GRPO-refined v3 adapter.
|
| 89 |
+
- **Compared to GPT-4o / Claude for function calling:** 100% free, fully local, zero per-call cost, fine-tunable, data never leaves your machine.
|
| 90 |
## Why MiniCPM5-1B-Agentic-Tooluse?
|
| 91 |
|
| 92 |
- **Tiny footprint, real accuracy.** 1B parameters total, LoRA adapter itself is under 100MB — deployable anywhere a 7B+ model can't go: mobile apps, browser extensions, IoT/embedded agents, offline assistants, cost-sensitive high-throughput API backends.
|