Safetensors
GGUF
English
governed-agent
retrieval
brain-navigator
grounded-only
proposal-only
research-only
szl-holdings
khipu
abstain-retrain
weights-unreceipted
conversational
Instructions to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16 # Run inference directly in the terminal: llama cli -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16 # Run inference directly in the terminal: llama cli -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16 # Run inference directly in the terminal: ./llama-cli -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Use Docker
docker model run hf.co/SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
- LM Studio
- Jan
- Ollama
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with Ollama:
ollama run hf.co/SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
- Unsloth Desktop
- Pi
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with Docker Model Runner:
docker model run hf.co/SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
- Lemonade
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Run and chat with the model
lemonade run user.SZL-Khipu-1.5B-abstain-F16
List all available models
lemonade list
- Hermes Agent
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use SZLHOLDINGS/SZL-Khipu-1.5B-abstain with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "SZLHOLDINGS/SZL-Khipu-1.5B-abstain:F16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download bom/model-bom.cdx.json from SZLHOLDINGS/SZL-Khipu-1.5B-abstain: direct link, hf CLI and curl.
- Browser
- Download file 4.8 kB
-
https://huggingface.co/SZLHOLDINGS/SZL-Khipu-1.5B-abstain/resolve/0b14f66abc5b3468f3656d35aa41103be67162ce/bom/model-bom.cdx.json
- Command line
-
hf download hf://SZLHOLDINGS/SZL-Khipu-1.5B-abstain@0b14f66abc5b3468f3656d35aa41103be67162ce/bom/model-bom.cdx.json
-
curl -L -o model-bom.cdx.json https://huggingface.co/SZLHOLDINGS/SZL-Khipu-1.5B-abstain/resolve/0b14f66abc5b3468f3656d35aa41103be67162ce/bom/model-bom.cdx.json
4.8 kB
| { | |
| "bomFormat": "CycloneDX", | |
| "specVersion": "1.5", | |
| "serialNumber": "urn:uuid:b49fdbef-f4dd-594f-963e-48f5a9c2a8f6", | |
| "version": 1, | |
| "metadata": { | |
| "timestamp": "2026-08-31T01:34:34.212013+00:00", | |
| "tools": [ | |
| { | |
| "vendor": "SZL Holdings", | |
| "name": "build_model_bom", | |
| "version": "1.0.0" | |
| } | |
| ], | |
| "component": { | |
| "type": "machine-learning-model", | |
| "bom-ref": "hf:SZLHOLDINGS/SZL-Khipu-1.5B-abstain", | |
| "name": "SZL-Khipu-1.5B-abstain", | |
| "version": "unspecified", | |
| "description": "HF model SZLHOLDINGS/SZL-Khipu-1.5B-abstain \u2014 base model: Qwen/Qwen2.5-1.5B-Instruct", | |
| "licenses": [ | |
| { | |
| "license": { | |
| "id": "apache-2.0" | |
| } | |
| } | |
| ], | |
| "externalReferences": [ | |
| { | |
| "type": "website", | |
| "url": "https://huggingface.co/SZLHOLDINGS/SZL-Khipu-1.5B-abstain" | |
| } | |
| ], | |
| "properties": [ | |
| { | |
| "name": "szl:base_model", | |
| "value": "Qwen/Qwen2.5-1.5B-Instruct" | |
| }, | |
| { | |
| "name": "szl:downloads", | |
| "value": "0" | |
| }, | |
| { | |
| "name": "szl:likes", | |
| "value": "0" | |
| }, | |
| { | |
| "name": "szl:last_modified", | |
| "value": "2026-08-30T23:26:02.000Z" | |
| }, | |
| { | |
| "name": "szl:pipeline_tag", | |
| "value": "unspecified" | |
| }, | |
| { | |
| "name": "szl:heldout_eval", | |
| "value": "MISSING \u2014 required before publication" | |
| }, | |
| { | |
| "name": "szl:publication_eligible", | |
| "value": "false" | |
| } | |
| ] | |
| } | |
| }, | |
| "components": [ | |
| { | |
| "type": "file", | |
| "bom-ref": "file:.gitattributes", | |
| "name": ".gitattributes", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:LICENSE", | |
| "name": "LICENSE", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:README.md", | |
| "name": "README.md", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "documentation" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:adversarial.jsonl", | |
| "name": "adversarial.jsonl", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:eval.jsonl", | |
| "name": "eval.jsonl", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:khipu.schema.json", | |
| "name": "khipu.schema.json", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "config" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:manifest.json", | |
| "name": "manifest.json", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "config" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:publication.json", | |
| "name": "publication.json", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "config" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:train.abstain.jsonl", | |
| "name": "train.abstain.jsonl", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:train.jsonl", | |
| "name": "train.jsonl", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| }, | |
| { | |
| "type": "file", | |
| "bom-ref": "file:train_khipu_abstain.py", | |
| "name": "train_khipu_abstain.py", | |
| "scope": "required", | |
| "properties": [ | |
| { | |
| "name": "szl:role", | |
| "value": "support" | |
| } | |
| ] | |
| } | |
| ], | |
| "dependencies": [ | |
| { | |
| "ref": "hf:SZLHOLDINGS/SZL-Khipu-1.5B-abstain", | |
| "dependsOn": [ | |
| "file:.gitattributes", | |
| "file:LICENSE", | |
| "file:README.md", | |
| "file:adversarial.jsonl", | |
| "file:eval.jsonl", | |
| "file:khipu.schema.json", | |
| "file:manifest.json", | |
| "file:publication.json", | |
| "file:train.abstain.jsonl", | |
| "file:train.jsonl", | |
| "file:train_khipu_abstain.py" | |
| ] | |
| } | |
| ] | |
| } |