Instructions to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Use Docker

docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

LM Studio
Jan

vLLM

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Ollama
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Ollama:
```
ollama run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
```
Unsloth Desktop

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Docker Model Runner:
```
docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
```

Lemonade

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Run and chat with the model

lemonade run user.Qwen3.8-Flash-CIRU-STRIX-IU4-Q8_0

List all available models

lemonade list

Hermes Agent

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Qwen3.8-Flash-CIRU-STRIX-IU4 / benchmarks /v4.4.0 /PACKAGE-LOAD-CHECK.json

jcbtc

Release v4.4: combined runtime, opt-in Boost and measured results

551722d verified 8 days ago

Raw

History Blame

4.24 kB

	{
	"status": "PASS",
	"seconds": 25.925079345703125,
	"scope": "Relocated complete archive, actual production launcher, full262144 MTP3 default, exact inference and HIP/ROCr maps, eight-token serving smoke; no repeated quality panel",
	"argv": [
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/llama-server",
	"--model",
	"/srv/llm/models/Qwen3.8-Flash-CIRU-STRIX-IU4/Qwen3.8-Flash-CIRU-STRIX-IU4.gguf",
	"--alias",
	"Qwen3.8-Flash-CIRU-STRIX-IU4",
	"--host",
	"0.0.0.0",
	"--port",
	"50283",
	"--jinja",
	"--ple-sidecar",
	"/srv/llm/models/Qwen3.8-Flash-CIRU-STRIX-IU4/ple",
	"--ple-cache-mib",
	"4096",
	"--slot-save-path",
	"/home/halo/flash-combined-20260916/release-v4.4.0/load-check-r2/slots",
	"-ngl",
	"all",
	"-sm",
	"none",
	"--fit",
	"off",
	"-lm",
	"none",
	"-lzm",
	"on-direct",
	"--no-kv-unified",
	"--no-context-shift",
	"-c",
	"262144",
	"-b",
	"8192",
	"-ub",
	"8192",
	"--parallel",
	"1",
	"-t",
	"8",
	"-tb",
	"8",
	"-ctk",
	"f16",
	"-ctv",
	"f16",
	"-fa",
	"on",
	"--cont-batching",
	"--cache-prompt",
	"--cache-ram",
	"1024",
	"--cache-idle-slots",
	"--ctx-checkpoints",
	"32",
	"--checkpoint-min-step",
	"8192",
	"--temp",
	"1.0",
	"--top-p",
	"0.95",
	"--top-k",
	"20",
	"--min-p",
	"0.0",
	"--metrics",
	"--slots",
	"--ui",
	"--path",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/ui",
	"--spec-type",
	"draft-mtp",
	"--spec-draft-model",
	"/srv/llm/models/Qwen3.8-Flash-CIRU-STRIX-IU4/mtp/Qwen3.8-Flash-CIRU-STRIX-IU4-MTP-Q8_0.gguf",
	"--spec-draft-ngl",
	"all",
	"--spec-draft-device",
	"ROCm0",
	"--spec-draft-type-k",
	"f16",
	"--spec-draft-type-v",
	"f16",
	"--spec-draft-threads",
	"8",
	"--spec-draft-threads-batch",
	"8",
	"--spec-draft-n-max",
	"3",
	"--spec-draft-n-min",
	"0",
	"--spec-draft-p-min",
	"0.0",
	"--spec-draft-p-split",
	"0.10",
	"--alias",
	"main"
	],
	"mapped": {
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/runtime/rocr/lib/libhsa-runtime64.so.1.21.0": "3478dde41ccdba3561f1a1d938587fdf6919e6015f268ec8bb611a06c052dcc7",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/runtime/hip/lib/libamdhip64.so.7.16.26366-7dda3ac": "3e8499d8e47d9db4f2a3140c0f3b4960167b27384dec5f9c1b9eef1f9cd94d26",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libggml-hip.so.0.23.0": "346547c8930a41f46b72d2c8a54268cac1ee38bd0833db6be9974db95301754d",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libggml-cpu.so.0.23.0": "5498beba4fea384bd87908b019eab01a2e28db0bc60e302a66ddd93489d08afe",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libllama.so.0.4.0": "cf1233a616ed082658ff45612f5ac2e16011cbb0d651d110cb60eccc5fd35517",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libllama-common.so.0.4.0": "334a8bb92b1151aac8befc6c18c34b41b7c1d0ae2c6792ed845306e4c923c408",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libggml-base.so.0.23.0": "988ca6568cda24be818894aae84c3efe1c7f6968fbc1fdb98688b68a5f93318d",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libllama-server-impl.so": "9512847e3bce1fb83035030f8d58c4740a6391597a145fc94220e85e748e38ef",
	"/home/halo/flash-combined-20260916/release-v4.4.0/ciru-runtime-v4.4.0-nixos-gfx1151/bin/libggml.so.0.23.0": "4d061b0caf4179de131e31d2666b770441500036e155cfc820a889931bfa6280"
	},
	"env": {
	"FLASH_K22_STAGED_DECAY": "1",
	"CIRU_MTP_SHORTLIST": "32768",
	"DEBUG_HIP_GRAPH_PM4": "1",
	"CIRU_HC_Q8_FUSE": "1",
	"CIRU_QSA_CACHE": "1",
	"ENABLE_RETAINED_PM4": "0",
	"FLASH_K21_VECTOR_STAGE": "1",
	"CIRU_FA_LEGACY_LDS_OCCUPANCY": "1",
	"DEBUG_HIP_GRAPH_PM4_UNQUALIFIED": "0"
	},
	"response_tokens": 8
	}