Instructions to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Use Docker

docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

LM Studio
Jan

vLLM

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Ollama
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Ollama:
```
ollama run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
```
Unsloth Desktop

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Docker Model Runner:
```
docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
```

Lemonade

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Run and chat with the model

lemonade run user.Qwen3.8-Flash-CIRU-STRIX-IU4-Q8_0

List all available models

lemonade list

Hermes Agent

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Qwen3.8-Flash-CIRU-STRIX-IU4 / benchmarks /v2.0 /competitor-artifacts.json

jcbtc

Release v2.0 runtime, matched comparisons and verified build instructions

0a31d75 verified 21 days ago

Raw

History Blame

7.92 kB

	{
	"agention": {
	"runtime_source": "https://github.com/LaurentZuijdwijk/llama.cpp",
	"runtime_commit": "5e085d123eead2e89b5c19f824fccb05727da6a2",
	"build": "Release; GGML_VULKAN=ON; GGML_NATIVE=ON; -march=native on identical Ryzen AI MAX+395; GCC15.2; glslc2026.1",
	"binary_sha256": {
	"agention-logit-capture": "e5e8fd13e0e30dd282c7e31c163a168ee5409779b95e57b2ffef3eb5d82db015",
	"libggml.so.0.22.0": "2bbc5d9d724471ce8ba2bd718f42540683937a516cbfd6e7a2db892142cae6c9",
	"libllama-bench-impl.so": "dd076a83339e15dd882511c4a572ea437769a1fbb9e0eac1431e1b79204ed375",
	"libggml-cpu.so.0.22.0": "3ef48c8227e760b0eef31a5cf8a9e304ba0e54da4c7bd25e1e85b8100170a287",
	"llama-perplexity": "18795d1a52d38afcbd98d9246e023a41254adaabb7bafa1432b9199c4e213f27",
	"libllama-common.so.0.3.0": "0ea75f4fbeddfb4f32df9551d351d2bd0070c3965386c41860de54abc803ce9c",
	"libllama.so.0.3.0": "ea96f618251bf27e91bbd01f6d88ec7c617b05bdb590696b33a19aed2fc039e4",
	"llama-server": "ee03ebdbfabd73ab96f4db975f64ee4c514ade22d7c91b5119a4c7298543cc23",
	"libllama-server-impl.so": "eaaf255d36c54f1792cceb9fc076139f3c7af082170dc464eb80b39585026e6a",
	"llama-bench": "0f86842c7c7d19be46715f92fd738b39457640d4a73f8564bb9e6e0bdf10db9f",
	"libggml-vulkan.so.0.22.0": "35027a5e4d4a16abbf03fb766179779801376d2706978f2802d5289b50302c5a",
	"libggml-base.so.0.22.0": "7c38040b141b7d992e5038fc41a0672a59e08f6da5100087d38f819db76efdaa",
	"libllama-perplexity-impl.so": "b4f4034405ea24ac288638dbd49958b250db9ad380243ae824ee399cc64c559d",
	"libmtmd.so.0.3.0": "77f181821ccb697b842e20ea17cbe373fe7a129c84a49c9bd24ed85230e94564"
	},
	"target": {
	"state": "COMPLETE",
	"repo": "agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF",
	"revision": "ad4c5717254a630ee0c5a8db5208eb1f8476e56c",
	"files": [
	{
	"file": ".gitattributes",
	"bytes": 3056,
	"sha256": "13abf0cb3eaf629e3431d353759d39dc05f6ee93be4e0be3659b998f3e83cd5f",
	"verified_utc": "2026-09-05T01:14:03.991766+00:00"
	},
	{
	"file": "README.md",
	"bytes": 9020,
	"sha256": "2aa99e13ea2f3e4329692282ea6aed56f2e73e62364627d8c8209b0ca06d8bbf",
	"verified_utc": "2026-09-05T01:14:04.302070+00:00"
	},
	{
	"file": "assets/throughput-vs-depth.png",
	"bytes": 185136,
	"sha256": "757755421061f21730f8251240e429e1ed2e1f683e277f81083c81146484c582",
	"verified_utc": "2026-09-05T01:14:04.930333+00:00"
	},
	{
	"file": "mmproj/mmproj-Qwen3.8-Flash-Next-f16.gguf",
	"bytes": 904004128,
	"sha256": "f456cd796fdbdef0cadb22710b54e0071b6cdf22c07963365baa898267aec517",
	"verified_utc": "2026-09-05T01:14:12.918470+00:00"
	},
	{
	"file": "Qwen3.8-Flash-Next-ROCmFP4-FAST-v2-ple16.gguf",
	"bytes": 93484237760,
	"sha256": "552a7a162f6a620c3aa0850d070086bc2b95094e0a4e8b860694c7f212cb59d8",
	"verified_utc": "2026-09-05T01:23:03.986191+00:00"
	}
	],
	"completed_utc": "2026-09-05T01:23:03.986271+00:00"
	},
	"draft": {
	"state": "COMPLETE",
	"repo": "agentionai/Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST-GGUF",
	"revision": "5a2cf56c3e0f8bc8d395d53bec649ec8e358a993",
	"files": [
	{
	"file": ".gitattributes",
	"bytes": 1596,
	"sha256": "2c8de7fbce4de3b2a94d3215ba4e3e33ebeb107c634b429d3b18e2713252d669",
	"verified_utc": "2026-09-05T03:33:09.932944+00:00"
	},
	{
	"file": "README.md",
	"bytes": 2939,
	"sha256": "fa6de4146c9b31e3f96c2969d6a8c958681f36a92b28033f98f36c24bc908a18",
	"verified_utc": "2026-09-05T03:33:10.160120+00:00"
	},
	{
	"file": "LICENSE",
	"bytes": 3235,
	"sha256": "a0dc422560841fd68e06d974907f8b4c709bca44a67daad2b528437bdf676c08",
	"verified_utc": "2026-09-05T03:33:10.377404+00:00"
	},
	{
	"file": "Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST.gguf",
	"bytes": 2444519296,
	"sha256": "5046d69571bb35c699e19c7a00b36633c2fdfdd06d70482551744ec523a6b590",
	"verified_utc": "2026-09-05T03:34:21.425457+00:00"
	}
	],
	"completed_utc": "2026-09-05T03:34:21.425537+00:00"
	}
	},
	"unsloth": {
	"runtime_source": "https://github.com/danielhanchen/llama.cpp",
	"runtime_branch": "qwen4exp/mtp (Unsloth MTP README option 2)",
	"runtime_commit": "d1a92352cbd417fd840b4e765c0b82f5fe3d1d89",
	"build": "native Release Vulkan GCC15.2",
	"binary_sha256": {
	"libggml.so.0.22.0": "98a1577666dbc408ea7e0ca53ecf131c9fb2e0fdc5aa722d700f3f6d32de364f",
	"libllama-bench-impl.so": "007fd5258bcbe3df3bcd3a920e5ef0d751256b706a03edfb0c325bafa2a3f549",
	"libggml-cpu.so.0.22.0": "e9b2cc40e27e87ebaab290b67b69f7e6148483a7310b8efc5a477b45df985fa8",
	"libllama-common.so.0.3.0": "f5e60bf4529920ed0e58099e5540da46857f2c6b4bbcd4112c0ab6f801b6d1ae",
	"libllama.so.0.3.0": "2b772ffdfe672a28faaa00f313bf2a407c0a26a09222c64b6437349bf2874c59",
	"llama-server": "f16f7acc3bcbf035166df093470797e3ffcc7bd05fc09570994bbff8ba949f69",
	"libllama-server-impl.so": "c8058db9aec86b1d7a9326881e10d95b9d529f4476d19bb69635c33f13b97bde",
	"logit-capture": "9fdff72b74e326b802228fdf2b35be3516d71b3bdf6238e4a408caa65a45b6fc",
	"llama-bench": "b28863f4bffd5dc210745e8d154824bd121fc6c1daa075c3a99de9c82233d228",
	"libggml-vulkan.so.0.22.0": "43a9fd1608f68f9a8358b1e64911c1ebd39583e07c2ff6677d6673ae9da7393a",
	"libggml-base.so.0.22.0": "b18eb78d5e212593aa3ad509892abba5fc6fab77cbb85241b5742443ff47f82e",
	"libmtmd.so.0.3.0": "1846d70cc91fe4af957fc4562ab2e18993a7e8cbd17af7fbd2f4d5fcd8d39cc3"
	},
	"artifacts": {
	"state": "COMPLETE",
	"repo": "unsloth/Qwen3.8-Flash-Next-GGUF",
	"revision": "38bb39ee97821de2c9009abb7e93950eec396e66",
	"files": [
	{
	"file": "README.md",
	"bytes": 59183,
	"sha256": "9538227ff778ba7d8ba61b42cde3927487bf4c9c647ce18ac31d08a0b42998e6",
	"verified_utc": "2026-09-05T05:04:33.439844+00:00"
	},
	{
	"file": "MTP/README.md",
	"bytes": 5906,
	"sha256": "18a8c2d894bb0b63e31cf8aec0fceeee30564fa3e8115fee81e94ec73027fd63",
	"verified_utc": "2026-09-05T05:04:33.728653+00:00"
	},
	{
	"file": "UD-IQ4_XS/Qwen3.8-Flash-Next-UD-IQ4_XS-00001-of-00003.gguf",
	"bytes": 10946624,
	"sha256": "5ce89370720f8bf90890f439361282104c1aa1482d4013bb9a50923e758e71a4",
	"verified_utc": "2026-09-05T05:04:34.952622+00:00"
	},
	{
	"file": "UD-IQ4_XS/Qwen3.8-Flash-Next-UD-IQ4_XS-00002-of-00003.gguf",
	"bytes": 49835229856,
	"sha256": "577a38a2392b40ca2193cea502e1d92f60b8cd370675d308e0ec21885d9daaa7",
	"verified_utc": "2026-09-05T05:11:01.301186+00:00"
	},
	{
	"file": "UD-IQ4_XS/Qwen3.8-Flash-Next-UD-IQ4_XS-00003-of-00003.gguf",
	"bytes": 43836407744,
	"sha256": "d4634e6d84f0ebb0940be15c90d3790bf6464e3dea3a1cddc567dc0e83ad8833",
	"verified_utc": "2026-09-05T05:19:54.395294+00:00"
	},
	{
	"file": "MTP/mtp-Qwen3.8-Flash-Next-Q8_0.gguf",
	"bytes": 4137429120,
	"sha256": "cd87e5d1a4dadaeed63e35929f3b2f28d13e081b4cd32e00f2835095ec09351e",
	"verified_utc": "2026-09-05T05:20:59.165207+00:00"
	},
	{
	"file": "MTP/mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf",
	"bytes": 2786568256,
	"sha256": "5ff54097406a905cf3a724c709124ceb0e3e10235ee862298969e91c96fa96e6",
	"verified_utc": "2026-09-05T05:21:22.474475+00:00"
	}
	],
	"completed_utc": "2026-09-05T05:21:22.474550+00:00"
	}
	}
	}