Instructions to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal # Run inference directly in the terminal: llama cli -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal # Run inference directly in the terminal: llama cli -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal # Run inference directly in the terminal: ./llama-cli -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal # Run inference directly in the terminal: ./build/bin/llama-cli -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Use Docker
docker model run hf.co/jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
- LM Studio
- Jan
- vLLM
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jcbtc/Qwen3.8-27B-IU4-Kairic-Signal" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jcbtc/Qwen3.8-27B-IU4-Kairic-Signal", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
- Ollama
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with Ollama:
ollama run hf.co/jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
- Unsloth Desktop
- Pi
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "jcbtc/Qwen3.8-27B-IU4-Kairic-Signal" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with Docker Model Runner:
docker model run hf.co/jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
- Lemonade
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Run and chat with the model
lemonade run user.Qwen3.8-27B-IU4-Kairic-Signal-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use jcbtc/Qwen3.8-27B-IU4-Kairic-Signal with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jcbtc/Qwen3.8-27B-IU4-Kairic-Signal
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "jcbtc/Qwen3.8-27B-IU4-Kairic-Signal" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Qwen3.8-27B · KAIRIC SIGNAL
AgentionAI's Signal tuning on CIRU's KAIRIC EDGE execution stack. A 27B local model for AMD Strix Halo, combining an IU4-accelerated body, a standard Q8 output head, and native multi-token prediction.
Signal is tuned for more direct answers and less unnecessary reasoning. This release brings that tuning into the existing KAIRIC build by replacing the vocabulary output layer. The remaining 865 GGUF tensors and all three acceleration files are unchanged.
Requires the custom KAIRIC ROCm runtime. This is not a stock llama.cpp, Ollama, or CUDA GGUF package.
What this release contains
| Component | Detail |
|---|---|
| Tuning | Signal-3.8-27B by AgentionAI |
| Model body | CIRU KAIRIC EDGE hybrid quantization with IU4 acceleration files |
| Output head | Signal BF16 → standard Q8_0 |
| Drafting | Original native MTP weights retained; launcher uses depth 4 |
| Default sampling | Temperature 0.7 · top-p 0.95 · top-k 20 · min-p 0 |
| Target hardware | AMD Strix Halo / gfx1151 |
v1.0 validation: source lineage, all-tensor integrity, and output-head conversion checks passed. This specific Signal build has not yet been inference-tested or benchmarked on AMD. Parent-model quality and speed results are not claimed for this release.
Download and run
Download the GGUF, all three .pfs files, and the runner into the same directory:
hf download jcbtc/Qwen3.8-27B-IU4-Kairic-Signal --local-dir kairic-signal
cd kairic-signal
sha256sum -c SHA256SUMS
Build the pinned KAIRIC v1.2 runtime using BUILD.md, then launch:
LLAMA_SERVER=/absolute/path/to/ROCmFPX/build-kairic/bin/llama-server \
ROCM_PATH=/opt/rocm \
PORT=8080 \
bash ./run-kairic-signal.sh
The runner defaults to a 32K context, thinking off, and Signal's sampling values. It disables greedy argmax shortcuts, draft backend sampling, prompt reuse, and the unsafe native M65 verifier. CONTEXT, HOST, PORT, and MODEL_ALIAS can be overridden through environment variables. Larger contexts need sufficient memory and separate validation.
curl http://127.0.0.1:8080/v1/chat/completions \
-H 'Content-Type: application/json' \
-d '{"model":"kairic-signal","messages":[{"role":"user","content":"Explain how a hash map works."}],"max_tokens":1024}'
The package is for text inference; a vision projector is not included.
Files
| File | Size |
|---|---|
Qwen3.8-27B-IU4-Kairic-Signal.gguf |
15.48 GiB |
Qwen3.8-27B-Kairic-IU4-FFN.pfs |
7.99 GiB |
Qwen3.8-27B-Kairic-IU4-GDN.pfs |
1.88 GiB |
Qwen3.8-27B-Kairic-IU4-GDN-Output.pfs |
0.70 GiB |
The .pfs files are prepacked execution views used by PromptForge. Keep all three alongside the GGUF. File size is not peak runtime memory.
Build verification
Only lm_head.weight differs between the pinned Signal and Qwen BF16 checkpoints. The first 17 shards have identical published SHA-256 values; every tensor in the final shard was compared directly. Tokenizer, configuration, and chat-template identities match.
The head was converted with the runtime's Q8_0 reference function. An independent implementation checked all 1,271,398,400 values with exact quantized-byte agreement. Every non-head GGUF tensor and all other payload bytes match the published KAIRIC donor. See build-report.json and SHA256SUMS.
These checks establish artifact integrity. They do not measure task quality, MTP acceptance, or generation speed.
Credits
- AgentionAI Signal-3.8-27B — output-layer tuning for concise responses.
- Qwen3.8-27B — base model, tokenizer, and MTP weights.
- CIRU KAIRIC EDGE — model body, IU4 execution views, and PromptForge integration.
- ROCmFPX, llama.cpp, and ROCm Composable Kernel — runtime and kernels.
Model weights: Apache 2.0. Runtime-derived launcher: MIT. This is a CIRU derivative of Signal, not an AgentionAI runtime release.
- Downloads last month
- 383
We're not able to determine the quantization variants.
