Instructions to use h2loop-ai/qwen3-0.6b-hexagon with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use h2loop-ai/qwen3-0.6b-hexagon with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf h2loop-ai/qwen3-0.6b-hexagon
# Run inference directly in the terminal:
llama cli -hf h2loop-ai/qwen3-0.6b-hexagon

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf h2loop-ai/qwen3-0.6b-hexagon
# Run inference directly in the terminal:
llama cli -hf h2loop-ai/qwen3-0.6b-hexagon

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf h2loop-ai/qwen3-0.6b-hexagon
# Run inference directly in the terminal:
./llama-cli -hf h2loop-ai/qwen3-0.6b-hexagon

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf h2loop-ai/qwen3-0.6b-hexagon
# Run inference directly in the terminal:
./build/bin/llama-cli -hf h2loop-ai/qwen3-0.6b-hexagon

Use Docker

docker model run hf.co/h2loop-ai/qwen3-0.6b-hexagon

LM Studio
Jan

vLLM

How to use h2loop-ai/qwen3-0.6b-hexagon with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "h2loop-ai/qwen3-0.6b-hexagon"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "h2loop-ai/qwen3-0.6b-hexagon",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/h2loop-ai/qwen3-0.6b-hexagon

Ollama
How to use h2loop-ai/qwen3-0.6b-hexagon with Ollama:
```
ollama run hf.co/h2loop-ai/qwen3-0.6b-hexagon
```
Unsloth Desktop

How to use h2loop-ai/qwen3-0.6b-hexagon with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf h2loop-ai/qwen3-0.6b-hexagon

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "h2loop-ai/qwen3-0.6b-hexagon"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use h2loop-ai/qwen3-0.6b-hexagon with Docker Model Runner:
```
docker model run hf.co/h2loop-ai/qwen3-0.6b-hexagon
```

Lemonade

How to use h2loop-ai/qwen3-0.6b-hexagon with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull h2loop-ai/qwen3-0.6b-hexagon

Run and chat with the model

lemonade run user.qwen3-0.6b-hexagon-{{QUANT_TAG}}

List all available models

lemonade list

Hermes Agent

How to use h2loop-ai/qwen3-0.6b-hexagon with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf h2loop-ai/qwen3-0.6b-hexagon

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default h2loop-ai/qwen3-0.6b-hexagon

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use h2loop-ai/qwen3-0.6b-hexagon with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf h2loop-ai/qwen3-0.6b-hexagon

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "h2loop-ai/qwen3-0.6b-hexagon" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

qwen3-0.6b-hexagon / SHA256SUMS

zi-roy

Qwen3-0.6B for Hexagon NPU: A16W4 (llama.cpp) and A16W8 + 16-bit KV (v79, v81)

d725fe3 27 days ago

Raw

History Blame Contribute Delete

2.77 kB

	33bcc57074ec7b6eada5a90651ee546ec0c2b271002c22baf9f1b2dd1e8f75cb qwen3-0.6b-a16w4-hexagon.gguf
	f11303db17de61db5db197c513ef7f04f410e24b31bbbcbcf0c456a4161604ee llama.cpp/bin/llama-bench
	371a5913b61a85dfc9655897d55fa95300dda35fd5edb6bd1a4443c27c8f5c84 llama.cpp/bin/llama-cli
	1b3310c927ab27ca7d1e2ff6a31cf43ebb36800ad8089ac67afcec65410f52b9 llama.cpp/lib/libggml-base.so
	0d71c265e5cdd7fa761a036ad5a17c13fe359b52a3dd086a402093196aac8b5b llama.cpp/lib/libggml-cpu.so
	4334f1bf4200764a78133a02bcbf91c9877f0ade2761bf5f8e7d3216cffa2f86 llama.cpp/lib/libggml-hexagon.so
	6eb04178e0c2109be42c2c822d7dd2b4283b9c8bf933decb2e89bdb6f2a02a0b llama.cpp/lib/libggml-htp-v79.so
	672569529c15f173af5b3c7982843dc388bfe3627799dcab1ebc44c223e126e3 llama.cpp/lib/libggml.so
	498bc2157b39c69d714489e887279b9189dfa3edb068fbece4fab723234cac8e llama.cpp/lib/libllama-bench-impl.so
	0df104c2c536df1bfa0c2f0573ac73dce175df72f94d393e86cdedcc68c7ba1e llama.cpp/lib/libllama-cli-impl.so
	2f359ef89d22199ad09ac734b462d31e766aa2daebd890687c61a726280ede10 llama.cpp/lib/libllama-common.so
	bbcc98382115f75c468e8dc3f65029a2302e6841fdbfa44e86ccb4cc8bcadacb llama.cpp/lib/libllama-server-impl.so
	d3cbf66d08cf070b92bfc39fa92b231b3ad6c2f10680475edca1dc3f48a2c314 llama.cpp/lib/libllama.so
	9005a0ca6e1c3433d1c857b94fea6e427a86e19bbfac610909dd07bae6ba4499 runtime/cli_kpis.sh
	5ea98e69a16016280828d27f028fc8a181836ddc94180b60b2113a3946cdb4d1 runtime/run_qdc_kpis.sh
	962e5353c8d34d4434ec60413be978bbb416d7f479c378bae7be995156344899 requirements.txt
	451b37794bc9155ffa5a24d92a17561b446d5ece6294a17e0cda5c0856ce6889 qwen3_part1_a16w8_int16kv_v79.bin
	452db07bb9c990dde8b21bd98e1c591e1a676237b93c80318674db3d61a28dbf qwen3_part2_a16w8_int16kv_v79.bin
	aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4 host-model/tokenizer.json
	3c0884a30471f4f542dc89630f62a380bb70a341fafda826136a7be921fec7ea host-model/tokenizer_config.json
	359105a4244cb162e66c3cd8e56e5ef25d56abc559c4d08124acaca246137ffe v79/genie_config_a16w8_int16kv.json
	6b22522e83c4313340daaf64b011ed3630e38e822165f1f3e976631cc4ccb75a v79/htp_backend_ext_config.json
	d7f380b63a510dd131c00a7115dbab3c00eb3677bb932a77c21c609bfddbe3f8 v79/metadata.json
	ac4cba5128b0f5647d26d1501727091b05554e7ed6121185c94f32de0a9b1c30 qwen3_part1_a16w8_int16kv_v81.bin
	2e6d616c7b49a59925717d3b91b9e01870544de33dab595db0ef37df60bb9aa4 qwen3_part2_a16w8_int16kv_v81.bin
	c3d2b7bdc47e3b55519a79de0d7dc856a94a73f90879d4ea186485c82c1e47dd v81/metadata.json
	a587d01f7f9c2dc11746f7247cd6f7aa2193c9695b516531ed823268294287ec results_v81_profile.json
	359105a4244cb162e66c3cd8e56e5ef25d56abc559c4d08124acaca246137ffe v81/genie_config_a16w8_int16kv.json
	6841a1b69f9986d695b011d1e4e9059fcb60afde1840694862dd2421b670b1dc v81/htp_backend_ext_config.json