Instructions to use DavidAU/Qwen3-30B-A6B-16-Extreme with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use DavidAU/Qwen3-30B-A6B-16-Extreme with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="DavidAU/Qwen3-30B-A6B-16-Extreme")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("DavidAU/Qwen3-30B-A6B-16-Extreme")
model = AutoModelForCausalLM.from_pretrained("DavidAU/Qwen3-30B-A6B-16-Extreme", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use DavidAU/Qwen3-30B-A6B-16-Extreme with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "DavidAU/Qwen3-30B-A6B-16-Extreme"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DavidAU/Qwen3-30B-A6B-16-Extreme",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/DavidAU/Qwen3-30B-A6B-16-Extreme

SGLang

How to use DavidAU/Qwen3-30B-A6B-16-Extreme with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "DavidAU/Qwen3-30B-A6B-16-Extreme" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DavidAU/Qwen3-30B-A6B-16-Extreme",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "DavidAU/Qwen3-30B-A6B-16-Extreme" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DavidAU/Qwen3-30B-A6B-16-Extreme",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use DavidAU/Qwen3-30B-A6B-16-Extreme with Docker Model Runner:
```
docker model run hf.co/DavidAU/Qwen3-30B-A6B-16-Extreme
```

DavidAU commited on Dec 18, 2025

Commit

569f7c9

verified ·

1 Parent(s): 9483da6

Upload folder using huggingface_hub

Browse files

Files changed (16) hide show

model-00001-of-00016.safetensors +3 -0
model-00002-of-00016.safetensors +3 -0
model-00003-of-00016.safetensors +3 -0
model-00004-of-00016.safetensors +3 -0
model-00005-of-00016.safetensors +3 -0
model-00006-of-00016.safetensors +3 -0
model-00007-of-00016.safetensors +3 -0
model-00008-of-00016.safetensors +3 -0
model-00009-of-00016.safetensors +3 -0
model-00010-of-00016.safetensors +3 -0
model-00011-of-00016.safetensors +3 -0
model-00012-of-00016.safetensors +3 -0
model-00013-of-00016.safetensors +3 -0
model-00014-of-00016.safetensors +3 -0
model-00015-of-00016.safetensors +3 -0
model-00016-of-00016.safetensors +3 -0

+version https://git-lfs.github.com/spec/v1
+oid sha256:454e77b346a61bfb201d54df60e15158838cf930617ee135113556204f2802b5
+size 3999417504

+version https://git-lfs.github.com/spec/v1
+oid sha256:47f015d6e5bb1782a834d75c06113c5e8c77ddca1cb7daf89686a4ec0deda19e
+size 3999974192

+version https://git-lfs.github.com/spec/v1
+oid sha256:ac0bf5990f2da995c1e8b77a3149dee71900b4fe1b8a614231dea9647193d96b
+size 3997360832

+version https://git-lfs.github.com/spec/v1
+oid sha256:89b01fd34a683c70fdb7f22c2e7090538d65063335ba0db46f3654642b17d1e5
+size 3999975056

+version https://git-lfs.github.com/spec/v1
+oid sha256:9849eb3584d928e35bf5956ccfd91b64207467e1fad8304aae68dc4d92d6d6d9
+size 3999975400

+version https://git-lfs.github.com/spec/v1
+oid sha256:920702a50f27a009e5f676da3b02978dbd794f6ad7854f301d709136154c1a84
+size 3999975472

+version https://git-lfs.github.com/spec/v1
+oid sha256:a85bf0cc8a8047c116172d4c08cf4792eb59d4375032708ba3e1a7ffca0f708a
+size 3997362064

+version https://git-lfs.github.com/spec/v1
+oid sha256:25cd8aaed86b8e17685efb152912f92448ea3fffb1bdc247f257f04d05907604
+size 3999975408

+version https://git-lfs.github.com/spec/v1
+oid sha256:8cb898bc5e78492600053d1105c9ff61d7a719f5cc2802df63e41535a652cc26
+size 3987400496

+version https://git-lfs.github.com/spec/v1
+oid sha256:599594421f314cb8e8ab4474db0eb490cc6310585067e82d73821254b93319ce
+size 3997353632

	@@ -0,0 +1,3 @@

	@@ -0,0 +1,3 @@

	@@ -0,0 +1,3 @@

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c979e314faf06e94a5e1841abd285d4e26e763c79c1abe7710d543192d9da48
+size 1087928584