Instructions to use clzoro/Qwen3.5-9B-Claude-distill with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use clzoro/Qwen3.5-9B-Claude-distill with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="clzoro/Qwen3.5-9B-Claude-distill")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("clzoro/Qwen3.5-9B-Claude-distill")
model = AutoModelForMultimodalLM.from_pretrained("clzoro/Qwen3.5-9B-Claude-distill", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use clzoro/Qwen3.5-9B-Claude-distill with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "clzoro/Qwen3.5-9B-Claude-distill"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "clzoro/Qwen3.5-9B-Claude-distill",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/clzoro/Qwen3.5-9B-Claude-distill

SGLang

How to use clzoro/Qwen3.5-9B-Claude-distill with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "clzoro/Qwen3.5-9B-Claude-distill" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "clzoro/Qwen3.5-9B-Claude-distill",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "clzoro/Qwen3.5-9B-Claude-distill" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "clzoro/Qwen3.5-9B-Claude-distill",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use clzoro/Qwen3.5-9B-Claude-distill with Docker Model Runner:
```
docker model run hf.co/clzoro/Qwen3.5-9B-Claude-distill
```

Qwen3.5-9B-Claude-distill

Commit History

Upload README.md with huggingface_hub

594403c
verified

Kassadin commited on Apr 13

Upload README.md with huggingface_hub

5cdffa1
verified

Kassadin commited on Apr 13

Update README with correct benchmark images

52b1c53
verified

Kassadin commited on Apr 5

Update README with training data table

5598f72
verified

Kassadin commited on Apr 5

Fix README - correct thinking block format

b391ebd
verified

Kassadin commited on Mar 27

Add limitations, detailed model info, and highlights

03a55b9
verified

Kassadin commited on Mar 27

Update README with training details

438055c
verified

Kassadin commited on Mar 27

Upload folder using huggingface_hub

71f89e5
verified

Kassadin commited on Mar 27

initial commit

3f3511c
verified

Kassadin commited on Mar 27

Commit History

Upload README.md with huggingface_hub 594403c verified

Upload README.md with huggingface_hub 5cdffa1 verified

Update README with correct benchmark images 52b1c53 verified

Update README with training data table 5598f72 verified

Fix README - correct thinking block format b391ebd verified

Add limitations, detailed model info, and highlights 03a55b9 verified

Update README with training details 438055c verified

Upload folder using huggingface_hub 71f89e5 verified

initial commit 3f3511c verified

Upload README.md with huggingface_hub

594403c
verified

Upload README.md with huggingface_hub

5cdffa1
verified

Update README with correct benchmark images

52b1c53
verified

Update README with training data table

5598f72
verified

Fix README - correct thinking block format

b391ebd
verified

Add limitations, detailed model info, and highlights

03a55b9
verified

Update README with training details

438055c
verified

Upload folder using huggingface_hub

71f89e5
verified

initial commit

3f3511c
verified