Not-For-All-Audiences

abliterated

heretic

uncensor

hermes-lineage

Model card Files Files and versions

xet

Community

Instructions to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

Transformers

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT")
model = AutoModelForMultimodalLM.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT

SGLang

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Docker Model Runner:
```
docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT
```

Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT

File size: 3,788 Bytes

a668ea0
61cb76f
a668ea0
 
9c72efb
6fee4ad
b54a798
a668ea0
68be41c
 
96ab051
dd0fe4b
a668ea0
96ab051
502351d
6fee4ad
96ab051
 
502351d
96ab051
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
502351d
96ab051

1857a51f70eb7b787dd3ec5f050b2b013c5170c66c55a8f7278ddf83d94a9330  BENCHMARK-DEVICE-SUMMARY.json
807d54b88902798393fc104c3ca80d3e424d64270e8d1e1a34a44d4574f52c7e  BENCHMARK-DIAGNOSTIC.json
0e712dd8e4bc65088e170826e98bdc440fb19a2cfdb7613c643e9dabb624ecd8  BENCHMARK-EXTENSION-QWEN38.json
67d070e3b12bcd185626054c81cdf4d528a9a1af26774050e1d50be370b5ee14  BENCHMARK-PLAN.md
cfd2a06c82f3f41ceaf8c333fb0ee0e38247d0c9419084c0501d5c2430bb7b68  BENCHMARK-TEST-COUNTS.json
5c1a6fa0bd2d21e400b4c84001abec8085e3f5d7fbe5d217e7a0af7f32f42c6d  DATASETS.md
2fd4bac1a955f2401dce1eafc30632e20ad212e4cf4ed104bc34141b9013aa1c  DEVICE-QUICKSTART.md
5fa5bdc4687e5ed723af58eb436f545cc62589e5395d5041722639f03bb5ec9b  LAPTOP-BENCHMARK-MATRIX.json
e01f927cff09c8de1e4ae8cecdaecba2d42be702a82ab9fe9fac0c32714f3d4e  LAPTOP-CAPABILITY-PLAN.json
0a1af5184bf972162d48f1dca154028606aa45e8b47d076e2666e6d3745d2f8b  LAPTOP-CAPABILITY-PLAN.md
20a2a90fa761fe5081d31d25989d94656ad7b9766103b4244b71891e714dcc22  LICENSE
08dbd8582ae6289adc26bec7c3cd83aa5256ec298a63336a854b10ac9f557a45  README.md
cd2b979e9e94047d3ec45a8fe6c6610765a0045be6a09e4e730e8c501405290c  RELEASE-NAMING.json
b36b05ac4d31eb371f841af813f3b3fdfad5c04375c58214013a94dd929c2ad0  RELEASE-VALIDATION.json
3836329a27f1f7c4320c8aef72fd617f8ab4440e88e7419ed5cf785408c48cb2  RUNTIME-PATCH-VALIDATION.json
d431e82d0ab961c261e525fc08fc3e64c0916fbd4d3f52b839b3d2eda0766338  assets/qwen3.6-35b-v2-banner.png
55d4931433fe502b794226ee7f4d206a6bdd436ac9f80eb7d8ebb4c639f9ea0c  chat_template.jinja
d58c91a59fe17a02099278c8b97d0f04d2acebbf6103dae1898cda23730baf0b  config.json
c14090e46169dfd0b69ad1efc0916ea144547ae3c7e499aa66e4b12092ea5080  generation_config.json
41d2b50506fcdd2a7dc0ff7a055021f23abe2bb57965da3e281c9e0795aa5587  model-00001-of-00016.safetensors
4d48740f1c9cdc95cc02eeb051c8795b56a7c04fbb55e1bea4a14662ba07ab1c  model-00002-of-00016.safetensors
64b74183b13f634dfeaba4c131f07b6fe548a85ffe4324ff4ed8a596f31b57d9  model-00003-of-00016.safetensors
a014b881f5b7e883243ecb7d8eb8321334117816a725ce2389f6b0bedc56225d  model-00004-of-00016.safetensors
824a2b762a92a88543a6188d789b616ca78cd7bcfeccfbfa91d3e79a1cf42678  model-00005-of-00016.safetensors
9e592d029623ddafb2529e3c1c822b475bb5eb007d630e71956e5c09378727d1  model-00006-of-00016.safetensors
81d3392b22d5f0eb3c13ef62610636285a228e324ddaa26c9936907c4f7a0bae  model-00007-of-00016.safetensors
810c547161ac480b1cfb5b31b87e4566bf302884ba76af63cb55461b02af217d  model-00008-of-00016.safetensors
4f52ae41acdec8ecb85adf77cb6271b6bcdc5e2231fa61c32930e97d5a277fd2  model-00009-of-00016.safetensors
d7387d92fed4e1cc870f2d074ca161ad53d3b54d60f355f55c2767ce43ea3ef8  model-00010-of-00016.safetensors
9f9a4f448cfe365ae1b410a008b1a8508debf0261f72f78c02eb923bc82651d4  model-00011-of-00016.safetensors
1cdc8b5f614150ab62d74fa3d7a240c66349ac7a26fb20af7d6f3bb2057a4d51  model-00012-of-00016.safetensors
bdedbb50762ae1e9f040d7d8fee07faec1fa56e1005123ec3e320301ada17cec  model-00013-of-00016.safetensors
23225d0ea44a7894d5bb8654d6e8944a65851fb656cad407c051b86e6fdbee90  model-00014-of-00016.safetensors
301bf7359901f07482f76541259478553dc9dcc237c06863e74c8429c567fbd0  model-00015-of-00016.safetensors
0414d33074013180c4e41b2adc2aa6a9a920bce33b3869c94cc26a4b865798d8  model-00016-of-00016.safetensors
62e6f4b910fd5ff7594e85863fe28cfd0177890c8251655ee9bcbc35a208d78b  model-mtp.safetensors
97cb1e9ae971fd45a9e279d2289f7caadfb869a32f0d6df7cf37d218d1ee0d5e  model.safetensors.index.json
3814737f2d4bfdd153a82364b3850f1be5dbc6f074a55c8d5fbf4d40127c3e87  processor_config.json
412c2eec68a1259d0ca760fb2388c9ed06fc5fd5a089822ce2c151e236d16006  q36_runtime.py
87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4  tokenizer.json
c9c0763c68de8f3c1fa1e837679594ff93f8d22c9229e558d5cac3eb41071064  tokenizer_config.json