Not-For-All-Audiences

abliterated

heretic

uncensor

hermes-lineage

Model card Files Files and versions

xet

Community

Instructions to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

Transformers

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT")
model = AutoModelForMultimodalLM.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT

SGLang

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Docker Model Runner:
```
docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT
```

Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT / SHA256SUMS

oktayd

Update README integrity hash

dd0fe4b verified 21 days ago

Raw

History Blame Contribute Delete

3.79 kB

	1857a51f70eb7b787dd3ec5f050b2b013c5170c66c55a8f7278ddf83d94a9330 BENCHMARK-DEVICE-SUMMARY.json
	807d54b88902798393fc104c3ca80d3e424d64270e8d1e1a34a44d4574f52c7e BENCHMARK-DIAGNOSTIC.json
	0e712dd8e4bc65088e170826e98bdc440fb19a2cfdb7613c643e9dabb624ecd8 BENCHMARK-EXTENSION-QWEN38.json
	67d070e3b12bcd185626054c81cdf4d528a9a1af26774050e1d50be370b5ee14 BENCHMARK-PLAN.md
	cfd2a06c82f3f41ceaf8c333fb0ee0e38247d0c9419084c0501d5c2430bb7b68 BENCHMARK-TEST-COUNTS.json
	5c1a6fa0bd2d21e400b4c84001abec8085e3f5d7fbe5d217e7a0af7f32f42c6d DATASETS.md
	2fd4bac1a955f2401dce1eafc30632e20ad212e4cf4ed104bc34141b9013aa1c DEVICE-QUICKSTART.md
	5fa5bdc4687e5ed723af58eb436f545cc62589e5395d5041722639f03bb5ec9b LAPTOP-BENCHMARK-MATRIX.json
	e01f927cff09c8de1e4ae8cecdaecba2d42be702a82ab9fe9fac0c32714f3d4e LAPTOP-CAPABILITY-PLAN.json
	0a1af5184bf972162d48f1dca154028606aa45e8b47d076e2666e6d3745d2f8b LAPTOP-CAPABILITY-PLAN.md
	20a2a90fa761fe5081d31d25989d94656ad7b9766103b4244b71891e714dcc22 LICENSE
	08dbd8582ae6289adc26bec7c3cd83aa5256ec298a63336a854b10ac9f557a45 README.md
	cd2b979e9e94047d3ec45a8fe6c6610765a0045be6a09e4e730e8c501405290c RELEASE-NAMING.json
	b36b05ac4d31eb371f841af813f3b3fdfad5c04375c58214013a94dd929c2ad0 RELEASE-VALIDATION.json
	3836329a27f1f7c4320c8aef72fd617f8ab4440e88e7419ed5cf785408c48cb2 RUNTIME-PATCH-VALIDATION.json
	d431e82d0ab961c261e525fc08fc3e64c0916fbd4d3f52b839b3d2eda0766338 assets/qwen3.6-35b-v2-banner.png
	55d4931433fe502b794226ee7f4d206a6bdd436ac9f80eb7d8ebb4c639f9ea0c chat_template.jinja
	d58c91a59fe17a02099278c8b97d0f04d2acebbf6103dae1898cda23730baf0b config.json
	c14090e46169dfd0b69ad1efc0916ea144547ae3c7e499aa66e4b12092ea5080 generation_config.json
	41d2b50506fcdd2a7dc0ff7a055021f23abe2bb57965da3e281c9e0795aa5587 model-00001-of-00016.safetensors
	4d48740f1c9cdc95cc02eeb051c8795b56a7c04fbb55e1bea4a14662ba07ab1c model-00002-of-00016.safetensors
	64b74183b13f634dfeaba4c131f07b6fe548a85ffe4324ff4ed8a596f31b57d9 model-00003-of-00016.safetensors
	a014b881f5b7e883243ecb7d8eb8321334117816a725ce2389f6b0bedc56225d model-00004-of-00016.safetensors
	824a2b762a92a88543a6188d789b616ca78cd7bcfeccfbfa91d3e79a1cf42678 model-00005-of-00016.safetensors
	9e592d029623ddafb2529e3c1c822b475bb5eb007d630e71956e5c09378727d1 model-00006-of-00016.safetensors
	81d3392b22d5f0eb3c13ef62610636285a228e324ddaa26c9936907c4f7a0bae model-00007-of-00016.safetensors
	810c547161ac480b1cfb5b31b87e4566bf302884ba76af63cb55461b02af217d model-00008-of-00016.safetensors
	4f52ae41acdec8ecb85adf77cb6271b6bcdc5e2231fa61c32930e97d5a277fd2 model-00009-of-00016.safetensors
	d7387d92fed4e1cc870f2d074ca161ad53d3b54d60f355f55c2767ce43ea3ef8 model-00010-of-00016.safetensors
	9f9a4f448cfe365ae1b410a008b1a8508debf0261f72f78c02eb923bc82651d4 model-00011-of-00016.safetensors
	1cdc8b5f614150ab62d74fa3d7a240c66349ac7a26fb20af7d6f3bb2057a4d51 model-00012-of-00016.safetensors
	bdedbb50762ae1e9f040d7d8fee07faec1fa56e1005123ec3e320301ada17cec model-00013-of-00016.safetensors
	23225d0ea44a7894d5bb8654d6e8944a65851fb656cad407c051b86e6fdbee90 model-00014-of-00016.safetensors
	301bf7359901f07482f76541259478553dc9dcc237c06863e74c8429c567fbd0 model-00015-of-00016.safetensors
	0414d33074013180c4e41b2adc2aa6a9a920bce33b3869c94cc26a4b865798d8 model-00016-of-00016.safetensors
	62e6f4b910fd5ff7594e85863fe28cfd0177890c8251655ee9bcbc35a208d78b model-mtp.safetensors
	97cb1e9ae971fd45a9e279d2289f7caadfb869a32f0d6df7cf37d218d1ee0d5e model.safetensors.index.json
	3814737f2d4bfdd153a82364b3850f1be5dbc6f074a55c8d5fbf4d40127c3e87 processor_config.json
	412c2eec68a1259d0ca760fb2388c9ed06fc5fd5a089822ce2c151e236d16006 q36_runtime.py
	87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4 tokenizer.json
	c9c0763c68de8f3c1fa1e837679594ff93f8d22c9229e558d5cac3eb41071064 tokenizer_config.json