Not-For-All-Audiences

abliterated

heretic

uncensor

hermes-lineage

Model card Files Files and versions

xet

Community

Instructions to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

Transformers

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT")
model = AutoModelForMultimodalLM.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT

SGLang

How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Docker Model Runner:
```
docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT
```

Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT / RELEASE-NAMING.json

oktayd

Publish Q36 v2 naming, complete edition guide and honest benchmark scope

a668ea0 verified 19 days ago

Raw

History Blame Contribute Delete

3.68 kB

	{
	"old_repo": "oktayd/Q36-v1.3-35B-A3B-MTP-Vision-BF16",
	"new_repo": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT",
	"old_revision": "61cb76f35c41e8f800e8b4e9fe9e36f4571580ae",
	"release_display_version": "v2",
	"tensor_changes": false,
	"weights_retrained": false,
	"file_renames": {},
	"historical_reports": "Immutable original diagnostic names retained; resolve via this mapping.",
	"weight_hashes": {
	"model-00001-of-00016.safetensors": {
	"size": 4323955448,
	"sha256": "41d2b50506fcdd2a7dc0ff7a055021f23abe2bb57965da3e281c9e0795aa5587",
	"pointer_size": 135
	},
	"model-00002-of-00016.safetensors": {
	"size": 4506431768,
	"sha256": "4d48740f1c9cdc95cc02eeb051c8795b56a7c04fbb55e1bea4a14662ba07ab1c",
	"pointer_size": 135
	},
	"model-00003-of-00016.safetensors": {
	"size": 4988775056,
	"sha256": "64b74183b13f634dfeaba4c131f07b6fe548a85ffe4324ff4ed8a596f31b57d9",
	"pointer_size": 135
	},
	"model-00004-of-00016.safetensors": {
	"size": 3962207584,
	"sha256": "a014b881f5b7e883243ecb7d8eb8321334117816a725ce2389f6b0bedc56225d",
	"pointer_size": 135
	},
	"model-00005-of-00016.safetensors": {
	"size": 4506431736,
	"sha256": "824a2b762a92a88543a6188d789b616ca78cd7bcfeccfbfa91d3e79a1cf42678",
	"pointer_size": 135
	},
	"model-00006-of-00016.safetensors": {
	"size": 4988775104,
	"sha256": "9e592d029623ddafb2529e3c1c822b475bb5eb007d630e71956e5c09378727d1",
	"pointer_size": 135
	},
	"model-00007-of-00016.safetensors": {
	"size": 3962207632,
	"sha256": "81d3392b22d5f0eb3c13ef62610636285a228e324ddaa26c9936907c4f7a0bae",
	"pointer_size": 135
	},
	"model-00008-of-00016.safetensors": {
	"size": 4506431816,
	"sha256": "810c547161ac480b1cfb5b31b87e4566bf302884ba76af63cb55461b02af217d",
	"pointer_size": 135
	},
	"model-00009-of-00016.safetensors": {
	"size": 4988775104,
	"sha256": "4f52ae41acdec8ecb85adf77cb6271b6bcdc5e2231fa61c32930e97d5a277fd2",
	"pointer_size": 135
	},
	"model-00010-of-00016.safetensors": {
	"size": 3962207632,
	"sha256": "d7387d92fed4e1cc870f2d074ca161ad53d3b54d60f355f55c2767ce43ea3ef8",
	"pointer_size": 135
	},
	"model-00011-of-00016.safetensors": {
	"size": 4506431816,
	"sha256": "9f9a4f448cfe365ae1b410a008b1a8508debf0261f72f78c02eb923bc82651d4",
	"pointer_size": 135
	},
	"model-00012-of-00016.safetensors": {
	"size": 4988775104,
	"sha256": "1cdc8b5f614150ab62d74fa3d7a240c66349ac7a26fb20af7d6f3bb2057a4d51",
	"pointer_size": 135
	},
	"model-00013-of-00016.safetensors": {
	"size": 3962207632,
	"sha256": "bdedbb50762ae1e9f040d7d8fee07faec1fa56e1005123ec3e320301ada17cec",
	"pointer_size": 135
	},
	"model-00014-of-00016.safetensors": {
	"size": 4506431816,
	"sha256": "23225d0ea44a7894d5bb8654d6e8944a65851fb656cad407c051b86e6fdbee90",
	"pointer_size": 135
	},
	"model-00015-of-00016.safetensors": {
	"size": 4988775104,
	"sha256": "301bf7359901f07482f76541259478553dc9dcc237c06863e74c8429c567fbd0",
	"pointer_size": 135
	},
	"model-00016-of-00016.safetensors": {
	"size": 2565674304,
	"sha256": "0414d33074013180c4e41b2adc2aa6a9a920bce33b3869c94cc26a4b865798d8",
	"pointer_size": 135
	},
	"model-mtp.safetensors": {
	"size": 1689283688,
	"sha256": "62e6f4b910fd5ff7594e85863fe28cfd0177890c8251655ee9bcbc35a208d78b",
	"pointer_size": 135
	}
	}
	}