Image-Text-to-Text
Transformers
Safetensors
qwen3_5_moe
vision
Mixture of Experts
conversational
Not-For-All-Audiences
abliterated
heretic
uncensor
hermes-lineage
mtp
coding
tool-calling
reasoning
roleplay
bf16
Instructions to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT") model = AutoModelForMultimodalLM.from_pretrained("oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT
- SGLang
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT with Docker Model Runner:
docker model run hf.co/oktayd/Qwen3.6-35B-v2-MoE-Ablit-Heretic-Uncensor-Hermes-MTP-Vision-FT
| 1857a51f70eb7b787dd3ec5f050b2b013c5170c66c55a8f7278ddf83d94a9330 BENCHMARK-DEVICE-SUMMARY.json | |
| 807d54b88902798393fc104c3ca80d3e424d64270e8d1e1a34a44d4574f52c7e BENCHMARK-DIAGNOSTIC.json | |
| 0e712dd8e4bc65088e170826e98bdc440fb19a2cfdb7613c643e9dabb624ecd8 BENCHMARK-EXTENSION-QWEN38.json | |
| 67d070e3b12bcd185626054c81cdf4d528a9a1af26774050e1d50be370b5ee14 BENCHMARK-PLAN.md | |
| cfd2a06c82f3f41ceaf8c333fb0ee0e38247d0c9419084c0501d5c2430bb7b68 BENCHMARK-TEST-COUNTS.json | |
| 5c1a6fa0bd2d21e400b4c84001abec8085e3f5d7fbe5d217e7a0af7f32f42c6d DATASETS.md | |
| 2fd4bac1a955f2401dce1eafc30632e20ad212e4cf4ed104bc34141b9013aa1c DEVICE-QUICKSTART.md | |
| 5fa5bdc4687e5ed723af58eb436f545cc62589e5395d5041722639f03bb5ec9b LAPTOP-BENCHMARK-MATRIX.json | |
| e01f927cff09c8de1e4ae8cecdaecba2d42be702a82ab9fe9fac0c32714f3d4e LAPTOP-CAPABILITY-PLAN.json | |
| 0a1af5184bf972162d48f1dca154028606aa45e8b47d076e2666e6d3745d2f8b LAPTOP-CAPABILITY-PLAN.md | |
| 20a2a90fa761fe5081d31d25989d94656ad7b9766103b4244b71891e714dcc22 LICENSE | |
| 08dbd8582ae6289adc26bec7c3cd83aa5256ec298a63336a854b10ac9f557a45 README.md | |
| cd2b979e9e94047d3ec45a8fe6c6610765a0045be6a09e4e730e8c501405290c RELEASE-NAMING.json | |
| b36b05ac4d31eb371f841af813f3b3fdfad5c04375c58214013a94dd929c2ad0 RELEASE-VALIDATION.json | |
| 3836329a27f1f7c4320c8aef72fd617f8ab4440e88e7419ed5cf785408c48cb2 RUNTIME-PATCH-VALIDATION.json | |
| d431e82d0ab961c261e525fc08fc3e64c0916fbd4d3f52b839b3d2eda0766338 assets/qwen3.6-35b-v2-banner.png | |
| 55d4931433fe502b794226ee7f4d206a6bdd436ac9f80eb7d8ebb4c639f9ea0c chat_template.jinja | |
| d58c91a59fe17a02099278c8b97d0f04d2acebbf6103dae1898cda23730baf0b config.json | |
| c14090e46169dfd0b69ad1efc0916ea144547ae3c7e499aa66e4b12092ea5080 generation_config.json | |
| 41d2b50506fcdd2a7dc0ff7a055021f23abe2bb57965da3e281c9e0795aa5587 model-00001-of-00016.safetensors | |
| 4d48740f1c9cdc95cc02eeb051c8795b56a7c04fbb55e1bea4a14662ba07ab1c model-00002-of-00016.safetensors | |
| 64b74183b13f634dfeaba4c131f07b6fe548a85ffe4324ff4ed8a596f31b57d9 model-00003-of-00016.safetensors | |
| a014b881f5b7e883243ecb7d8eb8321334117816a725ce2389f6b0bedc56225d model-00004-of-00016.safetensors | |
| 824a2b762a92a88543a6188d789b616ca78cd7bcfeccfbfa91d3e79a1cf42678 model-00005-of-00016.safetensors | |
| 9e592d029623ddafb2529e3c1c822b475bb5eb007d630e71956e5c09378727d1 model-00006-of-00016.safetensors | |
| 81d3392b22d5f0eb3c13ef62610636285a228e324ddaa26c9936907c4f7a0bae model-00007-of-00016.safetensors | |
| 810c547161ac480b1cfb5b31b87e4566bf302884ba76af63cb55461b02af217d model-00008-of-00016.safetensors | |
| 4f52ae41acdec8ecb85adf77cb6271b6bcdc5e2231fa61c32930e97d5a277fd2 model-00009-of-00016.safetensors | |
| d7387d92fed4e1cc870f2d074ca161ad53d3b54d60f355f55c2767ce43ea3ef8 model-00010-of-00016.safetensors | |
| 9f9a4f448cfe365ae1b410a008b1a8508debf0261f72f78c02eb923bc82651d4 model-00011-of-00016.safetensors | |
| 1cdc8b5f614150ab62d74fa3d7a240c66349ac7a26fb20af7d6f3bb2057a4d51 model-00012-of-00016.safetensors | |
| bdedbb50762ae1e9f040d7d8fee07faec1fa56e1005123ec3e320301ada17cec model-00013-of-00016.safetensors | |
| 23225d0ea44a7894d5bb8654d6e8944a65851fb656cad407c051b86e6fdbee90 model-00014-of-00016.safetensors | |
| 301bf7359901f07482f76541259478553dc9dcc237c06863e74c8429c567fbd0 model-00015-of-00016.safetensors | |
| 0414d33074013180c4e41b2adc2aa6a9a920bce33b3869c94cc26a4b865798d8 model-00016-of-00016.safetensors | |
| 62e6f4b910fd5ff7594e85863fe28cfd0177890c8251655ee9bcbc35a208d78b model-mtp.safetensors | |
| 97cb1e9ae971fd45a9e279d2289f7caadfb869a32f0d6df7cf37d218d1ee0d5e model.safetensors.index.json | |
| 3814737f2d4bfdd153a82364b3850f1be5dbc6f074a55c8d5fbf4d40127c3e87 processor_config.json | |
| 412c2eec68a1259d0ca760fb2388c9ed06fc5fd5a089822ce2c151e236d16006 q36_runtime.py | |
| 87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4 tokenizer.json | |
| c9c0763c68de8f3c1fa1e837679594ff93f8d22c9229e558d5cac3eb41071064 tokenizer_config.json | |