Upload NVFP4 (ModelOpt) quantization

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,59 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: Qwen/Qwen3.8-27B
+base_model_relation: quantized
+pipeline_tag: text-generation
+tags:
+- modelopt
+- nvfp4
+- fp4
+---
+
+# qwen3.8-27b-nvfp4-modelopt
+
+NVFP4 quantization of [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B) via NVIDIA ModelOpt.
+
+<!-- BEGIN quant:preview -->
+
+## Quantization details (auto-generated)
+
+- **source model:** [Qwen/Qwen3.8-27B](https://huggingface.co/Qwen/Qwen3.8-27B)
+- **qformat:** `nvfp4`  **kv_cache:** `fp8`
+- **calibration:** `?` samples from `?`
+- **producer:** NVIDIA ModelOpt `?`
+- **generated:** ?
+
+_Before/after sample generation was skipped for this run (`SKIP_GENERATE=1`)._
+
+<!-- END quant:preview -->
+
+<!-- BEGIN quant:remarks -->
+
+## Notes
+
+### Validation status -- structurally verified and smoke-tested coherent
+
+Quantized and served on a single DGX Spark (GB10/sm121) on 2026-08-15. The export passed every structural check: the vision tower is BF16 (333 tensors, zero scale tensors, dtypes and shapes identical to the source), `quant_algo` is `NVFP4` rather than `MIXED_PRECISION`, the FP8 KV scales sit on exactly the 16 full-attention layers (indices 3, 7, ..., 63), `in_proj_qkv` is NVFP4-packed on all 48 Gated-DeltaNet layers while `conv1d`/`in_proj_a`/`in_proj_b` stayed BF16, and all 15 `mtp.*` tensors are present and unquantized. Serving on SGLang 0.5.17 then produced coherent output on all four probe types (German two-sentence explanation, a multi-step train word problem, a five-sentence historical paragraph, a translation), each finishing with `finish_reason=stop`. The word problem was solved correctly (17:00, with the right derivation), which is the more informative signal: a broken Gated-DeltaNet path degrades into word salad rather than into arithmetic mistakes. This is a four-prompt smoke test, not an evaluation -- GSM8K or a comparable suite is still owed before any quality claim.
+
+### Uniform W4A4 on a Gated-DeltaNet hybrid
+
+Unlike NVIDIA's Qwen3.5/3.6 NVFP4 releases, which quantize the FFN/expert path and leave attention in BF16, this build quantizes attention as well, including the Gated-DeltaNet linear-attention path that carries 48 of the model's 64 layers. That is the deliberate point of the profile and it is also where the risk sits: an inadequately loaded scale on the fused `linear_attn.in_proj_qkv` degrades this architecture into complete word salad rather than into a measurable accuracy drop. Judge the build on generated output, not on the fact that it loads.
+
+### Serving requires the qwen3_5 attention-quant and KV-scale loader changes
+
+Because attention is quantized and FP8 KV scales are baked into the checkpoint, SGLang needs the `qwen3_5` attention-quant override and baked-KV-scale loader changes (sgl-project/sglang PR #31220) plus the NVFP4 scalar-scale fix for merged and fused linears (PR #29151, merged upstream 2026-07-13) that the fused Gated-DeltaNet `in_proj_qkv` depends on. Use the `flashinfer` attention backend: the `triton` backend hits a forward-time crash in `RadixLinearAttention.forward` for this exact configuration (sgl-project/sglang#29577, still open). A reliable check that the KV scales actually loaded is that the server logs "Using FP8 KV cache but no scaling factors provided" zero times.
+
+### Multimodal, vision tower kept BF16
+
+Calibration is text-only, so the 27-layer vision tower, its merger and the embeddings are excluded from quantization and stay BF16, avoiding the amax=0 degenerate-quant failure mode. The language-side FFNs that consume projected image tokens ARE quantized, and they were calibrated on text alone, so the image path is the least-validated surface of this build and should be checked against the BF16 source before being relied on.
+
+### BF16 MTP head, speculative decoding off by default
+
+The NEXTN/MTP draft head (`mtp_num_hidden_layers=1`) ships unquantized: transformers drops `mtp.*` at load for every Qwen3.5 architecture, so ModelOpt never sees it and passes the tensors through as BF16. Speculative decoding is therefore available but is left disabled in the shipped serving profile until bare serving is verified coherent, so that a quality regression can never be confused with a drafter problem.
+
+### Quantize on a single Spark with offload, not force-on-GPU
+
+Quantize with `SEQ_DEVICE_MAP=0` (offload / `device_map=auto`). GPU and CPU share the same ~121 GB unified memory pool on a DGX Spark, so offloading the 55.6 GB source costs nothing here. Do NOT use `SEQ_DEVICE_MAP=1` with a high `GPU_MAX_MEM_PCT` on a single Spark: that reserves most of the shared pool as GPU and OOM-kills weight loading regardless of the percentage. Force-on-GPU is a multi-GPU (4x H200) setting only.
+
+<!-- END quant:remarks -->

chat_template.jinja

@@ -0,0 +1,170 @@
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- macro render_content(content, do_vision_count, is_system_content=false) %}
+    {%- if content is string %}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping %}
+        {%- for item in content %}
+            {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain images.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set image_count.value = image_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Picture ' ~ image_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
+            {%- elif 'video' in item or item.type == 'video' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain videos.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set video_count.value = video_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Video ' ~ video_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
+            {%- elif 'text' in item %}
+                {{- item.text }}
+            {%- else %}
+                {{- raise_exception('Unexpected item type in content.') }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif content is none or content is undefined %}
+        {{- '' }}
+    {%- else %}
+        {{- raise_exception('Unexpected content type.') }}
+    {%- endif %}
+{%- endmacro %}
+{%- if not messages %}
+    {{- raise_exception('No messages provided.') }}
+{%- endif %}
+{%- set reasoning_instructions = '' %}
+{%- if enable_thinking is undefined or enable_thinking is true %}
+    {%- set resolved_reasoning_effort = reasoning_effort|default('xhigh') %}
+    {%- if resolved_reasoning_effort not in ('xhigh', 'medium', 'low') %}
+        {{- raise_exception('Unexpected reasoning effort ' ~ reasoning_effort ~ '. Supported types are xhigh (default), medium, and low.') }}
+    {%- endif %}
+    {%- if resolved_reasoning_effort == 'xhigh' %}
+        {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}
+    {%- elif resolved_reasoning_effort == 'low' %}
+        {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}
+    {%- endif %}
+{%- endif %}
+{%- if tools and tools is iterable and tools is not mapping %}
+    {{- '<|im_start|>system\n' }}
+    {%- if reasoning_instructions %}
+        {{- reasoning_instructions + '\n\n' }}
+    {%- endif %}
+    {{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>" }}
+    {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {%- if content %}
+            {{- '\n\n' + content }}
+        {%- endif %}
+    {%- endif %}
+    {{- '<|im_end|>\n' }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {%- if content %}
+            {{- '<|im_start|>system\n' + (reasoning_instructions + '\n\n' if reasoning_instructions else '')  + content + '<|im_end|>\n' }}
+        {%- elif reasoning_instructions %}
+            {{- '<|im_start|>system\n' + reasoning_instructions + '<|im_end|>\n' }}
+        {%- endif %}
+    {%- elif reasoning_instructions %}
+        {{- '<|im_start|>system\n' + reasoning_instructions + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for message in messages[::-1] %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == "user" %}
+        {%- set content = render_content(message.content, false)|trim %}
+        {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
+            {%- set ns.multi_step_tool = false %}
+            {%- set ns.last_query_index = index %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if ns.multi_step_tool %}
+    {{- raise_exception('No user query found in messages.') }}
+{%- endif %}
+{%- for message in messages %}
+    {%- set content = render_content(message.content, true)|trim %}
+    {%- if message.role == "system" %}
+        {%- if not loop.first %}
+            {{- raise_exception('System message must be at the beginning.') }}
+        {%- endif %}
+    {%- elif message.role == "user" %}
+        {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is string %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- endif %}
+        {%- set reasoning_content = reasoning_content|trim %}
+        {%- if preserve_thinking is undefined or preserve_thinking is true or loop.index0 > ns.last_query_index %}
+            {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if tool_call.function is defined %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {%- if loop.first %}
+                    {%- if content|trim %}
+                        {{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- else %}
+                        {{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- endif %}
+                {%- else %}
+                    {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                {%- endif %}
+                {%- if tool_call.arguments is defined and tool_call.arguments != '' %}
+                    {%- for args_name, args_value in tool_call.arguments|items %}
+                        {{- '<parameter=' + args_name + '>\n' }}
+                        {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}
+                        {{- args_value }}
+                        {{- '\n</parameter>\n' }}
+                    {%- endfor %}
+                {%- endif %}
+                {{- '</function>\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.previtem and loop.previtem.role != "tool" %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- content }}
+        {{- '\n</tool_response>' }}
+        {%- if not loop.last and loop.nextitem.role != "tool" %}
+            {{- '<|im_end|>\n' }}
+        {%- elif loop.last %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- else %}
+        {{- raise_exception('Unexpected message role.') }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- else %}
+        {{- '<think>\n' }}
+    {%- endif %}
+{%- endif %}

config.json

@@ -0,0 +1,473 @@
+{
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "image_token_id": 248056,
+  "language_model_only": false,
+  "model_type": "qwen3_5",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": 248044,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 5120,
+    "initializer_range": 0.02,
+    "intermediate_size": 17408,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 48,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 24,
+    "num_hidden_layers": 64,
+    "num_key_value_heads": 4,
+    "output_gate_type": "swish",
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": false,
+    "use_cache": true,
+    "vocab_size": 248320,
+    "torch_dtype": "bfloat16"
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "5.12.1",
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 27,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1152,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4304,
+    "model_type": "qwen3_5_vision",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 5120,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_start_token_id": 248053,
+  "quantization_config": {
+    "config_groups": {
+      "group_0": {
+        "input_activations": {
+          "dynamic": false,
+          "num_bits": 4,
+          "type": "float",
+          "group_size": 16
+        },
+        "weights": {
+          "dynamic": false,
+          "num_bits": 4,
+          "type": "float",
+          "group_size": 16
+        },
+        "targets": [
+          "Linear"
+        ]
+      }
+    },
+    "ignore": [
+      "lm_head",
+      "model.language_model.embed_tokens",
+      "model.language_model.layers.0.linear_attn.conv1d",
+      "model.language_model.layers.0.linear_attn.in_proj_a",
+      "model.language_model.layers.0.linear_attn.in_proj_b",
+      "model.language_model.layers.1.linear_attn.conv1d",
+      "model.language_model.layers.1.linear_attn.in_proj_a",
+      "model.language_model.layers.1.linear_attn.in_proj_b",
+      "model.language_model.layers.10.linear_attn.conv1d",
+      "model.language_model.layers.10.linear_attn.in_proj_a",
+      "model.language_model.layers.10.linear_attn.in_proj_b",
+      "model.language_model.layers.12.linear_attn.conv1d",
+      "model.language_model.layers.12.linear_attn.in_proj_a",
+      "model.language_model.layers.12.linear_attn.in_proj_b",
+      "model.language_model.layers.13.linear_attn.conv1d",
+      "model.language_model.layers.13.linear_attn.in_proj_a",
+      "model.language_model.layers.13.linear_attn.in_proj_b",
+      "model.language_model.layers.14.linear_attn.conv1d",
+      "model.language_model.layers.14.linear_attn.in_proj_a",
+      "model.language_model.layers.14.linear_attn.in_proj_b",
+      "model.language_model.layers.16.linear_attn.conv1d",
+      "model.language_model.layers.16.linear_attn.in_proj_a",
+      "model.language_model.layers.16.linear_attn.in_proj_b",
+      "model.language_model.layers.17.linear_attn.conv1d",
+      "model.language_model.layers.17.linear_attn.in_proj_a",
+      "model.language_model.layers.17.linear_attn.in_proj_b",
+      "model.language_model.layers.18.linear_attn.conv1d",
+      "model.language_model.layers.18.linear_attn.in_proj_a",
+      "model.language_model.layers.18.linear_attn.in_proj_b",
+      "model.language_model.layers.2.linear_attn.conv1d",
+      "model.language_model.layers.2.linear_attn.in_proj_a",
+      "model.language_model.layers.2.linear_attn.in_proj_b",
+      "model.language_model.layers.20.linear_attn.conv1d",
+      "model.language_model.layers.20.linear_attn.in_proj_a",
+      "model.language_model.layers.20.linear_attn.in_proj_b",
+      "model.language_model.layers.21.linear_attn.conv1d",
+      "model.language_model.layers.21.linear_attn.in_proj_a",
+      "model.language_model.layers.21.linear_attn.in_proj_b",
+      "model.language_model.layers.22.linear_attn.conv1d",
+      "model.language_model.layers.22.linear_attn.in_proj_a",
+      "model.language_model.layers.22.linear_attn.in_proj_b",
+      "model.language_model.layers.24.linear_attn.conv1d",
+      "model.language_model.layers.24.linear_attn.in_proj_a",
+      "model.language_model.layers.24.linear_attn.in_proj_b",
+      "model.language_model.layers.25.linear_attn.conv1d",
+      "model.language_model.layers.25.linear_attn.in_proj_a",
+      "model.language_model.layers.25.linear_attn.in_proj_b",
+      "model.language_model.layers.26.linear_attn.conv1d",
+      "model.language_model.layers.26.linear_attn.in_proj_a",
+      "model.language_model.layers.26.linear_attn.in_proj_b",
+      "model.language_model.layers.28.linear_attn.conv1d",
+      "model.language_model.layers.28.linear_attn.in_proj_a",
+      "model.language_model.layers.28.linear_attn.in_proj_b",
+      "model.language_model.layers.29.linear_attn.conv1d",
+      "model.language_model.layers.29.linear_attn.in_proj_a",
+      "model.language_model.layers.29.linear_attn.in_proj_b",
+      "model.language_model.layers.30.linear_attn.conv1d",
+      "model.language_model.layers.30.linear_attn.in_proj_a",
+      "model.language_model.layers.30.linear_attn.in_proj_b",
+      "model.language_model.layers.32.linear_attn.conv1d",
+      "model.language_model.layers.32.linear_attn.in_proj_a",
+      "model.language_model.layers.32.linear_attn.in_proj_b",
+      "model.language_model.layers.33.linear_attn.conv1d",
+      "model.language_model.layers.33.linear_attn.in_proj_a",
+      "model.language_model.layers.33.linear_attn.in_proj_b",
+      "model.language_model.layers.34.linear_attn.conv1d",
+      "model.language_model.layers.34.linear_attn.in_proj_a",
+      "model.language_model.layers.34.linear_attn.in_proj_b",
+      "model.language_model.layers.36.linear_attn.conv1d",
+      "model.language_model.layers.36.linear_attn.in_proj_a",
+      "model.language_model.layers.36.linear_attn.in_proj_b",
+      "model.language_model.layers.37.linear_attn.conv1d",
+      "model.language_model.layers.37.linear_attn.in_proj_a",
+      "model.language_model.layers.37.linear_attn.in_proj_b",
+      "model.language_model.layers.38.linear_attn.conv1d",
+      "model.language_model.layers.38.linear_attn.in_proj_a",
+      "model.language_model.layers.38.linear_attn.in_proj_b",
+      "model.language_model.layers.4.linear_attn.conv1d",
+      "model.language_model.layers.4.linear_attn.in_proj_a",
+      "model.language_model.layers.4.linear_attn.in_proj_b",
+      "model.language_model.layers.40.linear_attn.conv1d",
+      "model.language_model.layers.40.linear_attn.in_proj_a",
+      "model.language_model.layers.40.linear_attn.in_proj_b",
+      "model.language_model.layers.41.linear_attn.conv1d",
+      "model.language_model.layers.41.linear_attn.in_proj_a",
+      "model.language_model.layers.41.linear_attn.in_proj_b",
+      "model.language_model.layers.42.linear_attn.conv1d",
+      "model.language_model.layers.42.linear_attn.in_proj_a",
+      "model.language_model.layers.42.linear_attn.in_proj_b",
+      "model.language_model.layers.44.linear_attn.conv1d",
+      "model.language_model.layers.44.linear_attn.in_proj_a",
+      "model.language_model.layers.44.linear_attn.in_proj_b",
+      "model.language_model.layers.45.linear_attn.conv1d",
+      "model.language_model.layers.45.linear_attn.in_proj_a",
+      "model.language_model.layers.45.linear_attn.in_proj_b",
+      "model.language_model.layers.46.linear_attn.conv1d",
+      "model.language_model.layers.46.linear_attn.in_proj_a",
+      "model.language_model.layers.46.linear_attn.in_proj_b",
+      "model.language_model.layers.48.linear_attn.conv1d",
+      "model.language_model.layers.48.linear_attn.in_proj_a",
+      "model.language_model.layers.48.linear_attn.in_proj_b",
+      "model.language_model.layers.49.linear_attn.conv1d",
+      "model.language_model.layers.49.linear_attn.in_proj_a",
+      "model.language_model.layers.49.linear_attn.in_proj_b",
+      "model.language_model.layers.5.linear_attn.conv1d",
+      "model.language_model.layers.5.linear_attn.in_proj_a",
+      "model.language_model.layers.5.linear_attn.in_proj_b",
+      "model.language_model.layers.50.linear_attn.conv1d",
+      "model.language_model.layers.50.linear_attn.in_proj_a",
+      "model.language_model.layers.50.linear_attn.in_proj_b",
+      "model.language_model.layers.52.linear_attn.conv1d",
+      "model.language_model.layers.52.linear_attn.in_proj_a",
+      "model.language_model.layers.52.linear_attn.in_proj_b",
+      "model.language_model.layers.53.linear_attn.conv1d",
+      "model.language_model.layers.53.linear_attn.in_proj_a",
+      "model.language_model.layers.53.linear_attn.in_proj_b",
+      "model.language_model.layers.54.linear_attn.conv1d",
+      "model.language_model.layers.54.linear_attn.in_proj_a",
+      "model.language_model.layers.54.linear_attn.in_proj_b",
+      "model.language_model.layers.56.linear_attn.conv1d",
+      "model.language_model.layers.56.linear_attn.in_proj_a",
+      "model.language_model.layers.56.linear_attn.in_proj_b",
+      "model.language_model.layers.57.linear_attn.conv1d",
+      "model.language_model.layers.57.linear_attn.in_proj_a",
+      "model.language_model.layers.57.linear_attn.in_proj_b",
+      "model.language_model.layers.58.linear_attn.conv1d",
+      "model.language_model.layers.58.linear_attn.in_proj_a",
+      "model.language_model.layers.58.linear_attn.in_proj_b",
+      "model.language_model.layers.6.linear_attn.conv1d",
+      "model.language_model.layers.6.linear_attn.in_proj_a",
+      "model.language_model.layers.6.linear_attn.in_proj_b",
+      "model.language_model.layers.60.linear_attn.conv1d",
+      "model.language_model.layers.60.linear_attn.in_proj_a",
+      "model.language_model.layers.60.linear_attn.in_proj_b",
+      "model.language_model.layers.61.linear_attn.conv1d",
+      "model.language_model.layers.61.linear_attn.in_proj_a",
+      "model.language_model.layers.61.linear_attn.in_proj_b",
+      "model.language_model.layers.62.linear_attn.conv1d",
+      "model.language_model.layers.62.linear_attn.in_proj_a",
+      "model.language_model.layers.62.linear_attn.in_proj_b",
+      "model.language_model.layers.8.linear_attn.conv1d",
+      "model.language_model.layers.8.linear_attn.in_proj_a",
+      "model.language_model.layers.8.linear_attn.in_proj_b",
+      "model.language_model.layers.9.linear_attn.conv1d",
+      "model.language_model.layers.9.linear_attn.in_proj_a",
+      "model.language_model.layers.9.linear_attn.in_proj_b",
+      "model.visual*",
+      "mtp*",
+      "mtp.layers.0*",
+      "*embed_tokens",
+      "*layers.0.linear_attn.conv1d",
+      "*layers.0.linear_attn.in_proj_a",
+      "*layers.0.linear_attn.in_proj_b",
+      "*layers.1.linear_attn.conv1d",
+      "*layers.1.linear_attn.in_proj_a",
+      "*layers.1.linear_attn.in_proj_b",
+      "*layers.10.linear_attn.conv1d",
+      "*layers.10.linear_attn.in_proj_a",
+      "*layers.10.linear_attn.in_proj_b",
+      "*layers.12.linear_attn.conv1d",
+      "*layers.12.linear_attn.in_proj_a",
+      "*layers.12.linear_attn.in_proj_b",
+      "*layers.13.linear_attn.conv1d",
+      "*layers.13.linear_attn.in_proj_a",
+      "*layers.13.linear_attn.in_proj_b",
+      "*layers.14.linear_attn.conv1d",
+      "*layers.14.linear_attn.in_proj_a",
+      "*layers.14.linear_attn.in_proj_b",
+      "*layers.16.linear_attn.conv1d",
+      "*layers.16.linear_attn.in_proj_a",
+      "*layers.16.linear_attn.in_proj_b",
+      "*layers.17.linear_attn.conv1d",
+      "*layers.17.linear_attn.in_proj_a",
+      "*layers.17.linear_attn.in_proj_b",
+      "*layers.18.linear_attn.conv1d",
+      "*layers.18.linear_attn.in_proj_a",
+      "*layers.18.linear_attn.in_proj_b",
+      "*layers.2.linear_attn.conv1d",
+      "*layers.2.linear_attn.in_proj_a",
+      "*layers.2.linear_attn.in_proj_b",
+      "*layers.20.linear_attn.conv1d",
+      "*layers.20.linear_attn.in_proj_a",
+      "*layers.20.linear_attn.in_proj_b",
+      "*layers.21.linear_attn.conv1d",
+      "*layers.21.linear_attn.in_proj_a",
+      "*layers.21.linear_attn.in_proj_b",
+      "*layers.22.linear_attn.conv1d",
+      "*layers.22.linear_attn.in_proj_a",
+      "*layers.22.linear_attn.in_proj_b",
+      "*layers.24.linear_attn.conv1d",
+      "*layers.24.linear_attn.in_proj_a",
+      "*layers.24.linear_attn.in_proj_b",
+      "*layers.25.linear_attn.conv1d",
+      "*layers.25.linear_attn.in_proj_a",
+      "*layers.25.linear_attn.in_proj_b",
+      "*layers.26.linear_attn.conv1d",
+      "*layers.26.linear_attn.in_proj_a",
+      "*layers.26.linear_attn.in_proj_b",
+      "*layers.28.linear_attn.conv1d",
+      "*layers.28.linear_attn.in_proj_a",
+      "*layers.28.linear_attn.in_proj_b",
+      "*layers.29.linear_attn.conv1d",
+      "*layers.29.linear_attn.in_proj_a",
+      "*layers.29.linear_attn.in_proj_b",
+      "*layers.30.linear_attn.conv1d",
+      "*layers.30.linear_attn.in_proj_a",
+      "*layers.30.linear_attn.in_proj_b",
+      "*layers.32.linear_attn.conv1d",
+      "*layers.32.linear_attn.in_proj_a",
+      "*layers.32.linear_attn.in_proj_b",
+      "*layers.33.linear_attn.conv1d",
+      "*layers.33.linear_attn.in_proj_a",
+      "*layers.33.linear_attn.in_proj_b",
+      "*layers.34.linear_attn.conv1d",
+      "*layers.34.linear_attn.in_proj_a",
+      "*layers.34.linear_attn.in_proj_b",
+      "*layers.36.linear_attn.conv1d",
+      "*layers.36.linear_attn.in_proj_a",
+      "*layers.36.linear_attn.in_proj_b",
+      "*layers.37.linear_attn.conv1d",
+      "*layers.37.linear_attn.in_proj_a",
+      "*layers.37.linear_attn.in_proj_b",
+      "*layers.38.linear_attn.conv1d",
+      "*layers.38.linear_attn.in_proj_a",
+      "*layers.38.linear_attn.in_proj_b",
+      "*layers.4.linear_attn.conv1d",
+      "*layers.4.linear_attn.in_proj_a",
+      "*layers.4.linear_attn.in_proj_b",
+      "*layers.40.linear_attn.conv1d",
+      "*layers.40.linear_attn.in_proj_a",
+      "*layers.40.linear_attn.in_proj_b",
+      "*layers.41.linear_attn.conv1d",
+      "*layers.41.linear_attn.in_proj_a",
+      "*layers.41.linear_attn.in_proj_b",
+      "*layers.42.linear_attn.conv1d",
+      "*layers.42.linear_attn.in_proj_a",
+      "*layers.42.linear_attn.in_proj_b",
+      "*layers.44.linear_attn.conv1d",
+      "*layers.44.linear_attn.in_proj_a",
+      "*layers.44.linear_attn.in_proj_b",
+      "*layers.45.linear_attn.conv1d",
+      "*layers.45.linear_attn.in_proj_a",
+      "*layers.45.linear_attn.in_proj_b",
+      "*layers.46.linear_attn.conv1d",
+      "*layers.46.linear_attn.in_proj_a",
+      "*layers.46.linear_attn.in_proj_b",
+      "*layers.48.linear_attn.conv1d",
+      "*layers.48.linear_attn.in_proj_a",
+      "*layers.48.linear_attn.in_proj_b",
+      "*layers.49.linear_attn.conv1d",
+      "*layers.49.linear_attn.in_proj_a",
+      "*layers.49.linear_attn.in_proj_b",
+      "*layers.5.linear_attn.conv1d",
+      "*layers.5.linear_attn.in_proj_a",
+      "*layers.5.linear_attn.in_proj_b",
+      "*layers.50.linear_attn.conv1d",
+      "*layers.50.linear_attn.in_proj_a",
+      "*layers.50.linear_attn.in_proj_b",
+      "*layers.52.linear_attn.conv1d",
+      "*layers.52.linear_attn.in_proj_a",
+      "*layers.52.linear_attn.in_proj_b",
+      "*layers.53.linear_attn.conv1d",
+      "*layers.53.linear_attn.in_proj_a",
+      "*layers.53.linear_attn.in_proj_b",
+      "*layers.54.linear_attn.conv1d",
+      "*layers.54.linear_attn.in_proj_a",
+      "*layers.54.linear_attn.in_proj_b",
+      "*layers.56.linear_attn.conv1d",
+      "*layers.56.linear_attn.in_proj_a",
+      "*layers.56.linear_attn.in_proj_b",
+      "*layers.57.linear_attn.conv1d",
+      "*layers.57.linear_attn.in_proj_a",
+      "*layers.57.linear_attn.in_proj_b",
+      "*layers.58.linear_attn.conv1d",
+      "*layers.58.linear_attn.in_proj_a",
+      "*layers.58.linear_attn.in_proj_b",
+      "*layers.6.linear_attn.conv1d",
+      "*layers.6.linear_attn.in_proj_a",
+      "*layers.6.linear_attn.in_proj_b",
+      "*layers.60.linear_attn.conv1d",
+      "*layers.60.linear_attn.in_proj_a",
+      "*layers.60.linear_attn.in_proj_b",
+      "*layers.61.linear_attn.conv1d",
+      "*layers.61.linear_attn.in_proj_a",
+      "*layers.61.linear_attn.in_proj_b",
+      "*layers.62.linear_attn.conv1d",
+      "*layers.62.linear_attn.in_proj_a",
+      "*layers.62.linear_attn.in_proj_b",
+      "*layers.8.linear_attn.conv1d",
+      "*layers.8.linear_attn.in_proj_a",
+      "*layers.8.linear_attn.in_proj_b",
+      "*layers.9.linear_attn.conv1d",
+      "*layers.9.linear_attn.in_proj_a",
+      "*layers.9.linear_attn.in_proj_b",
+      "*visual*"
+    ],
+    "quant_algo": "NVFP4",
+    "kv_cache_scheme": {
+      "dynamic": false,
+      "num_bits": 8,
+      "type": "float"
+    },
+    "producer": {
+      "name": "modelopt",
+      "version": "0.45.0"
+    },
+    "quant_method": "modelopt"
+  },
+  "torch_dtype": "bfloat16"
+}

generation_config.json

@@ -0,0 +1,12 @@
+{
+    "bos_token_id": 248044,
+    "do_sample": true,
+    "eos_token_id": [
+        248046,
+        248044
+    ],
+    "pad_token_id": 248044,
+    "temperature": 1.0,
+    "top_k": 20,
+    "top_p": 0.95
+}

hf_quant_config.json

@@ -0,0 +1,308 @@
+{
+  "producer": {
+    "name": "modelopt",
+    "version": "0.45.0"
+  },
+  "quantization": {
+    "quant_algo": "NVFP4",
+    "kv_cache_quant_algo": "FP8",
+    "group_size": 16,
+    "exclude_modules": [
+      "lm_head",
+      "model.language_model.embed_tokens",
+      "model.language_model.layers.0.linear_attn.conv1d",
+      "model.language_model.layers.0.linear_attn.in_proj_a",
+      "model.language_model.layers.0.linear_attn.in_proj_b",
+      "model.language_model.layers.1.linear_attn.conv1d",
+      "model.language_model.layers.1.linear_attn.in_proj_a",
+      "model.language_model.layers.1.linear_attn.in_proj_b",
+      "model.language_model.layers.10.linear_attn.conv1d",
+      "model.language_model.layers.10.linear_attn.in_proj_a",
+      "model.language_model.layers.10.linear_attn.in_proj_b",
+      "model.language_model.layers.12.linear_attn.conv1d",
+      "model.language_model.layers.12.linear_attn.in_proj_a",
+      "model.language_model.layers.12.linear_attn.in_proj_b",
+      "model.language_model.layers.13.linear_attn.conv1d",
+      "model.language_model.layers.13.linear_attn.in_proj_a",
+      "model.language_model.layers.13.linear_attn.in_proj_b",
+      "model.language_model.layers.14.linear_attn.conv1d",
+      "model.language_model.layers.14.linear_attn.in_proj_a",
+      "model.language_model.layers.14.linear_attn.in_proj_b",
+      "model.language_model.layers.16.linear_attn.conv1d",
+      "model.language_model.layers.16.linear_attn.in_proj_a",
+      "model.language_model.layers.16.linear_attn.in_proj_b",
+      "model.language_model.layers.17.linear_attn.conv1d",
+      "model.language_model.layers.17.linear_attn.in_proj_a",
+      "model.language_model.layers.17.linear_attn.in_proj_b",
+      "model.language_model.layers.18.linear_attn.conv1d",
+      "model.language_model.layers.18.linear_attn.in_proj_a",
+      "model.language_model.layers.18.linear_attn.in_proj_b",
+      "model.language_model.layers.2.linear_attn.conv1d",
+      "model.language_model.layers.2.linear_attn.in_proj_a",
+      "model.language_model.layers.2.linear_attn.in_proj_b",
+      "model.language_model.layers.20.linear_attn.conv1d",
+      "model.language_model.layers.20.linear_attn.in_proj_a",
+      "model.language_model.layers.20.linear_attn.in_proj_b",
+      "model.language_model.layers.21.linear_attn.conv1d",
+      "model.language_model.layers.21.linear_attn.in_proj_a",
+      "model.language_model.layers.21.linear_attn.in_proj_b",
+      "model.language_model.layers.22.linear_attn.conv1d",
+      "model.language_model.layers.22.linear_attn.in_proj_a",
+      "model.language_model.layers.22.linear_attn.in_proj_b",
+      "model.language_model.layers.24.linear_attn.conv1d",
+      "model.language_model.layers.24.linear_attn.in_proj_a",
+      "model.language_model.layers.24.linear_attn.in_proj_b",
+      "model.language_model.layers.25.linear_attn.conv1d",
+      "model.language_model.layers.25.linear_attn.in_proj_a",
+      "model.language_model.layers.25.linear_attn.in_proj_b",
+      "model.language_model.layers.26.linear_attn.conv1d",
+      "model.language_model.layers.26.linear_attn.in_proj_a",
+      "model.language_model.layers.26.linear_attn.in_proj_b",
+      "model.language_model.layers.28.linear_attn.conv1d",
+      "model.language_model.layers.28.linear_attn.in_proj_a",
+      "model.language_model.layers.28.linear_attn.in_proj_b",
+      "model.language_model.layers.29.linear_attn.conv1d",
+      "model.language_model.layers.29.linear_attn.in_proj_a",
+      "model.language_model.layers.29.linear_attn.in_proj_b",
+      "model.language_model.layers.30.linear_attn.conv1d",
+      "model.language_model.layers.30.linear_attn.in_proj_a",
+      "model.language_model.layers.30.linear_attn.in_proj_b",
+      "model.language_model.layers.32.linear_attn.conv1d",
+      "model.language_model.layers.32.linear_attn.in_proj_a",
+      "model.language_model.layers.32.linear_attn.in_proj_b",
+      "model.language_model.layers.33.linear_attn.conv1d",
+      "model.language_model.layers.33.linear_attn.in_proj_a",
+      "model.language_model.layers.33.linear_attn.in_proj_b",
+      "model.language_model.layers.34.linear_attn.conv1d",
+      "model.language_model.layers.34.linear_attn.in_proj_a",
+      "model.language_model.layers.34.linear_attn.in_proj_b",
+      "model.language_model.layers.36.linear_attn.conv1d",
+      "model.language_model.layers.36.linear_attn.in_proj_a",
+      "model.language_model.layers.36.linear_attn.in_proj_b",
+      "model.language_model.layers.37.linear_attn.conv1d",
+      "model.language_model.layers.37.linear_attn.in_proj_a",
+      "model.language_model.layers.37.linear_attn.in_proj_b",
+      "model.language_model.layers.38.linear_attn.conv1d",
+      "model.language_model.layers.38.linear_attn.in_proj_a",
+      "model.language_model.layers.38.linear_attn.in_proj_b",
+      "model.language_model.layers.4.linear_attn.conv1d",
+      "model.language_model.layers.4.linear_attn.in_proj_a",
+      "model.language_model.layers.4.linear_attn.in_proj_b",
+      "model.language_model.layers.40.linear_attn.conv1d",
+      "model.language_model.layers.40.linear_attn.in_proj_a",
+      "model.language_model.layers.40.linear_attn.in_proj_b",
+      "model.language_model.layers.41.linear_attn.conv1d",
+      "model.language_model.layers.41.linear_attn.in_proj_a",
+      "model.language_model.layers.41.linear_attn.in_proj_b",
+      "model.language_model.layers.42.linear_attn.conv1d",
+      "model.language_model.layers.42.linear_attn.in_proj_a",
+      "model.language_model.layers.42.linear_attn.in_proj_b",
+      "model.language_model.layers.44.linear_attn.conv1d",
+      "model.language_model.layers.44.linear_attn.in_proj_a",
+      "model.language_model.layers.44.linear_attn.in_proj_b",
+      "model.language_model.layers.45.linear_attn.conv1d",
+      "model.language_model.layers.45.linear_attn.in_proj_a",
+      "model.language_model.layers.45.linear_attn.in_proj_b",
+      "model.language_model.layers.46.linear_attn.conv1d",
+      "model.language_model.layers.46.linear_attn.in_proj_a",
+      "model.language_model.layers.46.linear_attn.in_proj_b",
+      "model.language_model.layers.48.linear_attn.conv1d",
+      "model.language_model.layers.48.linear_attn.in_proj_a",
+      "model.language_model.layers.48.linear_attn.in_proj_b",
+      "model.language_model.layers.49.linear_attn.conv1d",
+      "model.language_model.layers.49.linear_attn.in_proj_a",
+      "model.language_model.layers.49.linear_attn.in_proj_b",
+      "model.language_model.layers.5.linear_attn.conv1d",
+      "model.language_model.layers.5.linear_attn.in_proj_a",
+      "model.language_model.layers.5.linear_attn.in_proj_b",
+      "model.language_model.layers.50.linear_attn.conv1d",
+      "model.language_model.layers.50.linear_attn.in_proj_a",
+      "model.language_model.layers.50.linear_attn.in_proj_b",
+      "model.language_model.layers.52.linear_attn.conv1d",
+      "model.language_model.layers.52.linear_attn.in_proj_a",
+      "model.language_model.layers.52.linear_attn.in_proj_b",
+      "model.language_model.layers.53.linear_attn.conv1d",
+      "model.language_model.layers.53.linear_attn.in_proj_a",
+      "model.language_model.layers.53.linear_attn.in_proj_b",
+      "model.language_model.layers.54.linear_attn.conv1d",
+      "model.language_model.layers.54.linear_attn.in_proj_a",
+      "model.language_model.layers.54.linear_attn.in_proj_b",
+      "model.language_model.layers.56.linear_attn.conv1d",
+      "model.language_model.layers.56.linear_attn.in_proj_a",
+      "model.language_model.layers.56.linear_attn.in_proj_b",
+      "model.language_model.layers.57.linear_attn.conv1d",
+      "model.language_model.layers.57.linear_attn.in_proj_a",
+      "model.language_model.layers.57.linear_attn.in_proj_b",
+      "model.language_model.layers.58.linear_attn.conv1d",
+      "model.language_model.layers.58.linear_attn.in_proj_a",
+      "model.language_model.layers.58.linear_attn.in_proj_b",
+      "model.language_model.layers.6.linear_attn.conv1d",
+      "model.language_model.layers.6.linear_attn.in_proj_a",
+      "model.language_model.layers.6.linear_attn.in_proj_b",
+      "model.language_model.layers.60.linear_attn.conv1d",
+      "model.language_model.layers.60.linear_attn.in_proj_a",
+      "model.language_model.layers.60.linear_attn.in_proj_b",
+      "model.language_model.layers.61.linear_attn.conv1d",
+      "model.language_model.layers.61.linear_attn.in_proj_a",
+      "model.language_model.layers.61.linear_attn.in_proj_b",
+      "model.language_model.layers.62.linear_attn.conv1d",
+      "model.language_model.layers.62.linear_attn.in_proj_a",
+      "model.language_model.layers.62.linear_attn.in_proj_b",
+      "model.language_model.layers.8.linear_attn.conv1d",
+      "model.language_model.layers.8.linear_attn.in_proj_a",
+      "model.language_model.layers.8.linear_attn.in_proj_b",
+      "model.language_model.layers.9.linear_attn.conv1d",
+      "model.language_model.layers.9.linear_attn.in_proj_a",
+      "model.language_model.layers.9.linear_attn.in_proj_b",
+      "model.visual*",
+      "mtp*",
+      "mtp.layers.0*",
+      "*embed_tokens",
+      "*layers.0.linear_attn.conv1d",
+      "*layers.0.linear_attn.in_proj_a",
+      "*layers.0.linear_attn.in_proj_b",
+      "*layers.1.linear_attn.conv1d",
+      "*layers.1.linear_attn.in_proj_a",
+      "*layers.1.linear_attn.in_proj_b",
+      "*layers.10.linear_attn.conv1d",
+      "*layers.10.linear_attn.in_proj_a",
+      "*layers.10.linear_attn.in_proj_b",
+      "*layers.12.linear_attn.conv1d",
+      "*layers.12.linear_attn.in_proj_a",
+      "*layers.12.linear_attn.in_proj_b",
+      "*layers.13.linear_attn.conv1d",
+      "*layers.13.linear_attn.in_proj_a",
+      "*layers.13.linear_attn.in_proj_b",
+      "*layers.14.linear_attn.conv1d",
+      "*layers.14.linear_attn.in_proj_a",
+      "*layers.14.linear_attn.in_proj_b",
+      "*layers.16.linear_attn.conv1d",
+      "*layers.16.linear_attn.in_proj_a",
+      "*layers.16.linear_attn.in_proj_b",
+      "*layers.17.linear_attn.conv1d",
+      "*layers.17.linear_attn.in_proj_a",
+      "*layers.17.linear_attn.in_proj_b",
+      "*layers.18.linear_attn.conv1d",
+      "*layers.18.linear_attn.in_proj_a",
+      "*layers.18.linear_attn.in_proj_b",
+      "*layers.2.linear_attn.conv1d",
+      "*layers.2.linear_attn.in_proj_a",
+      "*layers.2.linear_attn.in_proj_b",
+      "*layers.20.linear_attn.conv1d",
+      "*layers.20.linear_attn.in_proj_a",
+      "*layers.20.linear_attn.in_proj_b",
+      "*layers.21.linear_attn.conv1d",
+      "*layers.21.linear_attn.in_proj_a",
+      "*layers.21.linear_attn.in_proj_b",
+      "*layers.22.linear_attn.conv1d",
+      "*layers.22.linear_attn.in_proj_a",
+      "*layers.22.linear_attn.in_proj_b",
+      "*layers.24.linear_attn.conv1d",
+      "*layers.24.linear_attn.in_proj_a",
+      "*layers.24.linear_attn.in_proj_b",
+      "*layers.25.linear_attn.conv1d",
+      "*layers.25.linear_attn.in_proj_a",
+      "*layers.25.linear_attn.in_proj_b",
+      "*layers.26.linear_attn.conv1d",
+      "*layers.26.linear_attn.in_proj_a",
+      "*layers.26.linear_attn.in_proj_b",
+      "*layers.28.linear_attn.conv1d",
+      "*layers.28.linear_attn.in_proj_a",
+      "*layers.28.linear_attn.in_proj_b",
+      "*layers.29.linear_attn.conv1d",
+      "*layers.29.linear_attn.in_proj_a",
+      "*layers.29.linear_attn.in_proj_b",
+      "*layers.30.linear_attn.conv1d",
+      "*layers.30.linear_attn.in_proj_a",
+      "*layers.30.linear_attn.in_proj_b",
+      "*layers.32.linear_attn.conv1d",
+      "*layers.32.linear_attn.in_proj_a",
+      "*layers.32.linear_attn.in_proj_b",
+      "*layers.33.linear_attn.conv1d",
+      "*layers.33.linear_attn.in_proj_a",
+      "*layers.33.linear_attn.in_proj_b",
+      "*layers.34.linear_attn.conv1d",
+      "*layers.34.linear_attn.in_proj_a",
+      "*layers.34.linear_attn.in_proj_b",
+      "*layers.36.linear_attn.conv1d",
+      "*layers.36.linear_attn.in_proj_a",
+      "*layers.36.linear_attn.in_proj_b",
+      "*layers.37.linear_attn.conv1d",
+      "*layers.37.linear_attn.in_proj_a",
+      "*layers.37.linear_attn.in_proj_b",
+      "*layers.38.linear_attn.conv1d",
+      "*layers.38.linear_attn.in_proj_a",
+      "*layers.38.linear_attn.in_proj_b",
+      "*layers.4.linear_attn.conv1d",
+      "*layers.4.linear_attn.in_proj_a",
+      "*layers.4.linear_attn.in_proj_b",
+      "*layers.40.linear_attn.conv1d",
+      "*layers.40.linear_attn.in_proj_a",
+      "*layers.40.linear_attn.in_proj_b",
+      "*layers.41.linear_attn.conv1d",
+      "*layers.41.linear_attn.in_proj_a",
+      "*layers.41.linear_attn.in_proj_b",
+      "*layers.42.linear_attn.conv1d",
+      "*layers.42.linear_attn.in_proj_a",
+      "*layers.42.linear_attn.in_proj_b",
+      "*layers.44.linear_attn.conv1d",
+      "*layers.44.linear_attn.in_proj_a",
+      "*layers.44.linear_attn.in_proj_b",
+      "*layers.45.linear_attn.conv1d",
+      "*layers.45.linear_attn.in_proj_a",
+      "*layers.45.linear_attn.in_proj_b",
+      "*layers.46.linear_attn.conv1d",
+      "*layers.46.linear_attn.in_proj_a",
+      "*layers.46.linear_attn.in_proj_b",
+      "*layers.48.linear_attn.conv1d",
+      "*layers.48.linear_attn.in_proj_a",
+      "*layers.48.linear_attn.in_proj_b",
+      "*layers.49.linear_attn.conv1d",
+      "*layers.49.linear_attn.in_proj_a",
+      "*layers.49.linear_attn.in_proj_b",
+      "*layers.5.linear_attn.conv1d",
+      "*layers.5.linear_attn.in_proj_a",
+      "*layers.5.linear_attn.in_proj_b",
+      "*layers.50.linear_attn.conv1d",
+      "*layers.50.linear_attn.in_proj_a",
+      "*layers.50.linear_attn.in_proj_b",
+      "*layers.52.linear_attn.conv1d",
+      "*layers.52.linear_attn.in_proj_a",
+      "*layers.52.linear_attn.in_proj_b",
+      "*layers.53.linear_attn.conv1d",
+      "*layers.53.linear_attn.in_proj_a",
+      "*layers.53.linear_attn.in_proj_b",
+      "*layers.54.linear_attn.conv1d",
+      "*layers.54.linear_attn.in_proj_a",
+      "*layers.54.linear_attn.in_proj_b",
+      "*layers.56.linear_attn.conv1d",
+      "*layers.56.linear_attn.in_proj_a",
+      "*layers.56.linear_attn.in_proj_b",
+      "*layers.57.linear_attn.conv1d",
+      "*layers.57.linear_attn.in_proj_a",
+      "*layers.57.linear_attn.in_proj_b",
+      "*layers.58.linear_attn.conv1d",
+      "*layers.58.linear_attn.in_proj_a",
+      "*layers.58.linear_attn.in_proj_b",
+      "*layers.6.linear_attn.conv1d",
+      "*layers.6.linear_attn.in_proj_a",
+      "*layers.6.linear_attn.in_proj_b",
+      "*layers.60.linear_attn.conv1d",
+      "*layers.60.linear_attn.in_proj_a",
+      "*layers.60.linear_attn.in_proj_b",
+      "*layers.61.linear_attn.conv1d",
+      "*layers.61.linear_attn.in_proj_a",
+      "*layers.61.linear_attn.in_proj_b",
+      "*layers.62.linear_attn.conv1d",
+      "*layers.62.linear_attn.in_proj_a",
+      "*layers.62.linear_attn.in_proj_b",
+      "*layers.8.linear_attn.conv1d",
+      "*layers.8.linear_attn.in_proj_a",
+      "*layers.8.linear_attn.in_proj_b",
+      "*layers.9.linear_attn.conv1d",
+      "*layers.9.linear_attn.in_proj_a",
+      "*layers.9.linear_attn.in_proj_b",
+      "*visual*"
+    ]
+  }
+}

model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db717feebe5cc06ab38712d7bc7584c725290eec091517a799f282c3d9eb4bdd
+size 9972779344

model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92e7e33e398de639f386ac5f04070f2e33ea6cffad072411a733d87b4ade16cf
+size 9875841504

model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ce944d534eabdd493076a3a52c7ebd31f41c135b340a1ea95c5a695e6f1f6b2
+size 744532384

preprocessor_config.json

@@ -0,0 +1,21 @@
+{
+    "size": {
+        "longest_edge": 16777216,
+        "shortest_edge": 65536
+    },
+    "patch_size": 16,
+    "temporal_patch_size": 2,
+    "merge_size": 2,
+    "image_mean": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "image_std": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "processor_class": "Qwen3VLProcessor",
+    "image_processor_type": "Qwen2VLImageProcessorFast"
+}

processor_config.json

@@ -0,0 +1,60 @@
+{
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "Qwen2VLImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "merge_size": 2,
+    "patch_size": 16,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "size": {
+      "longest_edge": 16777216,
+      "shortest_edge": 65536
+    },
+    "temporal_patch_size": 2
+  },
+  "processor_class": "Qwen3VLProcessor",
+  "video_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": true,
+    "fps": 2,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_frames": 768,
+    "merge_size": 2,
+    "min_frames": 4,
+    "patch_size": 16,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "size": {
+      "longest_edge": 25165824,
+      "shortest_edge": 4096
+    },
+    "temporal_patch_size": 2,
+    "video_processor_type": "Qwen3VLVideoProcessor"
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0997f410c57a1f4e53b09e4be8f4a172d90edd9564368fb0847030937229b9f3
+size 12809320

tokenizer_config.json

@@ -0,0 +1,305 @@
+{
+    "add_prefix_space": false,
+    "added_tokens_decoder": {
+        "248044": {
+            "content": "<|endoftext|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248045": {
+            "content": "<|im_start|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248046": {
+            "content": "<|im_end|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248047": {
+            "content": "<|object_ref_start|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248048": {
+            "content": "<|object_ref_end|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248049": {
+            "content": "<|box_start|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248050": {
+            "content": "<|box_end|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248051": {
+            "content": "<|quad_start|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248052": {
+            "content": "<|quad_end|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248053": {
+            "content": "<|vision_start|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248054": {
+            "content": "<|vision_end|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248055": {
+            "content": "<|vision_pad|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248056": {
+            "content": "<|image_pad|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248057": {
+            "content": "<|video_pad|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248058": {
+            "content": "<tool_call>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248059": {
+            "content": "</tool_call>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248060": {
+            "content": "<|fim_prefix|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248061": {
+            "content": "<|fim_middle|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248062": {
+            "content": "<|fim_suffix|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248063": {
+            "content": "<|fim_pad|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248064": {
+            "content": "<|repo_name|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248065": {
+            "content": "<|file_sep|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248066": {
+            "content": "<tool_response>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248067": {
+            "content": "</tool_response>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248068": {
+            "content": "<think>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248069": {
+            "content": "</think>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": false
+        },
+        "248070": {
+            "content": "<|audio_start|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248071": {
+            "content": "<|audio_end|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248072": {
+            "content": "<tts_pad>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248073": {
+            "content": "<tts_text_bos>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248074": {
+            "content": "<tts_text_eod>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248075": {
+            "content": "<tts_text_bos_single>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        },
+        "248076": {
+            "content": "<|audio_pad|>",
+            "lstrip": false,
+            "normalized": false,
+            "rstrip": false,
+            "single_word": false,
+            "special": true
+        }
+    },
+    "additional_special_tokens": [
+        "<|im_start|>",
+        "<|im_end|>",
+        "<|object_ref_start|>",
+        "<|object_ref_end|>",
+        "<|box_start|>",
+        "<|box_end|>",
+        "<|quad_start|>",
+        "<|quad_end|>",
+        "<|vision_start|>",
+        "<|vision_end|>",
+        "<|vision_pad|>",
+        "<|image_pad|>",
+        "<|video_pad|>"
+    ],
+    "bos_token": null,
+    "chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n    {%- if content is string %}\n        {{- content }}\n    {%- elif content is iterable and content is not mapping %}\n        {%- for item in content %}\n            {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n                {%- if is_system_content %}\n                    {{- raise_exception('System message cannot contain images.') }}\n                {%- endif %}\n                {%- if do_vision_count %}\n                    {%- set image_count.value = image_count.value + 1 %}\n                {%- endif %}\n                {%- if add_vision_id %}\n                    {{- 'Picture ' ~ image_count.value ~ ': ' }}\n                {%- endif %}\n                {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n            {%- elif 'video' in item or item.type == 'video' %}\n                {%- if is_system_content %}\n                    {{- raise_exception('System message cannot contain videos.') }}\n                {%- endif %}\n                {%- if do_vision_count %}\n                    {%- set video_count.value = video_count.value + 1 %}\n                {%- endif %}\n                {%- if add_vision_id %}\n                    {{- 'Video ' ~ video_count.value ~ ': ' }}\n                {%- endif %}\n                {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n            {%- elif 'text' in item %}\n                {{- item.text }}\n            {%- else %}\n                {{- raise_exception('Unexpected item type in content.') }}\n            {%- endif %}\n        {%- endfor %}\n    {%- elif content is none or content is undefined %}\n        {{- '' }}\n    {%- else %}\n        {{- raise_exception('Unexpected content type.') }}\n    {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n    {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set reasoning_instructions = '' %}\n{%- if enable_thinking is undefined or enable_thinking is true %}\n    {%- set resolved_reasoning_effort = reasoning_effort|default('xhigh') %}\n    {%- if resolved_reasoning_effort not in ('xhigh', 'medium', 'low') %}\n        {{- raise_exception('Unexpected reasoning effort ' ~ reasoning_effort ~ '. Supported types are xhigh (default), medium, and low.') }}\n    {%- endif %}\n    {%- if resolved_reasoning_effort == 'xhigh' %}\n        {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}\n    {%- elif resolved_reasoning_effort == 'low' %}\n        {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}\n    {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n    {{- '<|im_start|>system\\n' }}\n    {%- if reasoning_instructions %}\n        {{- reasoning_instructions + '\\n\\n' }}\n    {%- endif %}\n    {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n    {%- for tool in tools %}\n        {{- \"\\n\" }}\n        {{- tool | tojson }}\n    {%- endfor %}\n    {{- \"\\n</tools>\" }}\n    {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n    {%- if messages[0].role == 'system' %}\n        {%- set content = render_content(messages[0].content, false, true)|trim %}\n        {%- if content %}\n            {{- '\\n\\n' + content }}\n        {%- endif %}\n    {%- endif %}\n    {{- '<|im_end|>\\n' }}\n{%- else %}\n    {%- if messages[0].role == 'system' %}\n        {%- set content = render_content(messages[0].content, false, true)|trim %}\n        {%- if content %}\n            {{- '<|im_start|>system\\n' + (reasoning_instructions + '\\n\\n' if reasoning_instructions else '')  + content + '<|im_end|>\\n' }}\n        {%- elif reasoning_instructions %}\n            {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n        {%- endif %}\n    {%- elif reasoning_instructions %}\n        {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n    {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n    {%- set index = (messages|length - 1) - loop.index0 %}\n    {%- if ns.multi_step_tool and message.role == \"user\" %}\n        {%- set content = render_content(message.content, false)|trim %}\n        {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n            {%- set ns.multi_step_tool = false %}\n            {%- set ns.last_query_index = index %}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n    {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n    {%- set content = render_content(message.content, true)|trim %}\n    {%- if message.role == \"system\" %}\n        {%- if not loop.first %}\n            {{- raise_exception('System message must be at the beginning.') }}\n        {%- endif %}\n    {%- elif message.role == \"user\" %}\n        {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n    {%- elif message.role == \"assistant\" %}\n        {%- set reasoning_content = '' %}\n        {%- if message.reasoning_content is string %}\n            {%- set reasoning_content = message.reasoning_content %}\n        {%- endif %}\n        {%- set reasoning_content = reasoning_content|trim %}\n        {%- if preserve_thinking is undefined or preserve_thinking is true or loop.index0 > ns.last_query_index %}\n            {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n        {%- else %}\n            {{- '<|im_start|>' + message.role + '\\n' + content }}\n        {%- endif %}\n        {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n            {%- for tool_call in message.tool_calls %}\n                {%- if tool_call.function is defined %}\n                    {%- set tool_call = tool_call.function %}\n                {%- endif %}\n                {%- if loop.first %}\n                    {%- if content|trim %}\n                        {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n                    {%- else %}\n                        {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n                    {%- endif %}\n                {%- else %}\n                    {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n                {%- endif %}\n                {%- if tool_call.arguments is defined and tool_call.arguments != '' %}\n                    {%- for args_name, args_value in tool_call.arguments|items %}\n                        {{- '<parameter=' + args_name + '>\\n' }}\n                        {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n                        {{- args_value }}\n                        {{- '\\n</parameter>\\n' }}\n                    {%- endfor %}\n                {%- endif %}\n                {{- '</function>\\n</tool_call>' }}\n            {%- endfor %}\n        {%- endif %}\n        {{- '<|im_end|>\\n' }}\n    {%- elif message.role == \"tool\" %}\n        {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n            {{- '<|im_start|>user' }}\n        {%- endif %}\n        {{- '\\n<tool_response>\\n' }}\n        {{- content }}\n        {{- '\\n</tool_response>' }}\n        {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n            {{- '<|im_end|>\\n' }}\n        {%- elif loop.last %}\n            {{- '<|im_end|>\\n' }}\n        {%- endif %}\n    {%- else %}\n        {{- raise_exception('Unexpected message role.') }}\n    {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|im_start|>assistant\\n' }}\n    {%- if enable_thinking is defined and enable_thinking is false %}\n        {{- '<think>\\n\\n</think>\\n\\n' }}\n    {%- else %}\n        {{- '<think>\\n' }}\n    {%- endif %}\n{%- endif %}",
+    "clean_up_tokenization_spaces": false,
+    "eos_token": "<|im_end|>",
+    "errors": "replace",
+    "model_max_length": 262144,
+    "pad_token": "<|endoftext|>",
+    "split_special_tokens": false,
+    "tokenizer_class": "Qwen2Tokenizer",
+    "unk_token": null,
+    "add_bos_token": false,
+    "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
+    "extra_special_tokens": {
+        "audio_bos_token": "<|audio_start|>",
+        "audio_eos_token": "<|audio_end|>",
+        "audio_token": "<|audio_pad|>",
+        "image_token": "<|image_pad|>",
+        "video_token": "<|video_pad|>",
+        "vision_bos_token": "<|vision_start|>",
+        "vision_eos_token": "<|vision_end|>"
+    }
+}

video_preprocessor_config.json

@@ -0,0 +1,21 @@
+{
+    "size": {
+        "longest_edge": 25165824,
+        "shortest_edge": 4096
+    },
+    "patch_size": 16,
+    "temporal_patch_size": 2,
+    "merge_size": 2,
+    "image_mean": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "image_std": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "processor_class": "Qwen3VLProcessor",
+    "video_processor_type": "Qwen3VLVideoProcessor"
+}