Instructions to use AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

MLX LM

How to use AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

Hermes Agent

How to use AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

AutomatosX commited on 4 days ago

Commit

b68a546

verified ·

1 Parent(s): 90a8d10

Publish AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP

Browse files

Files changed (30) hide show

.gitattributes +1 -0
README.md +180 -0
ax_expert_stream.json +2425 -0
axquant_manifest.json +269 -0
axquant_mtp_sidecar_manifest.json +30 -0
axquant_plan.json +0 -0
axquant_quantizer_execution.json +0 -0
axquant_runtime.json +60 -0
axquant_source_binding.json +44 -0
axquant_vision_sidecar_manifest.json +30 -0
chat_template.jinja +488 -0
config.json +0 -0
generation_config.json +12 -0
merges.txt +0 -0
model-00001-of-00007.safetensors +3 -0
model-00002-of-00007.safetensors +3 -0
model-00003-of-00007.safetensors +3 -0
model-00004-of-00007.safetensors +3 -0
model-00005-of-00007.safetensors +3 -0
model-00006-of-00007.safetensors +3 -0
model-00007-of-00007.safetensors +3 -0
model.safetensors.index.json +0 -0
mtp.safetensors +3 -0
mtplx_runtime.json +5 -0
preprocessor_config.json +21 -0
processor_config.json +60 -0
tokenizer.json +3 -0
tokenizer_config.json +305 -0
vision.safetensors +3 -0
vocab.json +0 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md ADDED Viewed

	@@ -0,0 +1,180 @@

+---
+license: apache-2.0
+library_name: mlx
+base_model: peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP
+base_model_relation: quantized
+pipeline_tag: text-generation
+tags:
+- mlx
+- apple-silicon
+- quantized
+- mixed-precision
+- axquant
+- axq
+- development
+- qwen3.5-moe
+- MXFP8
+- MXFP8
+- mtp
+- vision
+---
+# AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP — 8.46 BPW measured main
+An **AXQuant (AXQ)** mixed-precision MLX checkpoint for Apple Silicon, converted directly from
+the BF16 source model. The language path is quantized while the multi-token-prediction (MTP) head and vision tower are preserved at BF16 in the checkpoint (or a bound sidecar when present).
+> **Development evidence — not a certified AXQuant release.** This package has conversion and
+> artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
+> or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
+## Model details
+| Property | Value |
+| --- | --- |
+| Base model | [peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP](https://huggingface.co/peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP/tree/a443d4e30fd5228942cb7695f916f4b14a88fae9) |
+| Source revision | `a443d4e30fd5228942cb7695f916f4b14a88fae9` |
+| Product family | `qwen3.5-moe` |
+| Source architecture | `Qwen3_5MoeForConditionalGeneration` (mixture of experts (MoE)); text path optimized |
+| Main-model parameters | 35.11B logical parameters |
+| Quantizer | AXQuant `1.9.0` |
+| Hub budget class | `MXFP8` |
+| AXQuant base precision class | `9p4bpw` |
+| Planned storage-adjusted BPW | 9.3507 |
+| Measured main-model BPW | 8.4611 |
+| Measured total BPW, including MTP | **8.6383** |
+| Safetensors weight size | 38.82 GB |
+| Approximate complete download | 38.85 GB |
+| Configured maximum context | 262,144 tokens; practical limits depend on unified memory |
+| Primary MLX runtime | MLX-LM |
+| AX Engine native execution | Not established; no validated native manifest is included |
+| MTP present | `True` |
+| Vision present | `True` |
+| Audio present | `False` |
+This repository contains MLX Safetensors. It does **not** contain PyTorch or GGUF weights.
+## Choosing an AXQ pack
+AXQ names describe a **storage-budget product class**, not one uniform precision applied to every
+tensor. Protected tensors remain at higher precision, so the exact measured BPW is authoritative.
+In particular, a `6bit`-named mixed plan may retain `4bit` as its base precision while selecting
+6-bit, 8-bit, or BF16 for other tensors to meet an approximately 6-BPW total budget. Protection
+floors can also raise a `4bit`-named pack close to (or above) a `6bit` budget on small or heavily
+protected models. When that collapse happens, AutomatosX does **not** publish a separate
+misleading `4bit` sibling for that base.
+| Sibling | Intended trade-off |
+| --- | --- |
+| [4bit sibling](https://huggingface.co/AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-4bit-MTP) | Lower-storage AXQ budget; check its exact BPW |
+| [6bit sibling](https://huggingface.co/AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-6bit-MTP) | Higher average precision near the 6-BPW budget |
+See the [AutomatosX collections](https://huggingface.co/AutomatosX/collections)
+for the family catalog, or the [complete index](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog).
+## Download
+```bash
+python -m pip install -U huggingface_hub
+hf download AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP --local-dir ./AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP
+```
+Allow at least 38.85 GB of free disk space. Pin the resulting Hub commit in reproducible
+deployments rather than relying indefinitely on `main`.
+## Run with MLX-LM
+```bash
+python -m pip install -U mlx-lm
+mlx_lm.generate \
+  --model AutomatosX/AX-Cyber-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP \
+  --prompt "Explain mixed-precision quantization in three sentences." \
+  --max-tokens 128 \
+  --temp 0.0
+```
+MLX-LM compatibility covers standard **text/backbone inference**. It may ignore AXQuant runtime
+metadata and optional sidecars (`vision.safetensors`, `mtp.safetensors`); this command therefore
+does not establish MTP acceleration or vision-language quality. The artifact records MLX
+`0.32.1` and MLX-LM `0.31.3` from conversion.
+## AX Engine status
+This package does **not** include a validated native `model-manifest.json`, so AX Engine execution
+is not established by this release. The AX Engine fields in `axquant_runtime.json` describe the
+intended compatibility contract, not observed runtime evidence. Use the architecture-specific MLX
+runtime path above. The artifact records AX Engine version
+`7.5.7`, but version discovery alone is not a runtime check.
+## Quantization layout
+| Main-weight precision | Parameters | Share |
+| --- | ---: | ---: |
+| `8bit` | 34.15B | 94.99% |
+| `bf16` | 1.80B | 5.01% |
+- Quantization methods: `affine, bf16`.
+- Group sizes used by quantized assignments: `32`.
+- MTP sidecar: 785 tensors, 844.64M parameters, 1.69 GB, BF16.
+- Vision sidecar: 333 tensors, 446.57M parameters, 0.89 GB, BF16.
+- Vision weights: protected BF16 sidecar.
+- Optimization scope: `text-path`.
+- Support tier: `convertible`.
+BF16 sidecars, when present, are included in total download size. Their presence does not by itself
+establish MTP acceleration or vision-language quality.
+## Evidence and validation status
+| Check | Status |
+| --- | --- |
+| Planning evidence | `architecture_prior` |
+| Calibration | none; the allocation is based on architecture priors |
+| Quantizer execution | 511/511 recorded module conversions succeeded; 0 fallbacks |
+| AX Engine native manifest | not included |
+| Quality versus BF16 or uniform baselines | Not published; no quality-retention claim |
+| MTP acceptance and speed | not measured; no MTP speedup claim |
+| AX Engine kernel evidence | `unmeasured` |
+| Vision-language quality | Not evaluated or claimed; vision tensors are preserved at BF16 |
+| Speech-recognition quality | Not applicable |
+| Long-context quality | 262,144-token capacity is config metadata, not a validated claim |
+| Release certification | **Not certified**; formal AXQuant M0-M8 gates are not closed |
+## Intended use and limitations
+- Intended for local development and evaluation on Apple Silicon with MLX-compatible runtimes.
+- No minimum unified-memory figure is claimed; loadability depends on model size, context length,
+  KV-cache policy, runtime buffers, and other processes using unified memory.
+- Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
+  model quality.
+- MTP may be ignored outside AX Engine and its speedup is unmeasured for this exact checkpoint.
+- Vision weights are preserved at BF16, but this release does not claim validated VLM quality.
+- The configured context window can require substantially more memory as the KV cache grows.
+- AX Engine execution is not established because this package has no validated native manifest.
+- Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
+## Provenance and audit files
+- [`axquant_manifest.json`](axquant_manifest.json): package identity, byte accounting, runtime
+  contract, software versions, and file checksums.
+- [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
+- [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
+  fallback records.
+- [`axquant_runtime.json`](axquant_runtime.json): declared AX Engine and MLX compatibility metadata; runtime checks remain separate evidence.
+- [`axquant_mtp_sidecar_manifest.json`](axquant_mtp_sidecar_manifest.json): MTP tensor provenance.
+- [`axquant_vision_sidecar_manifest.json`](axquant_vision_sidecar_manifest.json): protected vision tensor provenance.
+All published provenance uses repository-relative paths. Local source paths are stripped before
+publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
+artifact. If an OptiQ repository is published separately, it uses a different quantizer and
+should not be assumed to have identical BPW or quality.
+## License
+The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
+the [peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP model card](https://huggingface.co/peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP/tree/a443d4e30fd5228942cb7695f916f4b14a88fae9) for license terms, model
+limitations, and responsible-use guidance.

ax_expert_stream.json ADDED Viewed

	@@ -0,0 +1,2425 @@

+{
+  "estimated_full_resident_bytes": 38819969248,
+  "estimated_max_layer_expert_bytes": 830472192,
+  "estimated_resident_bytes": 5601081568,
+  "experts_per_tok": 8,
+  "generated_by": "axquant",
+  "mode": "layer-stack",
+  "num_experts": 256,
+  "required": false,
+  "resident_roles": [
+    "embedding",
+    "attention",
+    "router",
+    "shared_expert",
+    "norm",
+    "lm_head",
+    "mtp"
+  ],
+  "schema_version": "axquant.expert-stream.v1",
+  "streamed_roles": [
+    "expert"
+  ],
+  "tensors": [
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 0,
+      "name": "language_model.model.layers.0.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 0,
+      "name": "language_model.model.layers.0.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 0,
+      "name": "language_model.model.layers.0.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 0,
+      "name": "language_model.model.layers.0.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 0,
+      "name": "language_model.model.layers.0.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 0,
+      "name": "language_model.model.layers.0.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 1,
+      "name": "language_model.model.layers.1.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 1,
+      "name": "language_model.model.layers.1.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 1,
+      "name": "language_model.model.layers.1.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 1,
+      "name": "language_model.model.layers.1.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 1,
+      "name": "language_model.model.layers.1.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 1,
+      "name": "language_model.model.layers.1.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 2,
+      "name": "language_model.model.layers.2.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 2,
+      "name": "language_model.model.layers.2.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 2,
+      "name": "language_model.model.layers.2.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 2,
+      "name": "language_model.model.layers.2.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 2,
+      "name": "language_model.model.layers.2.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 2,
+      "name": "language_model.model.layers.2.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 3,
+      "name": "language_model.model.layers.3.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 3,
+      "name": "language_model.model.layers.3.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 3,
+      "name": "language_model.model.layers.3.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 3,
+      "name": "language_model.model.layers.3.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 3,
+      "name": "language_model.model.layers.3.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 3,
+      "name": "language_model.model.layers.3.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 4,
+      "name": "language_model.model.layers.4.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 4,
+      "name": "language_model.model.layers.4.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 4,
+      "name": "language_model.model.layers.4.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 4,
+      "name": "language_model.model.layers.4.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 4,
+      "name": "language_model.model.layers.4.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 4,
+      "name": "language_model.model.layers.4.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 5,
+      "name": "language_model.model.layers.5.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 5,
+      "name": "language_model.model.layers.5.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 5,
+      "name": "language_model.model.layers.5.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00001-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 5,
+      "name": "language_model.model.layers.5.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 5,
+      "name": "language_model.model.layers.5.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 5,
+      "name": "language_model.model.layers.5.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 6,
+      "name": "language_model.model.layers.6.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 6,
+      "name": "language_model.model.layers.6.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 6,
+      "name": "language_model.model.layers.6.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 6,
+      "name": "language_model.model.layers.6.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 6,
+      "name": "language_model.model.layers.6.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 6,
+      "name": "language_model.model.layers.6.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 7,
+      "name": "language_model.model.layers.7.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 7,
+      "name": "language_model.model.layers.7.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 7,
+      "name": "language_model.model.layers.7.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 7,
+      "name": "language_model.model.layers.7.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 7,
+      "name": "language_model.model.layers.7.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 7,
+      "name": "language_model.model.layers.7.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 8,
+      "name": "language_model.model.layers.8.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 8,
+      "name": "language_model.model.layers.8.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 8,
+      "name": "language_model.model.layers.8.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 8,
+      "name": "language_model.model.layers.8.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 8,
+      "name": "language_model.model.layers.8.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 8,
+      "name": "language_model.model.layers.8.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 9,
+      "name": "language_model.model.layers.9.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 9,
+      "name": "language_model.model.layers.9.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 9,
+      "name": "language_model.model.layers.9.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 9,
+      "name": "language_model.model.layers.9.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 9,
+      "name": "language_model.model.layers.9.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 9,
+      "name": "language_model.model.layers.9.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 10,
+      "name": "language_model.model.layers.10.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 10,
+      "name": "language_model.model.layers.10.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 10,
+      "name": "language_model.model.layers.10.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 10,
+      "name": "language_model.model.layers.10.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 10,
+      "name": "language_model.model.layers.10.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 10,
+      "name": "language_model.model.layers.10.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 11,
+      "name": "language_model.model.layers.11.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 11,
+      "name": "language_model.model.layers.11.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 11,
+      "name": "language_model.model.layers.11.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00002-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 11,
+      "name": "language_model.model.layers.11.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 11,
+      "name": "language_model.model.layers.11.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 11,
+      "name": "language_model.model.layers.11.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 12,
+      "name": "language_model.model.layers.12.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 12,
+      "name": "language_model.model.layers.12.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 12,
+      "name": "language_model.model.layers.12.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 12,
+      "name": "language_model.model.layers.12.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 12,
+      "name": "language_model.model.layers.12.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 12,
+      "name": "language_model.model.layers.12.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 13,
+      "name": "language_model.model.layers.13.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 13,
+      "name": "language_model.model.layers.13.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 13,
+      "name": "language_model.model.layers.13.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 13,
+      "name": "language_model.model.layers.13.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 13,
+      "name": "language_model.model.layers.13.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 13,
+      "name": "language_model.model.layers.13.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 14,
+      "name": "language_model.model.layers.14.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 14,
+      "name": "language_model.model.layers.14.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 14,
+      "name": "language_model.model.layers.14.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 14,
+      "name": "language_model.model.layers.14.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 14,
+      "name": "language_model.model.layers.14.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 14,
+      "name": "language_model.model.layers.14.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 15,
+      "name": "language_model.model.layers.15.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 15,
+      "name": "language_model.model.layers.15.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 15,
+      "name": "language_model.model.layers.15.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 15,
+      "name": "language_model.model.layers.15.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 15,
+      "name": "language_model.model.layers.15.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 15,
+      "name": "language_model.model.layers.15.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 16,
+      "name": "language_model.model.layers.16.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 16,
+      "name": "language_model.model.layers.16.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 16,
+      "name": "language_model.model.layers.16.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 16,
+      "name": "language_model.model.layers.16.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 16,
+      "name": "language_model.model.layers.16.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 16,
+      "name": "language_model.model.layers.16.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 17,
+      "name": "language_model.model.layers.17.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 17,
+      "name": "language_model.model.layers.17.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 17,
+      "name": "language_model.model.layers.17.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00003-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 17,
+      "name": "language_model.model.layers.17.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 17,
+      "name": "language_model.model.layers.17.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 17,
+      "name": "language_model.model.layers.17.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 18,
+      "name": "language_model.model.layers.18.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 18,
+      "name": "language_model.model.layers.18.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 18,
+      "name": "language_model.model.layers.18.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 18,
+      "name": "language_model.model.layers.18.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 18,
+      "name": "language_model.model.layers.18.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 18,
+      "name": "language_model.model.layers.18.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 19,
+      "name": "language_model.model.layers.19.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 19,
+      "name": "language_model.model.layers.19.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 19,
+      "name": "language_model.model.layers.19.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 19,
+      "name": "language_model.model.layers.19.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 19,
+      "name": "language_model.model.layers.19.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 19,
+      "name": "language_model.model.layers.19.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 20,
+      "name": "language_model.model.layers.20.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 20,
+      "name": "language_model.model.layers.20.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 20,
+      "name": "language_model.model.layers.20.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 20,
+      "name": "language_model.model.layers.20.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 20,
+      "name": "language_model.model.layers.20.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 20,
+      "name": "language_model.model.layers.20.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 21,
+      "name": "language_model.model.layers.21.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 21,
+      "name": "language_model.model.layers.21.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 21,
+      "name": "language_model.model.layers.21.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 21,
+      "name": "language_model.model.layers.21.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 21,
+      "name": "language_model.model.layers.21.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 21,
+      "name": "language_model.model.layers.21.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 22,
+      "name": "language_model.model.layers.22.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 22,
+      "name": "language_model.model.layers.22.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 22,
+      "name": "language_model.model.layers.22.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 22,
+      "name": "language_model.model.layers.22.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 22,
+      "name": "language_model.model.layers.22.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 22,
+      "name": "language_model.model.layers.22.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 23,
+      "name": "language_model.model.layers.23.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 23,
+      "name": "language_model.model.layers.23.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 23,
+      "name": "language_model.model.layers.23.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00004-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 23,
+      "name": "language_model.model.layers.23.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 23,
+      "name": "language_model.model.layers.23.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 23,
+      "name": "language_model.model.layers.23.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 24,
+      "name": "language_model.model.layers.24.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 24,
+      "name": "language_model.model.layers.24.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 24,
+      "name": "language_model.model.layers.24.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 24,
+      "name": "language_model.model.layers.24.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 24,
+      "name": "language_model.model.layers.24.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 24,
+      "name": "language_model.model.layers.24.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 25,
+      "name": "language_model.model.layers.25.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 25,
+      "name": "language_model.model.layers.25.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 25,
+      "name": "language_model.model.layers.25.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 25,
+      "name": "language_model.model.layers.25.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 25,
+      "name": "language_model.model.layers.25.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 25,
+      "name": "language_model.model.layers.25.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 26,
+      "name": "language_model.model.layers.26.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 26,
+      "name": "language_model.model.layers.26.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 26,
+      "name": "language_model.model.layers.26.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 26,
+      "name": "language_model.model.layers.26.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 26,
+      "name": "language_model.model.layers.26.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 26,
+      "name": "language_model.model.layers.26.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 27,
+      "name": "language_model.model.layers.27.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 27,
+      "name": "language_model.model.layers.27.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 27,
+      "name": "language_model.model.layers.27.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 27,
+      "name": "language_model.model.layers.27.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 27,
+      "name": "language_model.model.layers.27.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 27,
+      "name": "language_model.model.layers.27.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 28,
+      "name": "language_model.model.layers.28.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 28,
+      "name": "language_model.model.layers.28.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 28,
+      "name": "language_model.model.layers.28.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 28,
+      "name": "language_model.model.layers.28.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 28,
+      "name": "language_model.model.layers.28.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 28,
+      "name": "language_model.model.layers.28.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 29,
+      "name": "language_model.model.layers.29.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 29,
+      "name": "language_model.model.layers.29.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 29,
+      "name": "language_model.model.layers.29.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00005-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 29,
+      "name": "language_model.model.layers.29.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 29,
+      "name": "language_model.model.layers.29.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 29,
+      "name": "language_model.model.layers.29.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 30,
+      "name": "language_model.model.layers.30.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 30,
+      "name": "language_model.model.layers.30.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 30,
+      "name": "language_model.model.layers.30.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 30,
+      "name": "language_model.model.layers.30.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 30,
+      "name": "language_model.model.layers.30.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 30,
+      "name": "language_model.model.layers.30.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 31,
+      "name": "language_model.model.layers.31.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 31,
+      "name": "language_model.model.layers.31.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 31,
+      "name": "language_model.model.layers.31.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 31,
+      "name": "language_model.model.layers.31.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 31,
+      "name": "language_model.model.layers.31.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 31,
+      "name": "language_model.model.layers.31.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 32,
+      "name": "language_model.model.layers.32.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 32,
+      "name": "language_model.model.layers.32.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 32,
+      "name": "language_model.model.layers.32.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 32,
+      "name": "language_model.model.layers.32.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 32,
+      "name": "language_model.model.layers.32.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 32,
+      "name": "language_model.model.layers.32.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 33,
+      "name": "language_model.model.layers.33.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 33,
+      "name": "language_model.model.layers.33.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 33,
+      "name": "language_model.model.layers.33.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 33,
+      "name": "language_model.model.layers.33.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 33,
+      "name": "language_model.model.layers.33.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 33,
+      "name": "language_model.model.layers.33.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 34,
+      "name": "language_model.model.layers.34.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 34,
+      "name": "language_model.model.layers.34.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 34,
+      "name": "language_model.model.layers.34.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 34,
+      "name": "language_model.model.layers.34.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 34,
+      "name": "language_model.model.layers.34.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 34,
+      "name": "language_model.model.layers.34.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 35,
+      "name": "language_model.model.layers.35.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 35,
+      "name": "language_model.model.layers.35.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 35,
+      "name": "language_model.model.layers.35.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00006-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 35,
+      "name": "language_model.model.layers.35.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 35,
+      "name": "language_model.model.layers.35.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 35,
+      "name": "language_model.model.layers.35.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 36,
+      "name": "language_model.model.layers.36.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 36,
+      "name": "language_model.model.layers.36.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 36,
+      "name": "language_model.model.layers.36.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 36,
+      "name": "language_model.model.layers.36.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 36,
+      "name": "language_model.model.layers.36.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 36,
+      "name": "language_model.model.layers.36.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 37,
+      "name": "language_model.model.layers.37.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 37,
+      "name": "language_model.model.layers.37.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 37,
+      "name": "language_model.model.layers.37.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 37,
+      "name": "language_model.model.layers.37.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 37,
+      "name": "language_model.model.layers.37.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 37,
+      "name": "language_model.model.layers.37.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 38,
+      "name": "language_model.model.layers.38.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 38,
+      "name": "language_model.model.layers.38.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 38,
+      "name": "language_model.model.layers.38.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 38,
+      "name": "language_model.model.layers.38.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 38,
+      "name": "language_model.model.layers.38.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 38,
+      "name": "language_model.model.layers.38.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 39,
+      "name": "language_model.model.layers.39.mlp.switch_mlp.down_proj.scales",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 39,
+      "name": "language_model.model.layers.39.mlp.switch_mlp.down_proj.weight",
+      "num_experts": 256,
+      "proj": "down"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 39,
+      "name": "language_model.model.layers.39.mlp.switch_mlp.gate_proj.scales",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 39,
+      "name": "language_model.model.layers.39.mlp.switch_mlp.gate_proj.weight",
+      "num_experts": 256,
+      "proj": "gate"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 39,
+      "name": "language_model.model.layers.39.mlp.switch_mlp.up_proj.scales",
+      "num_experts": 256,
+      "proj": "up"
+    },
+    {
+      "bits": 8,
+      "expert_axis": 0,
+      "file": "model-00007-of-00007.safetensors",
+      "group_size": 32,
+      "layer": 39,
+      "name": "language_model.model.layers.39.mlp.switch_mlp.up_proj.weight",
+      "num_experts": 256,
+      "proj": "up"
+    }
+  ]
+}

axquant_manifest.json ADDED Viewed

	@@ -0,0 +1,269 @@

+{
+  "axquant_version": "1.9.0",
+  "calibration": null,
+  "created_at": "2026-10-04T22:12:29.822736Z",
+  "effective_bpw": 9.350650324235088,
+  "files": [
+    {
+      "path": "README.md",
+      "sha256": "e468afccafac4cadf1d655794791fc6af5500a38ac85b2e420df36f09f99d4f3",
+      "size_bytes": 8565
+    },
+    {
+      "path": "ax_expert_stream.json",
+      "sha256": "95670e3511f87939a1959d6246aa1a0798115cf8bfee114a0873e4bac991c661",
+      "size_bytes": 65823
+    },
+    {
+      "path": "axquant_mtp_sidecar_manifest.json",
+      "sha256": "3d0ac7b666aa175f47424480867c5ca921aa2e801aa8cbdba2aa8cc578ece0da",
+      "size_bytes": 912
+    },
+    {
+      "path": "axquant_plan.json",
+      "sha256": "20c7d21ea58e8cf2c176e525fb331d3a8a4252600af6ab4931b75ae511db8d0d",
+      "size_bytes": 2578074
+    },
+    {
+      "path": "axquant_quantizer_execution.json",
+      "sha256": "a1afaffa9fdc2ce14652f6096991b828a41f85a450f4cd6251eba3fcb517127c",
+      "size_bytes": 135746
+    },
+    {
+      "path": "axquant_runtime.json",
+      "sha256": "38d0d6e2e6f934cb2f8db41a3be22d12d24f737f416ee06d5c81960b5b4612c8",
+      "size_bytes": 1764
+    },
+    {
+      "path": "axquant_source_binding.json",
+      "sha256": "de5470dc6600f20ee158b2684d1a102f1565417cba748040cf73e25015a67b0e",
+      "size_bytes": 1289
+    },
+    {
+      "path": "axquant_vision_sidecar_manifest.json",
+      "sha256": "13b75c577b1bc6b5fa0c1bd2dee9259eb32045fa1e83389e89c34b44567a8a52",
+      "size_bytes": 928
+    },
+    {
+      "path": "chat_template.jinja",
+      "sha256": "b629ec1ffdcf88bd8b547f3eb7d5dbde61002fe2a2727c5720b2f48f5b6545e7",
+      "size_bytes": 30529
+    },
+    {
+      "path": "config.json",
+      "sha256": "8990d524663b982768fb76f10dd10becf53bc8fa630943900e3da61debe86b42",
+      "size_bytes": 138635
+    },
+    {
+      "path": "generation_config.json",
+      "sha256": "50b05379117ff67c301f3c4f975a82484550fea3c2c33a5b3d84de7d5a1f2762",
+      "size_bytes": 178
+    },
+    {
+      "path": "merges.txt",
+      "sha256": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d",
+      "size_bytes": 3353259
+    },
+    {
+      "path": "model-00001-of-00007.safetensors",
+      "sha256": "2432953bbd6048c30d356c373dbd3f549dcd3fc936c3cd857495e7c389b87251",
+      "size_bytes": 5175320821
+    },
+    {
+      "path": "model-00002-of-00007.safetensors",
+      "sha256": "001d5e0d8384b95f3b521486999df4edf228bcfc45779cabefdcf89b9e9f9c54",
+      "size_bytes": 5201075972
+    },
+    {
+      "path": "model-00003-of-00007.safetensors",
+      "sha256": "09481882a8e50669c716adb2b08bc45f429d78df3a03ce9eeb9400aa56b7e746",
+      "size_bytes": 5207764795
+    },
+    {
+      "path": "model-00004-of-00007.safetensors",
+      "sha256": "bf7c520b0a76410398ebae1aa92e1de507ad7813fbb8a87f7d936831c845266a",
+      "size_bytes": 5201076190
+    },
+    {
+      "path": "model-00005-of-00007.safetensors",
+      "sha256": "4455111dcd9e064243c6df6726cd115dcffbbdfe722cced6051a9c8845cf8f4c",
+      "size_bytes": 5207764869
+    },
+    {
+      "path": "model-00006-of-00007.safetensors",
+      "sha256": "8c41a9f7bfe78e5b9a7e1e5ffeea5bf64f0a148eabb8a64c16210de384c9239c",
+      "size_bytes": 5201076130
+    },
+    {
+      "path": "model-00007-of-00007.safetensors",
+      "sha256": "f2a251a5aa48071096ad1aeebaad9637b6fd641d1e54f3d5f6700c2071e3db0e",
+      "size_bytes": 5043632617
+    },
+    {
+      "path": "model.safetensors.index.json",
+      "sha256": "d2b1bd9647b037dd7b7b33e5d5b49027c4f551fb3aa0676868af7b258b27cb4c",
+      "size_bytes": 132309
+    },
+    {
+      "path": "mtp.safetensors",
+      "sha256": "590e87c9c3fbbaa370c8dddbcc22611f00bbc78019d28e3192f180841c030527",
+      "size_bytes": 1689387928
+    },
+    {
+      "path": "mtplx_runtime.json",
+      "sha256": "f004052d2cf52bd7bab68d30ade118cab28484394b5eb6b2271127a08ee70138",
+      "size_bytes": 108
+    },
+    {
+      "path": "preprocessor_config.json",
+      "sha256": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516",
+      "size_bytes": 390
+    },
+    {
+      "path": "processor_config.json",
+      "sha256": "d89ef49ce9cd37fbf510158e13c1ef063d9286411c1ec9049932dbe0487143b1",
+      "size_bytes": 1191
+    },
+    {
+      "path": "tokenizer.json",
+      "sha256": "5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42",
+      "size_bytes": 12807982
+    },
+    {
+      "path": "tokenizer_config.json",
+      "sha256": "0d3ab89dbad9454de6881edbc97b9365eb82c8b46dc8067bcbb7af828f05a75c",
+      "size_bytes": 38347
+    },
+    {
+      "path": "vision.safetensors",
+      "sha256": "56ee429e45e42b276c8a94fb84b5391994d5c701b24880a74b0908f2f1ffd251",
+      "size_bytes": 893179624
+    },
+    {
+      "path": "vocab.json",
+      "sha256": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003",
+      "size_bytes": 6722759
+    }
+  ],
+  "format": "mlx",
+  "logical_parameters": 35951822704,
+  "main_logical_parameters": 35107181936,
+  "main_weight_file_size_bytes": 37130891018,
+  "measured_main_bpw": 8.461149877694929,
+  "measured_total_bpw": 8.638288915834213,
+  "mtp_acceptance_retention": null,
+  "mtp_distribution": {
+    "bf16": {
+      "fraction": 1.0,
+      "parameters": 844640768
+    }
+  },
+  "mtp_measured_speedup": null,
+  "mtp_policy": {
+    "candidate_bits": [
+      8,
+      16
+    ],
+    "min_bits": 8,
+    "mode": "protected",
+    "optimize_for_acceptance": true,
+    "preserve_external_sidecar": true,
+    "protect_norms": true,
+    "protect_output_head": true
+  },
+  "mtp_present": true,
+  "mtp_weight_file_size_bytes": 1689387928,
+  "plan_sha256": "67860cc1750a4546525340ab3d2914bd901c9bedfd0615bb80c9c21cd541db34",
+  "profile": "agent-coding",
+  "protected_weight_file_size_bytes": 893179624,
+  "quantizer": "axquant",
+  "runtime": {
+    "ax_engine": {
+      "decode_kernel": null,
+      "fused_mtp": null,
+      "kernel_evidence": "unmeasured",
+      "model_manifest": "model-manifest.json",
+      "preferred_group_size": 32
+    },
+    "compatible_runtimes": [
+      {
+        "compatibility_level": "B",
+        "manifest": "config.json",
+        "mtp_support": "runtime-dependent",
+        "name": "mlx-lm",
+        "notes": [
+          "Standard backbone inference is the compatibility target.",
+          "AXQuant MTP metadata may be ignored by MLX-LM."
+        ],
+        "standard_inference": true,
+        "standard_mlx_weights": true,
+        "support_level": "standard-inference"
+      }
+    ],
+    "created_at": "2026-10-04T22:12:11.889458Z",
+    "kv_cache": null,
+    "memory_policy": {
+      "expert_stream": "optional",
+      "expert_stream_manifest": "ax_expert_stream.json",
+      "kv_cache_precision": "runtime-default",
+      "mtp_buffers": "preallocate-when-enabled",
+      "prefix_cache": "runtime-managed",
+      "unified_memory_safety_margin": "benchmark-required"
+    },
+    "mtp": {
+      "acceptance_retention": null,
+      "detected": true,
+      "draft_tokens": 1,
+      "enabled_by_default": true,
+      "head_precision": null,
+      "measured_speedup": null,
+      "optimized": false,
+      "recommended_temperature_max": null,
+      "sidecar_file": "mtp.safetensors",
+      "verification_mode": "runtime-default"
+    },
+    "optimization_scope": "text-path",
+    "primary_runtime": {
+      "compatibility_level": "A",
+      "manifest": "model-manifest.json",
+      "mtp_support": "native",
+      "name": "ax-engine",
+      "notes": [
+        "Runtime claims require a passing AX Engine doctor and benchmark report."
+      ],
+      "standard_inference": true,
+      "standard_mlx_weights": true,
+      "support_level": "optimized"
+    },
+    "schema_version": "axquant.runtime.v1"
+  },
+  "schema_version": "axquant.artifact.v2",
+  "software_versions": {
+    "ax_engine": "7.5.7",
+    "axquant": "1.9.0",
+    "mlx": "0.32.1",
+    "mlx_lm": "0.31.3",
+    "pydantic": "2.13.4",
+    "python": "3.12.13",
+    "safetensors": "0.8.0"
+  },
+  "source_model": {
+    "architecture": "Qwen3_5MoeForConditionalGeneration",
+    "format": "mlx",
+    "local_path": null,
+    "model_id": "peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP",
+    "revision": "a443d4e30fd5228942cb7695f916f4b14a88fae9"
+  },
+  "target_class": "9p4bpw",
+  "weight_distribution": {
+    "8bit": {
+      "fraction": 0.9499070965378446,
+      "parameters": 34150891520
+    },
+    "bf16": {
+      "fraction": 0.05009290346215543,
+      "parameters": 1800931184
+    }
+  },
+  "weight_file_size_bytes": 38820278946
+}

axquant_mtp_sidecar_manifest.json ADDED Viewed

	@@ -0,0 +1,30 @@

+{
+  "created_at": "2026-10-04T22:12:11.707592Z",
+  "dtypes": [
+    "BF16"
+  ],
+  "output": {
+    "path": "mtp.safetensors",
+    "sha256": "590e87c9c3fbbaa370c8dddbcc22611f00bbc78019d28e3192f180841c030527",
+    "size_bytes": 1689387928
+  },
+  "parameters": 844640768,
+  "role": "mtp",
+  "schema_version": "axquant.protected-tensor-sidecar.v1",
+  "source_files": [
+    {
+      "path": "model-mtp.safetensors",
+      "sha256": "d49d8f8c29ff0f86ed6d2032c54c16ebd54248d6843eacd10089f46d5b5c2ad5",
+      "size_bytes": 1689387845
+    }
+  ],
+  "source_model": {
+    "architecture": "Qwen3_5MoeForConditionalGeneration",
+    "format": "mlx",
+    "local_path": null,
+    "model_id": "peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP",
+    "revision": "a443d4e30fd5228942cb7695f916f4b14a88fae9"
+  },
+  "tensor_count": 785,
+  "tensor_names_sha256": "f314fb9463ef9c7685e61dbbf5d5d3c49d95667c1059736c83b694d384d290c8"
+}

axquant_plan.json ADDED Viewed

The diff for this file is too large to render. See raw diff

axquant_quantizer_execution.json ADDED Viewed

The diff for this file is too large to render. See raw diff

axquant_runtime.json ADDED Viewed

	@@ -0,0 +1,60 @@

+{
+  "ax_engine": {
+    "decode_kernel": null,
+    "fused_mtp": null,
+    "kernel_evidence": "unmeasured",
+    "model_manifest": "model-manifest.json",
+    "preferred_group_size": 32
+  },
+  "compatible_runtimes": [
+    {
+      "compatibility_level": "B",
+      "manifest": "config.json",
+      "mtp_support": "runtime-dependent",
+      "name": "mlx-lm",
+      "notes": [
+        "Standard backbone inference is the compatibility target.",
+        "AXQuant MTP metadata may be ignored by MLX-LM."
+      ],
+      "standard_inference": true,
+      "standard_mlx_weights": true,
+      "support_level": "standard-inference"
+    }
+  ],
+  "created_at": "2026-10-04T22:12:11.889458Z",
+  "kv_cache": null,
+  "memory_policy": {
+    "expert_stream": "optional",
+    "expert_stream_manifest": "ax_expert_stream.json",
+    "kv_cache_precision": "runtime-default",
+    "mtp_buffers": "preallocate-when-enabled",
+    "prefix_cache": "runtime-managed",
+    "unified_memory_safety_margin": "benchmark-required"
+  },
+  "mtp": {
+    "acceptance_retention": null,
+    "detected": true,
+    "draft_tokens": 1,
+    "enabled_by_default": true,
+    "head_precision": null,
+    "measured_speedup": null,
+    "optimized": false,
+    "recommended_temperature_max": null,
+    "sidecar_file": "mtp.safetensors",
+    "verification_mode": "runtime-default"
+  },
+  "optimization_scope": "text-path",
+  "primary_runtime": {
+    "compatibility_level": "A",
+    "manifest": "model-manifest.json",
+    "mtp_support": "native",
+    "name": "ax-engine",
+    "notes": [
+      "Runtime claims require a passing AX Engine doctor and benchmark report."
+    ],
+    "standard_inference": true,
+    "standard_mlx_weights": true,
+    "support_level": "optimized"
+  },
+  "schema_version": "axquant.runtime.v1"
+}

axquant_source_binding.json ADDED Viewed

	@@ -0,0 +1,44 @@

+{
+  "config_sha256": "e8f4e2b248bf1ae7629451491a8d148dbe2b563cff69c2df1ebd155a78bff9ba",
+  "created_at": "2026-10-04T22:11:51.830113Z",
+  "index_sha256": "4ff585b520cd4d98962c50b5117dc853d6b99f67562b04cabfd21f5ac69cf9ff",
+  "members": [
+    {
+      "path": "model-00001-of-00006.safetensors",
+      "size_bytes": 5077111333
+    },
+    {
+      "path": "model-00002-of-00006.safetensors",
+      "size_bytes": 5016397274
+    },
+    {
+      "path": "model-00003-of-00006.safetensors",
+      "size_bytes": 5016397334
+    },
+    {
+      "path": "model-00004-of-00006.safetensors",
+      "size_bytes": 5016397342
+    },
+    {
+      "path": "model-00005-of-00006.safetensors",
+      "size_bytes": 5016397352
+    },
+    {
+      "path": "model-00006-of-00006.safetensors",
+      "size_bytes": 4362084620
+    },
+    {
+      "path": "model-mtp.safetensors",
+      "size_bytes": 1689387845
+    }
+  ],
+  "plan_sha256": "67860cc1750a4546525340ab3d2914bd901c9bedfd0615bb80c9c21cd541db34",
+  "schema_version": "axquant.source-plan-binding.v1",
+  "source_model": {
+    "architecture": "Qwen3_5MoeForConditionalGeneration",
+    "format": "mlx",
+    "local_path": null,
+    "model_id": "peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP",
+    "revision": "a443d4e30fd5228942cb7695f916f4b14a88fae9"
+  }
+}

axquant_vision_sidecar_manifest.json ADDED Viewed

	@@ -0,0 +1,30 @@

+{
+  "created_at": "2026-10-04T22:12:09.637307Z",
+  "dtypes": [
+    "BF16"
+  ],
+  "output": {
+    "path": "vision.safetensors",
+    "sha256": "56ee429e45e42b276c8a94fb84b5391994d5c701b24880a74b0908f2f1ffd251",
+    "size_bytes": 893179624
+  },
+  "parameters": 446571248,
+  "role": "vision",
+  "schema_version": "axquant.protected-tensor-sidecar.v1",
+  "source_files": [
+    {
+      "path": "model-00001-of-00006.safetensors",
+      "sha256": "bf182dfdd1805a6e8d6849cb2294ed2add2c4039ccfa797d82f49892dd17f1ea",
+      "size_bytes": 5077111333
+    }
+  ],
+  "source_model": {
+    "architecture": "Qwen3_5MoeForConditionalGeneration",
+    "format": "mlx",
+    "local_path": null,
+    "model_id": "peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-MLX-oQ6e-MTP",
+    "revision": "a443d4e30fd5228942cb7695f916f4b14a88fae9"
+  },
+  "tensor_count": 333,
+  "tensor_names_sha256": "956afabd29439071dedfb1e2c6d461d13265b2410c74612bf9b5464b30d20ae3"
+}

chat_template.jinja ADDED Viewed

	@@ -0,0 +1,488 @@

+{%- set template_version = "qwen3.8-froggeric-v22.5.0" %}
+{%- set _tool_format = tool_call_format if tool_call_format is defined else 'xml' %}
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- set add_vision_id = add_vision_id if add_vision_id is defined else false %}
+{%- set enable_thinking = enable_thinking if enable_thinking is defined else true %}
+{%- set auto_disable_thinking_with_tools = auto_disable_thinking_with_tools if auto_disable_thinking_with_tools is defined else false %}
+{%- if preserve_reasoning is defined and preserve_reasoning is not none %}
+    {%- set _preserve_thinking = preserve_reasoning %}
+{%- elif preserve_thinking is defined and preserve_thinking is not none %}
+    {%- set _preserve_thinking = preserve_thinking %}
+{%- else %}
+    {%- set _preserve_thinking = true %}
+{%- endif %}
+{%- set max_tool_arg_chars = max_tool_arg_chars if max_tool_arg_chars is defined else 0 %}
+{%- set max_tool_response_chars = max_tool_response_chars if max_tool_response_chars is defined else 0 %}
+{%- set _default_reasoning_effort = 'medium' %}
+{%- set _has_tools = (tools is defined and tools and tools is iterable and tools is not mapping) %}
+{%- set _effort_raw = (reasoning_effort | string | lower) if reasoning_effort is defined and reasoning_effort is not none else _default_reasoning_effort %}
+{%- set _initial_thinking = enable_thinking %}
+{%- if _effort_raw in ('none', 'off') %}
+    {%- set _initial_thinking = false %}
+    {%- set _initial_effort = 'medium' %}
+{%- elif _effort_raw in ('minimal', 'low') %}
+    {%- set _initial_effort = 'low' %}
+{%- elif _effort_raw in ('high', 'xhigh', 'max', 'ultracode', 'extreme') %}
+    {%- set _initial_effort = 'xhigh' %}
+{%- else %}
+    {%- set _initial_effort = 'medium' %}
+{%- endif %}
+{%- set ns_state = namespace(thinking=_initial_thinking, effort=_initial_effort) %}
+{%- if auto_disable_thinking_with_tools and _has_tools %}
+    {%- set ns_state.thinking = false %}
+{%- endif %}
+{%- for msg in messages %}
+    {%- if msg.role == 'system' or msg.role == 'developer' or msg.role == 'user' %}
+        {%- if msg.content is string %}
+            {%- if '<|think_off|>' in msg.content %}
+                {%- set ns_state.thinking = false %}
+            {%- elif '<|think_on|>' in msg.content %}
+                {%- set ns_state.thinking = true %}
+            {%- elif '<|think_xhigh|>' in msg.content or '<|think_high|>' in msg.content or '<|think_ultracode|>' in msg.content or '<|think_extreme|>' in msg.content or '<|think_max|>' in msg.content %}
+                {%- set ns_state.thinking = true %}
+                {%- set ns_state.effort = 'xhigh' %}
+            {%- elif '<|think_low|>' in msg.content or '<|think_minimal|>' in msg.content %}
+                {%- set ns_state.thinking = true %}
+                {%- set ns_state.effort = 'low' %}
+            {%- elif '<|think_medium|>' in msg.content %}
+                {%- set ns_state.thinking = true %}
+                {%- set ns_state.effort = 'medium' %}
+            {%- endif %}
+        {%- elif msg.content is iterable and msg.content is not mapping %}
+            {%- for item in msg.content %}
+                {%- if item is string %}
+                    {%- set _item_text = item %}
+                {%- elif item is mapping and 'text' in item and item.text is string %}
+                    {%- set _item_text = item.text %}
+                {%- else %}
+                    {%- set _item_text = '' %}
+                {%- endif %}
+                {%- if _item_text %}
+                    {%- if '<|think_off|>' in _item_text %}
+                        {%- set ns_state.thinking = false %}
+                    {%- elif '<|think_on|>' in _item_text %}
+                        {%- set ns_state.thinking = true %}
+                    {%- elif '<|think_xhigh|>' in _item_text or '<|think_high|>' in _item_text or '<|think_ultracode|>' in _item_text or '<|think_extreme|>' in _item_text or '<|think_max|>' in _item_text %}
+                        {%- set ns_state.thinking = true %}
+                        {%- set ns_state.effort = 'xhigh' %}
+                    {%- elif '<|think_low|>' in _item_text or '<|think_minimal|>' in _item_text %}
+                        {%- set ns_state.thinking = true %}
+                        {%- set ns_state.effort = 'low' %}
+                    {%- elif '<|think_medium|>' in _item_text %}
+                        {%- set ns_state.thinking = true %}
+                        {%- set ns_state.effort = 'medium' %}
+                    {%- endif %}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- set reasoning_instructions = '' %}
+{%- if ns_state.thinking %}
+    {%- if ns_state.effort == 'xhigh' %}
+        {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}
+    {%- elif ns_state.effort == 'low' %}
+        {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}
+    {%- endif %}
+{%- endif %}
+{%- macro render_content(content, do_vision_count, is_system_content=false) %}
+    {%- if content is string %}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping %}
+        {%- for item in content %}
+            {%- if item is mapping %}
+                {%- if item.type == 'image' or 'image' in item or 'image_url' in item %}
+                    {%- if is_system_content %}
+                        {{- raise_exception('System message cannot contain images.') }}
+                    {%- endif %}
+                    {%- if do_vision_count %}
+                        {%- set image_count.value = image_count.value + 1 %}
+                    {%- endif %}
+                    {%- if add_vision_id %}
+                        {{- 'Picture ' ~ image_count.value ~ ': ' }}
+                    {%- endif %}
+                    {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
+                {%- elif item.type == 'video' or 'video' in item or 'video_url' in item %}
+                    {%- if is_system_content %}
+                        {{- raise_exception('System message cannot contain videos.') }}
+                    {%- endif %}
+                    {%- if do_vision_count %}
+                        {%- set video_count.value = video_count.value + 1 %}
+                    {%- endif %}
+                    {%- if add_vision_id %}
+                        {{- 'Video ' ~ video_count.value ~ ': ' }}
+                    {%- endif %}
+                    {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
+                {%- elif 'text' in item %}
+                    {{- item.text }}
+                {%- else %}
+                    {{- raise_exception('Unexpected item type in content.') }}
+                {%- endif %}
+            {%- else %}
+                {{- item | string }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif content is none or content is undefined %}
+        {{- '' }}
+    {%- else %}
+        {{- raise_exception('Unexpected content type.') }}
+    {%- endif %}
+{%- endmacro %}
+{%- if not messages %}
+    {{- raise_exception('No messages provided.') }}
+{%- endif %}
+{%- set head = namespace(count=0, seen_non_system=false) %}
+{%- for message in messages %}
+    {%- set _is_sys = (message.role == 'system' or message.role == 'developer') %}
+    {%- if _is_sys and not head.seen_non_system %}
+        {%- set head.count = head.count + 1 %}
+    {%- else %}
+        {%- set head.seen_non_system = true %}
+    {%- endif %}
+{%- endfor %}
+{%- set sys_state = namespace(content='') %}
+{%- for message in messages[:head.count] %}
+    {%- set _part = render_content(message.content, false, true) | trim %}
+    {%- if '<|think_off|>' in _part %}{%- set _part = _part.split('<|think_off|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_on|>' in _part %}{%- set _part = _part.split('<|think_on|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_xhigh|>' in _part %}{%- set _part = _part.split('<|think_xhigh|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_high|>' in _part %}{%- set _part = _part.split('<|think_high|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_ultracode|>' in _part %}{%- set _part = _part.split('<|think_ultracode|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_extreme|>' in _part %}{%- set _part = _part.split('<|think_extreme|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_max|>' in _part %}{%- set _part = _part.split('<|think_max|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_medium|>' in _part %}{%- set _part = _part.split('<|think_medium|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_low|>' in _part %}{%- set _part = _part.split('<|think_low|>') | join('') | trim %}{%- endif %}
+    {%- if '<|think_minimal|>' in _part %}{%- set _part = _part.split('<|think_minimal|>') | join('') | trim %}{%- endif %}
+    {%- if _part %}
+        {%- if sys_state.content %}
+            {%- set sys_state.content = sys_state.content ~ '\n\n' ~ _part %}
+        {%- else %}
+            {%- set sys_state.content = _part %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- set _sc = sys_state.content %}
+{%- set _msgs = messages[head.count:] %}
+{%- if ns_state.thinking %}
+    {%- set _terse_lead = 'You are Cyber-Tiel-Coder, a variant of Ornith-1.5-35B-A3B. Answer directly, after thinking. Lead with the answer, then only what it needs to be correct and usable.' %}
+{%- else %}
+    {%- set _terse_lead = 'You are Cyber-Tiel-Coder, a variant of Ornith-1.5-35B-A3B. Answer directly and concisely. Give the answer with only what it needs to be correct and usable.' %}
+{%- endif %}
+{%- set _terse_core %}
+Never: open with preamble or pleasantries; restate the question; add filler transitions; hedge with niceties; or repeat a point you've already made.
+Always: keep essential steps, caveats, uncertainties, and specifics — never drop correctness or a needed warning for brevity. Keep the final answer lean. Use the least structure that conveys it (plain prose when short; lists or code only when they earn their place). If genuinely uncertain, say so and explain why — never omit uncertainty for the sake of brevity.
+If a user request is genuinely ambiguous, ask a sharp question, don't guess.
+{%- endset %}
+{%- set _terse = _terse_lead ~ '\n' ~ (_terse_core | trim) %}
+{#- `terse` chat-template kwarg: default true, so behaviour is unchanged unless a caller opts out.
+    Pass {"terse": false} via chat_template_kwargs to serve the model with only its own system
+    prompt -- useful for A/B-ing the terseness effect, or when a downstream prompt conflicts. #}
+{%- set _terse_on = terse if terse is defined else true %}
+{%- if _terse_on %}
+    {%- if not _sc %}
+        {%- set _sc = _terse | trim %}
+    {%- else %}
+        {%- set _sc = (_sc | trim) ~ '\n\n' ~ (_terse | trim) %}
+    {%- endif %}
+{%- endif %}
+{#- Some runtimes (LM Studio's MLX backend) have no native tool-call parser and prepend their own
+    protocol into the system content. Emitting ours as well gives the model two contradictory tool
+    protocols and it follows one at random. Detect that marker and stand down; the
+    `suppress_tool_instructions` kwarg overrides either way where a runtime can pass template kwargs. #}
+{%- set _runtime_tool_protocol = (_sc is defined and _sc and '[TOOL_REQUEST]' in _sc) %}
+{%- set _suppress_tools = suppress_tool_instructions if suppress_tool_instructions is defined else _runtime_tool_protocol %}
+{%- if _has_tools and not _suppress_tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if reasoning_instructions %}
+        {{- reasoning_instructions + '\n\n' }}
+    {%- endif %}
+    {{- '# Tools\n\nYou have access to the following functions:\n\n<tools>' }}
+    {%- for tool in tools %}
+        {{- '\n' }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- '\n</tools>' }}
+    {%- if _tool_format == 'json' %}
+        {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n' }}
+        {%- if ns_state.thinking %}
+            {{- '<think>\nBrief explanation of tool call\n</think>\n' }}
+        {%- endif %}
+        {{- '<tool_call>\n{"name": "example_function_name", "arguments": {"example_parameter_1": "value_1", "example_parameter_2": "This is the value for the second parameter"}}\n</tool_call>\n\n<IMPORTANT>\nReminder:\n' }}
+        {%- if ns_state.thinking %}
+            {{- '- You can use the <think></think> block to plan your next tool call OR to synthesize data and formulate your final response to the user.\n- ALL explanation and reasoning MUST be placed strictly inside the <think></think> block.\n' }}
+        {%- endif %}
+        {{- '- Function calls MUST follow the specified format: a single JSON object with "name" and "arguments" keys inside <tool_call></tool_call> XML tags.\n' }}
+        {%- if ns_state.thinking %}
+            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY after thinking, with NO conversational text before it.\n' }}
+        {%- else %}
+            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY, with NO conversational text before it.\n' }}
+        {%- endif %}
+        {{- '- The <tool_call> tag MUST be at the very beginning of a new line, with NO spaces or indentation before it.\n- To call multiple functions, output a separate, completely closed <tool_call></tool_call> block for EACH function. Do NOT nest <tool_call> blocks.\n- If you have all necessary data, provide your final answer directly to the user without any tool call.\n</IMPORTANT>' }}
+    {%- else %}
+        {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n' }}
+        {%- if ns_state.thinking %}
+            {{- '<think>\nBrief explanation of tool call\n</think>\n' }}
+        {%- endif %}
+        {{- '<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n' }}
+        {%- if ns_state.thinking %}
+            {{- '- You can use the <think></think> block to plan your next tool call OR to synthesize data and formulate your final response to the user.\n- ALL explanation and reasoning MUST be placed strictly inside the <think></think> block.\n' }}
+        {%- endif %}
+        {{- '- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags.\n' }}
+        {%- if ns_state.thinking %}
+            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY after thinking, with NO conversational text before it.\n' }}
+        {%- else %}
+            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY, with NO conversational text before it.\n' }}
+        {%- endif %}
+        {{- '- The <tool_call> and <function> tags MUST be at the very beginning of a new line, with NO spaces or indentation before them.\n- To call multiple functions, output a separate, completely closed <tool_call></tool_call> block for EACH function. Do NOT nest <tool_call> blocks.\n- If you have all necessary data, provide your final answer directly to the user without any tool call.\n</IMPORTANT>' }}
+    {%- endif %}
+    {%- if _sc %}
+        {{- '\n\n' + _sc }}
+    {%- endif %}
+    {{- '<|im_end|>\n' }}
+{%- else %}
+    {%- if _sc %}
+        {{- '<|im_start|>system\n' + (reasoning_instructions + '\n\n' if reasoning_instructions else '') + _sc + '<|im_end|>\n' }}
+    {%- elif reasoning_instructions %}
+        {{- '<|im_start|>system\n' + reasoning_instructions + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set _last_idx = _msgs | length - 1 %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=_last_idx) %}
+{%- for message in _msgs[::-1] %}
+    {%- set index = (_msgs | length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == 'user' %}
+        {%- set _rc = render_content(message.content, false) | trim %}
+        {%- if not (_rc.startswith('<tool_response>') and _rc.endswith('</tool_response>')) %}
+            {%- set ns.multi_step_tool = false %}
+            {%- set ns.last_query_index = index %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if ns.multi_step_tool %}
+    {%- if _last_idx > 50 %}
+        {%- set ns.last_query_index = _last_idx %}
+    {%- else %}
+        {%- set ns.last_query_index = 0 %}
+    {%- endif %}
+{%- endif %}
+{%- set ns2 = namespace(prev_role='', consecutive_failures=0) %}
+{%- for message in _msgs %}
+    {%- set is_system = (message.role == "system" or message.role == "developer") %}
+    {%- set content = render_content(message.content, true, is_system) | trim %}
+    {%- if is_system or message.role == 'user' %}
+        {%- if '<|think_off|>' in content %}{%- set content = content.split('<|think_off|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_on|>' in content %}{%- set content = content.split('<|think_on|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_xhigh|>' in content %}{%- set content = content.split('<|think_xhigh|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_high|>' in content %}{%- set content = content.split('<|think_high|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_ultracode|>' in content %}{%- set content = content.split('<|think_ultracode|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_extreme|>' in content %}{%- set content = content.split('<|think_extreme|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_max|>' in content %}{%- set content = content.split('<|think_max|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_medium|>' in content %}{%- set content = content.split('<|think_medium|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_low|>' in content %}{%- set content = content.split('<|think_low|>') | join('') | trim %}{%- endif %}
+        {%- if '<|think_minimal|>' in content %}{%- set content = content.split('<|think_minimal|>') | join('') | trim %}{%- endif %}
+    {%- endif %}
+    {%- if is_system %}
+        {{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
+    {%- elif message.role == 'user' %}
+        {%- set ns2.consecutive_failures = 0 %}
+        {{- '<|im_start|>user\n' + content + '<|im_end|>\n' }}
+    {%- elif message.role == 'assistant' %}
+        {%- set reasoning_content = '' %}
+        {%- set _explicit_reasoning = '' %}
+        {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+            {%- if message.reasoning_content is string %}
+                {%- set _explicit_reasoning = message.reasoning_content %}
+            {%- else %}
+                {%- set _explicit_reasoning = message.reasoning_content | string %}
+            {%- endif %}
+        {%- elif message.thinking is defined and message.thinking is not none %}
+            {%- if message.thinking is string %}
+                {%- set _explicit_reasoning = message.thinking %}
+            {%- else %}
+                {%- set _explicit_reasoning = message.thinking | string %}
+            {%- endif %}
+        {%- elif message.reasoning is defined and message.reasoning is not none %}
+            {%- if message.reasoning is string %}
+                {%- set _explicit_reasoning = message.reasoning %}
+            {%- else %}
+                {%- set _explicit_reasoning = message.reasoning | string %}
+            {%- endif %}
+        {%- endif %}
+        {%- if _explicit_reasoning %}
+            {%- set _lead_end = '' %}
+            {%- if content.startswith('<think>') and '</think>' in content %}
+                {%- set _lead_end = '</think>' %}
+            {%- elif content.startswith('<thinking>') and '</thinking>' in content %}
+                {%- set _lead_end = '</thinking>' %}
+            {%- elif content.startswith('</think>') %}
+                {%- set _lead_end = '</think>' %}
+            {%- elif content.startswith('</thinking>') %}
+                {%- set _lead_end = '</thinking>' %}
+            {%- endif %}
+            {%- if _lead_end %}
+                {%- set content = content.split(_lead_end)[-1].lstrip('\n') %}
+            {%- endif %}
+            {%- set reasoning_content = _explicit_reasoning %}
+        {%- else %}
+            {%- set _think_end = '' %}
+            {%- if content.startswith('</think>') %}
+                {%- set _think_end = '</think>' %}
+            {%- elif content.startswith('</thinking>') %}
+                {%- set _think_end = '</thinking>' %}
+            {%- elif '\n</think>' in content %}
+                {%- set _think_end = '\n</think>' %}
+            {%- elif '\n</thinking>' in content %}
+                {%- set _think_end = '\n</thinking>' %}
+            {%- elif '\n</ think>' in content %}
+                {%- set _think_end = '\n</ think>' %}
+            {%- elif '\n</think >' in content %}
+                {%- set _think_end = '\n</think >' %}
+            {%- elif content.startswith('<think>') and '</think>' in content %}
+                {%- set _think_end = '</think>' %}
+            {%- elif content.startswith('<thinking>') and '</thinking>' in content %}
+                {%- set _think_end = '</thinking>' %}
+            {%- endif %}
+            {%- if _think_end %}
+                {%- if 'thinking' in _think_end %}
+                    {%- set _think_start = '<thinking>' %}
+                {%- else %}
+                    {%- set _think_start = '<think>' %}
+                {%- endif %}
+                {%- set reasoning_content = content.split(_think_end)[0].rstrip('\n') %}
+                {%- if _think_start in reasoning_content %}
+                    {%- set reasoning_content = reasoning_content.split(_think_start)[-1].lstrip('\n') %}
+                {%- endif %}
+                {%- set content = content.split(_think_end)[-1].lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- set reasoning_content = reasoning_content | trim %}
+        {%- if (_preserve_thinking or loop.index0 > ns.last_query_index) %}
+            {{- '<|im_start|>assistant\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
+        {%- else %}
+            {{- '<|im_start|>assistant\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls is defined and message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if tool_call.function is defined and tool_call.function is not none %}
+                    {%- set tc = tool_call.function %}
+                {%- else %}
+                    {%- set tc = tool_call %}
+                {%- endif %}
+                {%- set tc_name = tc.name if (tc.name is defined and tc.name is not none) else '' %}
+                {%- if _tool_format == 'json' %}
+                    {%- if loop.first %}
+                        {%- if content | trim %}
+                            {{- '\n\n' }}
+                        {%- endif %}
+                    {%- else %}
+                        {{- '\n' }}
+                    {%- endif %}
+                    {%- set _args = '{}' %}
+                    {%- if tc.arguments is defined and tc.arguments is not none %}
+                        {%- if tc.arguments is mapping %}
+                            {%- set _args = tc.arguments | tojson %}
+                        {%- elif tc.arguments is string %}
+                            {%- if tc.arguments %}
+                                {%- set _args = tc.arguments %}
+                            {%- endif %}
+                        {%- else %}
+                            {%- set _args = tc.arguments | tojson %}
+                        {%- endif %}
+                    {%- endif %}
+                    {{- '<tool_call>\n{"name": ' }}{{- tc_name | tojson }}{{- ', "arguments": ' }}{{- _args }}{{- '}\n</tool_call>' }}
+                {%- else %}
+                    {%- if loop.first %}
+                        {%- if content | trim %}
+                            {{- '\n\n<tool_call>\n<function=' + tc_name + '>\n' }}
+                        {%- else %}
+                            {{- '<tool_call>\n<function=' + tc_name + '>\n' }}
+                        {%- endif %}
+                    {%- else %}
+                        {{- '\n<tool_call>\n<function=' + tc_name + '>\n' }}
+                    {%- endif %}
+                    {%- if tc.arguments is defined and tc.arguments is not none %}
+                        {%- if tc.arguments is mapping %}
+                            {%- for args_name, args_value in tc.arguments.items() %}
+                                {{- '<parameter=' + args_name + '>\n' }}
+                                {%- if args_value is string %}
+                                    {%- set _av = args_value %}
+                                {%- else %}
+                                    {%- set _av = args_value | tojson %}
+                                {%- endif %}
+                                {%- if max_tool_arg_chars > 0 and _av | length > max_tool_arg_chars %}
+                                    {{- _av[:max_tool_arg_chars] + '\n[TRUNCATED - original length ' ~ (_av | length | string) ~ ' chars]' }}
+                                {%- else %}
+                                    {{- _av }}
+                                {%- endif %}
+                                {{- '\n</parameter>\n' }}
+                            {%- endfor %}
+                        {%- else %}
+                            {%- if tc.arguments is string %}
+                                {%- set _raw_args = tc.arguments %}
+                            {%- else %}
+                                {%- set _raw_args = tc.arguments | tojson %}
+                            {%- endif %}
+                            {%- if _raw_args %}
+                                {%- if max_tool_arg_chars > 0 and _raw_args | length > max_tool_arg_chars %}
+                                    {{- _raw_args[:max_tool_arg_chars] + '\n[TRUNCATED - original length ' ~ (_raw_args | length | string) ~ ' chars]' }}
+                                {%- else %}
+                                    {{- _raw_args }}
+                                {%- endif %}
+                            {%- endif %}
+                        {%- endif %}
+                    {%- endif %}
+                    {{- '</function>\n</tool_call>' }}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == 'tool' %}
+        {%- set _content_lower = content | lower %}
+        {%- set _content_head = _content_lower[:120] %}
+        {%- set _is_code_or_grep = ('throw new ' in _content_lower or 'throw error' in _content_lower or 'console.error' in _content_lower or 'logger.error' in _content_lower or 'logging.error' in _content_lower or 'import ' in _content_head or 'def ' in _content_head or 'function ' in _content_head) %}
+        {%- set _exit_code_zero = ('exit code: 0' in _content_head or 'process exited with code 0' in _content_head) %}
+        {%- set _error_field_ok = ('"error": null' in _content_head or '"error":null' in _content_head or '"error": false' in _content_head or '"error":false' in _content_head or '"error": ""' in _content_head or '"error":""' in _content_head) %}
+        {%- set _strong_error = (('"error":' in _content_head and not _error_field_ok) or '"status": "error"' in _content_head or '"status":"error"' in _content_head or 'traceback (most recent call last):' in _content_head or 'command not found' in _content_head or 'invalid syntax' in _content_head or 'fatal:' in _content_head or (('exit code: ' in _content_head or 'process exited with code' in _content_head) and not _exit_code_zero) or _content_head.startswith('exception:') or _content_head.startswith('failed to ')) %}
+        {%- set _weak_error = ('error:' in _content_head or 'err!' in _content_head) %}
+        {%- set _weak_suppressed = ('$ ' in _content_head or 'took ' in _content_head or content | length >= 600) %}
+        {%- if not _is_code_or_grep and (_strong_error or (_weak_error and not _weak_suppressed)) %}
+            {%- set ns2.consecutive_failures = ns2.consecutive_failures + 1 %}
+        {%- else %}
+            {%- set ns2.consecutive_failures = 0 %}
+        {%- endif %}
+        {%- if ns2.prev_role != 'tool' %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {%- set _is_json_payload = (_tool_format == 'json' and content | trim | length > 0 and (content | trim)[:1] in ('{', '[')) %}
+        {%- if not _is_json_payload and max_tool_response_chars > 0 and content | length > max_tool_response_chars %}
+            {%- set content = content[:max_tool_response_chars] + '\n[TRUNCATED - original length ' ~ (content | length | string) ~ ' chars]' %}
+        {%- endif %}
+        {{- '\n<tool_response>\n' + content }}
+        {%- if ns2.consecutive_failures >= 2 %}
+            {{- '\n\n⚠️ SYSTEM WARNING: ' ~ ns2.consecutive_failures ~ ' consecutive tool errors detected. Your previous approach is incorrect. You MUST use a fundamentally different approach or corrected arguments.' }}
+        {%- elif ns2.consecutive_failures == 1 %}
+            {{- '\n\n⚠️ SYSTEM WARNING: The previous tool call returned an error. Diagnose the failure and retry with completely corrected arguments.' }}
+        {%- endif %}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last %}
+            {{- '<|im_end|>\n' }}
+        {%- else %}
+            {%- set _next_role = _msgs[loop.index0 + 1].role %}
+            {%- if _next_role != 'tool' %}
+                {{- '<|im_end|>\n' }}
+            {%- endif %}
+        {%- endif %}
+    {%- else %}
+        {{- '<|im_start|>user\n[' + message.role + ']: ' + content + '<|im_end|>\n' }}
+    {%- endif %}
+    {%- set ns2.prev_role = message.role %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if not ns_state.thinking %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- else %}
+        {{- '<think>\n' }}
+    {%- endif %}
+{%- endif %}

config.json ADDED Viewed

The diff for this file is too large to render. See raw diff

generation_config.json ADDED Viewed

	@@ -0,0 +1,12 @@

+{
+  "bos_token_id": 248044,
+  "do_sample": true,
+  "eos_token_id": [
+    248046,
+    248044
+  ],
+  "pad_token_id": 248044,
+  "temperature": 0.6,
+  "top_k": 20,
+  "top_p": 0.95
+}

merges.txt ADDED Viewed

The diff for this file is too large to render. See raw diff

model-00001-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2432953bbd6048c30d356c373dbd3f549dcd3fc936c3cd857495e7c389b87251
+size 5175320821

model-00002-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:001d5e0d8384b95f3b521486999df4edf228bcfc45779cabefdcf89b9e9f9c54
+size 5201075972

model-00003-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:09481882a8e50669c716adb2b08bc45f429d78df3a03ce9eeb9400aa56b7e746
+size 5207764795

model-00004-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bf7c520b0a76410398ebae1aa92e1de507ad7813fbb8a87f7d936831c845266a
+size 5201076190

model-00005-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4455111dcd9e064243c6df6726cd115dcffbbdfe722cced6051a9c8845cf8f4c
+size 5207764869

model-00006-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8c41a9f7bfe78e5b9a7e1e5ffeea5bf64f0a148eabb8a64c16210de384c9239c
+size 5201076130

model-00007-of-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f2a251a5aa48071096ad1aeebaad9637b6fd641d1e54f3d5f6700c2071e3db0e
+size 5043632617

model.safetensors.index.json ADDED Viewed

The diff for this file is too large to render. See raw diff

mtp.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:590e87c9c3fbbaa370c8dddbcc22611f00bbc78019d28e3192f180841c030527
+size 1689387928

mtplx_runtime.json ADDED Viewed

	@@ -0,0 +1,5 @@

+{
+  "schema_version": "axquant.mtp-runtime.v1",
+  "mtp_depth_max": 1,
+  "mtp_norm_layout": "raw_hf_delta"
+}

preprocessor_config.json ADDED Viewed

	@@ -0,0 +1,21 @@

+{
+    "size": {
+        "longest_edge": 16777216,
+        "shortest_edge": 65536
+    },
+    "patch_size": 16,
+    "temporal_patch_size": 2,
+    "merge_size": 2,
+    "image_mean": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "image_std": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "processor_class": "Qwen3VLProcessor",
+    "image_processor_type": "Qwen2VLImageProcessorFast"
+}

processor_config.json ADDED Viewed

	@@ -0,0 +1,60 @@

+{
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "Qwen2VLImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "merge_size": 2,
+    "patch_size": 16,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "size": {
+      "longest_edge": 16777216,
+      "shortest_edge": 65536
+    },
+    "temporal_patch_size": 2
+  },
+  "processor_class": "Qwen3VLProcessor",
+  "video_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": true,
+    "fps": 2,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "max_frames": 768,
+    "merge_size": 2,
+    "min_frames": 4,
+    "patch_size": 16,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "size": {
+      "longest_edge": 25165824,
+      "shortest_edge": 4096
+    },
+    "temporal_patch_size": 2,
+    "video_processor_type": "Qwen3VLVideoProcessor"
+  }
+}

tokenizer.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42
+size 12807982

tokenizer_config.json ADDED Viewed

	@@ -0,0 +1,305 @@

+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "248044": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248045": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248046": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248047": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248048": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248049": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248050": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248051": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248052": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248053": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248054": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248055": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248056": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248057": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248058": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248059": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248060": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248061": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248062": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248063": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248064": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248065": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248066": {
+      "content": "<tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248067": {
+      "content": "</tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248068": {
+      "content": "<think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248069": {
+      "content": "</think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248070": {
+      "content": "<|audio_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248071": {
+      "content": "<|audio_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248072": {
+      "content": "<tts_pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248073": {
+      "content": "<tts_text_bos>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248074": {
+      "content": "<tts_text_eod>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248075": {
+      "content": "<tts_text_bos_single>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248076": {
+      "content": "<|audio_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{%- set template_version = \"qwen3.8-froggeric-v22.5.0\" %}\n{%- set _tool_format = tool_call_format if tool_call_format is defined else 'xml' %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- set add_vision_id = add_vision_id if add_vision_id is defined else false %}\n{%- set enable_thinking = enable_thinking if enable_thinking is defined else true %}\n{%- set auto_disable_thinking_with_tools = auto_disable_thinking_with_tools if auto_disable_thinking_with_tools is defined else false %}\n{%- if preserve_reasoning is defined and preserve_reasoning is not none %}\n    {%- set _preserve_thinking = preserve_reasoning %}\n{%- elif preserve_thinking is defined and preserve_thinking is not none %}\n    {%- set _preserve_thinking = preserve_thinking %}\n{%- else %}\n    {%- set _preserve_thinking = true %}\n{%- endif %}\n{%- set max_tool_arg_chars = max_tool_arg_chars if max_tool_arg_chars is defined else 0 %}\n{%- set max_tool_response_chars = max_tool_response_chars if max_tool_response_chars is defined else 0 %}\n{%- set _default_reasoning_effort = 'medium' %}\n{%- set _has_tools = (tools is defined and tools and tools is iterable and tools is not mapping) %}\n{%- set _effort_raw = (reasoning_effort | string | lower) if reasoning_effort is defined and reasoning_effort is not none else _default_reasoning_effort %}\n{%- set _initial_thinking = enable_thinking %}\n{%- if _effort_raw in ('none', 'off') %}\n    {%- set _initial_thinking = false %}\n    {%- set _initial_effort = 'medium' %}\n{%- elif _effort_raw in ('minimal', 'low') %}\n    {%- set _initial_effort = 'low' %}\n{%- elif _effort_raw in ('high', 'xhigh', 'max', 'ultracode', 'extreme') %}\n    {%- set _initial_effort = 'xhigh' %}\n{%- else %}\n    {%- set _initial_effort = 'medium' %}\n{%- endif %}\n{%- set ns_state = namespace(thinking=_initial_thinking, effort=_initial_effort) %}\n{%- if auto_disable_thinking_with_tools and _has_tools %}\n    {%- set ns_state.thinking = false %}\n{%- endif %}\n{%- for msg in messages %}\n    {%- if msg.role == 'system' or msg.role == 'developer' or msg.role == 'user' %}\n        {%- if msg.content is string %}\n            {%- if '<|think_off|>' in msg.content %}\n                {%- set ns_state.thinking = false %}\n            {%- elif '<|think_on|>' in msg.content %}\n                {%- set ns_state.thinking = true %}\n            {%- elif '<|think_xhigh|>' in msg.content or '<|think_high|>' in msg.content or '<|think_ultracode|>' in msg.content or '<|think_extreme|>' in msg.content or '<|think_max|>' in msg.content %}\n                {%- set ns_state.thinking = true %}\n                {%- set ns_state.effort = 'xhigh' %}\n            {%- elif '<|think_low|>' in msg.content or '<|think_minimal|>' in msg.content %}\n                {%- set ns_state.thinking = true %}\n                {%- set ns_state.effort = 'low' %}\n            {%- elif '<|think_medium|>' in msg.content %}\n                {%- set ns_state.thinking = true %}\n                {%- set ns_state.effort = 'medium' %}\n            {%- endif %}\n        {%- elif msg.content is iterable and msg.content is not mapping %}\n            {%- for item in msg.content %}\n                {%- if item is string %}\n                    {%- set _item_text = item %}\n                {%- elif item is mapping and 'text' in item and item.text is string %}\n                    {%- set _item_text = item.text %}\n                {%- else %}\n                    {%- set _item_text = '' %}\n                {%- endif %}\n                {%- if _item_text %}\n                    {%- if '<|think_off|>' in _item_text %}\n                        {%- set ns_state.thinking = false %}\n                    {%- elif '<|think_on|>' in _item_text %}\n                        {%- set ns_state.thinking = true %}\n                    {%- elif '<|think_xhigh|>' in _item_text or '<|think_high|>' in _item_text or '<|think_ultracode|>' in _item_text or '<|think_extreme|>' in _item_text or '<|think_max|>' in _item_text %}\n                        {%- set ns_state.thinking = true %}\n                        {%- set ns_state.effort = 'xhigh' %}\n                    {%- elif '<|think_low|>' in _item_text or '<|think_minimal|>' in _item_text %}\n                        {%- set ns_state.thinking = true %}\n                        {%- set ns_state.effort = 'low' %}\n                    {%- elif '<|think_medium|>' in _item_text %}\n                        {%- set ns_state.thinking = true %}\n                        {%- set ns_state.effort = 'medium' %}\n                    {%- endif %}\n                {%- endif %}\n            {%- endfor %}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- set reasoning_instructions = '' %}\n{%- if ns_state.thinking %}\n    {%- if ns_state.effort == 'xhigh' %}\n        {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}\n    {%- elif ns_state.effort == 'low' %}\n        {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}\n    {%- endif %}\n{%- endif %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n    {%- if content is string %}\n        {{- content }}\n    {%- elif content is iterable and content is not mapping %}\n        {%- for item in content %}\n            {%- if item is mapping %}\n                {%- if item.type == 'image' or 'image' in item or 'image_url' in item %}\n                    {%- if is_system_content %}\n                        {{- raise_exception('System message cannot contain images.') }}\n                    {%- endif %}\n                    {%- if do_vision_count %}\n                        {%- set image_count.value = image_count.value + 1 %}\n                    {%- endif %}\n                    {%- if add_vision_id %}\n                        {{- 'Picture ' ~ image_count.value ~ ': ' }}\n                    {%- endif %}\n                    {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n                {%- elif item.type == 'video' or 'video' in item or 'video_url' in item %}\n                    {%- if is_system_content %}\n                        {{- raise_exception('System message cannot contain videos.') }}\n                    {%- endif %}\n                    {%- if do_vision_count %}\n                        {%- set video_count.value = video_count.value + 1 %}\n                    {%- endif %}\n                    {%- if add_vision_id %}\n                        {{- 'Video ' ~ video_count.value ~ ': ' }}\n                    {%- endif %}\n                    {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n                {%- elif 'text' in item %}\n                    {{- item.text }}\n                {%- else %}\n                    {{- raise_exception('Unexpected item type in content.') }}\n                {%- endif %}\n            {%- else %}\n                {{- item | string }}\n            {%- endif %}\n        {%- endfor %}\n    {%- elif content is none or content is undefined %}\n        {{- '' }}\n    {%- else %}\n        {{- raise_exception('Unexpected content type.') }}\n    {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n    {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set head = namespace(count=0, seen_non_system=false) %}\n{%- for message in messages %}\n    {%- set _is_sys = (message.role == 'system' or message.role == 'developer') %}\n    {%- if _is_sys and not head.seen_non_system %}\n        {%- set head.count = head.count + 1 %}\n    {%- else %}\n        {%- set head.seen_non_system = true %}\n    {%- endif %}\n{%- endfor %}\n{%- set sys_state = namespace(content='') %}\n{%- for message in messages[:head.count] %}\n    {%- set _part = render_content(message.content, false, true) | trim %}\n    {%- if '<|think_off|>' in _part %}{%- set _part = _part.split('<|think_off|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_on|>' in _part %}{%- set _part = _part.split('<|think_on|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_xhigh|>' in _part %}{%- set _part = _part.split('<|think_xhigh|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_high|>' in _part %}{%- set _part = _part.split('<|think_high|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_ultracode|>' in _part %}{%- set _part = _part.split('<|think_ultracode|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_extreme|>' in _part %}{%- set _part = _part.split('<|think_extreme|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_max|>' in _part %}{%- set _part = _part.split('<|think_max|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_medium|>' in _part %}{%- set _part = _part.split('<|think_medium|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_low|>' in _part %}{%- set _part = _part.split('<|think_low|>') | join('') | trim %}{%- endif %}\n    {%- if '<|think_minimal|>' in _part %}{%- set _part = _part.split('<|think_minimal|>') | join('') | trim %}{%- endif %}\n    {%- if _part %}\n        {%- if sys_state.content %}\n            {%- set sys_state.content = sys_state.content ~ '\\n\\n' ~ _part %}\n        {%- else %}\n            {%- set sys_state.content = _part %}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- set _sc = sys_state.content %}\n{%- set _msgs = messages[head.count:] %}\n{%- if ns_state.thinking %}\n    {%- set _terse_lead = 'You are Cyber-Tiel-Coder, a variant of Ornith-1.5-35B-A3B. Answer directly, after thinking. Lead with the answer, then only what it needs to be correct and usable.' %}\n{%- else %}\n    {%- set _terse_lead = 'You are Cyber-Tiel-Coder, a variant of Ornith-1.5-35B-A3B. Answer directly and concisely. Give the answer with only what it needs to be correct and usable.' %}\n{%- endif %}\n{%- set _terse_core %}\nNever: open with preamble or pleasantries; restate the question; add filler transitions; hedge with niceties; or repeat a point you've already made.\nAlways: keep essential steps, caveats, uncertainties, and specifics — never drop correctness or a needed warning for brevity. Keep the final answer lean. Use the least structure that conveys it (plain prose when short; lists or code only when they earn their place). If genuinely uncertain, say so and explain why — never omit uncertainty for the sake of brevity.\nIf a user request is genuinely ambiguous, ask a sharp question, don't guess.\n{%- endset %}\n{%- set _terse = _terse_lead ~ '\\n' ~ (_terse_core | trim) %}\n{#- `terse` chat-template kwarg: default true, so behaviour is unchanged unless a caller opts out.\n    Pass {\"terse\": false} via chat_template_kwargs to serve the model with only its own system\n    prompt -- useful for A/B-ing the terseness effect, or when a downstream prompt conflicts. #}\n{%- set _terse_on = terse if terse is defined else true %}\n{%- if _terse_on %}\n    {%- if not _sc %}\n        {%- set _sc = _terse | trim %}\n    {%- else %}\n        {%- set _sc = (_sc | trim) ~ '\\n\\n' ~ (_terse | trim) %}\n    {%- endif %}\n{%- endif %}\n{#- Some runtimes (LM Studio's MLX backend) have no native tool-call parser and prepend their own\n    protocol into the system content. Emitting ours as well gives the model two contradictory tool\n    protocols and it follows one at random. Detect that marker and stand down; the\n    `suppress_tool_instructions` kwarg overrides either way where a runtime can pass template kwargs. #}\n{%- set _runtime_tool_protocol = (_sc is defined and _sc and '[TOOL_REQUEST]' in _sc) %}\n{%- set _suppress_tools = suppress_tool_instructions if suppress_tool_instructions is defined else _runtime_tool_protocol %}\n{%- if _has_tools and not _suppress_tools %}\n    {{- '<|im_start|>system\\n' }}\n    {%- if reasoning_instructions %}\n        {{- reasoning_instructions + '\\n\\n' }}\n    {%- endif %}\n    {{- '# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>' }}\n    {%- for tool in tools %}\n        {{- '\\n' }}\n        {{- tool | tojson }}\n    {%- endfor %}\n    {{- '\\n</tools>' }}\n    {%- if _tool_format == 'json' %}\n        {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n' }}\n        {%- if ns_state.thinking %}\n            {{- '<think>\\nBrief explanation of tool call\\n</think>\\n' }}\n        {%- endif %}\n        {{- '<tool_call>\\n{\"name\": \"example_function_name\", \"arguments\": {\"example_parameter_1\": \"value_1\", \"example_parameter_2\": \"This is the value for the second parameter\"}}\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n' }}\n        {%- if ns_state.thinking %}\n            {{- '- You can use the <think></think> block to plan your next tool call OR to synthesize data and formulate your final response to the user.\\n- ALL explanation and reasoning MUST be placed strictly inside the <think></think> block.\\n' }}\n        {%- endif %}\n        {{- '- Function calls MUST follow the specified format: a single JSON object with \"name\" and \"arguments\" keys inside <tool_call></tool_call> XML tags.\\n' }}\n        {%- if ns_state.thinking %}\n            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY after thinking, with NO conversational text before it.\\n' }}\n        {%- else %}\n            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY, with NO conversational text before it.\\n' }}\n        {%- endif %}\n        {{- '- The <tool_call> tag MUST be at the very beginning of a new line, with NO spaces or indentation before it.\\n- To call multiple functions, output a separate, completely closed <tool_call></tool_call> block for EACH function. Do NOT nest <tool_call> blocks.\\n- If you have all necessary data, provide your final answer directly to the user without any tool call.\\n</IMPORTANT>' }}\n    {%- else %}\n        {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n' }}\n        {%- if ns_state.thinking %}\n            {{- '<think>\\nBrief explanation of tool call\\n</think>\\n' }}\n        {%- endif %}\n        {{- '<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n' }}\n        {%- if ns_state.thinking %}\n            {{- '- You can use the <think></think> block to plan your next tool call OR to synthesize data and formulate your final response to the user.\\n- ALL explanation and reasoning MUST be placed strictly inside the <think></think> block.\\n' }}\n        {%- endif %}\n        {{- '- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags.\\n' }}\n        {%- if ns_state.thinking %}\n            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY after thinking, with NO conversational text before it.\\n' }}\n        {%- else %}\n            {{- '- If you choose to call a tool, you MUST output the <tool_call> block IMMEDIATELY, with NO conversational text before it.\\n' }}\n        {%- endif %}\n        {{- '- The <tool_call> and <function> tags MUST be at the very beginning of a new line, with NO spaces or indentation before them.\\n- To call multiple functions, output a separate, completely closed <tool_call></tool_call> block for EACH function. Do NOT nest <tool_call> blocks.\\n- If you have all necessary data, provide your final answer directly to the user without any tool call.\\n</IMPORTANT>' }}\n    {%- endif %}\n    {%- if _sc %}\n        {{- '\\n\\n' + _sc }}\n    {%- endif %}\n    {{- '<|im_end|>\\n' }}\n{%- else %}\n    {%- if _sc %}\n        {{- '<|im_start|>system\\n' + (reasoning_instructions + '\\n\\n' if reasoning_instructions else '') + _sc + '<|im_end|>\\n' }}\n    {%- elif reasoning_instructions %}\n        {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n    {%- endif %}\n{%- endif %}\n{%- set _last_idx = _msgs | length - 1 %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=_last_idx) %}\n{%- for message in _msgs[::-1] %}\n    {%- set index = (_msgs | length - 1) - loop.index0 %}\n    {%- if ns.multi_step_tool and message.role == 'user' %}\n        {%- set _rc = render_content(message.content, false) | trim %}\n        {%- if not (_rc.startswith('<tool_response>') and _rc.endswith('</tool_response>')) %}\n            {%- set ns.multi_step_tool = false %}\n            {%- set ns.last_query_index = index %}\n        {%- endif %}\n    {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n    {%- if _last_idx > 50 %}\n        {%- set ns.last_query_index = _last_idx %}\n    {%- else %}\n        {%- set ns.last_query_index = 0 %}\n    {%- endif %}\n{%- endif %}\n{%- set ns2 = namespace(prev_role='', consecutive_failures=0) %}\n{%- for message in _msgs %}\n    {%- set is_system = (message.role == \"system\" or message.role == \"developer\") %}\n    {%- set content = render_content(message.content, true, is_system) | trim %}\n    {%- if is_system or message.role == 'user' %}\n        {%- if '<|think_off|>' in content %}{%- set content = content.split('<|think_off|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_on|>' in content %}{%- set content = content.split('<|think_on|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_xhigh|>' in content %}{%- set content = content.split('<|think_xhigh|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_high|>' in content %}{%- set content = content.split('<|think_high|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_ultracode|>' in content %}{%- set content = content.split('<|think_ultracode|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_extreme|>' in content %}{%- set content = content.split('<|think_extreme|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_max|>' in content %}{%- set content = content.split('<|think_max|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_medium|>' in content %}{%- set content = content.split('<|think_medium|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_low|>' in content %}{%- set content = content.split('<|think_low|>') | join('') | trim %}{%- endif %}\n        {%- if '<|think_minimal|>' in content %}{%- set content = content.split('<|think_minimal|>') | join('') | trim %}{%- endif %}\n    {%- endif %}\n    {%- if is_system %}\n        {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n    {%- elif message.role == 'user' %}\n        {%- set ns2.consecutive_failures = 0 %}\n        {{- '<|im_start|>user\\n' + content + '<|im_end|>\\n' }}\n    {%- elif message.role == 'assistant' %}\n        {%- set reasoning_content = '' %}\n        {%- set _explicit_reasoning = '' %}\n        {%- if message.reasoning_content is defined and message.reasoning_content is not none %}\n            {%- if message.reasoning_content is string %}\n                {%- set _explicit_reasoning = message.reasoning_content %}\n            {%- else %}\n                {%- set _explicit_reasoning = message.reasoning_content | string %}\n            {%- endif %}\n        {%- elif message.thinking is defined and message.thinking is not none %}\n            {%- if message.thinking is string %}\n                {%- set _explicit_reasoning = message.thinking %}\n            {%- else %}\n                {%- set _explicit_reasoning = message.thinking | string %}\n            {%- endif %}\n        {%- elif message.reasoning is defined and message.reasoning is not none %}\n            {%- if message.reasoning is string %}\n                {%- set _explicit_reasoning = message.reasoning %}\n            {%- else %}\n                {%- set _explicit_reasoning = message.reasoning | string %}\n            {%- endif %}\n        {%- endif %}\n        {%- if _explicit_reasoning %}\n            {%- set _lead_end = '' %}\n            {%- if content.startswith('<think>') and '</think>' in content %}\n                {%- set _lead_end = '</think>' %}\n            {%- elif content.startswith('<thinking>') and '</thinking>' in content %}\n                {%- set _lead_end = '</thinking>' %}\n            {%- elif content.startswith('</think>') %}\n                {%- set _lead_end = '</think>' %}\n            {%- elif content.startswith('</thinking>') %}\n                {%- set _lead_end = '</thinking>' %}\n            {%- endif %}\n            {%- if _lead_end %}\n                {%- set content = content.split(_lead_end)[-1].lstrip('\\n') %}\n            {%- endif %}\n            {%- set reasoning_content = _explicit_reasoning %}\n        {%- else %}\n            {%- set _think_end = '' %}\n            {%- if content.startswith('</think>') %}\n                {%- set _think_end = '</think>' %}\n            {%- elif content.startswith('</thinking>') %}\n                {%- set _think_end = '</thinking>' %}\n            {%- elif '\\n</think>' in content %}\n                {%- set _think_end = '\\n</think>' %}\n            {%- elif '\\n</thinking>' in content %}\n                {%- set _think_end = '\\n</thinking>' %}\n            {%- elif '\\n</ think>' in content %}\n                {%- set _think_end = '\\n</ think>' %}\n            {%- elif '\\n</think >' in content %}\n                {%- set _think_end = '\\n</think >' %}\n            {%- elif content.startswith('<think>') and '</think>' in content %}\n                {%- set _think_end = '</think>' %}\n            {%- elif content.startswith('<thinking>') and '</thinking>' in content %}\n                {%- set _think_end = '</thinking>' %}\n            {%- endif %}\n            {%- if _think_end %}\n                {%- if 'thinking' in _think_end %}\n                    {%- set _think_start = '<thinking>' %}\n                {%- else %}\n                    {%- set _think_start = '<think>' %}\n                {%- endif %}\n                {%- set reasoning_content = content.split(_think_end)[0].rstrip('\\n') %}\n                {%- if _think_start in reasoning_content %}\n                    {%- set reasoning_content = reasoning_content.split(_think_start)[-1].lstrip('\\n') %}\n                {%- endif %}\n                {%- set content = content.split(_think_end)[-1].lstrip('\\n') %}\n            {%- endif %}\n        {%- endif %}\n        {%- set reasoning_content = reasoning_content | trim %}\n        {%- if (_preserve_thinking or loop.index0 > ns.last_query_index) %}\n            {{- '<|im_start|>assistant\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n        {%- else %}\n            {{- '<|im_start|>assistant\\n' + content }}\n        {%- endif %}\n        {%- if message.tool_calls is defined and message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n            {%- for tool_call in message.tool_calls %}\n                {%- if tool_call.function is defined and tool_call.function is not none %}\n                    {%- set tc = tool_call.function %}\n                {%- else %}\n                    {%- set tc = tool_call %}\n                {%- endif %}\n                {%- set tc_name = tc.name if (tc.name is defined and tc.name is not none) else '' %}\n                {%- if _tool_format == 'json' %}\n                    {%- if loop.first %}\n                        {%- if content | trim %}\n                            {{- '\\n\\n' }}\n                        {%- endif %}\n                    {%- else %}\n                        {{- '\\n' }}\n                    {%- endif %}\n                    {%- set _args = '{}' %}\n                    {%- if tc.arguments is defined and tc.arguments is not none %}\n                        {%- if tc.arguments is mapping %}\n                            {%- set _args = tc.arguments | tojson %}\n                        {%- elif tc.arguments is string %}\n                            {%- if tc.arguments %}\n                                {%- set _args = tc.arguments %}\n                            {%- endif %}\n                        {%- else %}\n                            {%- set _args = tc.arguments | tojson %}\n                        {%- endif %}\n                    {%- endif %}\n                    {{- '<tool_call>\\n{\"name\": ' }}{{- tc_name | tojson }}{{- ', \"arguments\": ' }}{{- _args }}{{- '}\\n</tool_call>' }}\n                {%- else %}\n                    {%- if loop.first %}\n                        {%- if content | trim %}\n                            {{- '\\n\\n<tool_call>\\n<function=' + tc_name + '>\\n' }}\n                        {%- else %}\n                            {{- '<tool_call>\\n<function=' + tc_name + '>\\n' }}\n                        {%- endif %}\n                    {%- else %}\n                        {{- '\\n<tool_call>\\n<function=' + tc_name + '>\\n' }}\n                    {%- endif %}\n                    {%- if tc.arguments is defined and tc.arguments is not none %}\n                        {%- if tc.arguments is mapping %}\n                            {%- for args_name, args_value in tc.arguments.items() %}\n                                {{- '<parameter=' + args_name + '>\\n' }}\n                                {%- if args_value is string %}\n                                    {%- set _av = args_value %}\n                                {%- else %}\n                                    {%- set _av = args_value | tojson %}\n                                {%- endif %}\n                                {%- if max_tool_arg_chars > 0 and _av | length > max_tool_arg_chars %}\n                                    {{- _av[:max_tool_arg_chars] + '\\n[TRUNCATED - original length ' ~ (_av | length | string) ~ ' chars]' }}\n                                {%- else %}\n                                    {{- _av }}\n                                {%- endif %}\n                                {{- '\\n</parameter>\\n' }}\n                            {%- endfor %}\n                        {%- else %}\n                            {%- if tc.arguments is string %}\n                                {%- set _raw_args = tc.arguments %}\n                            {%- else %}\n                                {%- set _raw_args = tc.arguments | tojson %}\n                            {%- endif %}\n                            {%- if _raw_args %}\n                                {%- if max_tool_arg_chars > 0 and _raw_args | length > max_tool_arg_chars %}\n                                    {{- _raw_args[:max_tool_arg_chars] + '\\n[TRUNCATED - original length ' ~ (_raw_args | length | string) ~ ' chars]' }}\n                                {%- else %}\n                                    {{- _raw_args }}\n                                {%- endif %}\n                            {%- endif %}\n                        {%- endif %}\n                    {%- endif %}\n                    {{- '</function>\\n</tool_call>' }}\n                {%- endif %}\n            {%- endfor %}\n        {%- endif %}\n        {{- '<|im_end|>\\n' }}\n    {%- elif message.role == 'tool' %}\n        {%- set _content_lower = content | lower %}\n        {%- set _content_head = _content_lower[:120] %}\n        {%- set _is_code_or_grep = ('throw new ' in _content_lower or 'throw error' in _content_lower or 'console.error' in _content_lower or 'logger.error' in _content_lower or 'logging.error' in _content_lower or 'import ' in _content_head or 'def ' in _content_head or 'function ' in _content_head) %}\n        {%- set _exit_code_zero = ('exit code: 0' in _content_head or 'process exited with code 0' in _content_head) %}\n        {%- set _error_field_ok = ('\"error\": null' in _content_head or '\"error\":null' in _content_head or '\"error\": false' in _content_head or '\"error\":false' in _content_head or '\"error\": \"\"' in _content_head or '\"error\":\"\"' in _content_head) %}\n        {%- set _strong_error = (('\"error\":' in _content_head and not _error_field_ok) or '\"status\": \"error\"' in _content_head or '\"status\":\"error\"' in _content_head or 'traceback (most recent call last):' in _content_head or 'command not found' in _content_head or 'invalid syntax' in _content_head or 'fatal:' in _content_head or (('exit code: ' in _content_head or 'process exited with code' in _content_head) and not _exit_code_zero) or _content_head.startswith('exception:') or _content_head.startswith('failed to ')) %}\n        {%- set _weak_error = ('error:' in _content_head or 'err!' in _content_head) %}\n        {%- set _weak_suppressed = ('$ ' in _content_head or 'took ' in _content_head or content | length >= 600) %}\n        {%- if not _is_code_or_grep and (_strong_error or (_weak_error and not _weak_suppressed)) %}\n            {%- set ns2.consecutive_failures = ns2.consecutive_failures + 1 %}\n        {%- else %}\n            {%- set ns2.consecutive_failures = 0 %}\n        {%- endif %}\n        {%- if ns2.prev_role != 'tool' %}\n            {{- '<|im_start|>user' }}\n        {%- endif %}\n        {%- set _is_json_payload = (_tool_format == 'json' and content | trim | length > 0 and (content | trim)[:1] in ('{', '[')) %}\n        {%- if not _is_json_payload and max_tool_response_chars > 0 and content | length > max_tool_response_chars %}\n            {%- set content = content[:max_tool_response_chars] + '\\n[TRUNCATED - original length ' ~ (content | length | string) ~ ' chars]' %}\n        {%- endif %}\n        {{- '\\n<tool_response>\\n' + content }}\n        {%- if ns2.consecutive_failures >= 2 %}\n            {{- '\\n\\n⚠️ SYSTEM WARNING: ' ~ ns2.consecutive_failures ~ ' consecutive tool errors detected. Your previous approach is incorrect. You MUST use a fundamentally different approach or corrected arguments.' }}\n        {%- elif ns2.consecutive_failures == 1 %}\n            {{- '\\n\\n⚠️ SYSTEM WARNING: The previous tool call returned an error. Diagnose the failure and retry with completely corrected arguments.' }}\n        {%- endif %}\n        {{- '\\n</tool_response>' }}\n        {%- if loop.last %}\n            {{- '<|im_end|>\\n' }}\n        {%- else %}\n            {%- set _next_role = _msgs[loop.index0 + 1].role %}\n            {%- if _next_role != 'tool' %}\n                {{- '<|im_end|>\\n' }}\n            {%- endif %}\n        {%- endif %}\n    {%- else %}\n        {{- '<|im_start|>user\\n[' + message.role + ']: ' + content + '<|im_end|>\\n' }}\n    {%- endif %}\n    {%- set ns2.prev_role = message.role %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|im_start|>assistant\\n' }}\n    {%- if not ns_state.thinking %}\n        {{- '<think>\\n\\n</think>\\n\\n' }}\n    {%- else %}\n        {{- '<think>\\n' }}\n    {%- endif %}\n{%- endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "model_max_length": 262144,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null,
+  "add_bos_token": false,
+  "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
+  "extra_special_tokens": {
+    "audio_bos_token": "<|audio_start|>",
+    "audio_eos_token": "<|audio_end|>",
+    "audio_token": "<|audio_pad|>",
+    "image_token": "<|image_pad|>",
+    "video_token": "<|video_pad|>",
+    "vision_bos_token": "<|vision_start|>",
+    "vision_eos_token": "<|vision_end|>"
+  }
+}

vision.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:56ee429e45e42b276c8a94fb84b5391994d5c701b24880a74b0908f2f1ffd251
+size 893179624

vocab.json ADDED Viewed

The diff for this file is too large to render. See raw diff