Instructions to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

MLX LM

How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

Hermes Agent

How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP / runtime_audit.json

AutomatosX

Correct evidenced MXFP8 container mode and bind runtime format audit

edae195 verified 3 days ago

Raw History Blame Contribute Delete

3.95 kB

	{
	"applied_config_corrections": [
	{
	"field": "quantization.mode",
	"new": "mxfp8",
	"old": "affine",
	"physical_evidence_consistent": true
	},
	{
	"field": "quantization_config.mode",
	"new": "mxfp8",
	"old": "affine",
	"physical_evidence_consistent": true
	}
	],
	"current_config_sha256": "19ba4f1e9ca1e1576bf2b3dd1968ce59facb31ea75f4f37271db9e1b01f5bec3",
	"date": "2026-10-06",
	"header_sha256": {
	"model-00001-of-00007.safetensors": "10ff1b6d08c57bf5a77f0d8c2a6a701498ed04284b36d9d56fcba0ebf854f221",
	"model-00002-of-00007.safetensors": "6cd799227928a226b05d9816966dc6ffab93124762f993e96c27328a35bef543",
	"model-00003-of-00007.safetensors": "5fc7dc14699a6bc95a3a3196b1e19883cf7bb2940fc193d3b24326791492ea66",
	"model-00004-of-00007.safetensors": "dba7c367c038632a91f5b8afd3186096c724c257e3b69eba0e22730ff61b5139",
	"model-00005-of-00007.safetensors": "7d7d8ee10cfc768aa1e685ca7c67ecbcf38daf3157db8b298604a0f63cf19392",
	"model-00006-of-00007.safetensors": "5ffbef9f343c1b09483856096c801948a5b72a752a1d18e1ce96c59ce20ee1a0",
	"model-00007-of-00007.safetensors": "1057d271cab088366b759331b14c0c367d182927f826210baed1d47fe40eaad5",
	"mtp.safetensors": "e4ef62590d5569841386b14e6855fde43b03ef1e393822e5eff93dbcbce7a180",
	"vision.safetensors": "15903943ad5dfe22cbf056e186015df8c8df6789a74b423e910497cd77f736e4"
	},
	"input_bindings": {
	"axquant_manifest.json": "afb364d6bd9cb5cdee9bea518ee9681582a451a89e65509287d24f67fbc0531d",
	"axquant_mtp_sidecar_manifest.json": "741823e14934647e617c9cc6d278d42287e7f01efcb71421cf723345a33b18fc",
	"config.json": "8990d524663b982768fb76f10dd10becf53bc8fa630943900e3da61debe86b42",
	"model.safetensors.index.json": "d2b1bd9647b037dd7b7b33e5d5b49027c4f551fb3aa0676868af7b258b27cb4c",
	"mtplx_runtime.json": "f004052d2cf52bd7bab68d30ade118cab28484394b5eb6b2271127a08ee70138"
	},
	"issues": [],
	"model_type": "qwen3_5_moe",
	"mtp_files": [
	"mtp.safetensors"
	],
	"ngram_action": "none; do not invent n-gram data",
	"ngram_files": [],
	"ngram_quantization": [],
	"ngram_table_metadata": null,
	"ngram_tensor_count": 0,
	"quality_certified": false,
	"quantization": {
	"quantization": {
	"container_mode": "affine",
	"per_module_modes": {
	"mxfp8": 511
	},
	"physical_recipe_issues": []
	},
	"quantization_config": {
	"container_mode": "affine",
	"per_module_modes": {
	"mxfp8": 511
	},
	"physical_recipe_issues": []
	}
	},
	"removed_source_evidence": [],
	"repo_id": "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP",
	"runtime_arch_id": null,
	"runtime_verified": false,
	"schema_version": "axquant.hub-runtime-audit.v1",
	"scope": "Pinned remote config/index/Safetensors header audit; no runtime load or generation claim.",
	"source_revision": "02c98769046ba236ffd6b4e930013b9be65b4151",
	"status": "no-audited-peer-export-profile",
	"unchanged_weight_sha256": {
	"model-00001-of-00007.safetensors": "1b0040af5421394bed13f02818a9227499e0da98d27ddf676bd2b919ba4f56de",
	"model-00002-of-00007.safetensors": "37ba6bf75efc302d94bcaa7e26d52ac97e9107104349d113f1506551fe2a47cb",
	"model-00003-of-00007.safetensors": "091715ecbcf62541898c451d5ae3a1f5028b2ea1da54b1ba9c7d0f602d4d0c3e",
	"model-00004-of-00007.safetensors": "3e2f45228836fcea1224dd9f13cbaa416a456e45b7b14b48325da05d44b12177",
	"model-00005-of-00007.safetensors": "b36e935205879c8563c7305fd46646d456419962673571fb3935b061c2115938",
	"model-00006-of-00007.safetensors": "8c79981a35b593af8b2c5becabdce095ed4c32be0de4780c48d317cb3623efd4",
	"model-00007-of-00007.safetensors": "ffa71702e41916d51f965d7781ad0004d735d0b992da15e064a0ed25aa97b2ad",
	"mtp.safetensors": "0ced87b0462269a98bd393a808e1c9c02ace7054801c0e2745dd9dd9a4077915",
	"vision.safetensors": "b6fc71a34d6eeb55216a00fc8aee2bf238a4fce7d4177c6dcc1dbe84e18ae78e"
	}
	}