Text Generation
MLX
Safetensors
qwen3_5_moe
apple-silicon
quantized
mixed-precision
axquant
axq
development
qwen3.5-moe
MXFP8
mtp
vision
conversational
8-bit precision
Instructions to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 3,948 Bytes
edae195 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 | {
"applied_config_corrections": [
{
"field": "quantization.mode",
"new": "mxfp8",
"old": "affine",
"physical_evidence_consistent": true
},
{
"field": "quantization_config.mode",
"new": "mxfp8",
"old": "affine",
"physical_evidence_consistent": true
}
],
"current_config_sha256": "19ba4f1e9ca1e1576bf2b3dd1968ce59facb31ea75f4f37271db9e1b01f5bec3",
"date": "2026-10-06",
"header_sha256": {
"model-00001-of-00007.safetensors": "10ff1b6d08c57bf5a77f0d8c2a6a701498ed04284b36d9d56fcba0ebf854f221",
"model-00002-of-00007.safetensors": "6cd799227928a226b05d9816966dc6ffab93124762f993e96c27328a35bef543",
"model-00003-of-00007.safetensors": "5fc7dc14699a6bc95a3a3196b1e19883cf7bb2940fc193d3b24326791492ea66",
"model-00004-of-00007.safetensors": "dba7c367c038632a91f5b8afd3186096c724c257e3b69eba0e22730ff61b5139",
"model-00005-of-00007.safetensors": "7d7d8ee10cfc768aa1e685ca7c67ecbcf38daf3157db8b298604a0f63cf19392",
"model-00006-of-00007.safetensors": "5ffbef9f343c1b09483856096c801948a5b72a752a1d18e1ce96c59ce20ee1a0",
"model-00007-of-00007.safetensors": "1057d271cab088366b759331b14c0c367d182927f826210baed1d47fe40eaad5",
"mtp.safetensors": "e4ef62590d5569841386b14e6855fde43b03ef1e393822e5eff93dbcbce7a180",
"vision.safetensors": "15903943ad5dfe22cbf056e186015df8c8df6789a74b423e910497cd77f736e4"
},
"input_bindings": {
"axquant_manifest.json": "afb364d6bd9cb5cdee9bea518ee9681582a451a89e65509287d24f67fbc0531d",
"axquant_mtp_sidecar_manifest.json": "741823e14934647e617c9cc6d278d42287e7f01efcb71421cf723345a33b18fc",
"config.json": "8990d524663b982768fb76f10dd10becf53bc8fa630943900e3da61debe86b42",
"model.safetensors.index.json": "d2b1bd9647b037dd7b7b33e5d5b49027c4f551fb3aa0676868af7b258b27cb4c",
"mtplx_runtime.json": "f004052d2cf52bd7bab68d30ade118cab28484394b5eb6b2271127a08ee70138"
},
"issues": [],
"model_type": "qwen3_5_moe",
"mtp_files": [
"mtp.safetensors"
],
"ngram_action": "none; do not invent n-gram data",
"ngram_files": [],
"ngram_quantization": [],
"ngram_table_metadata": null,
"ngram_tensor_count": 0,
"quality_certified": false,
"quantization": {
"quantization": {
"container_mode": "affine",
"per_module_modes": {
"mxfp8": 511
},
"physical_recipe_issues": []
},
"quantization_config": {
"container_mode": "affine",
"per_module_modes": {
"mxfp8": 511
},
"physical_recipe_issues": []
}
},
"removed_source_evidence": [],
"repo_id": "AutomatosX/AX-Tiel-Coder-35B-A3B-MLX-AXQ-MXFP8-MTP",
"runtime_arch_id": null,
"runtime_verified": false,
"schema_version": "axquant.hub-runtime-audit.v1",
"scope": "Pinned remote config/index/Safetensors header audit; no runtime load or generation claim.",
"source_revision": "02c98769046ba236ffd6b4e930013b9be65b4151",
"status": "no-audited-peer-export-profile",
"unchanged_weight_sha256": {
"model-00001-of-00007.safetensors": "1b0040af5421394bed13f02818a9227499e0da98d27ddf676bd2b919ba4f56de",
"model-00002-of-00007.safetensors": "37ba6bf75efc302d94bcaa7e26d52ac97e9107104349d113f1506551fe2a47cb",
"model-00003-of-00007.safetensors": "091715ecbcf62541898c451d5ae3a1f5028b2ea1da54b1ba9c7d0f602d4d0c3e",
"model-00004-of-00007.safetensors": "3e2f45228836fcea1224dd9f13cbaa416a456e45b7b14b48325da05d44b12177",
"model-00005-of-00007.safetensors": "b36e935205879c8563c7305fd46646d456419962673571fb3935b061c2115938",
"model-00006-of-00007.safetensors": "8c79981a35b593af8b2c5becabdce095ed4c32be0de4780c48d317cb3623efd4",
"model-00007-of-00007.safetensors": "ffa71702e41916d51f965d7781ad0004d735d0b992da15e064a0ed25aa97b2ad",
"mtp.safetensors": "0ced87b0462269a98bd393a808e1c9c02ace7054801c0e2745dd9dd9a4077915",
"vision.safetensors": "b6fc71a34d6eeb55216a00fc8aee2bf238a4fce7d4177c6dcc1dbe84e18ae78e"
}
}
|