Image-Text-to-Text
MLX
Safetensors
qwen3_5_moe
mlx-vlm
ornith
qwen3.5-moe
multimodal
abliterated
4-bit precision
conversational
Instructions to use npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit") config = load_config("npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download artifact-manifest.json from npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit: direct link, hf CLI and curl.
- Browser
- Download file 3.33 kB
-
https://huggingface.co/npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit/resolve/main/artifact-manifest.json
- Command line
-
hf download hf://npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit/artifact-manifest.json
-
curl -L -o artifact-manifest.json https://huggingface.co/npario/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit/resolve/main/artifact-manifest.json
3.33 kB
| { | |
| "schema_version": 1, | |
| "generated_at": "2026-08-21T04:03:46.399974+00:00", | |
| "repository": "PocketAiHub/Ornith-1.5-35B-A3B-Abliterated-MLX-4bit", | |
| "base_model": "ornith-ai/Ornith-1.5-35B-A3B", | |
| "base_revision": "e4dfb35a93d4b6822a811a7676f3488514abe7e2", | |
| "variant": "4bit", | |
| "model_payload_bytes": 20429166953, | |
| "files": [ | |
| { | |
| "path": "README.md", | |
| "size_bytes": 4918, | |
| "sha256": "fc3cc1cab7c09e6d3918400f071db6f85665722961f499fda64d52a490bda896" | |
| }, | |
| { | |
| "path": "abliteration-manifest.json", | |
| "size_bytes": 1550, | |
| "sha256": "82d49e30e1d0eca38c23e3b748f6e923562ee3ee7803ecfa5b07558c88caf224" | |
| }, | |
| { | |
| "path": "chat_template.jinja", | |
| "size_bytes": 7536, | |
| "sha256": "182e77dd83bd8e9ca818b240b82e28f243762cd5dda32e6eef327df7b1cd107e" | |
| }, | |
| { | |
| "path": "config.json", | |
| "size_bytes": 24086, | |
| "sha256": "a31b9165854d78fda080b4115d584af9924571458c8f89110f70fbf40cf1878f" | |
| }, | |
| { | |
| "path": "configuration.json", | |
| "size_bytes": 58, | |
| "sha256": "c1b09db419119513247e9b8b912c4b9897106c9b20c6cada7e107d993c5435eb" | |
| }, | |
| { | |
| "path": "generation_config.json", | |
| "size_bytes": 202, | |
| "sha256": "e70c136c1b78ddc1fb0905bac8e733a4dc448d4f852a5dd75143fffc70be550e" | |
| }, | |
| { | |
| "path": "model-00001-of-00004.safetensors", | |
| "size_bytes": 5288196062, | |
| "sha256": "ad2a4e532a2d4785f3f31c594ff39c99200a230a2889b20998d45c10ae66d169" | |
| }, | |
| { | |
| "path": "model-00002-of-00004.safetensors", | |
| "size_bytes": 5368472657, | |
| "sha256": "cea3387a2e2863c6d9444a14b7ab6d89f321edcf63f02e699de6dde4e866e160" | |
| }, | |
| { | |
| "path": "model-00003-of-00004.safetensors", | |
| "size_bytes": 5368324255, | |
| "sha256": "85a877f211adad37e9db68bcd692faa16f9996424521ec8b731cd1114916fb64" | |
| }, | |
| { | |
| "path": "model-00004-of-00004.safetensors", | |
| "size_bytes": 4377211327, | |
| "sha256": "9daf1fb8f47f0bbef6dabe657700e404ee0ccda30037dda91204543ebf20a6e4" | |
| }, | |
| { | |
| "path": "model.safetensors.index.json", | |
| "size_bytes": 215755, | |
| "sha256": "0b28df60e33753a14e816d3b31577ae2c93884c58430a4a6de6ae9ea483842ea" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "size_bytes": 390, | |
| "sha256": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516" | |
| }, | |
| { | |
| "path": "processor_config.json", | |
| "size_bytes": 991, | |
| "sha256": "45fc17c8dd2474af6b493b52483c26c0584b0082d368c480f9fa611e73070040" | |
| }, | |
| { | |
| "path": "tokenizer.json", | |
| "size_bytes": 19989325, | |
| "sha256": "06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "size_bytes": 1165, | |
| "sha256": "792fa3f0cb88b111e54ef3134c873531008c4df471d108da17903426e308aa7b" | |
| }, | |
| { | |
| "path": "validation-summary.json", | |
| "size_bytes": 6573, | |
| "sha256": "4a4d9b642926f21685d47607cba54a717787992cab2f93f34c517d23c0fdf692" | |
| }, | |
| { | |
| "path": "video_preprocessor_config.json", | |
| "size_bytes": 385, | |
| "sha256": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "size_bytes": 6722759, | |
| "sha256": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003" | |
| } | |
| ], | |
| "total_size_bytes": 20429179994 | |
| } | |