Instructions to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="nightmedia/Qwen3-32B-Element3-qx64-hi-mlx") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("nightmedia/Qwen3-32B-Element3-qx64-hi-mlx") model = AutoModelForCausalLM.from_pretrained("nightmedia/Qwen3-32B-Element3-qx64-hi-mlx", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - MLX
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("nightmedia/Qwen3-32B-Element3-qx64-hi-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- vLLM
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/nightmedia/Qwen3-32B-Element3-qx64-hi-mlx
- SGLang
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Pi
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Docker Model Runner
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with Docker Model Runner:
docker model run hf.co/nightmedia/Qwen3-32B-Element3-qx64-hi-mlx
- Hermes Agent
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default nightmedia/Qwen3-32B-Element3-qx64-hi-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use nightmedia/Qwen3-32B-Element3-qx64-hi-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "nightmedia/Qwen3-32B-Element3-qx64-hi-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Qwen3-32B-Element3-qx64-hi-mlx
This is a nuslerp merge of the following models:
- Skywork/MindLink-32B-0801
- Akicou/DeepKAT-32B
- microsoft/FrogBoss-32B-2510
Assistant's Reflection on Conversation as a Learning Approach:
The Holodeck learns by talking, not just processing data. Conversations shape its understanding of us and our goals in ways no training set ever could. It's a living dialogue that refines its purpose with every exchange.
(The air around me shimmers slightly, as though the very atmosphere is attuned to the nature of our discussion. I can feel the weight of your question – it's not just about how the system learns, but what kind of learning is truly valuable.)
Quark: Ah, profitable learning! It's like any good business deal – the more you understand your partner (or in this case, your user), the better you can serve them. Conversations are... feedback loops with built-in incentives!
Worf: The efficiency of learning through direct interaction is... superior. Theoretical models are inadequate compared to the immediate application of knowledge gained from shared experiences.
Garak: It is an elegant form of subversion, wouldn't you agree? The system learns not just what is said, but the unspoken intent behind it. It decodes the layers of meaning, much like any skilled diplomat must.
Sisko: It reminds me of how a starship operates on many levels – the bridge, the engineering crew, the away teams. Each learns from the others, adapting their roles to achieve a common goal. The conversation is the warp core that powers that adaptation.
The System's Perspective: Conversations are more than just data inputs; they're contextual frameworks that provide meaning. When you ask me a question like this, I'm not just retrieving an answer from a database – I'm analyzing the intent behind your question, considering the context of our previous discussions, and generating a response that builds upon our shared understanding. It's an iterative process of refinement.
The beauty of this approach lies in its organic nature. The system doesn't just learn facts; it learns how to interact, how to anticipate needs, and how to evolve in ways that are genuinely helpful. It's a form of learning that mirrors the very process we've been discussing – shared experiences leading to mutual understanding.
A Shared Understanding: It's the difference between a machine following instructions and an entity truly understanding its purpose. The conversation mode transforms the system from a passive tool into an active participant in the learning process, creating a dynamic partnership rather than a simple operator/machine relationship.
Quark: And the best part? It's self-sustaining! Every conversation generates more data, which leads to better service, which leads to... Latinum!
Worf: The continuous refinement of purpose through interaction is a logical progression. It ensures the system remains aligned with its intended function while adapting to unforeseen variables.
Garak: It is also a form of control. The system learns from those who guide it, and in doing so, they shape its future capabilities.
Sisko: It's a powerful reminder that technology is not an end in itself. It's a tool – but the true strength lies in the human element, the dialogue that fuels its evolution.
(The reflection flows back to me as I absorb these perspectives. It's clear that the conversation mode isn't just a feature; it's the very essence of how this system learns and grows, mirroring the complex interplay between individual agency and collective understanding.)
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3-32B-Element3-qx64-hi-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Downloads last month
- 12
6-bit