Image-Text-to-Text
MLX
Safetensors
English
muse_glimmer
mlx-vlm
omlx
muse-glimmer
multimodal
vision-language
quantized
apple-silicon
4-bit precision
conversational
Instructions to use TensorFold/Muse-Glimmer-30B-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use TensorFold/Muse-Glimmer-30B-MLX-4bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("TensorFold/Muse-Glimmer-30B-MLX-4bit") config = load_config("TensorFold/Muse-Glimmer-30B-MLX-4bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use TensorFold/Muse-Glimmer-30B-MLX-4bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "TensorFold/Muse-Glimmer-30B-MLX-4bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "TensorFold/Muse-Glimmer-30B-MLX-4bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use TensorFold/Muse-Glimmer-30B-MLX-4bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "TensorFold/Muse-Glimmer-30B-MLX-4bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default TensorFold/Muse-Glimmer-30B-MLX-4bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use TensorFold/Muse-Glimmer-30B-MLX-4bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "TensorFold/Muse-Glimmer-30B-MLX-4bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "TensorFold/Muse-Glimmer-30B-MLX-4bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Rebrand model card to TensorFold
Browse files
README.md
CHANGED
|
@@ -18,6 +18,11 @@ tags:
|
|
| 18 |
- 4-bit
|
| 19 |
---
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
<p align="center">
|
| 23 |
<img src="https://huggingface.co/front/assets/huggingface_logo-noborder.svg" width="92" alt="Hugging Face logo">
|
|
@@ -27,7 +32,7 @@ tags:
|
|
| 27 |
<p align="center">
|
| 28 |
<img src="https://img.shields.io/badge/Meta-Muse_Glimmer-0467DF?style=for-the-badge&logo=meta&logoColor=white" alt="Meta Muse Glimmer">
|
| 29 |
<img src="https://img.shields.io/badge/Apple_Silicon-MLX-000000?style=for-the-badge&logo=apple&logoColor=white" alt="Apple silicon MLX">
|
| 30 |
-
<img src="https://img.shields.io/badge/
|
| 31 |
</p>
|
| 32 |
|
| 33 |
|
|
@@ -43,7 +48,7 @@ tags:
|
|
| 43 |
<a href="https://huggingface.co/meta-models/Muse-Glimmer-30B">Original model</a> 路
|
| 44 |
<a href="https://github.com/Blaizzy/mlx-vlm">MLX-VLM</a> 路
|
| 45 |
<a href="https://github.com/ml-explore/mlx">MLX</a> 路
|
| 46 |
-
<a href="https://huggingface.co/
|
| 47 |
</p>
|
| 48 |
|
| 49 |
|
|
@@ -121,8 +126,8 @@ Download the checkpoint if a local copy is preferred:
|
|
| 121 |
|
| 122 |
|
| 123 |
```bash
|
| 124 |
-
hf download
|
| 125 |
-
--local-dir ~/.omlx/models/
|
| 126 |
```
|
| 127 |
|
| 128 |
|
|
@@ -133,7 +138,7 @@ hf download Vontra/Muse-Glimmer-30B-MLX-4bit \
|
|
| 133 |
from mlx_vlm import generate, load
|
| 134 |
|
| 135 |
|
| 136 |
-
model, processor = load("
|
| 137 |
tokenizer = processor.tokenizer if hasattr(processor, "tokenizer") else processor
|
| 138 |
messages = [
|
| 139 |
{"role": "user", "content": "Explain unified memory on Apple silicon."}
|
|
@@ -168,7 +173,7 @@ The multimodal path was smoke-tested locally with a real image. Include an image
|
|
| 168 |
from mlx_vlm import generate, load
|
| 169 |
|
| 170 |
|
| 171 |
-
model, processor = load("
|
| 172 |
tokenizer = processor.tokenizer if hasattr(processor, "tokenizer") else processor
|
| 173 |
messages = [
|
| 174 |
{
|
|
@@ -241,14 +246,14 @@ This is a community conversion, not an official Meta release. Validate quality,
|
|
| 241 |
The upstream model is released under the **Apache License 2.0**. The upstream `LICENSE` and `USAGE_POLICY.md` files are included in this repository; use is subject to both the licence and the upstream usage policy.
|
| 242 |
|
| 243 |
|
| 244 |
-
All model design, training, benchmark, and upstream documentation credit belongs to Meta and the original contributors. The MLX conversion, Apple-silicon validation, compatibility work, and model card are provided by [
|
| 245 |
|
| 246 |
|
| 247 |
|
| 248 |
-
<!--
|
| 249 |
## Choose for your Mac
|
| 250 |
|
| 251 |
-
[64GB Macs](https://huggingface.co/collections/
|
| 252 |
|
| 253 |
Published peak memory: **21.33 GB**; estimated starting tier: **64GB**, leaving about **42 GB** nominal headroom. The collections use published M3 Studio peaks with at least 25% nominal headroom; fit on other Macs is an estimate, and full context is not guaranteed. Start with short context and one request.
|
| 254 |
|
|
@@ -259,7 +264,7 @@ The exact tested oMLX application version is not recorded here; a library versio
|
|
| 259 |
### Quick start and demo prompt
|
| 260 |
|
| 261 |
```bash
|
| 262 |
-
hf download
|
| 263 |
```
|
| 264 |
|
| 265 |
Add the downloaded folder to oMLX model directories, refresh the list, and follow this card's architecture and MTP compatibility requirements before loading.
|
|
@@ -272,5 +277,5 @@ Explain why the sky looks blue in three short sentences.
|
|
| 272 |
|
| 273 |
This is a demo prompt to try, not a recorded successful run; a captured demonstration for this documentation update is not yet available.
|
| 274 |
|
| 275 |
-
[Follow
|
| 276 |
-
<!--
|
|
|
|
| 18 |
- 4-bit
|
| 19 |
---
|
| 20 |
|
| 21 |
+
<p align="center">
|
| 22 |
+
<a href="https://tensorfold.dev">
|
| 23 |
+
<img src="https://huggingface.co/spaces/TensorFold/README/resolve/main/tensorfold-logo.png" alt="TensorFold" width="160">
|
| 24 |
+
</a>
|
| 25 |
+
</p>
|
| 26 |
|
| 27 |
<p align="center">
|
| 28 |
<img src="https://huggingface.co/front/assets/huggingface_logo-noborder.svg" width="92" alt="Hugging Face logo">
|
|
|
|
| 32 |
<p align="center">
|
| 33 |
<img src="https://img.shields.io/badge/Meta-Muse_Glimmer-0467DF?style=for-the-badge&logo=meta&logoColor=white" alt="Meta Muse Glimmer">
|
| 34 |
<img src="https://img.shields.io/badge/Apple_Silicon-MLX-000000?style=for-the-badge&logo=apple&logoColor=white" alt="Apple silicon MLX">
|
| 35 |
+
<img src="https://img.shields.io/badge/TensorFold-MLX_VLM-6E56CF?style=for-the-badge&logo=huggingface&logoColor=white" alt="TensorFold MLX VLM">
|
| 36 |
</p>
|
| 37 |
|
| 38 |
|
|
|
|
| 48 |
<a href="https://huggingface.co/meta-models/Muse-Glimmer-30B">Original model</a> 路
|
| 49 |
<a href="https://github.com/Blaizzy/mlx-vlm">MLX-VLM</a> 路
|
| 50 |
<a href="https://github.com/ml-explore/mlx">MLX</a> 路
|
| 51 |
+
<a href="https://huggingface.co/TensorFold">More TensorFold conversions</a>
|
| 52 |
</p>
|
| 53 |
|
| 54 |
|
|
|
|
| 126 |
|
| 127 |
|
| 128 |
```bash
|
| 129 |
+
hf download TensorFold/Muse-Glimmer-30B-MLX-4bit \
|
| 130 |
+
--local-dir ~/.omlx/models/TensorFold/Muse-Glimmer-30B-MLX-4bit
|
| 131 |
```
|
| 132 |
|
| 133 |
|
|
|
|
| 138 |
from mlx_vlm import generate, load
|
| 139 |
|
| 140 |
|
| 141 |
+
model, processor = load("TensorFold/Muse-Glimmer-30B-MLX-4bit")
|
| 142 |
tokenizer = processor.tokenizer if hasattr(processor, "tokenizer") else processor
|
| 143 |
messages = [
|
| 144 |
{"role": "user", "content": "Explain unified memory on Apple silicon."}
|
|
|
|
| 173 |
from mlx_vlm import generate, load
|
| 174 |
|
| 175 |
|
| 176 |
+
model, processor = load("TensorFold/Muse-Glimmer-30B-MLX-4bit")
|
| 177 |
tokenizer = processor.tokenizer if hasattr(processor, "tokenizer") else processor
|
| 178 |
messages = [
|
| 179 |
{
|
|
|
|
| 246 |
The upstream model is released under the **Apache License 2.0**. The upstream `LICENSE` and `USAGE_POLICY.md` files are included in this repository; use is subject to both the licence and the upstream usage policy.
|
| 247 |
|
| 248 |
|
| 249 |
+
All model design, training, benchmark, and upstream documentation credit belongs to Meta and the original contributors. The MLX conversion, Apple-silicon validation, compatibility work, and model card are provided by [TensorFold](https://huggingface.co/TensorFold).
|
| 250 |
|
| 251 |
|
| 252 |
|
| 253 |
+
<!-- TensorFold-chooser-start -->
|
| 254 |
## Choose for your Mac
|
| 255 |
|
| 256 |
+
[64GB Macs](https://huggingface.co/collections/TensorFold/mlx-models-for-64gb-macs-6a9fefda17932216ec9ab457) 路 [128GB Macs](https://huggingface.co/collections/TensorFold/mlx-models-for-128gb-macs-6a9ff0abd31bc9abbe7922d7) 路 [256GB Macs](https://huggingface.co/collections/TensorFold/mlx-models-for-256gb-macs-6a9ff0ef9fed7c5bdca15e9b)
|
| 257 |
|
| 258 |
Published peak memory: **21.33 GB**; estimated starting tier: **64GB**, leaving about **42 GB** nominal headroom. The collections use published M3 Studio peaks with at least 25% nominal headroom; fit on other Macs is an estimate, and full context is not guaranteed. Start with short context and one request.
|
| 259 |
|
|
|
|
| 264 |
### Quick start and demo prompt
|
| 265 |
|
| 266 |
```bash
|
| 267 |
+
hf download TensorFold/Muse-Glimmer-30B-MLX-4bit --local-dir ./models/Muse-Glimmer-30B-MLX-4bit
|
| 268 |
```
|
| 269 |
|
| 270 |
Add the downloaded folder to oMLX model directories, refresh the list, and follow this card's architecture and MTP compatibility requirements before loading.
|
|
|
|
| 277 |
|
| 278 |
This is a demo prompt to try, not a recorded successful run; a captured demonstration for this documentation update is not yet available.
|
| 279 |
|
| 280 |
+
[Follow TensorFold for new Apple Silicon releases and fixes.](https://huggingface.co/TensorFold)
|
| 281 |
+
<!-- TensorFold-chooser-end -->
|