Feature Extraction
MLX
Safetensors
qwen3
apple-silicon
quantized
mixed-precision
axquant
axq
development
MXFP4
embedding
sentence-similarity
4-bit precision
Instructions to use AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4 --local-dir AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download config_sentence_transformers.json from AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4: direct link, hf CLI and curl.
- Browser
- Download file 215 Bytes
-
https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4/resolve/main/config_sentence_transformers.json
- Command line
-
hf download hf://AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4/config_sentence_transformers.json
-
curl -L -o config_sentence_transformers.json https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-MXFP4/resolve/main/config_sentence_transformers.json
215 Bytes
| { | |
| "prompts": { | |
| "query": "Instruct: Given a web search query, retrieve relevant passages that answer the query\nQuery:", | |
| "document": "" | |
| }, | |
| "default_prompt_name": null, | |
| "similarity_fn_name": "cosine" | |
| } |