MLX
Safetensors
qwen3_5_moe
omlx
oq
oq8
quantized
qwen3.6
qwen3.6-35b-a3b
Mixture of Experts
mtp
apple-silicon
8-bit precision
Instructions to use orangeseasun/Qwopus3.6-35B-A3B-v1-oQ8-mtp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use orangeseasun/Qwopus3.6-35B-A3B-v1-oQ8-mtp with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwopus3.6-35B-A3B-v1-oQ8-mtp orangeseasun/Qwopus3.6-35B-A3B-v1-oQ8-mtp
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -73,41 +73,6 @@ MTP ON low-context peak ~70 tok/s
|
|
| 73 |
|
| 74 |
These are local observations, not standardized benchmarks. Actual speed depends on prompt length, context length, oMLX version, generation settings, temperature, cache behavior, and Apple Silicon memory pressure.
|
| 75 |
|
| 76 |
-
Intended use
|
| 77 |
-
|
| 78 |
-
This model is intended for local oMLX / MLX inference, especially:
|
| 79 |
-
|
| 80 |
-
* local agent workflows
|
| 81 |
-
* coding assistant experiments
|
| 82 |
-
* Runtime v2 / Claude Code style local agent tasks
|
| 83 |
-
* long-context local reasoning and review
|
| 84 |
-
* Apple Silicon local inference testing
|
| 85 |
-
* oMLX native MTP experiments
|
| 86 |
-
|
| 87 |
-
Not intended for
|
| 88 |
-
|
| 89 |
-
* production use without your own testing
|
| 90 |
-
* safety-critical decisions
|
| 91 |
-
* use as an official Qwen/QwOpus release
|
| 92 |
-
* non-MLX runtimes unless you know this format is supported
|
| 93 |
-
|
| 94 |
-
This is not GGUF, AWQ, GPTQ, or bitsandbytes format. It is an MLX safetensors conversion.
|
| 95 |
-
|
| 96 |
-
Suggested settings by task
|
| 97 |
-
|
| 98 |
-
advisor / planning:
|
| 99 |
-
temperature: 0.3-0.4
|
| 100 |
-
top_p: 0.9-0.95
|
| 101 |
-
execute / coding / shell edits:
|
| 102 |
-
temperature: 0.1-0.2
|
| 103 |
-
top_p: 0.9-0.95
|
| 104 |
-
review:
|
| 105 |
-
temperature: 0.2-0.3
|
| 106 |
-
top_p: 0.9-0.95
|
| 107 |
-
archive / summary:
|
| 108 |
-
temperature: 0.3-0.5
|
| 109 |
-
top_p: 0.9-0.95
|
| 110 |
-
|
| 111 |
Known notes
|
| 112 |
|
| 113 |
* Native MTP showed a measurable decode-speed improvement in local testing.
|
|
|
|
| 73 |
|
| 74 |
These are local observations, not standardized benchmarks. Actual speed depends on prompt length, context length, oMLX version, generation settings, temperature, cache behavior, and Apple Silicon memory pressure.
|
| 75 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
Known notes
|
| 77 |
|
| 78 |
* Native MTP showed a measurable decode-speed improvement in local testing.
|