Hugging Face's logo

sahilchachra
/
Qwythos-9B-Claude-Mythos-5-1M-mxfp4-mlx

MLX
Safetensors
qwen3_5
quantized
apple-silicon
4-bit precision
Model card Files
xet
 Community
sahilchachra commited on
Commit
2dade75
·
verified ·
1 Parent(s): 801a79f

Add files using upload-large-folder tool

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -7,7 +7,7 @@ tags:
7
  - apple-silicon
8
  ---
9
 
10
- # qwythos-9b-mxfp4-mlx
11
 
12
  MLX quantization of [empero-ai/Qwythos-9B-Claude-Mythos-5-1M](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M) for Apple Silicon.
13
 
@@ -54,7 +54,7 @@ pip install mlx-lm
54
  ```python
55
  from mlx_lm import load, generate
56
 
57
- model, tokenizer = load("sahilchachra/qwythos-9b-mxfp4-mlx")
58
  response = generate(model, tokenizer, prompt="Your prompt here", max_tokens=256, verbose=True)
59
  ```
60
 
@@ -62,9 +62,9 @@ response = generate(model, tokenizer, prompt="Your prompt here", max_tokens=256,
62
 
63
  | Model | Variant |
64
  |---|---|
65
- | [sahilchachra/qwythos-9b-mxfp4-mlx](https://huggingface.co/sahilchachra/qwythos-9b-mxfp4-mlx) | Block float MX FP4 ← this model |
66
- | [sahilchachra/qwythos-9b-mxfp8-mlx](https://huggingface.co/sahilchachra/qwythos-9b-mxfp8-mlx) | Block float MX FP8 |
67
- | [sahilchachra/qwythos-9b-optiq-5bpw-mlx](https://huggingface.co/sahilchachra/qwythos-9b-optiq-5bpw-mlx) | OptiQ mixed-precision (target 5.0 bpw) |
68
 
69
  ## Notes
70
 
 
7
  - apple-silicon
8
  ---
9
 
10
+ # Qwythos-9B-Claude-Mythos-5-1M-mxfp4-mlx
11
 
12
  MLX quantization of [empero-ai/Qwythos-9B-Claude-Mythos-5-1M](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M) for Apple Silicon.
13
 
 
54
  ```python
55
  from mlx_lm import load, generate
56
 
57
+ model, tokenizer = load("sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-mxfp4-mlx")
58
  response = generate(model, tokenizer, prompt="Your prompt here", max_tokens=256, verbose=True)
59
  ```
60
 
 
62
 
63
  | Model | Variant |
64
  |---|---|
65
+ | [sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-mxfp4-mlx](https://huggingface.co/sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-mxfp4-mlx) | Block float MX FP4 ← this model |
66
+ | [sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-mxfp8-mlx](https://huggingface.co/sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-mxfp8-mlx) | Block float MX FP8 |
67
+ | [sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-optiq-5bpw-mlx](https://huggingface.co/sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-optiq-5bpw-mlx) | OptiQ mixed-precision (target 5.0 bpw) |
68
 
69
  ## Notes
70