ur-dad-matt commited on
Commit
0d160bd
·
verified ·
1 Parent(s): cdf9169

docs(card): SEO + cross-link refresh (HF-DISCOVERABILITY-001)

Browse files
Files changed (1) hide show
  1. README.md +28 -52
README.md CHANGED
@@ -73,77 +73,53 @@ widget:
73
  content: A train leaves station A at 60 mph and another leaves station B, 180
74
  miles away, at 40 mph toward each other. When do they meet?
75
  ---
 
76
 
77
- # DeepSeek-R1-Distill-Llama-8B MLX 4-bit
78
 
79
- 4-bit MLX conversion of [DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) for Apple Silicon. Runs natively on
80
- M1, M2, M3, and M4 Macs via `mlx_lm`. Faithful port of the upstream weights — no
81
- fine-tuning, no merge.
82
 
83
- ## Quick facts
84
 
85
- - **Upstream base:** [DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B)
86
- - **Format:** MLX 4-bit (`mlx_lm.convert --q-bits 4 --q-group-size 64`)
87
- - **License:** `mit`
88
- - **Use case:** reasoning
89
- - **Runtime:** mlx-lm, LM Studio, Jan, Outlier desktop app
90
- - **Publisher:** Outlier-Ai (solo, Mac-native AI platform)
91
 
92
- ## Quickstart (mlx-lm)
93
 
94
  ```bash
95
- pip install -U mlx-lm
96
  python -m mlx_lm.generate \
97
  --model Outlier-Ai/DeepSeek-R1-Distill-Llama-8B-MLX-4bit \
98
- --prompt "Write a haiku about compilers." \
99
  --max-tokens 256
100
  ```
101
 
102
- ## Quickstart (LM Studio)
103
 
104
- Search for `Outlier-Ai/DeepSeek-R1-Distill-Llama-8B-MLX-4bit`, then Load and chat.
105
-
106
- ## Quickstart (Outlier desktop app)
107
-
108
- One-click install from [outlier.host](https://outlier.host). Listed in the library
109
- picker under `reasoning`.
110
-
111
- ## Why this repo exists
112
-
113
- This is a canonically-named twin of [Outlier-Ai/Outlier-R1-Distill-Llama-8B-MLX-4bit](https://huggingface.co/Outlier-Ai/Outlier-R1-Distill-Llama-8B-MLX-4bit).
114
- Same weights, same quant, different name. The branded repo carries the Outlier
115
- identity; this one carries the upstream identity so it's findable via searches
116
- like "deepseek-r1-distill-llama-8b 4bit mlx". Use whichever path you came across — both
117
- point to the same files.
118
-
119
- ## Provenance
120
-
121
- - Converted via `mlx_lm.convert --q-bits 4 --q-group-size 64`
122
- - Source: [DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B)
123
- - Date produced: 2026-04-19 (Day 19)
124
- - Conversion factory: Outlier MEGA-INFINITE phase3
125
 
126
- ## Related
127
 
128
- - **Branded twin (same weights):** [Outlier-Ai/Outlier-R1-Distill-Llama-8B-MLX-4bit](https://huggingface.co/Outlier-Ai/Outlier-R1-Distill-Llama-8B-MLX-4bit)
129
- - **Outlier org on HuggingFace:** [Outlier-Ai](https://huggingface.co/Outlier-Ai)
130
- - **Desktop app:** [outlier.host](https://outlier.host)
131
- - **Founders lifetime ($200, 500-seat cap):** [buy.polar.sh](https://buy.polar.sh/polar_cl_mJfYZsEpEMDcYrgxzvTdnahSeSQNq1UYLqV0l08CUhW)
132
- - **Discord:** [discord.gg/Hapennmdn9](https://discord.gg/Hapennmdn9)
133
 
134
- ## Collections
135
 
136
- - **Outlier for Apple Silicon (MLX):** [huggingface.co/collections/Outlier-Ai/outlier-consumer-edition-69e2fb4a0df119ea1747275e](https://huggingface.co/collections/Outlier-Ai/outlier-consumer-edition-69e2fb4a0df119ea1747275e)
137
- - **Outlier Research MoE:** [huggingface.co/collections/Outlier-Ai/outlier-research-69e2fb3a71984614b3c7a279](https://huggingface.co/collections/Outlier-Ai/outlier-research-69e2fb3a71984614b3c7a279)
138
- - **Outlier Server V3.2:** [huggingface.co/collections/Outlier-Ai/outlier-server-v32-69e2fb4b71984614b3c7a4a3](https://huggingface.co/collections/Outlier-Ai/outlier-server-v32-69e2fb4b71984614b3c7a4a3)
139
 
140
- ## Attribution
141
 
142
- Base model by the upstream author (see [DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B)). Outlier contributes
143
- the MLX 4-bit conversion and desktop-app packaging. Capability credit for the base
144
- belongs entirely to upstream.
 
 
145
 
146
  ## License
147
 
148
- Redistributed under the upstream license: `mit`. Respect the terms of
149
- [DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) when using this conversion.
 
73
  content: A train leaves station A at 60 mph and another leaves station B, 180
74
  miles away, at 40 mph toward each other. When do they meet?
75
  ---
76
+ > **Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=deepseek_r1_distill_llama_8b_mlx_4bit)** — a one-click app that loads MLX models locally. macOS arm64, free download.
77
 
78
+ # DeepSeek-R1-Distill-Llama-8B (MLX 4-bit)
79
 
80
+ MLX 4-bit conversion of [`deepseek-ai/DeepSeek-R1-Distill-Llama-8B`](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B), repackaged for Apple Silicon. Original weights, original license — see frontmatter above. This repo only changes the on-disk format (safetensors, MLX 4-bit, `chat_template.jinja`, tokenizer).
 
 
81
 
82
+ ## About this conversion
83
 
84
+ - **Format:** MLX 4-bit safetensors (group size 64, symmetric)
85
+ - **Tooling:** `mlx-lm` 0.31.x compatible
86
+ - **Files:** `model.safetensors` shards · `config.json` · tokenizer · `chat_template.jinja`
87
+ - **License:** inherits from the upstream base model — see YAML `license` field
 
 
88
 
89
+ ### Load directly with `mlx-lm`
90
 
91
  ```bash
92
+ pip install mlx-lm
93
  python -m mlx_lm.generate \
94
  --model Outlier-Ai/DeepSeek-R1-Distill-Llama-8B-MLX-4bit \
95
+ --prompt "Hello, world." \
96
  --max-tokens 256
97
  ```
98
 
99
+ Or in Python:
100
 
101
+ ```python
102
+ from mlx_lm import load, generate
103
+ model, tokenizer = load("Outlier-Ai/DeepSeek-R1-Distill-Llama-8B-MLX-4bit")
104
+ print(generate(model, tokenizer, prompt="Hello, world.", max_tokens=256))
105
+ ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
106
 
107
+ ## What is Outlier?
108
 
109
+ Outlier is a free macOS app that runs language models on your Mac, fully offline. Pick a model from a tier picker, click download, and chat — no API keys, no cloud round-trips, no usage caps. It ships with its own curated tier of MLX-4bit models and can also load any compatible MLX conversion (including this one) via the model picker.
 
 
 
 
110
 
111
+ Download Outlier (free, Apple Silicon): **[outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=deepseek_r1_distill_llama_8b_mlx_4bit)**
112
 
113
+ For benchmark numbers (MMLU, HumanEval, tok/s on M-series Macs) with full provenance, see [outlier.host/benchmarks](https://outlier.host/benchmarks?utm_source=hf&utm_medium=modelcard&utm_campaign=deepseek_r1_distill_llama_8b_mlx_4bit).
 
 
114
 
115
+ ## Other Outlier conversions
116
 
117
+ - [DeepSeek-R1-Distill-Qwen-7B (MLX 4-bit) — MLX 4-bit conversion (1,932 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-7B-MLX-4bit)
118
+ - [DeepSeek-R1-Distill-Qwen-32B (MLX 4-bit) MLX 4-bit conversion (1,353 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-32B-MLX-4bit)
119
+ - [DeepSeek-R1-Distill-Qwen-14B (MLX 4-bit) — MLX 4-bit conversion (1,087 downloads)](https://huggingface.co/Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit)
120
+ - [Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Core-27B-MLX-4bit)
121
+ - [Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)](https://huggingface.co/Outlier-Ai/Outlier-Nano-4B-MLX-4bit)
122
 
123
  ## License
124
 
125
+ This conversion preserves the upstream license declared in the frontmatter (`mit`). Refer to the upstream base model card for the canonical license text and any usage restrictions.