Text Generation
Transformers
Safetensors
qwen3
sft
trl
knowledge-distillation
thinking
longwriter
convergent-intelligence
convergentintel
edge
distillation
conversational
text-generation-inference
Instructions to use reaperdoesntknow/Qwen3-1.7B-Thinking-Distil with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use reaperdoesntknow/Qwen3-1.7B-Thinking-Distil with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="reaperdoesntknow/Qwen3-1.7B-Thinking-Distil") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("reaperdoesntknow/Qwen3-1.7B-Thinking-Distil") model = AutoModelForCausalLM.from_pretrained("reaperdoesntknow/Qwen3-1.7B-Thinking-Distil", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use reaperdoesntknow/Qwen3-1.7B-Thinking-Distil with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "reaperdoesntknow/Qwen3-1.7B-Thinking-Distil" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "reaperdoesntknow/Qwen3-1.7B-Thinking-Distil", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/reaperdoesntknow/Qwen3-1.7B-Thinking-Distil
- SGLang
How to use reaperdoesntknow/Qwen3-1.7B-Thinking-Distil with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "reaperdoesntknow/Qwen3-1.7B-Thinking-Distil" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "reaperdoesntknow/Qwen3-1.7B-Thinking-Distil", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "reaperdoesntknow/Qwen3-1.7B-Thinking-Distil" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "reaperdoesntknow/Qwen3-1.7B-Thinking-Distil", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use reaperdoesntknow/Qwen3-1.7B-Thinking-Distil with Docker Model Runner:
docker model run hf.co/reaperdoesntknow/Qwen3-1.7B-Thinking-Distil
Drop contradictory download columns + stale footer
Browse files
README.md
CHANGED
|
@@ -131,13 +131,13 @@ Different paths, different capabilities. This model prioritizes extended reasoni
|
|
| 131 |
|
| 132 |
## DistilQwen Collection
|
| 133 |
|
| 134 |
-
| Model |
|
| 135 |
-
|-------|-----------
|
| 136 |
-
| **[Qwen3-1.7B-Thinking-Distil](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Thinking-Distil)** | **
|
| 137 |
-
| [TopologicalQwen](https://huggingface.co/reaperdoesntknow/TopologicalQwen) |
|
| 138 |
-
| [DiStil-Qwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored) |
|
| 139 |
-
| [Qwen3-1.7B-Coder-Distilled-SFT](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Coder-Distilled-SFT) |
|
| 140 |
-
| [DistilQwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DistilQwen3-1.7B-uncensored) |
|
| 141 |
|
| 142 |
Full collection: [DistilQwen on HuggingFace](https://huggingface.co/collections/reaperdoesntknow/distilqwen-69bf40ec669117e3f069ef1c)
|
| 143 |
|
|
@@ -182,7 +182,7 @@ Standard knowledge distillation captures only term 1. Topological Knowledge Dist
|
|
| 182 |
|
| 183 |
---
|
| 184 |
|
| 185 |
-
*Convergent Intelligence LLC: Research Division
|
| 186 |
*[Full portfolio](https://huggingface.co/reaperdoesntknow) | [DistilQwen Collection](https://huggingface.co/collections/reaperdoesntknow/distilqwen-69bf40ec669117e3f069ef1c) | [DualMind Collection](https://huggingface.co/collections/reaperdoesntknow/dualmind-69c93f888c6e79ecc69cf41e)*
|
| 187 |
|
| 188 |
---
|
|
@@ -193,14 +193,14 @@ Standard knowledge distillation captures only term 1. Topological Knowledge Dist
|
|
| 193 |
|
| 194 |
### Related Models
|
| 195 |
|
| 196 |
-
| Model |
|
| 197 |
-
|-------|--------
|
| 198 |
-
| [TopologicalQwen](https://huggingface.co/reaperdoesntknow/TopologicalQwen) |
|
| 199 |
-
| [Qwen3-1.7B-Thinking-Distil](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Thinking-Distil) |
|
| 200 |
-
| [Qwen3-1.7B-Coder-Distilled-SFT](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Coder-Distilled-SFT) |
|
| 201 |
-
| [DiStil-Qwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored) |
|
| 202 |
-
| [DistilQwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DistilQwen3-1.7B-uncensored) |
|
| 203 |
-
| [Qwen3-1.7B-Distilled-30B-A3B](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Distilled-30B-A3B) |
|
| 204 |
|
| 205 |
### Papers
|
| 206 |
|
|
@@ -211,6 +211,4 @@ Standard knowledge distillation captures only term 1. Topological Knowledge Dist
|
|
| 211 |
| [Discrepancy Calculus](https://huggingface.co/reaperdoesntknow/Discrepancy_Calculus) | 10.57967/hf/8194 |
|
| 212 |
|
| 213 |
---
|
| 214 |
-
|
| 215 |
-
*Last updated: 2026-03-31 by Convergent Intelligence LLC: Research Division*
|
| 216 |
<!-- cix-keeper-ts:2026-08-03T13:16:26Z -->
|
|
|
|
| 131 |
|
| 132 |
## DistilQwen Collection
|
| 133 |
|
| 134 |
+
| Model | What It Does |
|
| 135 |
+
|-------|-------------|
|
| 136 |
+
| **[Qwen3-1.7B-Thinking-Distil](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Thinking-Distil)** | **← this model. Thinking teacher SFT.** |
|
| 137 |
+
| [TopologicalQwen](https://huggingface.co/reaperdoesntknow/TopologicalQwen) | Full TKD pipeline. BV decomposition + DualMind format. |
|
| 138 |
+
| [DiStil-Qwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored) | DISC-informed uncensored distillation. |
|
| 139 |
+
| [Qwen3-1.7B-Coder-Distilled-SFT](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Coder-Distilled-SFT) | Coder teacher. Hierarchical problem solving. |
|
| 140 |
+
| [DistilQwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DistilQwen3-1.7B-uncensored) | Base uncensored variant. |
|
| 141 |
|
| 142 |
Full collection: [DistilQwen on HuggingFace](https://huggingface.co/collections/reaperdoesntknow/distilqwen-69bf40ec669117e3f069ef1c)
|
| 143 |
|
|
|
|
| 182 |
|
| 183 |
---
|
| 184 |
|
| 185 |
+
*Convergent Intelligence LLC: Research Division.*
|
| 186 |
*[Full portfolio](https://huggingface.co/reaperdoesntknow) | [DistilQwen Collection](https://huggingface.co/collections/reaperdoesntknow/distilqwen-69bf40ec669117e3f069ef1c) | [DualMind Collection](https://huggingface.co/collections/reaperdoesntknow/dualmind-69c93f888c6e79ecc69cf41e)*
|
| 187 |
|
| 188 |
---
|
|
|
|
| 193 |
|
| 194 |
### Related Models
|
| 195 |
|
| 196 |
+
| Model | Format |
|
| 197 |
+
|-------|--------|
|
| 198 |
+
| [TopologicalQwen](https://huggingface.co/reaperdoesntknow/TopologicalQwen) | BF16 |
|
| 199 |
+
| [Qwen3-1.7B-Thinking-Distil](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Thinking-Distil) | BF16 |
|
| 200 |
+
| [Qwen3-1.7B-Coder-Distilled-SFT](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Coder-Distilled-SFT) | BF16 |
|
| 201 |
+
| [DiStil-Qwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DiStil-Qwen3-1.7B-uncensored) | BF16 |
|
| 202 |
+
| [DistilQwen3-1.7B-uncensored](https://huggingface.co/reaperdoesntknow/DistilQwen3-1.7B-uncensored) | BF16 |
|
| 203 |
+
| [Qwen3-1.7B-Distilled-30B-A3B](https://huggingface.co/reaperdoesntknow/Qwen3-1.7B-Distilled-30B-A3B) | BF16 |
|
| 204 |
|
| 205 |
### Papers
|
| 206 |
|
|
|
|
| 211 |
| [Discrepancy Calculus](https://huggingface.co/reaperdoesntknow/Discrepancy_Calculus) | 10.57967/hf/8194 |
|
| 212 |
|
| 213 |
---
|
|
|
|
|
|
|
| 214 |
<!-- cix-keeper-ts:2026-08-03T13:16:26Z -->
|