Instructions to use Bojun-Feng/DeepSeek-R1-Distill-Qwen-32B-GGUF-llamafile with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Bojun-Feng/DeepSeek-R1-Distill-Qwen-32B-GGUF-llamafile with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Bojun-Feng/DeepSeek-R1-Distill-Qwen-32B-GGUF-llamafile", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
| *.7z filter=lfs diff=lfs merge=lfs -text | |
| *.arrow filter=lfs diff=lfs merge=lfs -text | |
| *.bin filter=lfs diff=lfs merge=lfs -text | |
| *.bz2 filter=lfs diff=lfs merge=lfs -text | |
| *.ckpt filter=lfs diff=lfs merge=lfs -text | |
| *.ftz filter=lfs diff=lfs merge=lfs -text | |
| *.gz filter=lfs diff=lfs merge=lfs -text | |
| *.h5 filter=lfs diff=lfs merge=lfs -text | |
| *.joblib filter=lfs diff=lfs merge=lfs -text | |
| *.lfs.* filter=lfs diff=lfs merge=lfs -text | |
| *.mlmodel filter=lfs diff=lfs merge=lfs -text | |
| *.model filter=lfs diff=lfs merge=lfs -text | |
| *.msgpack filter=lfs diff=lfs merge=lfs -text | |
| *.npy filter=lfs diff=lfs merge=lfs -text | |
| *.npz filter=lfs diff=lfs merge=lfs -text | |
| *.onnx filter=lfs diff=lfs merge=lfs -text | |
| *.ot filter=lfs diff=lfs merge=lfs -text | |
| *.parquet filter=lfs diff=lfs merge=lfs -text | |
| *.pb filter=lfs diff=lfs merge=lfs -text | |
| *.pickle filter=lfs diff=lfs merge=lfs -text | |
| *.pkl filter=lfs diff=lfs merge=lfs -text | |
| *.pt filter=lfs diff=lfs merge=lfs -text | |
| *.pth filter=lfs diff=lfs merge=lfs -text | |
| *.rar filter=lfs diff=lfs merge=lfs -text | |
| *.safetensors filter=lfs diff=lfs merge=lfs -text | |
| saved_model/**/* filter=lfs diff=lfs merge=lfs -text | |
| *.tar.* filter=lfs diff=lfs merge=lfs -text | |
| *.tar filter=lfs diff=lfs merge=lfs -text | |
| *.tflite filter=lfs diff=lfs merge=lfs -text | |
| *.tgz filter=lfs diff=lfs merge=lfs -text | |
| *.wasm filter=lfs diff=lfs merge=lfs -text | |
| *.xz filter=lfs diff=lfs merge=lfs -text | |
| *.zip filter=lfs diff=lfs merge=lfs -text | |
| *.zst filter=lfs diff=lfs merge=lfs -text | |
| *tfevents* filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-F16.cat00.llamafile.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-F16.cat01.llamafile.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q2_K.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q2_K_L.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q3_K_M.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q4_K_M.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q5_K_M.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q6_K.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-Q8_0.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-F16.cat00.llamafile filter=lfs diff=lfs merge=lfs -text | |
| DeepSeek-R1-Distill-Qwen-32B-F16.cat01.llamafile filter=lfs diff=lfs merge=lfs -text | |