Instructions to use createthis/DeepSeek-V3.2-dense-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use createthis/DeepSeek-V3.2-dense-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf createthis/DeepSeek-V3.2-dense-GGUF:F16 # Run inference directly in the terminal: llama cli -hf createthis/DeepSeek-V3.2-dense-GGUF:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf createthis/DeepSeek-V3.2-dense-GGUF:F16 # Run inference directly in the terminal: llama cli -hf createthis/DeepSeek-V3.2-dense-GGUF:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf createthis/DeepSeek-V3.2-dense-GGUF:F16 # Run inference directly in the terminal: ./llama-cli -hf createthis/DeepSeek-V3.2-dense-GGUF:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf createthis/DeepSeek-V3.2-dense-GGUF:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf createthis/DeepSeek-V3.2-dense-GGUF:F16
Use Docker
docker model run hf.co/createthis/DeepSeek-V3.2-dense-GGUF:F16
- LM Studio
- Jan
- Ollama
How to use createthis/DeepSeek-V3.2-dense-GGUF with Ollama:
ollama run hf.co/createthis/DeepSeek-V3.2-dense-GGUF:F16
- Unsloth Desktop
- Docker Model Runner
How to use createthis/DeepSeek-V3.2-dense-GGUF with Docker Model Runner:
docker model run hf.co/createthis/DeepSeek-V3.2-dense-GGUF:F16
- Lemonade
How to use createthis/DeepSeek-V3.2-dense-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull createthis/DeepSeek-V3.2-dense-GGUF:F16
Run and chat with the model
lemonade run user.DeepSeek-V3.2-dense-GGUF-F16
List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub
Browse files- .gitattributes +9 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00001-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00002-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00003-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00004-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00005-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00006-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00007-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00008-of-00009.gguf +3 -0
- q4_k_m/DeepSeek-V3.2-Q4_K_M-00009-of-00009.gguf +3 -0
.gitattributes
CHANGED
|
@@ -63,3 +63,12 @@ bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00027-of-00030.gguf filter=lfs diff=lfs merg
|
|
| 63 |
bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00028-of-00030.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00029-of-00030.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00030-of-00030.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 63 |
bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00028-of-00030.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00029-of-00030.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
bf16/DeepSeek-V3.2-Bf16-256x20B-F16-00030-of-00030.gguf filter=lfs diff=lfs merge=lfs -text
|
| 66 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 67 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 68 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 69 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 72 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 73 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 74 |
+
q4_k_m/DeepSeek-V3.2-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00001-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:47f1093444d061236b6122858a83d9ae25de1cbfcf3349810aedc9a62bc2a770
|
| 3 |
+
size 45255408320
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00002-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aee0f29bdef5418cc2b715cc400e5150b3230d2e470ec41e7cdcdfd33f0e099f
|
| 3 |
+
size 46051329408
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00003-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1e19482e00b3c18cf535eba61589e9572064454f0abe1d8e144a3136ed46229d
|
| 3 |
+
size 47307181184
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00004-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d5ca1928737721ef005ecbe01a9cd389bd3cfc20aaa623eaeb1a6e118b644fe
|
| 3 |
+
size 47307181184
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00005-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14fab21d33ce264f1f2a77bf4fb8b3c01233106843eca186ee07a52b867a46a6
|
| 3 |
+
size 46150294400
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00006-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e0a2b409628794a450332d2450b4ecea9b7732b14edc52fc175b4bc64b3dd591
|
| 3 |
+
size 47307181184
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00007-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d45c8d5ac3f8ad5bada6c9eed9b10a36e71ac0fe86b2e4bf3dc0e0dd092400b
|
| 3 |
+
size 47307181184
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00008-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cf01b1a3930cce2cf2790e3fa81fd67884bfc1ca4d4ea31330382562ca08e25d
|
| 3 |
+
size 47996667264
|
q4_k_m/DeepSeek-V3.2-Q4_K_M-00009-of-00009.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3cc9b6355f3aca3c8b8621b6f4684eda2dcf2148e9f82f3f728ef745d83409af
|
| 3 |
+
size 29811729088
|