Instructions to use deepseek-ai/DeepSeek-V4-Pro-0813 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use deepseek-ai/DeepSeek-V4-Pro-0813 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="deepseek-ai/DeepSeek-V4-Pro-0813")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-0813")
model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-0813", device_map="auto")

Inference
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use deepseek-ai/DeepSeek-V4-Pro-0813 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "deepseek-ai/DeepSeek-V4-Pro-0813"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "deepseek-ai/DeepSeek-V4-Pro-0813",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/deepseek-ai/DeepSeek-V4-Pro-0813

SGLang

How to use deepseek-ai/DeepSeek-V4-Pro-0813 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "deepseek-ai/DeepSeek-V4-Pro-0813" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "deepseek-ai/DeepSeek-V4-Pro-0813",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "deepseek-ai/DeepSeek-V4-Pro-0813" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "deepseek-ai/DeepSeek-V4-Pro-0813",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use deepseek-ai/DeepSeek-V4-Pro-0813 with Docker Model Runner:
```
docker model run hf.co/deepseek-ai/DeepSeek-V4-Pro-0813
```

msr2000 commited on 19 days ago

Commit

a2f2780

verified ·

1 Parent(s): 812a554

Add files using upload-large-folder tool

Browse files

Files changed (16) hide show

model-00035-of-00066.safetensors +2 -2
model-00036-of-00066.safetensors +2 -2
model-00037-of-00066.safetensors +2 -2
model-00038-of-00066.safetensors +2 -2
model-00039-of-00066.safetensors +2 -2
model-00040-of-00066.safetensors +2 -2
model-00041-of-00066.safetensors +2 -2
model-00042-of-00066.safetensors +2 -2
model-00043-of-00066.safetensors +2 -2
model-00044-of-00066.safetensors +2 -2
model-00045-of-00066.safetensors +2 -2
model-00046-of-00066.safetensors +2 -2
model-00047-of-00066.safetensors +2 -2
model-00048-of-00066.safetensors +2 -2
model-00049-of-00066.safetensors +2 -2
model-00050-of-00066.safetensors +2 -2

model-00035-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2d6d1b67625f897eb52d463bad93de2d4664b889cc542a14b7255bafbc25f463
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:ca4454ca96c52f4601cc375c7c41eb60921c54d99bc3fb2e1dc904c565b37d03
+size 13868524408

model-00036-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:634520b61483a21e377ae5531ee338589cb68fc278b9fb0f377fea2f6ff89cca
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:4ac44a65a92d0fda841f162e5c02343a079fdcdc48ef4f4afb5c30d6f984e910
+size 13903805136

model-00037-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:777f5494d2fbe7598aa89ffadb4b58e42ceb172d25801096ec3514c47d4a9645
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:6aad5ecd60cdbe6c8dca6bafa2aa776d748abc0b079c7f7c1984caf66747ef4b
+size 13868524408

model-00038-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4f0315257105e6214fb0f76e2271e6ff9a2902bad33df9af1dedce537d005ce7
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:b8e9376eeba09924844494a471b560b5ea53cf12bb78a1fbd17abd54760834b6
+size 13903805136

model-00039-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e49dc2305101fa6f830c9de44cab04132393715aff9d77ae91e5c2a9355624a0
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:5182b6d508d4a5ba0ddfaecf6b9e35b69a54c369fed3e9f83521581fcbdb0d2a
+size 13868524408

model-00040-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6021b616995b31ab1c2cb3e6ad844c8d922af89ac6aea8381b4956f7715d2151
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:dc91a11234ee0673db36daa759109ea5f42d1f54df256a7e48df2afab2fef017
+size 13903805136

model-00041-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4cbec57dc24b83cb634e8548437a2e250e380606813da6a723745638db18dfff
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:1b446abc23a035807e6b55a195503daabb02e752fa424fbfe8f0530a944ce17d
+size 13868524408

model-00042-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bd303dd442f4c638d5c106c2ab0ea606426ccf4dc2c8eac74fbc84f734353d01
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:5ec38fcfe3901cb3bc5b809d336c09f213d2e52cc5b80fde484becad16a117b1
+size 13903805136

model-00043-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:700f16f315d198d57f5b13cab8b23a695d975c2c7584a9da1df6b090890cd6a2
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:a9279341f553af43e9ea63b06a0c61e2f6edd5ee224c3f228df2d3f5c62b5c01
+size 13868524408

model-00044-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9770ad7d25d1e94cbf15b7258f28a5922116b1e3d891a630833eacc2f111f5c8
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:ef67de8c818bc60d2d5b4aa652ee01afbea5fb2188f659bba6fc86af45ba00ba
+size 13903805136

model-00045-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f4df16a63bb58d2c9b5ca3e1eca9a930cd769cfa9ee865d239321f23c4162ad6
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:5830f22254b598bf9a0f336bacd233791421d02e7d110db00c1872d5d9afa8be
+size 13868524408

model-00046-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cc2fef84be8d0c7a85383190c80178f2687b08a2c9ed622dfbcda4fdd46ca0a0
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:22ae4fcc55b976724da9bd072096de540760f1eec3cff785e87621fd2d7060a4
+size 13903805136

model-00047-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9ffe1a62c54d4d41dfdbf92145ff4cfccb9129dca5fa7354e57b094d8d0163a4
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:30890437fc59315e6fa08fa8f045df3225fde77b15f586e0da5020d43f9fd4e9
+size 13868524408

model-00048-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fb640e644b7ade89fc7502eb29d05882afa75f1d7c70a8902d6d263cb18f58f9
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:877e6060d9c190230583ec56ce923a0b7f6c696f020fe3a9ab95fda0914e99b2
+size 13903805136

model-00049-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5c74f4e15612ce782f5f6edfaf1a4fc1a1c189dad6b8b056573a17c1088a968e
-size 13868438232

 version https://git-lfs.github.com/spec/v1
+oid sha256:0527cff3c52ce82191e437b1ca8b858e1d3bbec6ed5ef52aac013cd2e6a85bee
+size 13868524408

model-00050-of-00066.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b4034ab226e7a08f383116e6ba4eb153f108fd18caed71a927272b067a7c1494
-size 13903718936

 version https://git-lfs.github.com/spec/v1
+oid sha256:52a94fd51d93b5e35e50ff431bce848292211b8528c6afeed4a6f0d34e23cce8
+size 13903805136