Instructions to use RJTPP/scot0500s-deepseek-14b-full with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use RJTPP/scot0500s-deepseek-14b-full with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="RJTPP/scot0500s-deepseek-14b-full")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("RJTPP/scot0500s-deepseek-14b-full")
model = AutoModelForCausalLM.from_pretrained("RJTPP/scot0500s-deepseek-14b-full", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use RJTPP/scot0500s-deepseek-14b-full with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "RJTPP/scot0500s-deepseek-14b-full"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RJTPP/scot0500s-deepseek-14b-full",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/RJTPP/scot0500s-deepseek-14b-full

SGLang

How to use RJTPP/scot0500s-deepseek-14b-full with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "RJTPP/scot0500s-deepseek-14b-full" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RJTPP/scot0500s-deepseek-14b-full",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "RJTPP/scot0500s-deepseek-14b-full" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RJTPP/scot0500s-deepseek-14b-full",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Unsloth Desktop
Docker Model Runner
How to use RJTPP/scot0500s-deepseek-14b-full with Docker Model Runner:
```
docker model run hf.co/RJTPP/scot0500s-deepseek-14b-full
```

scot0500s-deepseek-14b-full

Commit History

Fix chat_template crash when assistant message omits the `content` key (#1)

6458371

RJTPP

qgallouedec HF Staff commited on May 8

(Trained with Unsloth)

3320b6f
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

ccb81cf
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

818c843
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

a7713cb
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

a641823
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

d258ece
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

6676836
verified

RJTPP commited on Apr 21

(Trained with Unsloth)

648bdd1
verified

RJTPP commited on Apr 21

Unsloth Model Card

684fc65
verified

RJTPP commited on Apr 21

initial commit

cc78850
verified

RJTPP commited on Apr 21

Commit History

Fix chat_template crash when assistant message omits the `content` key (#1) 6458371

(Trained with Unsloth) 3320b6f verified

(Trained with Unsloth) ccb81cf verified

(Trained with Unsloth) 818c843 verified

(Trained with Unsloth) a7713cb verified

(Trained with Unsloth) a641823 verified

(Trained with Unsloth) d258ece verified

(Trained with Unsloth) 6676836 verified

(Trained with Unsloth) 648bdd1 verified

Unsloth Model Card 684fc65 verified

initial commit cc78850 verified

Fix chat_template crash when assistant message omits the `content` key (#1)

6458371

(Trained with Unsloth)

3320b6f
verified

(Trained with Unsloth)

ccb81cf
verified

(Trained with Unsloth)

818c843
verified

(Trained with Unsloth)

a7713cb
verified

(Trained with Unsloth)

a641823
verified

(Trained with Unsloth)

d258ece
verified

(Trained with Unsloth)

6676836
verified

(Trained with Unsloth)

648bdd1
verified

Unsloth Model Card

684fc65
verified

initial commit

cc78850
verified