Instructions to use Surpem/Supertron1-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Surpem/Supertron1-8B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Surpem/Supertron1-8B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Surpem/Supertron1-8B")
model = AutoModelForCausalLM.from_pretrained("Surpem/Supertron1-8B", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Surpem/Supertron1-8B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Surpem/Supertron1-8B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Surpem/Supertron1-8B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Surpem/Supertron1-8B

SGLang

How to use Surpem/Supertron1-8B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Surpem/Supertron1-8B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Surpem/Supertron1-8B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Surpem/Supertron1-8B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Surpem/Supertron1-8B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Surpem/Supertron1-8B with Docker Model Runner:
```
docker model run hf.co/Surpem/Supertron1-8B
```

Supertron1-8B

Commit History

Add files using upload-large-folder tool

a27f20b
verified

Ill-Ness commited on Apr 15

Update LICENSE

c2e5902
verified

Selen martin commited on Apr 15

Update README.md

c0ef107
verified

Selen martin commited on Apr 15

Delete Readme.md

a84cf3a
verified

Selen martin commited on Apr 15

Update Readme.md

b7b35b7
verified

Selen martin commited on Apr 15

Add files using upload-large-folder tool

a1ea783
verified

Ill-Ness commited on Apr 15

Add files using upload-large-folder tool

a3dc44a
verified

Ill-Ness commited on Apr 15

Add files using upload-large-folder tool

069aceb
verified

Ill-Ness commited on Apr 15

Add files using upload-large-folder tool

a2ad9a0
verified

Ill-Ness commited on Apr 15

initial commit

c203cb4
verified

Ill-Ness commited on Apr 15

Commit History

Add files using upload-large-folder tool a27f20b verified

Update LICENSE c2e5902 verified

Update README.md c0ef107 verified

Delete Readme.md a84cf3a verified

Update Readme.md b7b35b7 verified

Add files using upload-large-folder tool a1ea783 verified

Add files using upload-large-folder tool a3dc44a verified

Add files using upload-large-folder tool 069aceb verified

Add files using upload-large-folder tool a2ad9a0 verified

initial commit c203cb4 verified

Add files using upload-large-folder tool

a27f20b
verified

Update LICENSE

c2e5902
verified

Update README.md

c0ef107
verified

Delete Readme.md

a84cf3a
verified

Update Readme.md

b7b35b7
verified

Add files using upload-large-folder tool

a1ea783
verified

Add files using upload-large-folder tool

a3dc44a
verified

Add files using upload-large-folder tool

069aceb
verified

Add files using upload-large-folder tool

a2ad9a0
verified

initial commit

c203cb4
verified