Instructions to use Blackfrost-AI/CYBER-FROST-3.8-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Blackfrost-AI/CYBER-FROST-3.8-FP8 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Blackfrost-AI/CYBER-FROST-3.8-FP8")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("Blackfrost-AI/CYBER-FROST-3.8-FP8")
model = AutoModelForMultimodalLM.from_pretrained("Blackfrost-AI/CYBER-FROST-3.8-FP8", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Blackfrost-AI/CYBER-FROST-3.8-FP8 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Blackfrost-AI/CYBER-FROST-3.8-FP8"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Blackfrost-AI/CYBER-FROST-3.8-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Blackfrost-AI/CYBER-FROST-3.8-FP8

SGLang

How to use Blackfrost-AI/CYBER-FROST-3.8-FP8 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Blackfrost-AI/CYBER-FROST-3.8-FP8" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Blackfrost-AI/CYBER-FROST-3.8-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Blackfrost-AI/CYBER-FROST-3.8-FP8" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Blackfrost-AI/CYBER-FROST-3.8-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Blackfrost-AI/CYBER-FROST-3.8-FP8 with Docker Model Runner:
```
docker model run hf.co/Blackfrost-AI/CYBER-FROST-3.8-FP8
```

CYBER-FROST-3.8-FP8 / ARTIFACT-VERIFICATION.json

Blackfrost-AI

Publish CYBER-FROST-3.8-FP8

d12095b verified 13 days ago

Raw History Blame Contribute Delete

1.47 kB

	{
	"status": "pass",
	"artifact": "BLACKFROST-3.8-DERISKED-FP8",
	"lineage": {
	"foundation": "Qwen/Qwen3.8-Flash-Next",
	"immediate_parent": "Blackfrost-AI/BLACKFROST-3.8-ICED-BF16",
	"immediate_parent_revision": "5321904427c4ef54df8a667edcbc2d1184e4286e",
	"fp8_layout_reference": "Qwen/Qwen3.8-Flash-Next-FP8",
	"fp8_layout_reference_revision": "236dfdf285828023ca3bcd3f37366c58a3469b13"
	},
	"quantization": {
	"format": "FP8 E4M3",
	"activation_scheme": "dynamic",
	"expert_weight_block_size": [128, 128],
	"target_expert_layers": 48,
	"mtp_expert_layers": 1
	},
	"artifact_counts": {
	"weight_shards": 131,
	"indexed_tensors": 152089,
	"indexed_tensor_bytes": 185502232570,
	"expert_weights": 75264,
	"expert_scales": 75264,
	"mtp_expert_entries": 3072,
	"mtp_preserved_tensors": 29,
	"ple_weights": 128,
	"ple_scales": 1,
	"vision_tensors": 333,
	"preserved_tensors": 1432
	},
	"checks": {
	"official_weight_map_match": true,
	"preserved_tensor_shape_and_dtype_match": true,
	"generated_fp8_values_finite": true,
	"generated_scales_finite_and_positive": true
	},
	"sha256": {
	"config.json": "6c41934d3fd7bda8a89f2af85292df2b94e3807927ca372a01bd5225f70f2953",
	"model.safetensors.index.json": "1f163f7efc9a4b981e6e13978b7f39f9a3d4ddb11fff562b80500538021b4407",
	"ASSETS/BLACKFROST-AI-BANNER.png": "52a12b0caf63c1859da518738f78517a49a2616a8bc04daecc515f8793e30f09"
	}
	}