Instructions to use Edens-Gate/qwq-32b-magnum-v2-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Edens-Gate/qwq-32b-magnum-v2-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Edens-Gate/qwq-32b-magnum-v2-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Edens-Gate/qwq-32b-magnum-v2-v1")
model = AutoModelForCausalLM.from_pretrained("Edens-Gate/qwq-32b-magnum-v2-v1", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Edens-Gate/qwq-32b-magnum-v2-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Edens-Gate/qwq-32b-magnum-v2-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Edens-Gate/qwq-32b-magnum-v2-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Edens-Gate/qwq-32b-magnum-v2-v1

SGLang

How to use Edens-Gate/qwq-32b-magnum-v2-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Edens-Gate/qwq-32b-magnum-v2-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Edens-Gate/qwq-32b-magnum-v2-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Edens-Gate/qwq-32b-magnum-v2-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Edens-Gate/qwq-32b-magnum-v2-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Edens-Gate/qwq-32b-magnum-v2-v1 with Docker Model Runner:
```
docker model run hf.co/Edens-Gate/qwq-32b-magnum-v2-v1
```

Delta-Vector commited on Mar 12, 2025

Commit

e588d80

verified ·

1 Parent(s): ee75ae5

Training in progress, step 95

Browse files

Files changed (15) hide show

model-00001-of-00014.safetensors +1 -1
model-00002-of-00014.safetensors +1 -1
model-00003-of-00014.safetensors +1 -1
model-00004-of-00014.safetensors +1 -1
model-00005-of-00014.safetensors +1 -1
model-00006-of-00014.safetensors +1 -1
model-00007-of-00014.safetensors +1 -1
model-00008-of-00014.safetensors +1 -1
model-00009-of-00014.safetensors +1 -1
model-00010-of-00014.safetensors +1 -1
model-00011-of-00014.safetensors +1 -1
model-00012-of-00014.safetensors +1 -1
model-00013-of-00014.safetensors +1 -1
model-00014-of-00014.safetensors +1 -1
training_args.bin +1 -1

model-00001-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9cf10ce50a8d003eaff8d51daae1bc78a87469963f79d7c53a3ce107db3666e5
 size 4891730992

 version https://git-lfs.github.com/spec/v1
+oid sha256:b59b78ab9bb06e6b8c2ed4cf69fa87a8ca10391fef4b38adeb5165a083a63504
 size 4891730992

model-00002-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e4e81bf27bad3b96697389808a44a571dbff4db739f57f41582ec0f7db527d76
 size 4876059352

 version https://git-lfs.github.com/spec/v1
+oid sha256:6659988665885e4f868e31ed175f350f1fab7d301d16c18f91a93b75739fb8c1
 size 4876059352

model-00003-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dcf6bf13b7617ff05293691beafd48c4a928a91fba50e1e1388a4a5c3d269109
 size 4876059384

 version https://git-lfs.github.com/spec/v1
+oid sha256:336c9a2a9acb4c0441ba41cc7b36a1fab7ce2c85b7841eb9443e06394d39a9e5
 size 4876059384

model-00004-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2ac13aaae6bdd992d8a58d0e596db8d562469b45316b604efb60b7c3780ccf8b
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:62c838f681f47e1a3343424b19f07db1f6fe31798b98cadded863b4c45b289aa
 size 4876059416

model-00005-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4b0c3632f86a8031f6cd02e8b6f7813b235993f6a7a65ca7ca3529885e4b24f0
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:b71fd2c70d620236a0cf3cc712fe380edfac3c212d478d87b4b73a64c18ef1a1
 size 4876059416

model-00006-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:01b5ffdf2e2c4c78ba4a60e3bc3014ee88c48a6069ecf274b06882eb679af1db
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:5d3d5a728b9e5add582fd21331012f9c9a65177bb875d74045190c6e1c6959a7
 size 4876059416

model-00007-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a48c262fd09b64848047caca69fc42deb1c0ef7d5f059f3163b708128737319a
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:5a9aa742d3a6b8cf76b6b60d8a6597b5af6635835034e21a5f77f1218af8f1eb
 size 4876059416

model-00008-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e8d2a6506e468823609ad1a0c20c9b137c1fb686cc179c052bd0a576340e433e
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:470fd86cea4f6d87d4b03b85067c0c7680d81d1379995c2ad6bb8ff1fed91acd
 size 4876059416

model-00009-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4aeb06318c94ab8ae043d59a01f8b66b39df677db6bef203523608b396d823fe
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:a77bcd179a159e47aa37da34df41faa0cbd22ad91ee2e7e898409fa3cf6483f8
 size 4876059416

model-00010-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ec1eed2a46b3a63174b1020cf13f4b3841e6a7d0fb1e28ead346fb0d36a68f60
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:c83f2622b99a712bab1c27b04ddcdfa39de48eeba7210acd1057f23b6a3c7d64
 size 4876059416

model-00011-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c0cdd742a90b658ebd2e3ba8c13768db9306f507e2615ae25f9a29c38fbf401d
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:6ccdec93a48a0028de67e517bf47285fa9b4de1caa36e254faf36dc46cae73d6
 size 4876059416

model-00012-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:82e664c4014f96f9ce810b8804b2a30aa18f9896b4c2760974f39e0e8a1c94cf
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:69776e809d20dc3a8e4b12520145e3b0fee792177e905a90159a59c2e609156b
 size 4876059416

model-00013-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:77bae41788091207a2adafa153a080d989fc7dec91f121873d81b4ed1ba455e9
 size 4876059416

 version https://git-lfs.github.com/spec/v1
+oid sha256:795b311e5d100a6ee12571412656cadce82b936d0f7188609f9c5396a7229514
 size 4876059416

model-00014-of-00014.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ece41c61d65c36120db9a4efe3e9602ecf07c02eacb1462298a677d1e20477f4
 size 2123397800

 version https://git-lfs.github.com/spec/v1
+oid sha256:66269b7488a5708353163cfbb88dc3f525d065b12137c7b9b9860aa1acdb8e94
 size 2123397800

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6c0d2528dcfd8d62d3c517248c2d231cc9ff64ec148911ec3ce58a9d39f7507d
 size 8376

 version https://git-lfs.github.com/spec/v1
+oid sha256:b860c7e838727b1a9d8001f5c7a769bd0d63566ea45620719245b6beb59f1cd9
 size 8376