Instructions to use nex-agi/Nex-N2.5-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use nex-agi/Nex-N2.5-Pro with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="nex-agi/Nex-N2.5-Pro")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("nex-agi/Nex-N2.5-Pro")
model = AutoModelForMultimodalLM.from_pretrained("nex-agi/Nex-N2.5-Pro", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use nex-agi/Nex-N2.5-Pro with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "nex-agi/Nex-N2.5-Pro"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2.5-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/nex-agi/Nex-N2.5-Pro

SGLang

How to use nex-agi/Nex-N2.5-Pro with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "nex-agi/Nex-N2.5-Pro" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2.5-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "nex-agi/Nex-N2.5-Pro" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2.5-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use nex-agi/Nex-N2.5-Pro with Docker Model Runner:
```
docker model run hf.co/nex-agi/Nex-N2.5-Pro
```

00index commited on 5 days ago

Commit

58becb6

verified ·

1 Parent(s): 61d75ed

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00042-of-00122.safetensors +3 -0
model-00047-of-00122.safetensors +3 -0
model-00048-of-00122.safetensors +3 -0
model-00049-of-00122.safetensors +3 -0
model-00050-of-00122.safetensors +3 -0
model-00051-of-00122.safetensors +3 -0
model-00052-of-00122.safetensors +3 -0
model-00053-of-00122.safetensors +3 -0
model-00054-of-00122.safetensors +3 -0
model-00055-of-00122.safetensors +3 -0
model-00056-of-00122.safetensors +3 -0
model-00057-of-00122.safetensors +3 -0
model-00058-of-00122.safetensors +3 -0
model-00059-of-00122.safetensors +3 -0
model-00060-of-00122.safetensors +3 -0
model-00061-of-00122.safetensors +3 -0
model-00062-of-00122.safetensors +3 -0
model-00063-of-00122.safetensors +3 -0
model-00064-of-00122.safetensors +3 -0
model-00065-of-00122.safetensors +3 -0
model-00066-of-00122.safetensors +3 -0
model-00067-of-00122.safetensors +3 -0
model-00068-of-00122.safetensors +3 -0
model-00069-of-00122.safetensors +3 -0
model-00070-of-00122.safetensors +3 -0
model-00071-of-00122.safetensors +3 -0
model-00072-of-00122.safetensors +3 -0
model-00073-of-00122.safetensors +3 -0
model-00074-of-00122.safetensors +3 -0
model-00075-of-00122.safetensors +3 -0
model-00076-of-00122.safetensors +3 -0
model-00077-of-00122.safetensors +3 -0
model-00078-of-00122.safetensors +3 -0
model-00079-of-00122.safetensors +3 -0
model-00080-of-00122.safetensors +3 -0
model-00081-of-00122.safetensors +3 -0
model-00082-of-00122.safetensors +3 -0
model-00083-of-00122.safetensors +3 -0
model-00084-of-00122.safetensors +3 -0
model-00085-of-00122.safetensors +3 -0
model-00086-of-00122.safetensors +3 -0
model-00087-of-00122.safetensors +3 -0
model-00088-of-00122.safetensors +3 -0
model-00089-of-00122.safetensors +3 -0
model-00090-of-00122.safetensors +3 -0
model-00091-of-00122.safetensors +3 -0
model-00092-of-00122.safetensors +3 -0
model-00093-of-00122.safetensors +3 -0
model-00094-of-00122.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -35,3 +35,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 figures/Nex-N2-Benchmark-white.png filter=lfs diff=lfs merge=lfs -text
 figures/Nex-N2.5-Benchmark-white.png filter=lfs diff=lfs merge=lfs -text

 *tfevents* filter=lfs diff=lfs merge=lfs -text
 figures/Nex-N2-Benchmark-white.png filter=lfs diff=lfs merge=lfs -text
 figures/Nex-N2.5-Benchmark-white.png filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

model-00042-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6d68747e579178ba96f12f38af253f8f46962f0ae4c8be6f8b1735796ca1db08
+size 4295774896

model-00047-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:df89f9b290a139bf3b0c9edb4b137b4357a5106afe1ebfce8de1903bdafe4aba
+size 2386990784

model-00048-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7484252de7c805d81a2f11f5c633f78d960fb326184613864e0d0156cfa5aad2
+size 4295774896

model-00049-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:97c553c2dac56de5e1d86d3a4fa1bd97bee2b6893794d23fc33c87fc06a1f3ba
+size 2413303376

model-00050-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:453a5e993f5f650ba7dca5e11fa11f8ac9993a566c267e551c7ee8b2acd31d4d
+size 4295774896

model-00051-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f80823816047a1b67fbcb5063bd3a1a7027ef77f6b16a0b3e02e5dfe3da7586b
+size 2413303376

model-00052-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4681d0fba796a31e013044f53306851be0c9cd6611586b1d9d6d956445c6f45d
+size 4295774896

model-00053-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f0b0f389aa8d9bd28f8242576d5111f0d958e666b07081dbfebeb6c5d4a83aa7
+size 2413303376

model-00054-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ab6464f8be4485a68ce6ad2593f35ac32151f4aa0a5ef2f351919c244145445d
+size 4295774896

model-00055-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c45b67628a3e3d3e124704e26447cffa4902f40762a8acf542ef7951117248ab
+size 2386990784

model-00056-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6e51d8a50a6efa78b4129ba94969b57ccceef56f2c60d71fbe2d3519ca44008c
+size 4295774896

model-00057-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:847088610a540c85e00565346caacdd3ce0e524d4ef82b6e5254fab31a1baeab
+size 2413303376

model-00058-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd38c0a929b2521e908fc384ee8247384d17a7c28b69bed46da0df4ac73f09c5
+size 4295774896

model-00059-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:442c46e9621cdb4b78d05138881062e5887b72c0e86969808bad328fdd76fe76
+size 2413303376

model-00060-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c62ec2a7b9cc68ea9e8bb8ace3f73068dcf62f1a899010a2963168e0af5687df
+size 4295774896

model-00061-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dffaf89cecd146ffb72ab821e9d04082647d59b4122ca5ce0367b829d4b335da
+size 2413303376

model-00062-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:255dc5176c223b6ee2530cffeac669c2f8a0ca66065a837d474af47d5ab37b0b
+size 4295774896

model-00063-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3ef9b9650097d7e78dbba7b5f10a3b7f0b958c476a16d985e4928ffa4f992df3
+size 2386990784

model-00064-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a9f059554738c1df82b6869fa544ecbfbcb055d27e2ac53aefb64bdad32d7500
+size 4295774896

model-00065-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:28b6153880755f1e6b7d9515a13a9d2dcb9b304fce53181275ca519e2ff73044
+size 2413303376

model-00066-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9e021cfb402712344fa73c0819b9c4cda804dc89dc06d0fada01603d344db409
+size 4295774896

model-00067-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b67b39c24ea05553897c08a7034e5838631523f05401823ac942a0857697ab13
+size 2413303376

model-00068-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f838096e9f8cce4ec1584362311fb3b01fd94c5d5289026aa9b3b6be104bb735
+size 4295774896

model-00069-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3440e1a6fb03276fa67e80d1ca9c066e5b4cd3d9beb3cc7c276badfcd6178951
+size 2413303376

model-00070-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cac543a94a374900f0c667f499b60c108826b5f1719b07788154e5ff39a93e96
+size 4295774896

model-00071-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0046507f24da47421b04de074094cbf7bf7299d7e74f94f53dc4d7d5311837af
+size 2386990784

model-00072-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4f0b21681790e7702e037b9bf33e78dfb7f5d61872fad949314aa7562226b0f7
+size 4295774896

model-00073-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7936eec76018a94f4dead64e607331b94ad8ac4acf83c10101ec55df677984a5
+size 2413303376

model-00074-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:60c2d1c3349f972fafae6a152961d9f15b4cded083165e2225765d6bca4d767f
+size 4295774896

model-00075-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:331fd1c2e1ff49bbc8628c280aab2d0a0cb11223375106d37fe74da03a239348
+size 2413303376

model-00076-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3255083e2cd63ad38b1287963543f1e50e325812a6d1b5f5a9e244437a9abef0
+size 4295774896

model-00077-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:393276dfb33360eaa1cd8f0aeb8fef25ba7caa1ae628a5d22fdf0c7d86dc49d3
+size 2413303376

model-00078-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d08ba11ab8c489bed66dff3738a8fb37af8b5e4d0f9af2d21c730b1a19a19da8
+size 4295774896

model-00079-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:643545e948ddab6ff9df0d3148d02e45c04c03b1c4fb23801357327b69e87b7c
+size 2386990784

model-00080-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:417e47922a2c8a38aed67501b0653dc24ce84201c1a2c102fcd5e8e93ffdf58a
+size 4295774896

model-00081-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e4fa45359acf8a704c2025ef61938a5189c8f2575d5c43cf0eea72a3c2d99f2
+size 2413303376

model-00082-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:35531452241256c56dc8f9595e4c1abee0ff06cb8b41503f0180f27fd9f77ccf
+size 4295774896

model-00083-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:71f01f02b54791cf768229340f1fdd151ecf1a907b57361087eeffc9eebb3bdc
+size 2413303376

model-00084-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e8f35676426ef269915d6781c7c20181dba4e1006f22fe5a04b788d56aa18af4
+size 4295774896

model-00085-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1be33c98cde785381026bf6fc44312ee5b4eb70adb2e67db89eb1c60b7600ca7
+size 2413303376

model-00086-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:93efb923a42b00c3f032033fd8075ebb9d2b3385bfae2e194427b3b5f6f7a2da
+size 4295774896

model-00087-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9bfac8eccdaa8ed912011f8490bd536b2fa948c2b92cb16eb1781553e1dcffd2
+size 2386990784

model-00088-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f69329b9dc9aaf828ce40fb9391175a183c32db904020e2a1bfb422cde443b61
+size 4295774896

model-00089-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c1775a43aff8e3c8da9a8846fca6b7da89838e99148ff5125d76c3c39b78af93
+size 2413303376

model-00090-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:17c3c842fe437c2f39657585d871a32e452a556c823b6a284bd766391af1c226
+size 4295774896

model-00091-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1aed05d680484be9bae1d6b99750c4144285f5f7a5b61aeae54f1b39bd7b04aa
+size 2413303376

model-00092-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0b4177f94e17065ca3ea90f6b348fa63a9668f4ad7e5f4bf70457bf8d7efcf38
+size 4295774896

model-00093-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c73c7698e4c61b4318dbab545edf0f81bd06014daeb238d99052a32b8a833afb
+size 2413303376

model-00094-of-00122.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bd9685b589cf785e3a466ab8942142e3301d084f16b8e103ee12bd46284fd0bc
+size 4295774896