Instructions to use selimaktas/MiniMax-M2.75-460B-A20B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use selimaktas/MiniMax-M2.75-460B-A20B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="selimaktas/MiniMax-M2.75-460B-A20B", trust_remote_code=True)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("selimaktas/MiniMax-M2.75-460B-A20B", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("selimaktas/MiniMax-M2.75-460B-A20B", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use selimaktas/MiniMax-M2.75-460B-A20B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "selimaktas/MiniMax-M2.75-460B-A20B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "selimaktas/MiniMax-M2.75-460B-A20B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/selimaktas/MiniMax-M2.75-460B-A20B

SGLang

How to use selimaktas/MiniMax-M2.75-460B-A20B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "selimaktas/MiniMax-M2.75-460B-A20B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "selimaktas/MiniMax-M2.75-460B-A20B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "selimaktas/MiniMax-M2.75-460B-A20B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "selimaktas/MiniMax-M2.75-460B-A20B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use selimaktas/MiniMax-M2.75-460B-A20B with Docker Model Runner:
```
docker model run hf.co/selimaktas/MiniMax-M2.75-460B-A20B
```

selimaktas commited on Apr 14

Commit

c323809

verified ·

1 Parent(s): f5d90fe

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00005-of-00130.safetensors +3 -0
model-00009-of-00130.safetensors +3 -0
model-00012-of-00130.safetensors +3 -0
model-00021-of-00130.safetensors +3 -0
model-00023-of-00130.safetensors +3 -0
model-00025-of-00130.safetensors +3 -0
model-00026-of-00130.safetensors +3 -0
model-00029-of-00130.safetensors +3 -0
model-00031-of-00130.safetensors +3 -0
model-00036-of-00130.safetensors +3 -0
model-00037-of-00130.safetensors +3 -0
model-00039-of-00130.safetensors +3 -0
model-00045-of-00130.safetensors +3 -0
model-00047-of-00130.safetensors +3 -0
model-00050-of-00130.safetensors +3 -0
model-00055-of-00130.safetensors +3 -0
model-00057-of-00130.safetensors +3 -0
model-00058-of-00130.safetensors +3 -0
model-00059-of-00130.safetensors +3 -0
model-00060-of-00130.safetensors +3 -0
model-00061-of-00130.safetensors +3 -0
model-00067-of-00130.safetensors +3 -0
model-00069-of-00130.safetensors +3 -0
model-00070-of-00130.safetensors +3 -0
model-00071-of-00130.safetensors +3 -0
model-00072-of-00130.safetensors +3 -0
model-00073-of-00130.safetensors +3 -0
model-00074-of-00130.safetensors +3 -0
model-00078-of-00130.safetensors +3 -0
model-00082-of-00130.safetensors +3 -0
model-00084-of-00130.safetensors +3 -0
model-00085-of-00130.safetensors +3 -0
model-00086-of-00130.safetensors +3 -0
model-00090-of-00130.safetensors +3 -0
model-00094-of-00130.safetensors +3 -0
model-00095-of-00130.safetensors +3 -0
model-00096-of-00130.safetensors +3 -0
model-00097-of-00130.safetensors +3 -0
model-00098-of-00130.safetensors +3 -0
model-00101-of-00130.safetensors +3 -0
model-00103-of-00130.safetensors +3 -0
model-00108-of-00130.safetensors +3 -0
model-00109-of-00130.safetensors +3 -0
model-00111-of-00130.safetensors +3 -0
model-00113-of-00130.safetensors +3 -0
model-00115-of-00130.safetensors +3 -0
model-00117-of-00130.safetensors +3 -0
model-00119-of-00130.safetensors +3 -0
model-00120-of-00130.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text

model-00005-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99444d6d83c614776397faa167dc908d48016414e0dd6edef57fd9c040e01d21
+size 1208321176

model-00009-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d897820ce912aa7ae2feb4377d9b8684eca38c18be550b6bcf7316cb9d7c6e30
+size 1208321176

model-00012-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5acd7bea7c66cf78466e23bb113bd6ff5cc3f85d1c8df3376620235855612aa
+size 2467015696

model-00021-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8a76ddac05820e58676b3b56e2990c598dae551f1f65adf55a90a3754f66e2b4
+size 1208321688

model-00023-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9eee017222d3eb90afa5126fccb194de12c67828bd4353b3a466ce3da17877d2
+size 1208321688

model-00025-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:68580bdb4da65c22fb95a16e7fe13b1f0bbde861327d7c0bb6cb76a86794d38d
+size 1208321688

model-00026-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b87241ff5fd0c6028d2778262d5728930d44b820251bcfee0e9d747c060522f0
+size 2467016728

model-00029-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:961ca8675f7ee7a1a65e5ea5f1e35dfe7427d566e68a1f56f04a463252763683
+size 1208321688

model-00031-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:345042a4520442dccd7428238a2d80a5b5b7d990d1d5b61395ffcaad7e4e8794
+size 1208321688

model-00036-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:42366e2e52d479f79319157d1ba902ba363c1c38f248c7a939d3aa7767f0bd2b
+size 2467016728

model-00037-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3a42e3dfe02d8f2b8b2bfc8d35942e93de8746f74f88390f66d2106d6d7ee328
+size 1208321688

model-00039-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bbf5e9eff7646b206eb25ba1a744d6d2e3544b3713638692a5869f8ef7143680
+size 1208321688

model-00045-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:54673ecdf05ea6b01934af72c258b05fd6c6018d0cd2d9acec530116d16285db
+size 1208321688

model-00047-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:38785114c81c6545b8ddefde004e154bd75a0095de6d1f59cb8e5b36d209d069
+size 1208321688

model-00050-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:038b05edeef7dac635d11169d9c8f39ba1a0dd5e44b3cdc82d771269069ec0b9
+size 2467016728

model-00055-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:da2a90dda71ac298bcda0d6ef83dc28a129fe66ecefe27a064d3637c4f3f723d
+size 1208321688

model-00057-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1e8d73847187dc7d4da9a41ed3f5e7fd8f324d14eb107845188138b464299eb8
+size 1208321688

model-00058-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f142cffff7bdb0c5c5e80a11569fabb3089d5bf35a1e274ce31a5dffea30d83
+size 2467016728

model-00059-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2f19cb6bc24a9937faffa46939c209f5ef790825e964cb6a2b86ab56719bfe2b
+size 1208321688

model-00060-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b4363ef2d197586c528060e539e619f0ea67c6d838ce5049a47fc738fb42c26
+size 2467016728

model-00061-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0ed80e6f71a57a8d74ffcb046d39c836441efb2d2bbe542299550b929a2d6ceb
+size 1208321688

model-00067-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4bface08c504ab1bf82e693c360accc76e49e579908e9b59dbd730ba9b8d756a
+size 1208321688

model-00069-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:246239f37d0a7ac21cb105235861fbe48945361dbd5091d5cf1cffa5d5d24e14
+size 1208321688

model-00070-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c4a96c5297de1e8056f9cc570720f1f33069ab7fe11b5319e7e739fbaf29e4d9
+size 2467016728

model-00071-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9e1a3b6d59ca4dcf99af877931f96cee754eb5019648f10b0fe01803c57a53b2
+size 1208321688

model-00072-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a5922397e4c9c428b0d7be90e13df8dbf315fe480e9d1dd584ed89fa1d666202
+size 2467016728

model-00073-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c71864e0febd666681bd413d2deaa82103227eaf4a77a42c00ca5b9f363c969d
+size 1208321688

model-00074-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c69243308af976e5d99883842efefb582c6f6b3a45658d207c122768abee93a7
+size 2467016728

model-00078-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e6d7f3ec3cbae4cf636c92d2e9f77e7f97d4c533656ad988b3ec50894097fe56
+size 2467016728

model-00082-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fea0f75e84d539b7ccecc7f2396578b4165f01e3bde14ca27e4d08346b6e1d0e
+size 2467016728

model-00084-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e54af99fee001e9b5b887d09fcca307fe7f21406095a26e50f87f525f25a7e8a
+size 2467016728

model-00085-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:35ea447ad683c811138d91696d8fda8008293a785518b7b86b1aa6c9ddc209b9
+size 1208321688

model-00086-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8398cf9d4f7cc806bc4c12b47246a887015e6ac1b737bfe570254628859c2fc
+size 2467016728

model-00090-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e145dd8b131d7c618dead69f5ef17807b232c5b0481fbe433efd1cb17549929b
+size 2467016728

model-00094-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:244f3548ff0784db7a3a134dc87c337176fef7b35cb4a55f1bdfd7ddb95126eb
+size 2467016728

model-00095-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a8480d9cc9216c650a30cd7168244b84aa6762c7835a92600ce198da2d15fbb1
+size 1208321688

model-00096-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:44078df5296b770934dc14bd2d83b54e76d63dd6d2fad083be19854c885d92ba
+size 2467016728

model-00097-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:181466337b86afbc94dfae30196ca15a27ff01b35c5cf3939682032c5c0469c3
+size 1208321688

model-00098-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:342e9b4f89f44db5f54011c2e44be8d3bffb81c26f944fd43ca66360186e34ce
+size 2467016728

model-00101-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:82ed509a2950aacc0a217e61fd8ca43bf06cbd5c6fa734c33bb7e6baec4a85cb
+size 1208321688

model-00103-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4ac162b3348bc1ed712146b4d2a3bf443250c2268bceaca15c8cdce38a7fca7c
+size 1208321688

model-00108-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9904f91d1624426ec81725a27a7610169682ddabf3c68084b933ab167cb9f05f
+size 2467016728

model-00109-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5a528b71b52c2211e6f91deb829d11cb22b655dd57dc251d84ba4fe521e47ba2
+size 1208321688

model-00111-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f63b6c84659c71d9d253bf5c22237c562d3a3fb44c70fd54cca9d7993c35ea04
+size 1208321688

model-00113-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e48bfe3f2a384aebf1038c14c651c69c64a8fac061e5b9547fb7d67da9ee5029
+size 1208321688

model-00115-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:adf4ab941b453ba215787230e4a4f001623a5f06180deb3c5bed050160f463d7
+size 1208321688

model-00117-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7f2a7438c4f6c66ac95eaaaba65c1935bfcb917884e021c30e588c74ac189fc5
+size 1208321688

model-00119-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5cf0b16b764dd9303984a467fe3ad8a04b2b3908e230fc902425ec8746df804e
+size 1208321688

model-00120-of-00130.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:33f4b418d9479c417e2118dc954dfe64c2b9ba64302ee08ce179426b55e02ad5
+size 2467016728