129 GB
46 files
Updated about 2 months ago
Name
Size
figures
.gitattributes1.58 kB
xet
LICENSE3.34 kB
xet
README.md5.46 kB
xet
added_tokens.json1.66 kB
xet
chat_template.jinja12 kB
xet
config.json5.72 kB
xet
configuration_minimax_m3_vl.py4.36 kB
xet
generation_config.json374 Bytes
xet
hf_quant_config.json373 Bytes
xet
image_processor.py7.86 kB
xet
merges.txt2.41 MB
xet
model-00001-of-00024.safetensors5.37 GB
xet
model-00002-of-00024.safetensors5.38 GB
xet
model-00003-of-00024.safetensors5.37 GB
xet
model-00004-of-00024.safetensors5.37 GB
xet
model-00005-of-00024.safetensors5.37 GB
xet
model-00006-of-00024.safetensors5.37 GB
xet
model-00007-of-00024.safetensors5.37 GB
xet
model-00008-of-00024.safetensors5.37 GB
xet
model-00009-of-00024.safetensors5.37 GB
xet
model-00010-of-00024.safetensors5.37 GB
xet
model-00011-of-00024.safetensors5.37 GB
xet
model-00012-of-00024.safetensors5.37 GB
xet
model-00013-of-00024.safetensors5.37 GB
xet
model-00014-of-00024.safetensors5.37 GB
xet
model-00015-of-00024.safetensors5.37 GB
xet
model-00016-of-00024.safetensors5.37 GB
xet
model-00017-of-00024.safetensors5.37 GB
xet
model-00018-of-00024.safetensors5.37 GB
xet
model-00019-of-00024.safetensors5.37 GB
xet
model-00020-of-00024.safetensors5.37 GB
xet
model-00021-of-00024.safetensors5.37 GB
xet
model-00022-of-00024.safetensors5.37 GB
xet
model-00023-of-00024.safetensors5.37 GB
xet
model-00024-of-00024.safetensors5.29 GB
xet
model.safetensors.index.json5.44 MB
xet
preprocessor_config.json772 Bytes
xet
processing_minimax.py9.97 kB
xet
special_tokens_map.json277 Bytes
xet
tokenizer.json9.73 MB
xet
tokenizer_config.json23.7 kB
xet
video_processor.py7.32 kB
xet
vocab.json4.71 MB
xet
README.md

NOTICE

This is an experimental quantization of MiniMax M3 to NVFP4 for use on DGX Spark.

On top of that, REAP 50% to make it fix on 2x DGX Sparks instead of 4x.

NVFP4 uses w1/3 scales, so need either: https://github.com/scitrera/sglang/tree/nvfp4-w13-scale-normalization (or possibly sglang PR#27588) in place to properly use the calibration from this model.

The calibration is still a work in progress (hence "v0" model). Updates are planned to improve performance.

Re: REAP50, I've tested that it's coherent, but I haven't exhaustively tested the quality degradation associated with REAP50. YMMV.

Run with sparkrun; part of Spark Arena

https://sparkrun.dev https://spark-arena.com

To run with sparkrun on 2x DGX Spark Nodes:

sparkrun run @experimental/minimax-m3-v0-nvfp4-2x-reap50
MiniMax

MiniMax Agent API MiniMax Website
WeChat Discord Hugging Face GitHub arXiv Paper LICENSE

MiniMax-M3 is a native multimodal model with 1M context. It has ~428B parameters and ~23B activated parameters.

Highlights:

  • Native Multimodality: M3 undergoes mixed-modality training from the very first step, enabling deeper semantic fusion across text, image, and video.
  • Context Scaling via Sparse Attention: M3 introduces MiniMax Sparse Attention (MSA) to improve long context efficiency. M3 delivers 9ร— prefill and 15ร— decode speedups compared to M2 at 1M context, reducing per-token compute to 1/20.
  • Coding & Cowork Capability: M3 achieves frontier-level performance across long-horizon agentic benchmarks, excelling in both coding and cowork.

MiniMax Sparse Attention (MSA)

M3 is powered by MiniMax Sparse Attention (MSA), a high-performance sparse attention operator designed for million-token contexts. Compared with GQA, MSA dramatically reduces the attention compute and memory footprint while preserving model quality.

GQA vs MSA Efficiency Comparison

๐Ÿ“„ Read the technical report: arXiv:2606.13392 ยท Hugging Face Papers

How to Use

M3 supports two reasoning modes:

  • thinking โ€” for complex reasoning, agentic tasks, and long-horizon collaboration.
  • non-thinking โ€” for latency-sensitive scenarios such as chat and code completion.

Local Deployment

Download the model:

hf download MiniMaxAI/MiniMax-M3 --local-dir MiniMax-M3

We recommend the following inference frameworks (listed alphabetically) to serve the model:

Inference Parameters

We recommend the following parameters for best performance: temperature=1.0, top_p=0.95, top_k=40.

Contact Us

Contact us at model@minimax.io.

Total size
129 GB
Files
46
Last updated
Jul 21
Pre-warmed CDN
US EU US EU

Contributors