File size: 1,461 Bytes
4bcf80e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | # MiniCPM5-2B release notices
The checkpoint is OpenBMB's `MiniCPM5-2B-GPTQ` revision
`6c1ee6fa521aa53f47cfb32696e6d8ef5b0db805`, under Apache-2.0.
The name says GPTQ; its actual stored tensors use asymmetric AWQ GEMM packing,
4-bit weights, group size 128. We redistribute a pinned downloader, not weights
inside the container. The original checkpoint is unchanged. Runtime preparation
losslessly transposes packed nibbles, scales and zero points in GPU memory.
No calibration or additional quantization is performed. The publisher does not
establish an exact BF16 source revision or calibration dataset in this checkpoint's
metadata; we do not claim to reproduce their quantization procedure.
The checkpoint license is retained in `LICENSES/MiniCPM-Apache-2.0.txt`, from
OpenBMB/MiniCPM commit `f7988734fb95d43091dfda2d3c618ed2ebf0a9d0`.
Retain applicable copyright notices, license and modification attribution when
redistributing. This license permits commercial redistribution subject to its terms.
The plugin and retained vLLM/AITemplate components use Apache-2.0. ROCm,
Composable Kernel and other runtime components retain their respective notices
and licenses in the image and repository's top-level `LICENSES` and
`THIRD_PARTY_NOTICES.md`. The lazy FlashAttention import patch modifies the pinned
vLLM runtime; its original SPDX notice is retained. Paiton compiled artifacts
contain generated runtime code; private compiler source is not included.
|