immanuelpeter/Muse-Glimmer-Vision

Muse Glimmer Vision

This repository packages the Tower and Projector from Muse-Glimmer-30B.

Contents

File	Tensors	What it holds
model.safetensors	806	Muse Glimmer Tower
projector.safetensors	3	Two vision-adapter matrices and the language-width projection
projector_config.json, projector.py		Projector shapes and loader
config.json, preprocessor_config.json		Vision-only model and image-processing configuration

Architecture

Component	Details
Tower	50 layers, 1536 hidden, 16 heads, 8960 intermediate, patch size 14
Token compression	2x2 pixel shuffle, no learned parameters
Projector	Linear(6144, 4096), GELU, Linear(4096, 4096), GELU, Linear(4096, 6656), scale-free RMSNorm(6656)

All three Projector linear layers omit bias. The native MuseGlimmerVisionModel returns the merged 6144-wide tokens; projector.py maps them to the 6656-wide language space.

Usage

See examples/inference.py for image feature extraction.

Validation

The release tests compare all 806 Tower tensors and three Projector tensors with the pinned parent checkpoint using torch.equal. Fixed-image merged and projected outputs also match the parent implementation bit-for-bit on CPU and in BF16 on an NVIDIA A100.

Reproduction

The export script reads the Tower and Projector ranges from both meta-models/Muse-Glimmer-30B shards. It removes the parent prefixes, preserves the original BF16 weights, and extracts the image section of the parent processor configuration. The script pins the parent revision.

Credits

Meta released the Muse Glimmer weights and the native Transformers implementation.

License

Apache License 2.0, the same license as the source model. The source usage policy is included.