redhillsmediafl/rhm-gemma-4-31b-it-mm-staged-caix

Gemma 4 31B IT MM Staged - caix

Run Gemma 4 31B IT MM Staged with caix as a staged multimodal package.

Install & run

brew install redhillsmediafl/caix/caix
caix catalog install redhillsmediafl/rhm-gemma-4-31b-it-mm-staged-caix
caix serve --model gemma4-31b-it-mm-splitcache-masked-singleasset-staged-4bit-ctx256k-6x10

At a glance

• Base model: google/gemma-4-31B-it
• Context: 262,144 tokens (matches base model)
• Quantization: 4-bit Core AI
• Disk: 19.0 GB
• Runs on: Apple silicon with caix 0.2.13-beta+

Status

Package	Runtime	Hardware	RAM	Model	Prompt	Output tokens	Median tok/s
staged package	staged/distributed	Apple silicon	-	-	package-specific staged request	-	pending verified result
staged package	local same-machine staged	Apple silicon	-	-	default decode	-	pending verified result

For optimized single-device speed, use redhillsmediafl/rhm-gemma-4-31b-it-mm-monolithic-caix.

caix catalog performance-report --model ~/.caix/models/exports/gemma4-31b-it-mm-splitcache-masked-singleasset-staged-4bit-ctx256k-6x10 --repo redhillsmediafl/rhm-gemma-4-31b-it-mm-staged-caix

License

Gemma license

_{More open-source work: redhillsmediafl.com/open-source.}