redhillsmediafl/rhm-qwen3-14b-caix

Qwen3 14B - caix

Run Qwen3 14B locally with caix.

Install & run

brew install redhillsmediafl/caix/caix
caix catalog install redhillsmediafl/rhm-qwen3-14b-caix
caix serve --model qwen3-14b-coreai-4bit-ctx40960

At a glance

• Base model: Qwen/Qwen3-14B
• Context: 40,960 tokens (matches base model)
• Quantization: 4-bit Core AI
• Disk: 15.5 GB
• Runs on: Apple silicon with caix 0.2.13-beta+

Status

Package	Runtime	Hardware	RAM	Model	Prompt	Output tokens	Median tok/s
this package	standalone	Apple M1 Ultra	64 GB	Mac Studio (2022)	default decode	128	pending verified result

caix catalog performance-report --model ~/.caix/models/exports/qwen3-14b-coreai-4bit-ctx40960 --repo redhillsmediafl/rhm-qwen3-14b-caix

License

Apache 2.0

_{More open-source work: redhillsmediafl.com/open-source.}