Instructions to use apocryphx/gemma-4-31b-it-qat-q4-apml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use apocryphx/gemma-4-31b-it-qat-q4-apml with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download apocryphx/gemma-4-31b-it-qat-q4-apml --local-dir gemma-4-31b-it-qat-q4-apml
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
|
Download README.md from apocryphx/gemma-4-31b-it-qat-q4-apml: direct link, hf CLI and curl.
- Browser
- Download file 1.14 kB
-
https://huggingface.co/apocryphx/gemma-4-31b-it-qat-q4-apml/resolve/main/README.md
- Command line
-
hf download hf://apocryphx/gemma-4-31b-it-qat-q4-apml/README.md
-
curl -L -o README.md https://huggingface.co/apocryphx/gemma-4-31b-it-qat-q4-apml/resolve/main/README.md
1.14 kB
| license: gemma | |
| base_model: google/gemma-4-31B-it-qat-q4_0-unquantized | |
| tags: | |
| - apertura | |
| - apml | |
| - mlx | |
| - quantized | |
| - gemma4 | |
| # gemma-4-31b-it-qat-q4.apml — Apertura model bundle | |
| Gemma 4 31B instruction-tuned, Google's QAT-Q4 weights converted to the | |
| **Apertura `.apml` bundle format**: MLX-affine 4-bit quantization | |
| (group size 64, 8-bit embeddings), `tokenizer.json` + | |
| `chat_template.jinja` included, runtime `mlx`, architecture `gemma4`. | |
| Consumed by [Apertura](https://github.com/apocryphx/Apertura) — an | |
| Objective-C++ transformer engine + macOS chat app on MLX. | |
| ## Download | |
| ```sh | |
| hf download apocryphx/gemma-4-31b-it-qat-q4-apml --local-dir gemma-4-31b-it-qat-q4.apml | |
| ``` | |
| ## License | |
| Gemma is provided under and subject to the | |
| [Gemma Terms of Use](https://ai.google.dev/gemma/terms). By downloading this | |
| model you agree to those terms, including the | |
| [Gemma Prohibited Use Policy](https://ai.google.dev/gemma/prohibited_use_policy). | |
| This repository redistributes a quantized **Model Derivative** of | |
| `google/gemma-4-31B-it-qat-q4_0-unquantized`; the same terms and use | |
| restrictions apply to it and to any further derivatives. | |