Instructions to use apocryphx/gemma-4-E2B-it-q4-apml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use apocryphx/gemma-4-E2B-it-q4-apml with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download apocryphx/gemma-4-E2B-it-q4-apml --local-dir gemma-4-E2B-it-q4-apml
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 834 Bytes
e5dca01 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 | {
"config" : "config.json",
"source" : {
"revision" : "",
"model_id" : "\/Volumes\/Macintosh HD - Data\/Users\/apocryphx\/.cache\/huggingface\/hub\/models--google--gemma-4-E2B-it\/snapshots\/70af34e20bd4b7a91f0de6b22675850c43922a03"
},
"variants" : [
{
"path" : "weights\/mlx-q4",
"id" : "mlx-q4",
"quantization" : {
"embed_bits" : 8,
"bits" : 4,
"scheme" : "mlx-affine",
"group_size" : 64
},
"precision" : "q4",
"files" : [
"model.safetensors"
],
"runtime" : "mlx"
}
],
"tokenizer" : {
"file" : "tokenizer.json",
"kind" : "huggingface-tokenizers"
},
"chat_template" : "chat_template.jinja",
"architecture" : "gemma4",
"kind" : "apertura-model",
"format_version" : 1,
"default_variant" : "mlx-q4"
} |