gemma-4-31b-it-qat-q4-g32-apml / generation_config.json
apocryphx's picture
bundle: gemma-4-31b-it QAT q4 g32 (mlx-affine g32, embed q8)
1ee1862 verified
Raw History Blame Contribute Delete
203 Bytes
{
"bos_token_id": 2,
"do_sample": true,
"eos_token_id": [
1,
106,
50
],
"pad_token_id": 0,
"temperature": 1.0,
"top_k": 64,
"top_p": 0.95,
"transformers_version": "5.6.2"
}