decider-4b-fp8 / generation_config.json
fogf's picture
decider-4b-fp8: quantized weights and model card
c69c18f verified
Raw History Blame
116 Bytes
{
"_from_model_config": true,
"eos_token_id": 248044,
"transformers_version": "5.17.0",
"use_cache": true
}