mixtral-8x7b-fp8-topo2026 / generation_config.json
frankmorales2020's picture
Mixtral-8x7B FP8 TOPO-2026 | Embeddings BF16 | MoE gates BF16 | LLMCompressor
88db8d8 verified
Raw
History Blame
111 Bytes
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 2,
"transformers_version": "4.57.6"
}