frankmorales2020's picture
DeepSeek-V2-Lite FP8 TOPO-2026 | Embeddings BF16 | MoE gates BF16 | MLA kv_a BF16 | LLMCompressor
00f9c8d verified
Raw
History Blame Contribute Delete
214 Bytes
default_stage:
default_modifiers:
QuantizationModifier:
targets: [Linear]
ignore: [lm_head, 're:.*gate.*', 're:.*embed.*', 're:.*kv_a.*']
scheme: FP8
bypass_divisibility_checks: false