AutomatosX's picture
Add native AXQuant NVFP4 W4A4 development checkpoint with two-GPU evidence
f93bb79 verified
Raw History Blame Contribute Delete
313 Bytes
{
"word_embedding_dimension": 4096,
"pooling_mode_cls_token": false,
"pooling_mode_mean_tokens": false,
"pooling_mode_max_tokens": false,
"pooling_mode_mean_sqrt_len_tokens": false,
"pooling_mode_weightedmean_tokens": false,
"pooling_mode_lasttoken": true,
"include_prompt": true
}