maya / maya_config.json
VishalMysore's picture
Maya v0.2 (DeBERTa-v3-large fine-tune)
1356723 verified
Raw History Blame Contribute Delete
555 Bytes
{
"p_yes": "sigmoid((logit_yes - logit_no) / temperature)",
"temperature": 1.65,
"temperature_fitted_on": "data/dev (64 hand-labeled answers, never a test set)",
"thresholds": {
"t_yes": 0.5,
"t_no": 0.5
},
"thresholds_note": "Default is strict yes/no. For 'not sure' with a bounded error rate, fit maya.conformal.Abstainer on a labeled sample of your own inputs (a few hundred answers per side are needed to certify ~10% error).",
"pad_token_id": 0,
"version": "0.2",
"base_model": "MoritzLaurer/deberta-v3-large-zeroshot-v2.0"
}