MiMo-V2.6-Flash-RL-exl3 / eval /dflash-bench-dflash-dynamic.json
benthecarman's picture
Model card, corrected config.json, repaired DFlash drafter config, eval artifacts
3d2885d verified
Raw History Blame
1.78 kB
{
"model": "/data/hf/exl3/mimo-2.25bpw-hq",
"draft": "/data/hf/exl3/mimo-dflash-draft",
"tokens": 512,
"stamp": "20260922-042903",
"runs": {
"coding": {
"dflash": {
"new_tokens": 235,
"seconds": 6.041,
"ttft": 1.692,
"tok_per_s": 38.9,
"accepted": 197,
"rejected": 46,
"text_head": "```python\ndef merge_intervals(intervals):\n \"\"\"Merge overlapping closed integer intervals.\n\n Args:\n intervals: list of (start, end) tuples.\n\n Returns:\n list of merged (start, end",
"prompt_tokens": 56,
"accept_pct": 81.07,
"mean_accepted_per_step": 6.184
}
},
"prose": {
"dflash": {
"new_tokens": 312,
"seconds": 11.476,
"ttft": 0.465,
"tok_per_s": 27.19,
"accepted": 124,
"rejected": 122,
"text_head": "The rain has been falling since dusk, a steady hand that smooths the harbour into a dark mirror. From the gallery, I watch the last fishing boats nose toward the quay, their lamps smeared into soft go",
"prompt_tokens": 55,
"accept_pct": 50.41,
"mean_accepted_per_step": 1.66
}
},
"reasoning": {
"dflash": {
"new_tokens": 512,
"seconds": 9.199,
"ttft": 0.506,
"tok_per_s": 55.66,
"accepted": 414,
"rejected": 199,
"text_head": "<think>Let me work through this step by step.\n\n**Train 1 (from A):**\n- Departs at 09:00\n- Speed: 60 km/h\n- Distance to B: 300 km\n\n**Train 2 (from B):**\n- Departs at 09:40\n- Speed: 90 km/h\n- Distance t",
"prompt_tokens": 76,
"accept_pct": 67.54,
"mean_accepted_per_step": 5.224
}
}
},
"dynamic_draft": true
}