MiMo-V2.6-Flash-RL-exl3 / eval /dflash-bench-ngram.json
benthecarman's picture
Model card, corrected config.json, repaired DFlash drafter config, eval artifacts
3d2885d verified
Raw History Blame
1.75 kB
{
"model": "/data/hf/exl3/mimo-2.25bpw-hq",
"draft": "/data/hf/exl3/mimo-dflash-draft",
"tokens": 512,
"stamp": "20260922-042716",
"runs": {
"coding": {
"ngram": {
"new_tokens": 235,
"seconds": 9.596,
"ttft": 1.043,
"tok_per_s": 24.49,
"accepted": 32,
"rejected": 144,
"text_head": "```python\ndef merge_intervals(intervals):\n \"\"\"Merge overlapping closed integer intervals.\n\n Args:\n intervals: list of (start, end) tuples.\n\n Returns:\n list of merged (start, end",
"prompt_tokens": 56,
"accept_pct": 18.18,
"mean_accepted_per_step": 1.158
}
},
"prose": {
"ngram": {
"new_tokens": 359,
"seconds": 12.783,
"ttft": 0.404,
"tok_per_s": 28.08,
"accepted": 3,
"rejected": 165,
"text_head": "The rain has been falling since dusk, a steady hand on the glass of my lantern room. Below, the harbour town folds itself into the wet, its slate roofs shining like fish scales and its narrow lanes ru",
"prompt_tokens": 55,
"accept_pct": 1.79,
"mean_accepted_per_step": 1.008
}
},
"reasoning": {
"ngram": {
"new_tokens": 512,
"seconds": 16.683,
"ttft": 0.433,
"tok_per_s": 30.69,
"accepted": 143,
"rejected": 435,
"text_head": "<think>Let me work through this step by step.\n\nTrain 1: Leaves A at 09:00, speed 60 km/h, heading toward B (300 km away)\nTrain 2: Leaves B at 09:40, speed 90 km/h, heading toward A\n\nLet me set up coor",
"prompt_tokens": 76,
"accept_pct": 24.74,
"mean_accepted_per_step": 1.388
}
}
}
}