tau2 telecom full-114: 0.965 (110/114), conc profile
Browse files
README.md
CHANGED
|
@@ -87,7 +87,7 @@ measured on the same hardware.
|
|
| 87 |
| GSM8K flexible / strict (n=50) | 0.86 / 0.84 | **0.92 / 0.88** | 0.90 / 0.88 |
|
| 88 |
| IFEval inst-strict (n=80) | **0.875** | 0.875 [0.836–0.883]⁵ | 0.867 |
|
| 89 |
| IFEval prompt-strict (n=80) | 0.800 | 0.738 | 0.813 |
|
| 90 |
-
| τ²-bench telecom reward (n=114) |
|
| 91 |
|
| 92 |
⁵DFlash IFEval cells are 5-seed median [range]. Short-suite single-seed cells (±2 items ≈ noise): the quant sits at or above its official
|
| 93 |
FP8 reference. \*Speculative decoding is distribution-preserving (rejection sampling), so
|
|
|
|
| 87 |
| GSM8K flexible / strict (n=50) | 0.86 / 0.84 | **0.92 / 0.88** | 0.90 / 0.88 |
|
| 88 |
| IFEval inst-strict (n=80) | **0.875** | 0.875 [0.836–0.883]⁵ | 0.867 |
|
| 89 |
| IFEval prompt-strict (n=80) | 0.800 | 0.738 | 0.813 |
|
| 90 |
+
| τ²-bench telecom reward (n=114) | **0.965** (110/114) | same distribution* | not measured |
|
| 91 |
|
| 92 |
⁵DFlash IFEval cells are 5-seed median [range]. Short-suite single-seed cells (±2 items ≈ noise): the quant sits at or above its official
|
| 93 |
FP8 reference. \*Speculative decoding is distribution-preserving (rejection sampling), so
|