restore winning v8 config on main; README: final-day results (v11-v13 all negative) d7120b7 verified arvindcr4 commited on Jul 26
v11: beam search (num_beams=4) on the answer pass; single change on the 0.2245 v8 config 004b3a0 verified arvindcr4 commited on Jul 26
restore batch=1 default (the winning configuration); v10 batch=4 variant captured at commit 1aa6a60c 72dfaad verified arvindcr4 commited on Jul 25
v10: winning config but batch=4 (tests empirically whether left-padded batching costs exact match; batch=1 winner is commit f283a4a3/8aa238da) 1aa6a60 verified arvindcr4 commited on Jul 25
v9: winning baseline config kept as default; document the 0.2245 rank-1 result; make baseline batch size configurable (default 1, the winning setting) 1c2dbc7 verified arvindcr4 commited on Jul 25
v8: faithful replication of the organizers' baseline (batch=1, no padding, 512 tok, naive parse, no N-forcing) + repetition_penalty=1.0 f0cb1e7 verified arvindcr4 commited on Jul 25
v6: pass repetition_penalty=1.0 explicitly (model ships 1.05, silently applied under greedy) 09ed4d9 verified arvindcr4 commited on Jul 25
v5: revert to the best-measured config (submission 2) + match_letters assignment solver d32c9e0 verified arvindcr4 commited on Jul 25
v4: mirror the problem's own gloss style (36/36 verified) instead of forcing capitalisation; equation-aware text_to_num; digit+letter-case normalisation (99.9% safe on 920 golds) e8d32e6 verified arvindcr4 commited on Jul 25
v4 981a->mirror: answer style copies the problem's own gloss style (measured 36/36); equation-aware text_to_num; one-to-one match_letters 6457bd8 verified arvindcr4 commited on Jul 25
answer-style guidance per task type (closes the EM/chrF gap); relax pass margin to 1.1 5c73efd verified arvindcr4 commited on Jul 25
fix: greedy-anchored voting (symmetric vote cost 4x EM on mock), truncation diagnostic 86077a9 verified arvindcr4 commited on Jul 25
script.py: aligned answer blocks, self-consistency voting, task-type format hints 73ebad8 verified arvindcr4 commited on Jul 25