Spaces:
Running
Running
Sync S_bal^test scores and intervals with the technical report
#1
by jean-livingmodels - opened
The leaderboard shows the S_bal^test scores and 95% intervals from the technical report's latest main (dotomics/BOTANIC1-technical-report @ d1bc232d, identical to overleaf). Scores and intervals come from the same evaluation; intervals are not translated onto a point estimate from a different run.
What readers see:
- Botanic1 S/M/L/XL: 0.758 / 0.764 / 0.768 / 0.770. PlantCAD2-L: 0.752.
- Margins over PlantCAD2-L: S +0.006 (not significant under either test), M +0.012 (significant over examples only), L +0.016 and XL +0.018 (significant under both).
- Evo 2 after the report's protocol corrections: 1B 0.709, 7B 0.716, 20B 0.698; Evo2-1b moves up five places.
- Family leaders: Botanic1-XL leads LLR, conservation and TTS; Botanic1-L leads genomic region and TIS; Botanic1-M leads splicing; PlantCAD2-L leads chromatin and PRO-seq; Evo2-40b leads causal variant discovery (0.756).
scripts/sync_leaderboard.py (replaces add_bootstrap_ci.py) regenerates data/leaderboard.json from figures/data/botanic1_scorecard_28.csv and fig3_rerun/rerun_ci.json in the report repo. All S_bal values match botanic1_sbal_vs_baselines.csv to 4 decimals, and the significance table matches sections/tables/sbal_uncertainty.tex. Prose in leaderboard.html and index.html follows sections/results.tex.
Test plan
- Visually check the leaderboard page (bars, whiskers, heatmap tooltips, scatter) on the Space preview.
š¤ Generated with Claude Code
jean-livingmodels changed pull request status to merged