Sync S_bal^test scores and intervals with the technical report

#1
Living Models org

The leaderboard shows the S_bal^test scores and 95% intervals from the technical report's latest main (dotomics/BOTANIC1-technical-report @ d1bc232d, identical to overleaf). Scores and intervals come from the same evaluation; intervals are not translated onto a point estimate from a different run.

What readers see:

  • Botanic1 S/M/L/XL: 0.758 / 0.764 / 0.768 / 0.770. PlantCAD2-L: 0.752.
  • Margins over PlantCAD2-L: S +0.006 (not significant under either test), M +0.012 (significant over examples only), L +0.016 and XL +0.018 (significant under both).
  • Evo 2 after the report's protocol corrections: 1B 0.709, 7B 0.716, 20B 0.698; Evo2-1b moves up five places.
  • Family leaders: Botanic1-XL leads LLR, conservation and TTS; Botanic1-L leads genomic region and TIS; Botanic1-M leads splicing; PlantCAD2-L leads chromatin and PRO-seq; Evo2-40b leads causal variant discovery (0.756).

scripts/sync_leaderboard.py (replaces add_bootstrap_ci.py) regenerates data/leaderboard.json from figures/data/botanic1_scorecard_28.csv and fig3_rerun/rerun_ci.json in the report repo. All S_bal values match botanic1_sbal_vs_baselines.csv to 4 decimals, and the significance table matches sections/tables/sbal_uncertainty.tex. Prose in leaderboard.html and index.html follows sections/results.tex.

Test plan

  • Visually check the leaderboard page (bars, whiskers, heatmap tooltips, scatter) on the Space preview.

šŸ¤– Generated with Claude Code

jean-livingmodels changed pull request status to merged

Sign up or log in to comment