How Can I Publish My LLM Benchmark Without Giving the True Answers Away? Paper • 2505.18102 • Published May 23, 2025 • 2
Running Repro — CapBencher: Give Your LLM Benchmark a Built-in Alarm for Test-Set Overfitting (formerly “How Can I Publish My LLM Benchmark Without Giving the True Answers Away?”) 🎯 Explore and sync LLM benchmark logs with a collaborative agent