Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards
Abstract
Tev-Gym provides verified long-horizon training environments with dense progressive rewards, and progress-potential reward shaping enables efficient training of Tev-27B, which achieves competitive long-horizon agent performance.
Long-horizon agents have drawn growing attention for their ability to work autonomously -- from hours to days -- on economically valuable tasks, a capability essential to automated discovery and recursive self-improvement (RSI). Yet open-source models still struggle on long-horizon tasks, largely for lack of both training data and a working recipe, and scaling both is hard: long, complex tasks are difficult to curate and verify, and their rewards are sparse. We address both. First, we introduce Tev-Gym, the first long-horizon agent training dataset with verifiable, dense, progressive rewards -- 1,170 verified task environments across 7 domains. It is built on a latent-world-first approach that first constructs a latent world: a complete and correct hidden specification of the task domain, workflow, and expected state after each step. Each task is then progressively rendered from this specification into an agent-facing environment, enabling controllable complexity and a natural progress metric. Second, we turn this metric into a training recipe: via progress-potential reward shaping (PPRS), we convert progress into a dense per-step reward that improves training efficiency and makes otherwise-intractable tasks trainable. Training with this recipe yields Tev-27B, which achieves substantial gains on the Agents' Last Exam computing and math sciences domains (ALE-CM), matching GPT-6 Astra and Claude Opus 5 at Pass@5. Despite training only on ALE-related data, it generalizes to the Terminal-Bench (TB) 3.0 and 4.0 subsets, surpassing GLM 5.2 and Gemini 3.7 Flash, and reaches Claude Opus 4.8-level performance on middle-horizon tasks such as TB 2.1.
Community
How to scale long-horizon agentic RL envs? ๐ค
๐ We introduce Tev-Gym: 1,170 envs with dense progress rewards. Trained on it:
๐ฅ Tev-27B matches GPT-6 Astra & Claude Opus 5 on ALE-CM (Pass@5)
๐ Tev-320B tops open models on Terminal-Bench 4.0-CM
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments (2026)
- CompoWorld: Compositional Environment Scaling for General Agents (2026)
- Scaling Agentic Data for Long-Horizon Terminal Intelligence (2026)
- Explore More, Drift Less: Outcome-Only Reinforcement Learning Can Suffice for Long-Horizon Interactive Agents (2026)
- T1: Terminal Agent Reinforcement Learning for Long-Horizon Tasks (2026)
- DRACO: Fine-Grained Credit Assignment with Dynamic Rubrics for Long-Horizon Agent Training (2026)
- Learning Generalizable Behaviors for Terminal Agents (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.18868 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 3
gordonhu/Tev-27B
Datasets citing this paper 0
No dataset linking this paper