EBR-bench updates include card ban and multi-agent testing
Summary
The introduction of two new experimental settings to the EBR-bench, a benchmark for assessing AI models' abilities in playing the Earthborne Rangers board game, marks a significant development in AI strategy testing. The changes include banning the game's strongest card, which had previously enabled models like GPT-6 Astra to bypass key tactical challenges by exploiting a "pseudo-infinite combo" that circumvented the game’s fatigue mechanic, making it easier to achieve high scores. Additionally, a multi-agent setup was implemented to assess whether the use of subagents could enhance models' exploration of diverse strategies. However, this setup showed limited effect on overall performance. These adjustments aim to ensure that EBR-bench better evaluates genuine strategic learning and adaptation in AI systems, reflecting ongoing advancements in long-horizon task capabilities.