Google's Dream-RSI reduces discovery-agent calls by 162x
Summary
Google researchers have unveiled a new system called Dream-RSI, designed to significantly reduce the number of discovery-agent calls by using a replay simulator that leverages previously accumulated search histories. In tests, Dream-RSI demonstrated the ability to cut discovery-agent calls by up to 162 times compared to existing systems like SimpleTES, highlighting its efficiency in refining exploration loops without the need for repeated costly online reruns. This innovation comes shortly after Dario Amodei published an essay discussing the need to manage AI developments, particularly regarding recursive self-improvement, and emphasizes how Dream-RSI offers practical solutions for enhancing exploration policies by utilizing a structured historical discovery tree.