OpenAI Web Search ranks 5th on Artificial Analysis Search Index

Summary

OpenAI Web Search has launched on the Artificial Analysis Search Index, debuting at a score of 74, placing it fifth among search providers including leaders Perplexity, Octen, Parallel, and Brave. This integrated search tool leverages OpenAI's proprietary web_search feature, allowing it to efficiently execute the entire search loop through the OpenAI Responses API, which reduces token consumption compared to other Search API offerings. Despite its competitive pricing at approximately $0.05 per task—making it cheaper than most offerings on the board—OpenAI Web Search ranks well, achieving the third-highest accuracy on the AA-Omniscience benchmark for factual answers. The benchmarking process evaluates search providers based on a fixed model to ensure consistent quality, cost, and latency metrics.

Tokens

$OPENAI

Analysis

OpenAI: OpenAI is an AI research and deployment company focused on developing advanced language models and integrated tools for developers. Its Web Search feature provides a native search capability directly within model interactions rather than relying on external API calls. In the news, OpenAI's built-in web_search tool is evaluated on the Artificial Analysis Search Index using GPT-5.6 Luna. GPT-5.6 Luna: GPT-5.6 Luna is an OpenAI language model variant configured for medium reasoning effort in agentic tasks. It serves as the candidate answer model in the benchmark, paired with different search providers to measure uplift. In the news, it powers all setups including the OpenAI Web Search evaluation. Responses API: Responses API is an OpenAI interface that enables models to handle tool calls and responses in a single interaction. It supports built-in tools like web_search without external agent loops. In the news, OpenAI Web Search executes entirely within one Responses API call using the web_search tool. Artificial Analysis: Artificial Analysis runs independent benchmarks and leaderboards for AI models, search providers, and related tools. It maintains the Search Index that evaluates search-enhanced performance across multiple quality metrics. In the news, the organization publishes results placing OpenAI Web Search fifth on its leaderboard. Efficiency: The approach reduces token usage compared with many Search API providers while maintaining competitive benchmark performance. Integration: OpenAI Web Search executes the full search loop internally via its native tool rather than using external agent frameworks. Benchmarking: Artificial Analysis evaluates search providers in an agentic setting using a fixed model across quality, cost, and latency dimensions.

Categories

aiai_agentstechhyperliquid
View Original Tweet