Artificial Analysis Data Playground enables custom index creation

Summary

Artificial Analysis has enhanced its Data Playground by allowing users to build custom indices with personalized benchmarks and weights, alongside features for advanced analytics such as formula metrics and interactive scatter charts. This announcement follows the release of Decision Index v2 in November 2026, which integrates additional private datasets and introduces a new metric aimed at rewarding model calibration, further expanding the platform's capabilities for data evaluation and visualization.

Analysis

Data Playground: The Data Playground is an interactive tool offered by Artificial Analysis that enables users to construct personalized model evaluation indices by selecting benchmarks, adjusting weights, and visualizing results through charts and heat maps. It includes features for combining metrics with mathematical operations, animating model performance over time by launch date, and comparing open-weight versus proprietary models. Access to the full Data Playground is provided through the Artificial Analysis Pro subscription, aligning with the news item’s focus on custom index creation. Artificial Analysis: Artificial Analysis is an independent AI benchmarking organization that develops and maintains composite indices and leaderboards for evaluating language models across multiple dimensions. It provides tools for developers and researchers to compare models on intelligence, decision-making, and endpoint performance using proprietary and public evaluations. The company recently introduced updates to its Decision Index and continues to expand its suite of agentic and knowledge work benchmarks, directly supporting the custom index-building capabilities promoted in the Data Playground. Artificial Analysis Pro: Artificial Analysis Pro is the paid subscription tier of the Artificial Analysis platform that unlocks advanced analytical tools including the Data Playground. It supports users in performing detailed, customizable model analysis beyond public leaderboards. This tier is referenced in the news as the required access level for building and plotting custom indices with full feature availability. Platform Features: The Data Playground allows users to add any Artificial Analysis benchmarks, customize their weights, plot results with additional chart axes, and use formula metrics such as log and sqrt. Recent Developments: In November 2026, Artificial Analysis released the Decision Index v2, which incorporates more private datasets and a new metric rewarding model calibration.

Categories

aimachine_learning

Related sources

View Original Tweet