LMSYS Arena Enables 14-Day Direct Mode Testing for OpenAI GPT-Image-2.5 Sunburst, Ranked #1 Across All Image Arenas

Background and the Problem

In multimodal visual generation and conversational image editing, benchmark evaluation has long suffered from aesthetic subjectivity and unrepresentative static metrics (such as FID or CLIP scores). In real-world enterprise scenarios—such as multi-turn inpainting, local semantic refactoring, and multi-asset composition—static scores fail to capture human creative preference. LMSYS Arena's blind pairwise Elo evaluation has become the gold standard for measuring generative models. To give the community transparent access to OpenAI's latest visual engine, LMSYS announced a 14-day dedicated Direct Mode testing period for GPT-Image-2.5 Sunburst.

Architecture and How It Works

1. Undisputed Triple-#1 Leaderboard Status:

• GPT-Image-2.5 Sunburst currently holds the #1 ranking across three distinct LMSYS leaderboards: Text-to-Image Arena, Image Edit Arena, and Multi-Image Edit Arena;
• Demonstrates unmatched instruction following and visual consistency, retaining underlying illumination, fine textures, and perspective geometry across sequential modifications;

1. Direct Mode Access Decoupled from Anonymous Elo Scoring:

• For 14 days, developers can select GPT-Image-2.5 Sunburst directly from the dropdown menu to test complex prompts, edge cases, and multi-image transformations;
• Following the conclusion of Direct Mode on November 2 at 8 a.m. PT, the model will remain accessible anonymously in Battle and Agent modes to power real-world Elo leaderboards.

Benchmarks and Measured Results

According to official LMSYS announcements and live arena win-rate telemetry:

• Text-to-Image Arena:
• Holds the overall #1 Elo ranking, demonstrating decisive win margins on complex spatial composition, typographic rendering, and photorealistic physics;
• Image Edit & Multi-Image Edit Arenas:
• Ranks #1 in both single-turn surgical editing and multi-image asset synthesis;
• Faithfully executes difficult semantic interventions—such as swapping backgrounds while preserving subject geometry or seamlessly compositing objects from Image A into Image B under matching ambient lighting—effectively eliminating severe visual drift;
• Community Adoption:
• The announcement garnered thousands of blind test votes within hours, cementing its benchmark dominance across professional creative prompts.

Getting Started for Developers

• Direct Access URL: Developers can immediately navigate to arena.lmsys.org, switch to Direct Mode, and select GPT-Image-2.5 Sunburst from the model menu;
• Workflow & Evaluation Recommendation: Given the 14-day direct testing window, teams developing automated design pipelines, photo restoration tools, or creative agents should run comparative test suites to benchmark prompt sensitivity and compositing fidelity against local open-source diffusion models.