The Archive

Google Gemini 4 Carbon ranks #1 on Artificial Analysis Intelligence Index v5 benchmark suite.

Google releases Gemini 4 Carbon frontier model with coding/agentic improvements, tops Artificial Analysis benchmark; initially cybersecurity partners only.

and from Baseten are now available for free on AI Gateway for one week. Free access is available through October 27. These decision models classify text, route requests, and score content against criteria you define.Mammoth-1Elephant-1 Mammoth-1 is the larger, 27B model, while Elephant-1 is a smaller, 9B option. Mammoth-1 is #1 on the Jev Decision Index and Elephant-1 is tied for #1 on the Artificial Analysis Decision Index. Both support a 16k-token context window and return choices, probabilities, and scores. Ask several questions about the same input in one request: select a support team wi...

Meta releases Muse Wonder, positioned as first Fable-class model, scoring GPT-6.1 equivalent on Artificial Analysis; llm-meta-ai plugin updated.

Qwen 3.8 27B scores 52 on the Artificial Analysis Intelligence Index That's the same score as GPT-5.6 Luna (max), and just one point behind GLM-5.2 (max) and DeepSeek V4 Pro 0813 (max) - that GLM is 753B and that DeepSeek is 1.6B parameters, and Luna is size unknown but presumably a whole lot bigger than 27B. Qwen 3.8 27B is a truly astonishing model . Via Hacker News Tags: ai , generative-ai , llms , qwen , ai-in-china , artificial-analysis

SciCode is the standard measure of the scientific-coding ability of language models: research-level problems that demand both frontier scientific theory and its implementation as working numerical code. It is a component of the Artificial Analysis Intelligence Index and a standing evaluation in government and national-laboratory suites. Yet its scores have recently plateaued: the strongest 2026 models cluster tightly around 60\% subproblem accuracy, and a successor model ties its predecessor. We trace this stagnation to defects in the benchmark itself. A per-problem, domain-expert audit of al...

Anthropic releases Claude Opus 5, matching Fable 5 frontier performance at half the cost, now leading Artificial Analysis leaderboard.

Chinese AI lab Z.ai released GLM-5.2 to their coding plan subscribers on June 13th, and then yesterday (June 16th) released the full open weights under an MIT license. Similar in size to their previous GLM-5 and GLM-5.1 releases, this is 753B parameter, 1.51TB monster - with 40 active parameters (Mixture of Experts). GLM-5.2 is a text input only model - Z.ai have a separate vision family most recently represented by GLM-5V-Turbo , but that one isn't open weights. GLM-5.2 has a 1 million token context window, up from GLM-5.1's 200,000. The buzz around this model is strong. Artificial Analysis,...

AI agents have fundamentally changed the complexity of inference workloads. Until now, the industry has struggled to define a standard for measuring how... AI agents have fundamentally changed the complexity of inference workloads. Until now, the industry has struggled to define a standard for measuring how inference systems perform under these conditions. Artificial Analysis AgentPerf (AA-AgentPerf) offers the industry’s first multi-vendor open benchmarks profiling trajectories that are representative of real-world AI agent coding tasks. Source

Qwen3.7 Max ranks 5th on Artificial Analysis leaderboard; 27B/35B variants pending evaluation.

Gemini 3.5 Flash benchmarks lower than 3.1 Pro (55 vs 57 intelligence) yet higher total eval cost ($1,552 vs $892) despite cheaper per-token pricing.

Artificial Analysis releases Coding Agent Index benchmarking frontier models across SWE-Bench-Pro-Hard, Terminal-Bench v2, and SWE-Atlas-QnA.

Anonymous text-to-image model 'Peanut' ranks #8 on Artificial Analysis arena; open-weights release promised to compete with FLUX and Qwen models.

Xiaomi's MiMo V2.5 Pro ranks #54 on Artificial Analysis Intelligence Index; weights announced for local deployment.

OpenAI performance analysis chart generated via GPT image generation; lacks methodology and context.

DeepSeek V4 Pro costs 15x more to run than V3.2 on Artificial Analysis benchmarks, exceeding Gemini 3.1 Pro pricing.

Qwen 3.6 27B matches Claude Sonnet 4.6 on agentic benchmarks, surpassing GPT 5.2/5.3 and Gemini 3.1 Pro.

Unsubstantiated claim about ChatGPT image model photorealism without technical details.

Kimi K2.6 ranks #4 on Artificial Analysis Intelligence Index leaderboard.

Reddit commentary on Meta Muse Spark ranking 4th on Artificial Analysis Index; notes competitive market among Google, Anthropic, OpenAI, Meta, xAI.