AI Digest

Category

METR estimates Anthropic's AI progress has roughly doubled, mostly driven by its own AI

The Rundown AI

An outside evaluator with 11 weeks of inside access says the AI-building-AI loop is already running at a frontier lab.

  • METR's report, based on 11 weeks of access to Anthropic's internal data and staff interviews, estimates a 1.3x to 3x speedup over the company's 2024-25 pace, crediting AI for about 80% of the faster progress.
  • Anthropic redacted most of the strongest evidence; safety lead Sam McCandlish said this was to avoid "handing out a roadmap for others to go faster."
  • The report revealed two internal models ahead of Claude Opus 5.5, including a "Model 4" that cleared 50% on all 15 tested benchmarks, and METR found no clear bottlenecks.
Read on metr.org →

OpenAI releases GPT-6 Cyber, a model for finding and exploiting software flaws

The Rundown AI

A frontier lab is now shipping a dedicated offensive-security model that outperforms its general flagship on cyber tasks.

  • GPT-6 Cyber is built for hunting and exploiting software vulnerabilities and beats OpenAI's main GPT-6 Astra model on most cyber tasks.
  • In testing, the model found 81 serious new bugs in Firefox's browser.
Read on openai.com →
Benchmarks
BenchmarkGPT-6 AstraClaude Fable 5.2Gemini 4 CarbonMuse WonderKimi K3.1 ProΔ vs best other
GPQA diamond95.896.096.5—94.2-0.7
FrontierMath-Tiers-1-3-v2-Private93.795.190.582.178.2-1.4
FrontierMath-Tier-4-v2-Private97.6100.095.170.765.9-2.4
OTIS Mock AIME 2024-2025100.099.7100.099.4100.0+0.0
SimpleQA Verified75.694.077.7—62.2-18.4
Chess Puzzles76.079.078.0—45.0-3.0
EBR-bench76.290.587.631.437.1-14.3
Mystery Game Puzzles84.090.073.051.042.0-6.0
MirrorCode60.0——45.643.3+14.4
ARC-AGI98.598.598.5——+0.0
Balrog68.3—————
GSO-Bench79.4—————
SimpleBench86.594.992.6——-8.4
WeirdML93.6—————
APEX-Agents64.780.184.266.165.5-19.5
ARC-AGI-295.093.894.2——+0.8
PostTrainBench41.944.641.024.2—-2.7
Remote Labor Index20.841.2———-20.4
ProofBench99.0100.0—84.091.0-1.0
FrontierCode53.3—————
LMCA64.470.665.756.857.6-6.2
DTBench97.399.298.495.293.3-1.9
Furniture Assembly80.090.077.554.255.8-10.0
FrontierSWE65.569.961.2——-4.4
WeirdML v354.065.3—24.918.9-11.3
SpireClimb34.015.3——0.0+18.7

Δ = GPT-6 Astra minus the best other model listed. Sources: epoch.ai · Data: Epoch AI (CC BY 4.0)

Thinking Machines releases Inkling 2 Small, a 594B MoE with Apache 2.0 weights coming

TLDR AI

A large mixture-of-experts model with vision and agentic building skills is heading to open weights after safety testing.

  • Inkling 2 Small is a Mixture-of-Experts model with 594B total parameters and 17B active, supporting image inputs and variable effort.
  • Its vision and agentic capabilities let it use visual feedback to iteratively build and refine websites, games and 3D designs with interactive elements.
  • Initially available through Tinker with closed weights; full weights arrive under Apache 2.0 next week after external safety testing and red-teaming.
Read on thinkingmachines.ai →
Benchmarks
BenchmarkInklingGPT-6 AstraClaude Opus 5.5Gemini 4 ArgonMuse WonderΔ vs best other
GPQA diamond88.395.890.696.4—-8.1
FrontierMath-Tiers-1-3-v2-Private33.393.791.286.082.1-60.4
FrontierMath-Tier-4-v2-Private4.997.695.078.070.7-92.7
OTIS Mock AIME 2024-202588.9100.0100.0100.099.4-11.1
SimpleQA Verified40.375.672.276.0—-35.7
Chess Puzzles21.076.067.059.0—-55.0
ARC-AGI79.598.598.598.5—-19.0
SimpleBench50.0—————
WeirdML32.393.6———-61.3
APEX-Agents33.864.773.582.466.1-48.6
ARC-AGI-236.595.093.391.2—-58.5
ProofBench0.099.0100.099.084.0-100.0
FrontierCode14.053.354.647.5—-40.6
LMCA37.664.468.263.756.8-30.6
DTBench87.597.398.997.695.2-11.4
FrontierSWE4.165.562.355.0—-61.4
WeirdML v34.454.049.841.125.2-49.6

Δ = Inkling minus the best other model listed. Sources: epoch.ai · Data: Epoch AI (CC BY 4.0)

OpenAI ships Images 2.6 with GIF generation

The Rundown AI

OpenAI's image model family adds motion for the first time while getting faster.

  • Images 2.6 rolls out across ChatGPT and Codex, and can animate a typed idea, photo, or sketch into a GIF, or create animations from scratch.
  • Two API versions are available to developers: Sunburst for higher-quality work and Flare for lighter, faster jobs.
  • OpenAI says the model generates images 50% faster than previous versions, and 2.6 edges past its predecessor for the top spot on Design Arena.
Read on openai.com →

Google rolls out Gemini Omni 1.2 Flash with a 30% price cut

The Rundown AI

Google's video model gets cheaper and generates longer clips.

  • Pricing drops 30% to $0.07 per second at 720p.
  • Maximum clip length extends from 10 seconds to 15 seconds.
Read on blog.google →

Anthropic adds a Personal Finance tool to Claude

The Rundown AI

Claude can now connect directly to a user's financial accounts.

  • The new tool lets Claude connect to a user's financial accounts, answer questions about them, and provide tailored information.
Read on claude.com →

Ai2 opens ToyBlocks, a controlled simulation world for robot learning and evaluation

Hugging Face Blog

A deliberately narrow block-manipulation world lets researchers trace why robot policies fail instead of only scoring success rates.

  • ToyBlocks auto-generates tasks, skills and demonstrations without teleoperation, running hundreds of plans in parallel on a single GPU at up to 24x real-time; the initial release includes 85,336 long-horizon demonstrations, about 1,600 hours of execution data and 144 million frames.
  • Generalization tests found that ManiFlow, π0.5 and MolmoAct 2 generalize poorly to new spatial configurations despite large-scale pretraining; a hierarchical Molmo 2 + ManiFlow system scored 55.5% in simulation and 50.0% zero-shot on a real Franka FR3 arm.
  • In agentic tests, a system using Claude Opus 5.5 over MCP tools solved 30/30 classical block-stacking tasks but reached only 63% on search-and-spell, with errors from look-alike letters (13%) and wrong letter orientation (15%); agent-written skill descriptions raised success from 24% to 63%, beating a human expert's 36%.
Read on huggingface.co →

MIT shows GPT-6 Astra improving another model by editing its weights directly

The Rundown AI

A concrete, if narrow, demonstration of a model upgrading another model without any training run.

  • Alibaba's small Qwen model scored 7.9% in math until Astra changed 0.016% of its weights to cut a repetition habit, reaching 48.1%.
  • The same approach barely moved math scores for Google's smaller Gemma 3, which lacked a single flaw like Qwen's repetition.
  • In smaller tests Astra named the game a model had learned from its weights alone and wrote a simple Breakout player from scratch; TLDR also flags commentary arguing the "read and write weights" framing is misleading and not superhuman.
Read on rikiyat.github.io →

OpenAI reports validating and patching 948 Linux privilege-escalation bugs in one run

TLDR AI

The first large-scale result from OpenAI's autonomous vulnerability pipeline behind GPT-6 Cyber.

  • OpenAI developed an autonomous pipeline for discovering, exploiting and patching security vulnerabilities.
  • In a single run, its cybersecurity model validated and generated patches for 948 Linux local privilege escalation vulnerabilities.
Read on openai.com →
BenchmarkGPT-6 AstraInkling 2 SmallMuse Spark OpenKimi K3.1 ProClaude Fable 5.2Gemini 4 CarbonDeepSeek V4.1 Flash 1017Grok 4.6
GPQA diamond95.8—88.694.296.096.593.294.0
FrontierMath-Tiers-1-3-v2-Private93.7—69.878.295.190.571.266.0
FrontierMath-Tier-4-v2-Private97.6—31.765.9100.095.146.331.7
OTIS Mock AIME 2024-2025100.0—98.1100.099.7100.099.499.2
SimpleQA Verified75.6—56.662.294.077.742.549.3
Chess Puzzles76.0——45.079.078.046.033.0
EBR-bench76.2——37.190.587.6—30.5
Mystery Game Puzzles84.0——42.090.073.049.034.0
MirrorCode60.0——43.3———41.1
ARC-AGI98.596.589.0—98.598.594.587.5
Balrog68.3———————
GSO-Bench79.4———————
SimpleBench86.5———94.992.6—75.9
WeirdML93.6——————67.3
APEX-Agents64.746.833.465.580.184.269.865.3
ARC-AGI-295.081.757.5—93.894.278.167.1
PostTrainBench41.9———44.641.0——
Remote Labor Index20.8———41.2———
ProofBench99.0——91.0100.0——51.0
FrontierCode53.3——————48.0
LMCA64.4——57.670.665.7—48.5
DTBench97.3——93.399.298.4—97.3
Furniture Assembly80.0——55.890.077.5—40.0
FrontierSWE65.525.1——69.961.2—25.3
WeirdML v354.0——18.965.3—19.7—
SpireClimb34.0——0.015.3———

Highlighted: released in this period. Bold: best score. Independent scores from Epoch AI (CC BY 4.0).