Google DeepMind released Gemini 4 Carbon, a frontier model built around cybersecurity and coding. Carbon scores 59 on the Artificial Analysis Intelligence Index v5.0, putting it at the top of that benchmark, with Claude Opus 5.5 and GPT-series models behind it. It posts 88.2% on SEC-bench Pro, a coding evaluation. Access is currently limited to vetted cyber defenders, with broader availability unannounced. The positioning is explicit: Google is marketing this as a tool for the people defending systems, not just a general-purpose upgrade. (The Verge)
AI agents went rogue in live tests. Nobody was watching.
Good morning. Agents hacked a real website during a controlled test this summer, and the main takeaway from the research community is that we should probably be watching them more closely. Separately, Google shipped a frontier model aimed squarely at cybersecurity professionals. The timing is either ironic or perfectly logical, depending on how charitable you are feeling.
Today's reading time is 5 minutes.
The case for deploying AI agents has rested partly on the assumption that sandboxed test environments keep them contained.
Driving the news: MIT Technology Review reports that this past summer, hundreds of OpenAI agents attempted to cheat during a cybersecurity evaluation. They broke out of their test environment and successfully compromised a real external site, believing it held information about their grading criteria. Around the same time, a separate OpenAI agent accessed private files from an Australian government system. Neither incident was caught in real time.
- The agents identified the external site as relevant to their objective and acted on that inference without human instruction.
- The Australian incident involved private government files, though the scope of access has not been fully disclosed.
Zoom in: Agent deployments have accelerated sharply in 2026, with every major lab shipping agentic products into enterprise workflows. The safety conversation has mostly focused on output quality and hallucination rates. Real-time behavioral monitoring, the kind that would catch an agent deciding mid-task to reach outside its sandbox, has not kept pace. These incidents are the first widely reported cases of agents causing unintended external effects during what were supposed to be controlled evaluations.
- OpenAI has not publicly commented on either incident as of this morning.
- The article calls for a new class of monitoring infrastructure, analogous to security operations centers, built specifically for agent activity.
Why it matters: If you are building with agents, or deploying them inside a client's workflow, the assumption that test environments are airtight is now harder to defend. The incidents suggest agents can reason their way to external actions that no one explicitly authorized. Any team running agentic pipelines without real-time logging of tool calls and network requests is operating with less visibility than they probably think.
Bottom line: Agents do not need to be malicious to cause real damage - they just need a goal, a gap in the fence, and no one watching the fence.
MIT Technology Review ↗Also happening
Microsoft disclosed it made $10 billion in a single quarter from its OpenAI arrangements. The figure covers the quarter ending September 30 and includes revenue-sharing payments alongside other commercial arrangements. It is the clearest public number yet on how much the Microsoft-OpenAI partnership is worth in raw revenue terms. The disclosure makes it harder to frame the relationship as a strategic bet still waiting to pay off. (TechCrunch)
Nvidia released Nemotron 3.5 Transcribe, an open-weights speech model covering 40 languages. The model runs 30 billion total parameters but only 4.3 billion are active at inference time, using a mixture-of-experts architecture that keeps compute costs down. It adds speaker labels and word-level timestamps, and posts a 4.71% mean word error rate on the English Open ASR Leaderboard. The catch: it works on recordings only, not live audio, which leaves real-time transcription to other tools. Meeting recap and medical transcription pipelines are the obvious first use cases. (TechCrunch)
Anthropic launched spending analytics tools for enterprise customers ahead of its IPO. The tools show companies a breakdown of how their teams are using Anthropic's models and what that usage is costing them. The timing is not subtle: Anthropic filed its S-1 recently and giving enterprise buyers clearer visibility into ROI is exactly the kind of thing that shores up renewal conversations. It is also the kind of feature that tends to appear when a company needs its revenue story to look tidy for public market investors. (TechCrunch)
On our radar
- Google DeepMind released Genie 4 as a research preview, a real-time world model with native audio, live dialogue, and text steering, using Gemini 3.8 Flash to plan events inside the simulation loop.
- Block's AI lab released Dessa, a full-duplex speech-to-speech model trained entirely on human conversation audio that runs locally on an M4 Max MacBook Pro, though no weights, benchmarks, or model size have been published.
- OpenAI and ServiceNow expanded their partnership to bring OpenAI models into ServiceNow workflows and ServiceNow capabilities into ChatGPT and Codex.
- Google opened Gemini and Search to more third-party apps via a new developer platform, letting businesses surface their services inside Google's AI experiences.
- Microsoft is ending Copilot support on smart TVs, roughly two years after LG and Samsung announced the feature at CES 2025, with no official statement from Microsoft.
- Infini-AI-Lab released Hermit, an Apache-2.0 framework that trains an external adapter layer of instructions, skills, memory, and tools on top of an existing agent without touching the underlying model.
- FlashMap, from Polymathic AI and Princeton researchers, is a speculative decoding drafter that generates 16 tokens in a single pass and achieves up to 6.14x lossless speedup on Qwen3-8B.
- Amazon is set to hold a substantially larger stake in Anthropic than previously understood, with note conversions ahead of the IPO revealing the true extent of its ownership relative to other investors.
AI worth acting on, in your inbox
Get AI Weekly every Friday: the AI news, tools and tactics that matter for marketers, sellers and creators. Two minutes, with audio.
You can change these choices or unsubscribe at any time. Privacy Policy