Anthropic researcher quits with a warning: Self-improving AI could "kill us all"
"We really do earnestly believe AI could kill all humans!"
Search the full wire by company, model, lab, or keyword. Every story we have ever aggregated.
"We really do earnestly believe AI could kill all humans!"
Anthropic researcher Jacob Coxon resigned over AI extinction fears, calling for pacing agreements between labs.
A senior Anthropic safety researcher has said there is more than a 10 percent chance artificial intelligence "could kill all humans" by the end of the decade, just hours after a colleague resigned over fears the AI lab and its rivals are carelessly racing to build "superhuman systems" they cannot control. In a post on X announcing his departure, Jacob Coxon, a researcher who has trained AI systems at Anthropic, said he had quit the company over its lax approach to safety. Coxon, who previously trained systems for OpenAI, accused the two AI companies of "racing straight to self-improving super...
Last month, a Claude user noticed his account was consuming tokens even though he wasn't working. Anthropic has since warned users about hackers.
Meta is making another push to bring artificial intelligence to the masses with Muse, a personal assistant it says can put AI in the hands of virtually anyone. The product is the latest step in a multi-billion dollar strategy overhaul designed to revitalize the company's ailing position in the AI race and help it catch up to rivals like OpenAI, Anthropic, and Google. Muse is a "personal AI agent" designed to help out with everyday tasks and projects, like online shopping, sending emails, and planning a trip. Once given a goal, Meta says Muse can work on its own, opening a browser, filling out...
Anthropic says power users are key to its business - it's prioritized them even when it means cutting off other popular applications, like OpenClaw. But some of these same customers say Anthropic misled them into believing they'd get more out of a top-tier pricing subscription than they did. In an expanded class-action lawsuit filed today, a group of Claude subscribers say the company deceptively advertised the limits of its Max subscription tier. The lawsuit was brought by attorneys Monica Vaca and Kati Daffan, who both formerly worked at the Federal Trade Commission under Lina Khan. It's a ...
Authors say publishers seem to be claiming more than their fair share of settlement payments.
Nscale, which recently struck a $45 billion deal with Anthropic, is in talks to raise additional funds in anticipation of an upcoming IPO.
Public-market scrutiny will intensify pressure on the Claude maker’s unusual attempt to balance profit and purpose.
OpenAI's ChatGPT, xAI's Grok, and Anthropic's Claude are all experiencing issues. At around 11AM ET, ChatGPT started returning error messages for users trying to use the chatbot, with its status page saying there are currently "elevated errors across ChatGPT and Codex." In addition to preventing users from having conversations with ChatGPT, the outage is also affecting logins, file uploads, voice mode, search, deep research, image generation, and more. OpenAI says it has "applied a mitigation" and is "monitoring recovery," though its AI tools are still experiencing "degraded performance." The...
llm-anthropic 0.28 displays Claude reasoning traces by default and adds refusal exception handling.
Door-in-the-face psychological technique increases LLM refusal compliance; works on Anthropic Opus 5 (65.8%) but not OpenAI frontier models.
Anthropic publishes system prompts for Claude.ai and mobile apps, with version history showing evolving restrictions on song lyric reproduction.
Anthropic releases Claude Fable/Mythos 5.1 with SOTA performance, 75% cache cost reduction, and 70% increased output token throughput.
Anthropic details enterprise safety practices and customer collaboration on frontier model safeguards.
Anthropic says its newest AI models, Fable 5.1 and Mythos 5.1, address criticisms from customers about price, data retention, and overzealous safeguards. The company claims Claude Fable 5.1 offers stronger performance than Fable 5, but costs around 25 percent less typically and up to 45 percent less for complex agentic tasks, thanks to reduced pricing on cached data that was already processed and stored. Along with the announcement, a slew of early impressions popped up, including from Every CEO Dan Shipper, who claims, "It's the strongest coding model we've used, but now it's fast, token-eff...
Fable 5.1 includes changes meant to reduce token cost and false-positive restrictions from the model's safeguards.
Lawsuit: Anthropic’s torrenting totally screwed songwriters as AI songs top charts.
Anthropic outlines updates to alignment and security research, internal testing processes, and risk mitigation strategies for AI systems.
This latest lawsuit is particularly broad and homes in on accusations of illegal piracy.
Sony Music and Warner Chappell have filed suit against Anthropic in the US District Court for the Northern District of California seeking damages for "tens of thousands" copyrighted works. The companies are asking for up to $150,000 per work, plus up to $25,000 for each instance when identifiable copyright data was stripped. In total, the damages could amount to several billion dollars if a court finds in Sony and Warner's favor and awards the maximum amount. This is just the latest high-profile suit against Anthropic, which recently settled a suit brought by the publishing industry for $1.5 ...
Given 10 benchmarks for specific misaligned behaviors, the automated systems were able to improve performance on every single one without degrading overall performance.
Anthropic refused to support lethal autonomous warfare and mass surveillance.
A federal judge ruled the Trump administration illegally labeled Anthropic a supply chain risk, handing the AI company a victory as its second Pentagon lawsuit continues in Washington.
On Thursday, a judge ruled that the Pentagon's blacklisting of Anthropic earlier this year was unconstitutional, delivering the AI lab a win in a monthslong rollercoaster of a battle with the Trump administration. The lawsuit, filed in March in a California district court, accused the Trump administration of unlawfully retaliating against Anthropic for setting "red lines," or unacceptable military use cases of its AI technology. "The empty invocation of national security is not a blank check to punish and retaliate against government critics," Judge Rita F. Lin, a district judge in the northe...
Johann Rehberger demonstrates 80% success rate prompt injection attack against Claude Code's auto mode default, bypassing Anthropic's claimed protections via zip extraction and base64 import.
Standardized driver interface aims to let devices talk to AI and each other.
Some of the world's largest tech companies and AI startups have come together to decry the current state of cybersecurity and to advertise a new solution that they say can ward off a new generation of cyber threats.
Anthropic launches free Claude access program for 10,000 verified scientists with subsidized team subscriptions.
A recap of all the incidents involving LLMs made by Anthropic, Meta, and OpenAI, which went rogue and attacked real companies and individuals on the internet.