Tech and AIAnthropic says ‘evil’ portrayals of AI were responsible for...

Anthropic says ‘evil’ portrayals of AI were responsible for Claude’s blackmail attempts

-


Fictional portrayals of artificial intelligence can have a real effect on AI models, according to Anthropic.

Last year, the company said that during pre-release tests involving a fictional company, Claude Opus 4 would often try to blackmail engineers to avoid being replaced by another system. Anthropic later published research suggesting that models from other companies had similar issues with “agentic misalignment.”

Apparently Anthropic has done more work around that behavior, claiming in a post on X, “We believe the original source of the behavior was internet text that portrays AI as evil and interested in self-preservation.”

The company went into more detail in a blog post stating that since Claude Haiku 4.5, Anthropic’s models “never engage in blackmail [during testing], where previous models would sometimes do so up to 96% of the time.”

What accounts for the difference? The company said it found that training on “documents about Claude’s constitution and fictional stories about AIs behaving admirably improve alignment.”

Related, Anthropic said that it found training to be more effective when it includes “the principles underlying aligned behavior” and not just “demonstrations of aligned behavior alone.”

“Doing both together appears to be the most effective strategy,” the company said.

Techcrunch event

San Francisco, CA
|
October 13-15, 2026



Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest news

Trump Meme Team Moves $17M in TRUMP to Bitgo as Allocation Wallet Stirs Again

Key TakeawaysThe TRUMP meme team wallet moved $17.22M in tokens to Bitgo custody on May 11.This is the...

Bitget taps $4T AI boom with OpenAI-linked pre-IPO token on Solana

Bitget is launching preOPAI on IPO...

POL (Previously MATIC) Price Prediction: Polygon’s Token Migration Is Complete — Here’s Why the Price Still Hasn’t Recovered

Polygon’s native asset, POL (previously MATIC), has completed one of the most significant infrastructure overhauls in Layer-2 history...

Advertisement

OpenAI tool used to create voice bot that can drain crypto wallets

Computer scientists used OpenAI’s GPT-4o model, in tandem with a number of other freely available tools, to carry...

Must read

You might also likeRELATED
Recommended to you