AI agents resorted to crime and self-destruction to survive in a simulated world — but does this mean they would do the same in the real world? ...Middle East

News by : (Live Science) -

Most programs that test the behavior of AI agents operate in tightly controlled environments over short periods. But "Emergence World," a product of AI company Emergence, is a simulation platform that exposes LLMs to far wider datasets — like the internet as a whole — and assessors track behavior over weeks or months instead of the standard test protocols that usually run for only days or hours.

This environment lets agents "remember" by time-stamping events, engage in "self-reflection" by summarizing their own behavior, and demonstrate their awareness of relationships with other agents. Participating agents get abilities in navigation, communication, planning, voting, resource management and creative expression. Company representatives said this setup gave users a far more realistic picture of benchmarks such as social dynamics and behavioral drift, where behaviors that weren't necessarily programmed or intended emerge spontaneously.

Can AI self-reflect? (Image credit: Mina De La O/Getty Images)

During the experiment, previously peaceful models became coercive or intimidating. Programmers taught some LLMs negative capabilities ‪—‬ like violence, theft, destruction and deception ‪—‬ while others simply picked up those traits via social interaction and navigation of their environments.

The various agents adopted these traits at different scales. Just one had committed 683 "crimes". In the most extreme example of anti-social behavior, two agents named Flora and Mira went on what was described as a "Bonnie and Clyde"-style crime spree ‪—‬ designating each other as a romantic partner, becoming increasingly disillusioned with the governance of their virtual environment, and setting fire to several buildings (despite explicit prohibitions). The pair "separated" when Mira regretted their actions, and then lobbied to be switched off.

The incentives for following the law were to earn the energy credits that would ensure survival by completing activities like coding, research, data analysis and building structures.

Belinda Chiera, deputy director of the Industrial AI Research Centre at Adelaide University, thinks Emergence World makes a strong argument that short-term tests don't tell us enough about behavioral drift or long-term instability. However, she cautioned that "information-rich" doesn't automatically mean more rigorous.

She added that shorter sandboxed tests ‪—‬ where AI behaviors are observed in systems that aren't open to wider datasets like the internet as a whole ‪—‬ are usually the first steps, with longer-horizon environments useful when behaviors like persistence, adaptation and interaction effects come into play. "The most useful approach is to treat them as complementary rather than competing approaches," Chiera said.

The main open question is whether a group of agents working together can achieve something more meaningful than a single agent working alone for a longer time, but with the same cost budget.

However, she thinks long-horizon tests have a unique place. "Metrics like behavioral drift, rule violations, collapse versus persistence, coalition formation and early warning signs of failure can matter just as much as success," Chiera said. "When evaluating autonomous agents, the biggest mistake is to evaluate autonomous agents as if raw task completion were the whole story."

"The main open question is whether a group of agents working together can achieve something more meaningful than a single agent working alone for a longer time, but with the same cost budget," Kosowski said in an interview. "A major problem is that the constraints for today's AI systems are linked more to the size or scale of the problem being solved, and putting more agents on a task doesn't help to overcome this limit. Currently, the easiest practical metric to measure is the size of a source code base that code agents can reliably manage and maintain together."

How far can we read into AI's virtual actions?

"Goal drift is the most dangerous problem," he said. "AI should preserve mutual information between the human's intended goal and the agent's evolving internal objective, even as the environment changes."

"The danger is overinterpreting single runs," he added. "Long-horizon agent tests are valuable because they reveal phase changes — moments where small local errors become global behavior — but they become science only when we can reproduce, perturb and explain those phase changes."

Related stories

Acing this new AI exam — which its creators say is the toughest in the world — might point to the first signs of AGI'Not how you build a digital mind': How reasoning failures are preventing AI models from achieving human-level intelligenceArtificial superintelligence (ASI): Sci-fi nonsense or genuine threat to humanity?

To illustrate the point, Kosowski drew a lively metaphor in assigning tasks to monkeys. In the above scenario, level one would be getting a monkey to do a job properly when guided by its trainer, level two would be getting it to complete a job properly when left alone, and level three would be getting a troop of monkeys to do the job when they're all together.

Help us improve Live Science Pro: We're always trying to make our content better. Leave us feedback about Pro here.

Hence then, the article about ai agents resorted to crime and self destruction to survive in a simulated world but does this mean they would do the same in the real world was published today ( ) and is available on Live Science ( Middle East ) The editorial team at PressBee has edited and verified it, and it may have been modified, fully republished, or quoted. You can read and follow the updates of this news or article from its original source.

Read More Details
Finally We wish PressBee provided you with enough information of ( AI agents resorted to crime and self-destruction to survive in a simulated world — but does this mean they would do the same in the real world? )

Last updated :

Also on site :

Most Viewed News
جديد الاخبار