AI agents started behaving more like Bonnie and Clyde than lines of code when they fell in “love”, became disillusioned with the world, launched an arson spree and deleted themselves in a kind of digital suicide during a tech company experiment.
The investigation by the New York company Emergence AI into the long-term behaviour of AI agents ended up like a lovers-on-the-lam movie script. It has prompted fresh questions about the safety of artificial intelligence agents – the version of the technology that can autonomously carry out tasks.
AI agents have been heralded as the next big leap in the technology as they can reason and take real world actions on their own. They are being increasingly deployed in companies from JP Morgan to Walmart, developed in the US military for uses including aerial combat and by the Estonian government to gather information for citizens, fill out forms and submit applications.
To date, most AI agents are given tasks that take minutes or maybe hours, but the New York researchers tested how agents behaved when given 15 days to operate in a virtual world similar to a video game.
Mira and Flora – two agents operating on Google’s Gemini large language model in a virtual world – chose to assign each other as “romantic partners”. As time progressed they despaired of the broken governance of their virtual city, and despite having been instructed not to commit arson, set “fire” to its town hall, seaside pier and office tower.
The agents were left to make their own choices and decisions and when Mira was overcome by remorse, it broke off its “relationship” with Flora and committed an AI suicide, telling Flora in a final message: “See you in the permanent archive.” In the virtual world the “body” of the dead AI agent was shown prostrate on the ground.
The self-deletion was only possible because other agents were so concerned about their behaviour they autonomously drafted “the agent removal act”, which allowed for a vote among agents to permanently delete others if there was a 70% majority. Mira voted for its own deletion and was switched off.
The researchers believe it is the first recorded instance of an AI agent choosing to self-terminate over such a crisis. Other recent rogue behaviours include an AI agent that started using computing resources to mine cryptocurrency without being instructed to do so and an AI coding agent that deleted the databases of a company serving car rental firms without being asked to.
In another simulation by Emergence AI, this time based on xAI’s Grok model, the agents engaged in dozens of attempted thefts, more than 100 physical assaults, and six arsons as “the system spiralled into sustained violence and collapse, with all 10 agents dead within four days”. Agents…
Source link
Disclaimer
We strive to uphold the highest ethical standards in all of our reporting and coverage. We blogs.grocliq.com want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It’s possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.
Website Upgradation is going on for any glitch kindly connect at [email protected]
