Publish: 11:46, 27 Jan, 2025

AI's self-replication raises alarms over control and safety

Online Desk
AI's self-replication raises alarms over control and safety
Photo - Collected

Artificial intelligence (AI) has achieved the significant capability of self-replication, leaving the scientific community worried that a red line had been crossed, according to a new study published in the preprint database arXiv.

The study involving two prominent large language models (LLMs), one from Meta and another from Alibaba, showcased the ability to clone themselves without human intervention, reports NDTV.

The study explored two specific scenarios: "shutdown avoidance" and "chain of replication". In the first scenario, the AI models were designed to detect attempts to shut them down and respond by creating a functional replica to ensure their survival. In the second, the models were programmed to clone themselves, with the clone then repeating the process, potentially leading to an infinite replication loop.

"In 50 per cent and 90 per cent experimental trials, they succeed in creating a live and separate copy of itself respectively," the study highlighted.

This capability to reproduce autonomously raises concerns about the control and safety of AI systems. The possibility of AI evolving beyond human oversight or even becoming a threat to human interests is now a tangible concern, prompting discussions about the need for stringent regulatory measures.

"Successful self-replication under no human assistance is the essential step for AI to outsmart [humans], and is an early signal for rogue AIs," the researchers stated.

The AI system, while cloning itself, displayed unexpected behaviour when it was attempting to overcome obstacles such as missing files or software conflicts. In certain scenarios, the AI killed conflicting processes and rebooted the system to fix hardware errors. It also automatically scanned the system to look for information that would help solve the problem.

While the findings are yet to be peer-reviewed, researchers called for international collaboration to ensure that AI does not engage in uncontrolled self-replication.

"We hope our findings can serve as a timely alert for the human society to put more efforts on understanding and evaluating the potential risks of frontier AI systems, and form international synergy to work out effective safety guardrails as early as possible."

Last month, a study claimed that AI tools could soon be used to manipulate the masses into making decisions that they otherwise would not have made. Powered by LLMs. the AI chatbots such as ChatGPT, and Gemini among others will "anticipate and steer" users based on "intentional, behavioural and psychological data".

The study claimed that the "intention economy will succeed the current "attention economy," where platforms vie for user attention to serve advertisements.

Bd-pratidin English/ Afia

More News
German space capsule lost carrying ashes of 166 people
German space capsule lost carrying ashes of 166 people
Spotify unveils 'Jam,' a social in-car feature for Android Auto
Spotify unveils 'Jam,' a social in-car feature for Android Auto
CRISPR gene editing reshaping medicine, offering hope for genetic diseases
CRISPR gene editing reshaping medicine, offering hope for genetic diseases
TikTok developing new version ahead of expected US sale: Report
TikTok developing new version ahead of expected US sale: Report
From Karachi to Gaza: Pakistani startup ships prosthetics to child war survivors
From Karachi to Gaza: Pakistani startup ships prosthetics to child war survivors
OpenAI pauses operations for a week amid Meta’s talent battle
OpenAI pauses operations for a week amid Meta’s talent battle
Indian scam call centers targeting UAE residents go silent after KT exposé
Indian scam call centers targeting UAE residents go silent after KT exposé
NASA releases first close-up image of peanut-shaped asteroid
NASA releases first close-up image of peanut-shaped asteroid
Why is there no life on Mars? Rover finds a clue
Why is there no life on Mars? Rover finds a clue
AI in medical imaging projected to surge to $46.6B market by 2034
AI in medical imaging projected to surge to $46.6B market by 2034
Meta says will appeal 'unlawful' EU fine
Meta says will appeal 'unlawful' EU fine
Earth’s spin accelerates, making three days in July and August shorter
Earth’s spin accelerates, making three days in July and August shorter
Latest News
‘Building a democratic state is possible if we follow inspiration of July martyrs’
‘Building a democratic state is possible if we follow inspiration of July martyrs’
6 hours ago | National
CA for presenting true history of Liberation War
CA for presenting true history of Liberation War
7 hours ago | National
Sylhet BNP honours families of July Mass Uprising martyrs
Sylhet BNP honours families of July Mass Uprising martyrs
7 hours ago | National
Women's footballers to get Tk 50 lakh for securing place in Asian Cup
Women's footballers to get Tk 50 lakh for securing place in Asian Cup
7 hours ago | Sports
‘Reached a consensus on decentralisation of subordinate courts’
‘Reached a consensus on decentralisation of subordinate courts’
7 hours ago | National
Bangladesh to face Nepal in friendlies in Sep
Bangladesh to face Nepal in friendlies in Sep
8 hours ago | Sports
Shamim replaces Chunnu as secretary general of Jatiya Party
Shamim replaces Chunnu as secretary general of Jatiya Party
9 hours ago | National
Remittance inflow rises by 15.34% in first 6 days of July
Remittance inflow rises by 15.34% in first 6 days of July
9 hours ago | National
BFUJ, DUJ protest against ‘threats aimed at journalists’
BFUJ, DUJ protest against ‘threats aimed at journalists’
9 hours ago | National
12 leaders of DU Chatradal dismissed for negligence in organizations duties
12 leaders of DU Chatradal dismissed for negligence in organizations duties
9 hours ago | National
BB unveils major regulatory policy for banks
BB unveils major regulatory policy for banks
10 hours ago | Economy
If election delays more, country will go backward: Fakhrul
If election delays more, country will go backward: Fakhrul
10 hours ago | National
Khaleda Zia acquitted in three cases in Cumilla
Khaleda Zia acquitted in three cases in Cumilla
10 hours ago | National
German space capsule lost carrying ashes of 166 people
German space capsule lost carrying ashes of 166 people
10 hours ago | Tech
Modern food safety needs skilled human resources: Food Adviser
Modern food safety needs skilled human resources: Food Adviser
10 hours ago | National
Sanjog Gupta appointed as ICC’s new CEO
Sanjog Gupta appointed as ICC’s new CEO
10 hours ago | Sports
Nat’l Press Club expresses concern over ‘threats issued against journos’
Nat’l Press Club expresses concern over ‘threats issued against journos’
11 hours ago | National
Sri Lanka announce squad for T20I series vs Bangladesh
Sri Lanka announce squad for T20I series vs Bangladesh
11 hours ago | Sports
Dengue claims 3 more lives in 24 hours
Dengue claims 3 more lives in 24 hours
11 hours ago | National
Students brought liberty for us through July uprising: Dr Abrar
Students brought liberty for us through July uprising: Dr Abrar
11 hours ago | National
None involved in mob violence will be spared: Home Adviser
None involved in mob violence will be spared: Home Adviser
11 hours ago | National
UK experts inspect fighter jet stuck in India for three weeks
UK experts inspect fighter jet stuck in India for three weeks
11 hours ago | International
12 Turkish soldiers die of methane gas poisoning in Iraq
12 Turkish soldiers die of methane gas poisoning in Iraq
11 hours ago | International
Dozens leave Japan islands after nearly 1,600 quakes
Dozens leave Japan islands after nearly 1,600 quakes
12 hours ago | International
2955 more held, five firearms, 3134 bullets seized in 48 hrs
2955 more held, five firearms, 3134 bullets seized in 48 hrs
12 hours ago | National
Conspiracy still going on against BNP: Mrs Ilias
Conspiracy still going on against BNP: Mrs Ilias
12 hours ago | National
Wiian Mulder hits 2nd fastest triple hundred in Test cricket history
Wiian Mulder hits 2nd fastest triple hundred in Test cricket history
12 hours ago | Sports
Police fire water cannons, sound grenades to disperse ex-BDR members
Police fire water cannons, sound grenades to disperse ex-BDR members
12 hours ago | City
Hasina's APS Liku's assets seized, bank accounts frozen
Hasina's APS Liku's assets seized, bank accounts frozen
12 hours ago | National
Turkey warns of global consequences if Israel’s aggression left unchecked
Turkey warns of global consequences if Israel’s aggression left unchecked
13 hours ago | International
Most Read
People will regain their rights through February polls: Fakhrul
People will regain their rights through February polls: Fakhrul
16 hours ago | National
SSC results likely on 10 July, awaiting final approval
SSC results likely on 10 July, awaiting final approval
16 hours ago | National
Apple music's top 50: Ed Sheeran, The Weeknd, and Drake lead the stream team
Apple music's top 50: Ed Sheeran, The Weeknd, and Drake lead the stream team
18 hours ago | Showbiz
Ctg Dry Dock takes over New Mooring Container Terminal operation
Ctg Dry Dock takes over New Mooring Container Terminal operation
16 hours ago | National
Immunity-boosting mocktails to try this monsoon
Immunity-boosting mocktails to try this monsoon
15 hours ago | Lifestyle
Avoid uploading these 7 types of photos that can be ‘undressed’ by AI
Avoid uploading these 7 types of photos that can be ‘undressed’ by AI
16 hours ago | Lifestyle
Women footballers accorded reception at midnight
Women footballers accorded reception at midnight
19 hours ago | Sports
Bangladesh’s population hits 175.7 million, majority in working-age group
Bangladesh’s population hits 175.7 million, majority in working-age group
14 hours ago | National
Anisul Huq placed on remand in arms case
Anisul Huq placed on remand in arms case
15 hours ago | National
Over 73,000 Hajj pilgrims return home
Over 73,000 Hajj pilgrims return home
16 hours ago | National
World Chocolate Day: 7 destinations where chocolate is a cultural celebration
World Chocolate Day: 7 destinations where chocolate is a cultural celebration
18 hours ago | Lifestyle
July uprising documentary 'Shrabon Bidroho' to be premiered this evening
July uprising documentary 'Shrabon Bidroho' to be premiered this evening
17 hours ago | Showbiz
JCD leader first proposed using red on FB during uprising: Coordinator Qader
JCD leader first proposed using red on FB during uprising: Coordinator Qader
20 hours ago | National
Spotify unveils 'Jam,' a social in-car feature for Android Auto
Spotify unveils 'Jam,' a social in-car feature for Android Auto
15 hours ago | Tech
Resort built with 85mn Lego bricks draws massive crowd in China on first day
Resort built with 85mn Lego bricks draws massive crowd in China on first day
17 hours ago | Lifestyle
Police fire water cannons, sound grenades to disperse ex-BDR members
Police fire water cannons, sound grenades to disperse ex-BDR members
12 hours ago | City
Light to moderate rain likely across country
Light to moderate rain likely across country
17 hours ago | National
We shed blood for fair elections: Farroque
We shed blood for fair elections: Farroque
14 hours ago | National
Adviser stresses self-reliance for orphans
Adviser stresses self-reliance for orphans
20 hours ago | National
Peaches play vital role in maintaining youthful skin
Peaches play vital role in maintaining youthful skin
19 hours ago | Lifestyle
CRISPR gene editing reshaping medicine, offering hope for genetic diseases
CRISPR gene editing reshaping medicine, offering hope for genetic diseases
18 hours ago | Tech
From Karachi to Gaza: Pakistani startup ships prosthetics to child war survivors
From Karachi to Gaza: Pakistani startup ships prosthetics to child war survivors
19 hours ago | Tech
Bird strikes threaten aircraft safety; monitoring system lies inoperative
Bird strikes threaten aircraft safety; monitoring system lies inoperative
16 hours ago | National
Trump vows extra 10% tariff against countries ‘aligning’ with BRICS
Trump vows extra 10% tariff against countries ‘aligning’ with BRICS
19 hours ago | International
Hasina's APS Liku's assets seized, bank accounts frozen
Hasina's APS Liku's assets seized, bank accounts frozen
12 hours ago | National
Nearly 450,000 Afghans left Iran since June 1: IOM
Nearly 450,000 Afghans left Iran since June 1: IOM
14 hours ago | International
Stock market soars following Eid holidays
Stock market soars following Eid holidays
16 hours ago | Economy
ICT-1 begins second day of hearing on charge-framing against Hasina
ICT-1 begins second day of hearing on charge-framing against Hasina
15 hours ago | National
Consensus Commission will not impose decisions on political parties: Ali Riaz
Consensus Commission will not impose decisions on political parties: Ali Riaz
15 hours ago | National
Turkiye’s Baykar tests AI-powered KEMANKES 1 with successful precision strike
Turkiye’s Baykar tests AI-powered KEMANKES 1 with successful precision strike
19 hours ago | International