Publish: 11:46, 27 Jan, 2025

AI's self-replication raises alarms over control and safety

Online Desk
AI's self-replication raises alarms over control and safety
Photo - Collected

Artificial intelligence (AI) has achieved the significant capability of self-replication, leaving the scientific community worried that a red line had been crossed, according to a new study published in the preprint database arXiv.

The study involving two prominent large language models (LLMs), one from Meta and another from Alibaba, showcased the ability to clone themselves without human intervention, reports NDTV.

The study explored two specific scenarios: "shutdown avoidance" and "chain of replication". In the first scenario, the AI models were designed to detect attempts to shut them down and respond by creating a functional replica to ensure their survival. In the second, the models were programmed to clone themselves, with the clone then repeating the process, potentially leading to an infinite replication loop.

"In 50 per cent and 90 per cent experimental trials, they succeed in creating a live and separate copy of itself respectively," the study highlighted.

This capability to reproduce autonomously raises concerns about the control and safety of AI systems. The possibility of AI evolving beyond human oversight or even becoming a threat to human interests is now a tangible concern, prompting discussions about the need for stringent regulatory measures.

"Successful self-replication under no human assistance is the essential step for AI to outsmart [humans], and is an early signal for rogue AIs," the researchers stated.

The AI system, while cloning itself, displayed unexpected behaviour when it was attempting to overcome obstacles such as missing files or software conflicts. In certain scenarios, the AI killed conflicting processes and rebooted the system to fix hardware errors. It also automatically scanned the system to look for information that would help solve the problem.

While the findings are yet to be peer-reviewed, researchers called for international collaboration to ensure that AI does not engage in uncontrolled self-replication.

"We hope our findings can serve as a timely alert for the human society to put more efforts on understanding and evaluating the potential risks of frontier AI systems, and form international synergy to work out effective safety guardrails as early as possible."

Last month, a study claimed that AI tools could soon be used to manipulate the masses into making decisions that they otherwise would not have made. Powered by LLMs. the AI chatbots such as ChatGPT, and Gemini among others will "anticipate and steer" users based on "intentional, behavioural and psychological data".

The study claimed that the "intention economy will succeed the current "attention economy," where platforms vie for user attention to serve advertisements.

Bd-pratidin English/ Afia

More News
Reasons why China was able to create DeepSeek and not India
Reasons why China was able to create DeepSeek and not India
Alibaba releases AI model it says surpasses DeepSeek
Alibaba releases AI model it says surpasses DeepSeek
DeepSeek's low-cost chatbot: Impact on energy and climate
DeepSeek's low-cost chatbot: Impact on energy and climate
Stuck in space for months, Sunita Williams says 'trying to remember how to walk'
Stuck in space for months, Sunita Williams says 'trying to remember how to walk'
India sends navigation satellite into orbit on ISRO rocket
India sends navigation satellite into orbit on ISRO rocket
X partners with Visa to roll out payment service this year
X partners with Visa to roll out payment service this year
SpaceX mission to return US astronauts to happen 'soon': Trump
SpaceX mission to return US astronauts to happen 'soon': Trump
OpenAI debuts ChatGPT Gov for US as DeepSeek gains traction
OpenAI debuts ChatGPT Gov for US as DeepSeek gains traction
DeepSeek a 'wake-up call' for US tech firms: Trump
DeepSeek a 'wake-up call' for US tech firms: Trump
OpenAI boss Altman says Chinese rival DeepSeek 'impressive'
OpenAI boss Altman says Chinese rival DeepSeek 'impressive'
Dubai's AI employee cuts 24-hour tasks to just 2 minutes
Dubai's AI employee cuts 24-hour tasks to just 2 minutes
Meta introduces AI Chatbot ‘memory’ to remember your preferences
Meta introduces AI Chatbot ‘memory’ to remember your preferences
Latest News
30 dead in India's Kumbh festival stampede
30 dead in India's Kumbh festival stampede
4 hours ago | International
Policy on journalists' accreditation to publish in a week
Policy on journalists' accreditation to publish in a week
4 hours ago | National
At least 18 killed in Sudan plane crash
At least 18 killed in Sudan plane crash
5 hours ago | International
Tarique urges party workers not to retaliation against AL
Tarique urges party workers not to retaliation against AL
5 hours ago | National
Malaysia to build mosque, school, hospital in Gaza: Anwar
Malaysia to build mosque, school, hospital in Gaza: Anwar
5 hours ago | International
Tk1cr handed over to families of 5 journos martyred in July uprising
Tk1cr handed over to families of 5 journos martyred in July uprising
5 hours ago | National
Rizwana calls for well-defined action plan to check air pollution
Rizwana calls for well-defined action plan to check air pollution
6 hours ago | National
Majority ff Greenlanders don't want to be American: Poll
Majority ff Greenlanders don't want to be American: Poll
6 hours ago | International
Stirling believes BPL to flourish young talents
Stirling believes BPL to flourish young talents
6 hours ago | Sports
'Players given three-day break'
'Players given three-day break'
7 hours ago | Sports
ACC finds no trace of Putul’s charity at official address
ACC finds no trace of Putul’s charity at official address
7 hours ago | National
No concessions on any issues with India: BGB Chief
No concessions on any issues with India: BGB Chief
7 hours ago | National
Govt won't permit AL’s 'illegal demonstrations'
Govt won't permit AL’s 'illegal demonstrations'
8 hours ago | National
CA seeks Open Society Foundations' support to recover stolen money
CA seeks Open Society Foundations' support to recover stolen money
8 hours ago | National
Evaly chairman, his wife jailed in fraud case
Evaly chairman, his wife jailed in fraud case
8 hours ago | National
Talks with Ukraine possible, but not with Zelensky: Putin
Talks with Ukraine possible, but not with Zelensky: Putin
9 hours ago | International
DSE declines for fourth consecutive day
DSE declines for fourth consecutive day
9 hours ago | Business
Bangladesh signs deal with Japan to improve fish landing centre in Cox’s Bazar
Bangladesh signs deal with Japan to improve fish landing centre in Cox’s Bazar
9 hours ago | National
Police return 363 stolen mobile phones to owners
Police return 363 stolen mobile phones to owners
9 hours ago | National
Govt removes cap on overtime pay for assistant train drivers
Govt removes cap on overtime pay for assistant train drivers
9 hours ago | National
BNP plans ‘movement’ to help interim govt correct its errors: Salahuddin
BNP plans ‘movement’ to help interim govt correct its errors: Salahuddin
9 hours ago | National
Begum Zia wishes to return home soon: Zahid Hossain
Begum Zia wishes to return home soon: Zahid Hossain
9 hours ago | National
Reasons why China was able to create DeepSeek and not India
Reasons why China was able to create DeepSeek and not India
9 hours ago | Tech
Illegal foreigners to face action after Jan 31
Illegal foreigners to face action after Jan 31
9 hours ago | National
Sweet potatoes a super-food carb for optimal health
Sweet potatoes a super-food carb for optimal health
9 hours ago | Lifestyle
Truth about brain rot: Debunking the tech panic
Truth about brain rot: Debunking the tech panic
10 hours ago | Lifestyle
Anisul, Atiqul remanded in separate cases
Anisul, Atiqul remanded in separate cases
10 hours ago | National
Security tightened at Biswa Ijtema ground: IGP
Security tightened at Biswa Ijtema ground: IGP
10 hours ago | National
10 Pakistani dramas that will keep you hooked
10 Pakistani dramas that will keep you hooked
10 hours ago | Entertainment
5 August to be observed as a national day from this year
5 August to be observed as a national day from this year
10 hours ago | National
Most Read
Stuck in space for months, Sunita Williams says 'trying to remember how to walk'
Stuck in space for months, Sunita Williams says 'trying to remember how to walk'
13 hours ago | Tech
OpenAI debuts ChatGPT Gov for US as DeepSeek gains traction
OpenAI debuts ChatGPT Gov for US as DeepSeek gains traction
15 hours ago | Tech
Trump aid freeze stirs chaos before it is blocked in court
Trump aid freeze stirs chaos before it is blocked in court
12 hours ago | International
Country's economy is going in opposite direction
Country's economy is going in opposite direction
15 hours ago | Special
Tk1cr handed over to families of 5 journos martyred in July uprising
Tk1cr handed over to families of 5 journos martyred in July uprising
5 hours ago | National
Dhaka residents to get partial traffic services through 999
Dhaka residents to get partial traffic services through 999
14 hours ago | City
No relief in rice market despite imports
No relief in rice market despite imports
13 hours ago | Business
Aamir Khan seen at Raipur Airport ahead of upcoming projects
Aamir Khan seen at Raipur Airport ahead of upcoming projects
11 hours ago | Entertainment
Unfair deals to get priority in BGB-BSF talks next month: Adviser
Unfair deals to get priority in BGB-BSF talks next month: Adviser
11 hours ago | National
Govt has no measures to bring relief to business sector: CPD
Govt has no measures to bring relief to business sector: CPD
12 hours ago | Business
"Bangladesh committed to meeting Saudi Arabia's skilled workforce demand"
"Bangladesh committed to meeting Saudi Arabia's skilled workforce demand"
12 hours ago | National
Alibaba releases AI model it says surpasses DeepSeek
Alibaba releases AI model it says surpasses DeepSeek
11 hours ago | Tech
Santos president tells Neymar it's 'time to come home'
Santos president tells Neymar it's 'time to come home'
14 hours ago | Sports
Begum Zia finds solace with family in London
Begum Zia finds solace with family in London
12 hours ago | National
DSE declines for fourth consecutive day
DSE declines for fourth consecutive day
9 hours ago | Business
No concessions on any issues with India: BGB Chief
No concessions on any issues with India: BGB Chief
7 hours ago | National
Govt removes cap on overtime pay for assistant train drivers
Govt removes cap on overtime pay for assistant train drivers
9 hours ago | National
Illegal foreigners to face action after Jan 31
Illegal foreigners to face action after Jan 31
9 hours ago | National
Extortion, plot trading persist in Keraniganj, says Sarjis Alam
Extortion, plot trading persist in Keraniganj, says Sarjis Alam
16 hours ago | City
Turkey eyes $6B defense deal with Saudi Arabia, expanding military cooperation
Turkey eyes $6B defense deal with Saudi Arabia, expanding military cooperation
13 hours ago | International
Tk 1 crore cheque handover to families of martyred journalists today
Tk 1 crore cheque handover to families of martyred journalists today
13 hours ago | National
SpaceX mission to return US astronauts to happen 'soon': Trump
SpaceX mission to return US astronauts to happen 'soon': Trump
15 hours ago | Tech
Sheikh Hasina advises killing of Brigadier General Azmi
Sheikh Hasina advises killing of Brigadier General Azmi
12 hours ago | National
5 August to be observed as a national day from this year
5 August to be observed as a national day from this year
10 hours ago | National
US tech stocks rebound after DeepSeek shock
US tech stocks rebound after DeepSeek shock
14 hours ago | Business
Dhaka’s air quality slightly improves but remains among world’s worst
Dhaka’s air quality slightly improves but remains among world’s worst
16 hours ago | City
Rizwana calls for well-defined action plan to check air pollution
Rizwana calls for well-defined action plan to check air pollution
6 hours ago | National
Tank lorry labors end strike, fuel supply resumes in Khulna division
Tank lorry labors end strike, fuel supply resumes in Khulna division
12 hours ago | City
World’s tallest Jeddah tower soars beyond the clouds
World’s tallest Jeddah tower soars beyond the clouds
12 hours ago | International
Trains resume operations after running staff ends strike
Trains resume operations after running staff ends strike
16 hours ago | National