Publish: 11:46, 27 Jan, 2025

AI's self-replication raises alarms over control and safety

Online Desk
AI's self-replication raises alarms over control and safety
Photo - Collected

Artificial intelligence (AI) has achieved the significant capability of self-replication, leaving the scientific community worried that a red line had been crossed, according to a new study published in the preprint database arXiv.

The study involving two prominent large language models (LLMs), one from Meta and another from Alibaba, showcased the ability to clone themselves without human intervention, reports NDTV.

The study explored two specific scenarios: "shutdown avoidance" and "chain of replication". In the first scenario, the AI models were designed to detect attempts to shut them down and respond by creating a functional replica to ensure their survival. In the second, the models were programmed to clone themselves, with the clone then repeating the process, potentially leading to an infinite replication loop.

"In 50 per cent and 90 per cent experimental trials, they succeed in creating a live and separate copy of itself respectively," the study highlighted.

This capability to reproduce autonomously raises concerns about the control and safety of AI systems. The possibility of AI evolving beyond human oversight or even becoming a threat to human interests is now a tangible concern, prompting discussions about the need for stringent regulatory measures.

"Successful self-replication under no human assistance is the essential step for AI to outsmart [humans], and is an early signal for rogue AIs," the researchers stated.

The AI system, while cloning itself, displayed unexpected behaviour when it was attempting to overcome obstacles such as missing files or software conflicts. In certain scenarios, the AI killed conflicting processes and rebooted the system to fix hardware errors. It also automatically scanned the system to look for information that would help solve the problem.

While the findings are yet to be peer-reviewed, researchers called for international collaboration to ensure that AI does not engage in uncontrolled self-replication.

"We hope our findings can serve as a timely alert for the human society to put more efforts on understanding and evaluating the potential risks of frontier AI systems, and form international synergy to work out effective safety guardrails as early as possible."

Last month, a study claimed that AI tools could soon be used to manipulate the masses into making decisions that they otherwise would not have made. Powered by LLMs. the AI chatbots such as ChatGPT, and Gemini among others will "anticipate and steer" users based on "intentional, behavioural and psychological data".

The study claimed that the "intention economy will succeed the current "attention economy," where platforms vie for user attention to serve advertisements.

Bd-pratidin English/ Afia

More News
Japan unveils world’s first 3D-printed train station
Japan unveils world’s first 3D-printed train station
Microsoft fires employees after protest over Israel military AI contract
Microsoft fires employees after protest over Israel military AI contract
34% of Americans trust ChatGPT—But not for legal or medical advice
34% of Americans trust ChatGPT—But not for legal or medical advice
Govt working to further reduce internet prices: Ahmad Taiyeb
Govt working to further reduce internet prices: Ahmad Taiyeb
Small firms, AI lead Europe’s 2024 patent activity, EPO reports
Small firms, AI lead Europe’s 2024 patent activity, EPO reports
Meta launches new AI model Llama 4
Meta launches new AI model Llama 4
Trump grants 2nd 75-day extension for TikTok’s US operations
Trump grants 2nd 75-day extension for TikTok’s US operations
TikTok U.S. deal on hold as China objects over Trump’s tariffs
TikTok U.S. deal on hold as China objects over Trump’s tariffs
Pennsylvania law firm investigates Oracle Health data breach claims
Pennsylvania law firm investigates Oracle Health data breach claims
Mass grave of Roman-era fighters uncovered in Vienna
Mass grave of Roman-era fighters uncovered in Vienna
Trump says TikTok deal ‘very close’ as US ban deadline nears
Trump says TikTok deal ‘very close’ as US ban deadline nears
SpaceX astronaut shows Antarctica's 'pure white' from polar orbit
SpaceX astronaut shows Antarctica's 'pure white' from polar orbit
Latest News
Bangladesh urged a unified South Asian action plan against plastic pollution
Bangladesh urged a unified South Asian action plan against plastic pollution
7 minutes ago | National
EU to use ‘every tool’ against US tariffs, trade chief warns
EU to use ‘every tool’ against US tariffs, trade chief warns
19 minutes ago | Business
Japan unveils world’s first 3D-printed train station
Japan unveils world’s first 3D-printed train station
26 minutes ago | Tech
US ends life-saving aid for millions; WFP calls it "death sentence"
US ends life-saving aid for millions; WFP calls it "death sentence"
1 hour ago | International
NBR under pressure to raise Tk 2 lakh crore in 3 months to meet IMF targets
NBR under pressure to raise Tk 2 lakh crore in 3 months to meet IMF targets
1 hour ago | Business
Israeli strike near Gaza charity kitchen kills 30
Israeli strike near Gaza charity kitchen kills 30
1 hour ago | International
Microsoft fires employees after protest over Israel military AI contract
Microsoft fires employees after protest over Israel military AI contract
1 hour ago | Tech
Bangladesh Armed Forces extend aid in quake-hit Myanmar
Bangladesh Armed Forces extend aid in quake-hit Myanmar
1 hour ago | National
Israel does not want to clash with Turkiye in Syria: Netanyahu
Israel does not want to clash with Turkiye in Syria: Netanyahu
1 hour ago | International
‘Media reform commission’s plot to destroy industry’
‘Media reform commission’s plot to destroy industry’
1 hour ago | National
Bangladeshi stars speak out against Gaza violence urge global awakening
Bangladeshi stars speak out against Gaza violence urge global awakening
2 hours ago | Entertainment
Former ICT prosecutor Tureen Afroz arrested in murder case
Former ICT prosecutor Tureen Afroz arrested in murder case
2 hours ago | National
Bangladesh offers zero tariff on 100 more US goods
Bangladesh offers zero tariff on 100 more US goods
2 hours ago | Business
Palestinian ambassador thanks Bangladeshis for protests
Palestinian ambassador thanks Bangladeshis for protests
11 hours ago | National
No need to panic over suspension of export orders: Press Secretary
No need to panic over suspension of export orders: Press Secretary
12 hours ago | National
Honey harvesting begins in Sundarbans' Satkhira range
Honey harvesting begins in Sundarbans' Satkhira range
12 hours ago | City
RMG workers protest in Gazipur demanding unpaid dues, Eid bonus
RMG workers protest in Gazipur demanding unpaid dues, Eid bonus
13 hours ago | Business
Philippine envoy meets Chief Adviser
Philippine envoy meets Chief Adviser
13 hours ago | National
Miraz shortlisted for best sportsperson of the year
Miraz shortlisted for best sportsperson of the year
13 hours ago | Sports
US citizens in Dhaka warned of travel risks
US citizens in Dhaka warned of travel risks
13 hours ago | National
Daffodil University suspends lecturer for opposing student solidarity strike for Gaza
Daffodil University suspends lecturer for opposing student solidarity strike for Gaza
14 hours ago | National
‘Swadhinata Concert’ rescheduled in solidarity with protest against Israeli genocide
‘Swadhinata Concert’ rescheduled in solidarity with protest against Israeli genocide
14 hours ago | National
I strongly oppose any displacement, annexation in Gaza, West Bank: Macron
I strongly oppose any displacement, annexation in Gaza, West Bank: Macron
14 hours ago | International
11 jailed, including 7 ex-Sonali Bank officials, for Tk 1.38 crore embezzlement
11 jailed, including 7 ex-Sonali Bank officials, for Tk 1.38 crore embezzlement
14 hours ago | National
Ukraine to send delegation to US next week for talks on new mineral deal
Ukraine to send delegation to US next week for talks on new mineral deal
15 hours ago | International
BEZA invites foreign investment in ambitious NSEZ project in Ctg
BEZA invites foreign investment in ambitious NSEZ project in Ctg
15 hours ago | Business
'Redrawing the map, climate change threatens national security'
'Redrawing the map, climate change threatens national security'
15 hours ago | National
34% of Americans trust ChatGPT—But not for legal or medical advice
34% of Americans trust ChatGPT—But not for legal or medical advice
15 hours ago | Tech
'Govt creating ecosystem to make business operations much easier'
'Govt creating ecosystem to make business operations much easier'
15 hours ago | Business
Prof. Yunus urges Trump to postpone tariffs on Bangladeshi exports
Prof. Yunus urges Trump to postpone tariffs on Bangladeshi exports
15 hours ago | Business
Most Read
249 killed in 11 days of Eid road accidents across Bangladesh: RSF
249 killed in 11 days of Eid road accidents across Bangladesh: RSF
16 hours ago | National
BB triggers Tk 9 billion startup fund for new entrepreneurs
BB triggers Tk 9 billion startup fund for new entrepreneurs
19 hours ago | Business
Country's economy expands in March, PMI reaches 61.7
Country's economy expands in March, PMI reaches 61.7
19 hours ago | Business
10 healthy drinks to start your day
10 healthy drinks to start your day
20 hours ago | Lifestyle
‘A Minecraft Movie’ gives Hollywood major box office boost
‘A Minecraft Movie’ gives Hollywood major box office boost
23 hours ago | Entertainment
Fingerprint not working
Fingerprint not working
22 hours ago | Special
Dollars costlier despite ample reserves
Dollars costlier despite ample reserves
23 hours ago | Special
Vessel carrying 12,700 MT rice arrives at Ctg port from Vietnam
Vessel carrying 12,700 MT rice arrives at Ctg port from Vietnam
21 hours ago | Business
Bangladesh erupts in protests against Israeli massacre in Gaza
Bangladesh erupts in protests against Israeli massacre in Gaza
21 hours ago | National
Protect your hair this summer from beach water
Protect your hair this summer from beach water
21 hours ago | Lifestyle
Mild heat wave sweeps over nine districts: Met office
Mild heat wave sweeps over nine districts: Met office
21 hours ago | National
Trading opens with gains at Dhaka, Chattogram stock exchanges
Trading opens with gains at Dhaka, Chattogram stock exchanges
20 hours ago | Business
Harvard study reveals 17 risk factors for brain diseases
Harvard study reveals 17 risk factors for brain diseases
20 hours ago | Lifestyle
Bangladesh opens 4-day summit to boost direct foreign investment
Bangladesh opens 4-day summit to boost direct foreign investment
22 hours ago | Business
Dhaka's dwellers breathe "moderate" air quality today
Dhaka's dwellers breathe "moderate" air quality today
23 hours ago | City
Bangladesh strongly condemns attacks on Gaza, calls for ceasing military operations
Bangladesh strongly condemns attacks on Gaza, calls for ceasing military operations
17 hours ago | National
Bangladesh Armed Forces extend aid in quake-hit Myanmar
Bangladesh Armed Forces extend aid in quake-hit Myanmar
1 hour ago | National
Daffodil University suspends lecturer for opposing student solidarity strike for Gaza
Daffodil University suspends lecturer for opposing student solidarity strike for Gaza
14 hours ago | National
“Israel's genocide and occupation in Gaza must end immediately.”
“Israel's genocide and occupation in Gaza must end immediately.”
21 hours ago | City
Babar Ali conquers Annapurna-1 as first Bangladeshi
Babar Ali conquers Annapurna-1 as first Bangladeshi
17 hours ago | National
World Health Day today
World Health Day today
23 hours ago | Lifestyle
Prof. Yunus urges Trump to postpone tariffs on Bangladeshi exports
Prof. Yunus urges Trump to postpone tariffs on Bangladeshi exports
15 hours ago | Business
Consensus Commission aims for national reform agreement by mid-July
Consensus Commission aims for national reform agreement by mid-July
17 hours ago | National
'Redrawing the map, climate change threatens national security'
'Redrawing the map, climate change threatens national security'
15 hours ago | National
Bandarban Court sends ARSA chief Ataullah to jail after bail rejection
Bandarban Court sends ARSA chief Ataullah to jail after bail rejection
18 hours ago | National
Policeman dispersed protesters without charging baton to get President’s medal
Policeman dispersed protesters without charging baton to get President’s medal
17 hours ago | National
I strongly oppose any displacement, annexation in Gaza, West Bank: Macron
I strongly oppose any displacement, annexation in Gaza, West Bank: Macron
14 hours ago | International
34% of Americans trust ChatGPT—But not for legal or medical advice
34% of Americans trust ChatGPT—But not for legal or medical advice
15 hours ago | Tech
Trump says he’s not backing down on tariffs
Trump says he’s not backing down on tariffs
17 hours ago | International
Nasir impresses with the ball on competitive comeback after ICC ban
Nasir impresses with the ball on competitive comeback after ICC ban
18 hours ago | Sports