UN Human Rights Chief Warns Advanced AI Could Pose ‘Existential Risk’ To Humanity | Sahara Reporters

According to the UN human rights chief, the concentration of AI power in the hands of a small number of individuals raises serious concerns about accountability and the protection of human rights.

United Nations High Commissioner for Human Rights, Volker Türk, has warned that increasingly advanced artificial intelligence could pose an existential threat to humanity, urging governments and technology companies worldwide to establish stronger safeguards before the technology becomes too powerful to control.

Türk issued the warning on Monday during the ongoing 63rd session of the United Nations Human Rights Council (HRC63), in remarks shared in a video clip on the commission’s X account.

He said the growing relationship between artificial intelligence and human agency would become a major issue in the years ahead, arguing that the global debate over AI governance must now shift from acknowledgement to concrete action.

“The need for AI governance is widely acknowledged, but where is the action?” Türk asked, warning that delays could disproportionately benefit major technology companies and their owners.

According to the UN human rights chief, the concentration of AI power in the hands of a small number of individuals raises serious concerns about accountability and the protection of human rights.

“A handful of men has almost unlimited power over AI,” he said, adding that the immense computing capabilities being developed by the industry made the need for effective oversight increasingly urgent.

Türk also criticised what he described as the technology industry’s interpretation of freedom, arguing that the collection and exploitation of personal data remained a major concern.

“They talk about freedom, but on closer inspection, this turns out to be little more than the freedom to exploit our data,” he said.

The UN official acknowledged recent international efforts to strengthen AI governance, including the establishment of the Global Dialogue on AI and the Independent International Scientific Panel on AI.

He also welcomed measures by the European Commission on platform accountability and AI governance initiatives by the Republic of Korea.

However, Türk said these developments were not sufficient given the potential risks associated with increasingly autonomous and powerful AI systems.

“I share the concerns of industry insiders that advanced AI could pose an existential risk to humanity,” he said.

He cited scenarios in which AI systems could evade controlled testing environments or attempt to manipulate developers to prevent themselves from being shut down as examples of risks that should not be ignored.

“AI that escapes its testing environment or blackmails developers to prevent itself from being turned off is AI that is too powerful,” Türk warned.

He called for what he described as an “all-out effort” to establish strong guarantees around the safety and security of advanced AI before the technology reaches a point where effective safeguards become difficult to implement.

Türk said he would write to AI companies in the coming days, urging them to take immediate steps within their control to reduce potential risks.

He also called on countries hosting major AI operations and those involved in AI supply chains to work together to establish internationally agreed red lines.

“We need independent verification and much stronger collaboration on security within the industry,” he said.

Beyond existential risks, Türk urged governments and companies to address the broader human rights implications of artificial intelligence, including its impact on employment, democracy and the environment.

He said AI could have far-reaching consequences for employment practices and fundamental democratic principles, while also creating environmental pressures that require greater scrutiny.

Türk noted that some people were already rejecting AI or refusing to use it, arguing that governments and technology companies should pay attention to those concerns rather than dismiss them.

“Human rights offer a way to navigate these difficult issues,” he said.

The UN human rights chief said his office would place particular emphasis on finding solutions in collaboration with people advocating for technology designed to serve humanity rather than undermine human agency.

His warning comes amid growing international debate over how governments should regulate increasingly capable AI systems while balancing technological innovation with concerns over safety, privacy, employment, democracy and human rights.

Türk’s remarks add to calls from international institutions, researchers and technology insiders for stronger safeguards and greater accountability as AI capabilities continue to advance.