AI corporate leaders tell UN the industry needs global regulation

The heads of several major AI firms told the United Nations Security Council (UNSC) their industry urgently needed global oversight to avoid dangers that could threaten the whole world.

“If managed poorly, I even believe AI could be a risk to humanity as a whole,” Dario Amodei, the chief executive officer of Anthropic, told members of the body on Wednesday.

Sam Altman, the head of rival company OpenAI, echoed his concerns, telling the 15-member council tasked with tackling major crises globally that humanity could “lose control of the future of AI”.

The meeting, which coincides with the UN General Assembly (UNGA) gathering in New York City, was convened by France and comes at a time when experts are increasingly warning that the rapid development of AI needs more human oversight to ensure it does not slip out of control and cause a global catastrophe.

“If AI is to be democratic, the most important decisions cannot be made by labs in San Francisco alone,” Altman told members. “They must be shaped through democratic processes and by governments accountable to the people they serve.”

Their concerns were shared by several representatives on the council, including the foreign ministers of France and the United Kingdom, who said the international community needed to step in and create common frameworks for how the technology should be controlled.

Hugging Face CEO Clement Delangue, whose company has come under attack by out-of-control AI models in recent months – incidents used by the other companies as evidence of the need for more safety measures – told the UNSC his company had relied on the technology to defend itself in those same incidents.

Delangue said Hugging Face had relied on a Chinese AI model to help defend against the attack by OpenAI’s AI agents, because it faced fewer restrictions than comparable US tools.