The King of the United Kingdom convened a summit to focus on the risks of AI. Huang Renxun said that products that are not safe enough should be postponed.

📅 2026-09-18

Abstract:

Heavyweights in the artificial intelligence (AI) industry have gathered in Scotland, where the King has urged them to ensure they do not lose control of the technology. King Charles III convened a summit with technology industry leaders and other influential figures to focus on the growing risks of AI. The topic has become a global focus this week. Executives at the meeting did not publicly commit to any changes, but some responded directly to safety concerns.

"Those of us who develop AI must rigorously test systems," Nvidia CEO Jensen Huang said briefly at the royal event on Thursday. "If the product is not safe enough, we should hold off on releasing it."

Also attending the Scottish summit with Jen-Hsun Huang were Sarah Friar, chief financial officer of OpenAI, and Demis Hassabis, co-founder of Google DeepMind. Tino Cuéllar, director of public affairs at Anthropic PBC, also participated in the AI ​​forum held at Dumfries Estate. Other attendees included heads of technology companies, nonprofits and educational institutions, including Tsinghua University.

“Those of us in this world who value humanity and its vital moral values ​​are anxiously seeking your assurances – assurances that we will not lose control of our own destiny,” said Charles III in his opening address. Buckingham Palace said in a statement that the event was aimed at discussing how the technology could be used to benefit society and the natural world.

King Charles III of England (left), Google DeepMind's (center) and Nvidia CEO Jensen Huang at Dumfries Estate in Cumnock, Scotland on September 17.
British King Charles III (left), Google DeepMind's (center) and Nvidia CEO Jensen Huang at Dumfries Estate in Cumnock, Scotland on September 17.

This summit comes at the right time. Anthropic CEO Dario Amodei published an article last weekend calling for slowing down the development of cutting-edge models, which triggered a global discussion on the rising risks of AI.

“There’s been a lot of heated debate lately around the catastrophic risks of this technology,” Hassabis said at the summit. The British scientist recently stepped down from his role managing Google's AI business. He said that he has two main concerns about powerful AI: one is that the autonomous system is out of control, and the other is that "malicious actors" use AI to do evil. However, he believes that the industry can solve these problems. “I have full faith in human ingenuity,” he said.

Charles III raised two key questions at the summit: "First, how do we make full use of the benefits of AI while ensuring security? Second, how do we build international cooperation and consensus to achieve this goal, ensuring that no country is left behind, and protecting the future of mankind?

According to the schedule distributed at the event, during the summit, Charles III also held closed-door talks with Huang Jen-Hsun, Hassabis, Cuéllar, Friar and five other guests.

Related tags

Related articles

Comments

0/500
Captcha (click to refresh)
No comments yet