King Charles III hosted a private summit with senior AI industry leaders at Dumfries House in Ayrshire, Scotland, on September 17, urging them to keep artificial intelligence under control and “in the service of people and the planet.” 

The King convened the gathering as a neutral host, bringing together executives from OpenAI, Anthropic, Google DeepMind, and Nvidia for a private, informal discussion, according to The Associated Press.

Around 30 executives, policymakers, and ethics researchers attended in total. The summit produced no formal agreements or binding commitments.

A Stark Warning, But No Binding Outcome

“The development of AI, its substance and its pace, are both intriguing and deeply concerning in equal measure,” the King said in his opening remarks, according to the AP. He warned of AI’s “existential dangers,” saying the technology’s creators are increasingly warning it “risks developing darker capacities, perhaps even to take life.” 

Charles opened the summit before stepping aside to let the executives talk among themselves, according to CNN.

The CNN report noted that members of the British royal family move carefully around complicated policy issues. Bound by convention to stay out of politics, they’re able to draw attention to a problem, but not to propose how it should be fixed.

Even AI’s Biggest Boosters Are Talking About Restraint

At the summit, Nvidia CEO Jensen Huang told the BBC that AI companies need to be “more rigorous in testing and securing” their systems, according to CNN.

A Signal Worth Tracking

Huang’s comment is worth taking a note, because even Nvidia, whose business depends on AI’s continued rapid growth, is now saying publicly that testing and securing AI systems needs to be more rigorous.

That’s a useful data point for anyone building the case internally for stronger AI governance investment: when the industry’s own leaders are converging on the language of testing rigor and control, it’s a signal that governance is now more critical than ever.