A former OpenAI leader says safety has 'taken a backseat to shiny products' at the AI company

A former OpenAI leader who resigned from the company earlier this week said Friday that safety has “taken a backseat to shiny products”.

A former OpenAI leader who resigned from the company earlier this week said Friday that safety has “taken a backseat to shiny products” at the influential artificial intelligence company.

Jan Leike, who ran OpenAI's “Superalignment” team alongside a company co-founder who also resigned this week, wrote in a series of posts on the social media platform X that he joined the San Francisco-based company because he thought it would be the best place to do AI research.

“However, I have been disagreeing with OpenAI leadership about the company’s core priorities for quite some time, until we finally reached a breaking point,” wrote Leike, whose last day was Thursday.

An AI researcher by training, Leike said he believes there should be more focus on preparing for the next generation of AI models, including on things like safety and analysing the societal impacts of such technologies. He said building “smarter-than-human machines is an inherently dangerous endeavor” and that the company “is shouldering an enormous responsibility on behalf of all of humanity.”

(For top technology news of the day, subscribe to our tech newsletter Today’s Cache)

“OpenAI must become a safety-first AGI company,” wrote Leike, using the abbreviated version of artificial general intelligence, a futuristic vision of machines that are as broadly smart as humans or at least can do many things as well as people can.

Open AI CEO Sam Altman wrote in a reply to Leike's posts that he was “super appreciative” of Leike's contributions to the company was “very sad to see him leave.”