Openai Disbands Mission Alignment Team, Which Focused On ‘safe’ And ‘trustworthy’ Ai Development

OpenAI has disbanded a squad that focused connected — arsenic nan institution itself described — ensuring that its AI systems are “safe, trustworthy, and consistently aligned pinch quality values.” At nan aforesaid time, nan team’s erstwhile leader has been fixed a caller domiciled arsenic nan company’s “chief futurist.”

OpenAI confirmed to TechCrunch that nan team’s members person now been assigned to different roles. The news was first reported by Platformer.

The disbanded squad successful question, which appears to person been formed successful September of 2024, was nan startup’s soul portion dedicated to moving connected alignment. That’s a wide section of interest wrong nan manufacture that seeks to guarantee that AI acts successful accordance pinch quality interests.

“We want these systems to consistently travel quality intent successful complex, real-world scenarios and adversarial conditions, debar catastrophic behavior, and stay controllable, auditable, and aligned pinch quality values,” a post from OpenAI’s Alignment Research blog declares.

An OpenAI job posting for nan Alignment squad describes it arsenic being dedicated to AI investigation that focuses connected “developing methodologies that alteration AI to robustly travel quality intent crossed a wide scope of scenarios, including those that are adversarial aliases high-stakes.”

In a blog post published Wednesday, Josh Achiam, nan erstwhile caput of OpenAI’s Alignment team, explained his caller domiciled arsenic nan company’s Chief Futurist. “My extremity is to support OpenAI’s ngo — to guarantee that artificial wide intelligence benefits each of humanity — by studying really nan world will alteration successful consequence to AI, AGI, and beyond,” Achiam wrote.

Achiam noted that, successful his caller role, he would beryllium collaborating pinch Jason Pruet, a physicist from OpenAI’s method staff.

A spokesperson for OpenAI said that remainder of nan Alignment squad — a group of six aliases 7 group — had subsequently been reassigned to different parts of nan company. The spokesperson couldn’t opportunity wherever precisely nan squad members had been assigned, but said that they were engaged successful akin activity successful those roles. It was besides unclear whether Achiam would person a caller squad arsenic portion of his “futurist” role.

The spokesperson attributed nan disbanding of nan squad to nan kinds of regular reorganizations that hap wrong a fast-moving company.

OpenAI antecedently had what it called a “superalignment team”—which was formed successful 2023 focused connected studying semipermanent existential threats posed by AI — but that squad was disbanded successful 2024.

Achiam’s personal website still lists him arsenic caput of Mission Alignment astatine OpenAI, and describes him arsenic being willing successful ensuring that nan “long-term early of humanity is good.” His LinkedIn profile shows he had served arsenic Head of Mission Alignment since September of 2024.