OpenAI is on the lookout for a new executive to spearhead efforts in studying emerging AI-related risks, spanning from computer security to mental health. The company’s CEO, Sam Altman, highlighted the challenges posed by AI models, emphasizing concerns about their impact on mental well-being and their prowess in identifying critical vulnerabilities in computer security.
The new Head of Preparedness at OpenAI will play a pivotal role in implementing the company’s preparedness framework, focusing on tracking and preparing for frontier capabilities that introduce new risks of severe harm. This move comes after OpenAI initiated the formation of a dedicated preparedness team in 2023, tasked with assessing potential catastrophic risks, including immediate threats like phishing attacks and speculative dangers such as nuclear risks.
As part of its evolving safety protocols, OpenAI recently updated its Preparedness Framework to address scenarios where competing AI labs release high-risk models without equivalent safeguards, indicating a willingness to adapt safety requirements proactively.
Source: TechCrunch
Leave a Reply