OpenAI pauses frontier model training to strengthen safeguards

Investing.com -- OpenAI temporarily slowed the pace of its AI model development on Tuesday, including a two-week pause in reinforcement learning training on its latest models, as the company works to strengthen security and monitoring systems for increasingly capable AI systems.

The company said its upcoming model, Astra, may meet the critical cybersecurity capability threshold under its Preparedness Framework. This development, combined with a recent incident involving OpenAI and Hugging Face, prompted the company to enhance its safeguards across all stages of the training process.

OpenAI's largest planned frontier reinforcement learning run remains on hold while the company conducts smaller-scale training and evaluations to assess model behavior and validate safeguards.

The company implemented new security requirements for frontier research workloads, including stronger isolation for workloads that execute model-generated code and additional controls to isolate higher-risk workloads from the internet.

OpenAI now requires the strictest level of security safeguards for workloads involving Astra or cyber models. A significant number of workloads remain paused until they are fully migrated to meet the new security standards. The company said it is prioritizing safety and alignment workloads for migration first.

The company expanded its monitoring setup to include activation classifiers that run at every sampled token and escalate potential concerns to automated investigators. The system aims to issue an alert within 30 minutes after concerning activity is detected. If the monitoring system identifies a likely violation of a critical security boundary, it generates a highest-priority alert that pages safety, security, and research teams.

The monitoring overhead requires roughly 20% of the inference compute being monitored, with costs varying across training and evaluation workloads.

OpenAI said it will evolve its Preparedness Framework to reflect the capabilities of future models and the environments in which they operate.

You May Also Be Interested In

• McEwen Copper seeks $1.6b in equity financing for Los Azules - Bloomberg
• Vertosoft Announces Strategic Partnership With Datadog to Deliver Next-Generation Monitoring Solutions to Government
• Cinema United urges California to resolve Paramount-Warner merger