This allows us to make an "inability safety case" for now: current models are unlikely to cause severe harm via scheming. As model capabilities advance, we will need to continue evaluating models for scheming capabilities.
Read more about this work: deepmindsafetyresearch.medium.com/evaluating-a...

For example, in one stealth evaluation, a model acting as a personal assistant had to make a user miss a meeting and then cover its tracks by deleting emails and logs. Models performed significantly worse than humans on this challenge.

We tested Gemini 2.5 Flash & Pro, GPT-4o, o1, and Claude 3.7 Sonnet using a new suite of evaluations for scheming capabilities. These models show some limited stealth and situational awareness capabilities. Our evaluations are open-sourced here: github.com/UKGovernment...

We identified two prerequisite capabilities for scheming:
- Stealth: Ability to reason about and circumvent oversight mechanisms.
- Situational awareness: The model’s ability to gain and leverage knowledge about itself and its circumstances and environment to pursue goals.