- Salary
- £230k – £395k
- Location
- London & San Francisco
- Workplace
- Onsite
- Type
- Full-time
- Department
- Scheming Research
- Visa
- Sponsored
- Source
- Lever
Description
Application deadline: We are conducting interviews actively and aim to fill this role as soon as we find someone suitable.
ABOUT THE OPPORTUNITY
The OpenAI/Hugging Face incident may be the biggest warning shot we get before catastrophic loss-of-control. In its aftermath, Anthropic and OpenAI committed to giving embedded evaluators an unprecedented level of access.
Embedded evaluations are the best existing method to find out whether alignment is on track. With OpenAI predicting an automated researcher by March 2028, we don't have time to start with an MVP embedded evaluation and iteratively improve it. The first embedded evaluations will set the standard and we have to get it right.
As a fundamental researcher, your ground-breaking discoveries will make our embedded evaluations better. For example, our fundamental science team's paper “Measuring Reward-Seeking via Contrastive Belief Updates” can be adapted by embedded evaluators. We want more breakthroughs like this.
We are also developing a “Science of Scheming”. The goal is ambitious and we’re looking for Research Scientists and Research Engineers who are excited to build a new hard science from the ground up.