Curated AI safety and governance jobs

A remote global funding call for founders to start new organizations tackling critical AI safety problems, including alignment moonshots and frontier capabilities work.

Staff+ software engineer role building production ML infrastructure for Claude's safety systems, including safety deployments, monitoring, and productionizing safety research.

Postdoctoral research role on safe, controllable agentic AI, combining runtime behavioral control, normative constraints, integrated evaluation, and publication in AI safety and formal methods venues.

Research engineer role studying whether values persist after reinforcement learning, using training pipelines, evaluations, and interpretability methods to analyze model behavior and alignment.

Fully-funded PhD position researching responsible machine learning, with explicit focus on AI safety and robust alignment in multi-agent LLM systems.

Research scientist role in Resolution’s philosophy program focused on AI alignment research, including conceptual analysis, empirical hypotheses, and evaluation methods for aligned ASI.

Security architect role designing physical and operational security for an adversarial testbed supporting AI compute verification, red-teaming, and governance-relevant verification standards.

Senior SRE role on Anthropic's Safeguards ML Infra team, focused on deploying, verifying, and operating production safety infrastructure and safety classifiers for frontier model launches.

Senior compliance leadership role owning Anthropic's sanctions compliance program and supporting export controls, with explicit responsibility for risk governance, policy frameworks, remediation, and AI-related regulatory compliance.

Program manager for the Canadian AI Safety Institute research program, supporting AI safety initiatives, research partnerships, proposal calls, and related events.

Research role on agent safety, oversight, evaluations, red-teaming, and system-level mitigations for increasingly capable AI agents operating safely and autonomously.

Legal counsel role on Anthropic's Research Legal team advising on frontier AI model development, AI regulation, model launches, system cards, Responsible Scaling Policy, and capability evaluations.

Lead research role at an AI safety organization focused on frontier model risks, misalignment, loss of control, harmful manipulation, and rigorous model evaluation research.

Research manager/generalist for SPAR, an AI safety research fellowship, supporting mentors and mentees, cohort programming, and program operations in the AI safety ecosystem.

Senior role leading AISA’s frontier AI risk policy and research agenda, briefing governments across Asia and shaping governance options around evaluations, assurance, misuse pathways, and compute/supply-chain governance.

Hands-on management role leading Anthropic’s biological safety research engineering team, focused on frontier model evaluations, safety classifiers, red-teaming, and deployment safeguards to prevent catastrophic misuse.

Leads a portfolio of new Kairos programs and ecosystem infrastructure projects aimed at advancing AI safety and reducing risks from advanced AI.

Founding lead for Kairos Labs, an incubator that will design, launch, and support new AI safety organizations and projects.

Lead Kairos’s AI safety university groups portfolio, setting strategy, launching new initiatives, and managing the team supporting AI safety fieldbuilding.