Curated AI safety and governance jobs

Technical security researcher role focused on red-teaming AI agent systems, securing agent sandboxes and access controls, and building monitoring and controls to reduce catastrophic risks from coding agents.

Research engineer role on DeepMind’s AGI Safety and Alignment Team, focused on alignment methods, adversarially robust control systems, interpretability, and frontier-model safety work.

Research scientist role leading Frontier Safety Framework governance research and risk modeling for frontier AI models, including safety evaluations, mitigation assessment, and external safety reporting.

A 3-month full-time research fellowship in applied mathematics for AI safety, centered on technical AI alignment research and producing a research proposal.

Lead Talos Network’s AI governance incubator, recruiting and supporting participants to launch new European AI governance initiatives and mapping field gaps in frontier AI governance capacity.

Research scientist role focused on monitoring deployed GenAI models for safety, alignment, misuse, and coordinated harms using automated evaluations, classifiers, and large-scale production data.

Research engineer role on DeepMind's AGI Safety and Alignment Team focused on alignment methods, adversarially robust AGI control systems, and interpretability for frontier models.

Research Manager for GovAI’s DC Seasonal Fellowships, managing fellows and supporting an AI governance and policy talent development program.

Policy role in Anthropic's Safeguards organization focused on conventional weapons: defining policy boundaries, building threat models and evaluations, and operationalizing enforcement for model misuse prevention.

Research engineer role building technical prototypes for AI verification mechanisms, with direct links to policymakers and real-world AI governance.

Senior software engineering role on OpenAI's API Safety team building safety controls, observability, and safeguards for safe deployment of frontier models in the API.

Senior Model Policy Manager role focused on creating and operationalizing policies, taxonomies, and evaluation criteria to keep frontier AI systems safe, especially for biological and chemical risk.

Policy advisor role on MIRI’s Technical Governance Team focused on AI governance research, policy implementation, government outreach, and drafting/feedback on AI-related regulations and legislation.

Founding program officer role focused on AI resources, grantmaking, partnerships, and strategy for AI resilience work that explicitly includes model safety, cybersecurity, and related AI safety ecosystem support.

Founding grantmaker for the AI Model Safety program, funding independent evaluations, standards, and foundational safety research to improve frontier model safety.

Senior AI red team role on SEI's AI Security team focused on adversary emulation against AI-enabled systems, developing offensive techniques to improve defender preparedness and AI system security.

Principal researcher role focused on AI risk management and NIST AI RMF adoption, including developing guidance, implementation profiles, and advising agencies on trustworthy AI practices.

Two-year postdoctoral research role on mechanistic interpretability and AI reasoning within an ERC-funded project on explainable and robust automatic fact checking. Relevant as adjacent AI safety work because it studies model internals and reasoning behavior.

Research scientist role on DeepMind's GenAI Safety team focused on production monitoring, automated evaluations, and misuse detection for deployed AI models.