Curated AI safety and governance jobs

The role involves pursuing a PhD with a focus on AI safety, generative AI, and agentic AI systems, addressing critical aspects of AI development and deployment.

Research engineer building AI platforms and infrastructure for alignment research, safety research, and evaluation of AI alignment/control approaches at CARMA.

The Lead Researcher will examine AI offense-defense dynamics, developing frameworks and guidance for policymakers and stakeholders to manage AI risks and enhance societal safety.

Senior economist role researching the systemic economic and geopolitical risks of transformative AI, with outputs intended for policymakers and AI risk management work.

The AI Red Teamer role involves probing frontier AI systems for vulnerabilities, designing attack strategies, and building safety evaluation infrastructure to ensure AI safety.

Expressions of interest for policy and engineering roles focused on frontier AI auditing, verification, and evaluation; relevant because it directly concerns AI governance and auditing of AI systems.

Research Scientist role studying latent structure and behavior in neural networks, with explicit emphasis on understanding as safety, safety-relevant tools, and internal red teaming.

Lead a CSET research team on frontier AI issues, producing policy-relevant research on capabilities, risks, governance, and implications for policymakers.

Technical lead for ARIA’s multi-agent security programme, supporting research on AI agents operating and coordinating in untrusted environments, with explicit emphasis on AI red-teaming and security research.

Policy advocacy role briefing US policymakers on superintelligence risks and advancing AI-related governance action, including a campaign to prohibit superintelligence.

State organizer role building grassroots public-engagement and issue advocacy around the risks of advanced AI in New Hampshire or Iowa.

Computational biologist role focused on building evaluation frameworks and experiments for biological security problems using frontier AI systems.

Role building evaluation task pipelines and infrastructure for frontier model testing, including systems to prevent models from detecting evaluations.

Research fellowship studying frontier AI capability thresholds, human performance comparisons, and forecasting when AI systems surpass expert performance; relevant as public-interest AI policy research on frontier general-purpose AI.

Remote global course on frontier AI governance that prepares participants for government and policy roles, with content on capability evaluations, policy debates, and roadmap development.

Research lab administrator managing operations for Purdue's Governance and Responsible AI Lab, with responsibilities including policies, compliance, data quality, grants, communications, and events supporting AI governance research.

Research analyst role conducting policy-relevant research on frontier AI and cybersecurity, producing publications and presentations for policy audiences.

Academic fellowship producing legal scholarship on AI law and policy, focused on the legal challenges posed by transformative artificial intelligence.

Three-month in-person fellowship in Washington, DC for research on AI governance and policy, with mentorship and policy-focused professional development.