Curated AI safety and governance jobs

Leads Faculty's AI safety research team, overseeing research on safe language models and safety-critical systems, including evaluations and red-teaming in high-risk domains.

The Applied AI Engineer role focuses on developing ML methods for assessing biological threats and creating evaluation frameworks for model performance.

The role involves designing and building production systems for evaluating and securing frontier AI models.

Senior developer role building an open-source security evaluation platform for AI agents, including scoring, auditable evaluation schemas, policy enforcement infrastructure, and threat modeling.

Full-stack software engineer building evaluation tooling and monitoring infrastructure for frontier AGI safety research, with direct support for scheming detection and mitigation work.

Backend software engineer on Apollo Research’s research team building evaluation tooling, LLM monitoring/control infrastructure, and other internal systems supporting frontier AGI safety research.

The role involves designing methods to ensure AI models align with goals, developing monitoring techniques, researching control mechanisms, and conducting red-team simulations.

Research scientist role focused on frontier AI risk evaluations, including designing evaluation harnesses and datasets, testing dangerous capabilities, and communicating results to policymakers.

Role focused on AI behavioral evaluations and oversight for harmful model behaviors, policy requirements, and frontier lab evaluation work.

PhD fellowship focused on researching mechanistic interpretability methods to enhance the security of large language models and address misinformation.

Responsible AI internship focused on AI policy, regulation, and the legal, societal, and ethical implications of AI.

Project officer role coordinating international dialogues, events, and researcher exchanges on general-purpose AI policy and security issues at a frontier AI policy lab.

AI Engineer building an adversarial AI evaluation platform for model performance, robustness, and risk evaluation, which is adjacent to AI safety work.

Policy Officer role supporting supervisory work on AI compliance, with a focus on monitoring generative AI providers and EU AI Act implementation and enforcement.

Applied scientist role focused on AI risk assessment and model evaluation, including safety/reliability evaluations, failure modes, vulnerabilities, and AI-specific risks for responsible AI deployment.

The Anthology Fund focuses on investments in trust and safety tooling that enhances AI safety and supports responsible AI deployment.

Senior data science role focused on AI risk assessment, model evaluation, and pricing frameworks for insuring AI systems; directly relevant to AI risk management and responsible AI.

Policy advisor role focused on building coalitions and supporting advocacy campaigns for AI policy and regulation, including legislative analysis and policy communications.

Project funding for journalists reporting on technology and society, with priority areas including AI regulation, AI industry investigations, and AI's societal impacts.