Curated AI safety and governance jobs

Project-based adversarial evaluation and red teaming network for frontier AI systems, with work spanning ML security, prompt injection/jailbreaking, agentic system evaluation, and translating findings into governance and mitigation decisions.

Lead threat modeling for CBRNe risks in advanced AI systems, building evaluations and safety frameworks to inform deployment decisions and mitigate dual-use misuse.

Policy Director role supporting executive operations while building AI policy expertise at a nonprofit focused on pragmatic policies to reduce severe risks from frontier AI models.

CTO role leading engineering at Syntony, with direct responsibility for evaluation tooling, AI risk mapping, and governance instrumentation across the product suite.

Lead role at DeepMind focused on threat modeling and safety evaluations for CBRNe risks in advanced AI models, supporting the Frontier Safety Framework and deployment decisions.

Funding call for foundational research on safety and risk in multi-agent AI systems, including emergent dynamics, trustworthy interaction infrastructure, and scalable monitoring and control.

Open call for contractors to support CLTR’s AI policy unit and related AI-bio work, including AI governance, AI safety concepts, frontier-lab security practices, and safeguard approaches for capable models.

Senior backend/infrastructure engineer for BioTrust's verification platform, focused on auditability, access controls, data separation, and compliance-oriented security in a misuse-prevention context.

An 8-week in-person residency for engineers and researchers working on frontier AI security and verification, including projects to mitigate frontier AI risks and secure AI systems and infrastructure.

Full-time Congressional policy role leading Hill engagement, briefing offices, and developing AI-risk legislative proposals for Palisade Research.

Full-time policy role at Palisade Research focused on AI governance and legal/regulatory work, translating AI risk research into legislative and executive-branch proposals and advocating policy changes related to AI national security risks.

National security policy role focused on helping the national security community understand and respond to AI risks through policy and capability recommendations and external advocacy.

Policy role focused on building and executing AI policy engagement with Congress, the Executive Branch, media, and think tanks to advance Palisade Research's AI risk agenda.

Multiple in-person grantmaking and Chief of Staff roles on Coefficient Giving’s U.S. AI Policy team, focused on building U.S. AI governance capacity, supporting coalitions, and funding AI policy organizations.

State policy and public affairs role focused on OpenAI’s AI policy priorities, including guardrails for advanced AI models, legislative review, and engagement with state and local governments.

EU policy role focused on shaping OpenAI’s approach to AI-related legislative and regulatory issues in Brussels, including engagement with policymakers and support for regulation and industry standards.

Research engineer role focused on building and maintaining AI safety evaluation benchmarks, guardrails, and research on agentic failure modes.

Three AI research engineer roles building the safety-pretraining stack for Apertus, including evaluation/red-teaming, synthetic data, and training systems for open frontier LLMs.

Research engineer role at DeepMind focused on frontier AI safety risk assessment, including measuring and mitigating advanced model risks, loss of control, and harmful manipulation.