Curated AI safety and governance jobs

Lead research on frontier AI risk modeling across cyber, CBRN, and loss of control, setting methodological standards that inform safety cases, evaluations, mitigations, and AI governance.

Senior research role focused on creating next-generation evaluation methods, benchmarks, and infrastructure to measure LLM progress and model capabilities.

Forward Deployed Engineer role building and deploying LLM-powered agentic workflows for enterprise customers, with explicit responsibility for evaluation frameworks, safety, observability, and auditability of AI systems.

Senior technical staff role on Cohere’s Safety for Agents team focused on data generation, post-training algorithms, and evaluation methods to improve safety and trustworthiness of LLMs and agents.

Technical program manager for Cohere’s public sector and defence AI deployments, focused on delivery, governance checkpoints, regulatory compliance, and responsible AI considerations.

Technical role at METR focused on executing and scaling AI evaluations for capabilities, risks, mitigations, autonomy, and alignment.

Senior programs role at FAR.AI focused on designing and curating AI safety events, convenings, and field-building programming across the AI safety ecosystem.

Remote hourly contract role analyzing AI and LLM security scenarios, probing frontier models for vulnerabilities, misuse, and adversarial threats; relevant because it directly involves AI system safety, red-teaming, and misuse prevention.

Research role focused on frontier model evaluations and environments to improve agent capabilities while steering models toward safe AGI/ASI, in collaboration with safety/alignment partners.

A full-time, in-person research fellowship in Singapore focused on technical AI safety and governance, with projects aimed at frontier AI safety practice and policy translation.

Editorial role on OpenAI’s Safety Systems team focused on producing and improving public-facing transparency materials about technical safety work, including evaluations, safeguards, red teaming, and deployment decisions for frontier models.

Technical AI Safety Project Sprint BlueDot Impact Remote, Global This course teaches how to make a meaningful contribution to AI safety research or engineering through a structured 30-hour project sprint. Includes weekly mentorship from an AI safety expert to scope, refine, and execute your project with rapid feedback. Publishes projects on the course website as a public signal of your technical AI safety skills to collaborators and employers. Provides collaborative check-ins with peers to receive feedback and build your AI safety portfolio. BlueDot Impact is a nonprofit that runs courses which aim to help participants develop the knowledge, ...

Deputy Head of Programme (Security and Technology) Location Geneva Closing date 25 June 2026 Contract Temporary Position Title: Deputy Head of Programme (Security and Technology) Starting date: Negotiable, as soon as possible Occupational rate: 100% (Full-time) Duration: 364 days, with the possibility of extension Remuneration: P-4 Application Background The United Nations Institute for Disarmament Research (UNIDIR) is a voluntarily funded, autonomous institute within the United Nations. One of the few policy institutes worldwide focusing on disarmament, UNIDIR generates knowledge and promotes dialogue and action on disarmament and security. ...

Research Scientist Patronus AI Remote, USA, San Francisco Bay Area, New York, NY In this role, you will help solve challenging open research problems facing society’s adoption of AI today, surrounding AI evaluation, language model understanding, and robustness challenges. Develop state-of-the-art systems for AI evaluation and implement algorithms based on NLP advancements. Conduct novel research on redteaming language models, automated evaluation, and alignment. Scope out and lead research projects, including experiment design and understanding results. Patronus AI aims to provide a security and risk management layer for AI by building an aut...

The Jailbreaking Lead will focus on identifying and mitigating vulnerabilities in frontier AI models, leading a red team to enhance AI safety and security through hands-on technical work and collaboration with AI developers and governments.

Senior Research Engineer FAR AI San Francisco Bay Area, Remote, Global, Remote, USA $150,000 - $250,000 In this role, you'll accelerate AI safety research by tackling challenging engineering problems and increasing research depth. Lead projects in detecting AI deception, preventing misuse, or building research infrastructure. Mentor team members in technical work to elevate the team's capabilities. Apply software engineering expertise and Python skills to solve complex AI safety challenges. Contribute specialized knowledge in machine learning, high-performance computing, or technical leadership. FAR AI aims to ensure AI systems are trustworth...

Back to careers AI Security Research Engineer Remote / Part-time / Competitive The Mission The last major shift in cybersecurity produced CrowdStrike and SentinelOne. The next shift, AI-driven offense, will be bigger, and defense isn't ready. AI is compressing offensive cyber capability. Attacks that required nation-state resources will soon run autonomously, at machine speed. The industry's response so far has been to replay scripted attack simulations and hope for the best. That's not going to hold. 0Labs is building an AI-native platform and service for continuous purple teaming. Teams of agents execute real, adaptive cyber campaigns, then...

Machine Learning Researcher Gray Swan Remote, USA, Remote, Global In this role, you'll conduct AI safety research to identify and defend against failure modes in advanced AI systems. Discover emerging failure modes through stress-testing cutting-edge AI models. Help enterprises deploy AI safely and at scale without compromising innovation. Inform official safety evaluations of the world's most advanced AI models. Develop research-backed solutions for emerging AI safety challenges. Gray Swan is an AI security company that develops tools that automatically assess the risks of AI models.

Policy Analyst / Director Encode Washington, DC $110,000 In this role, you'll drive full-stack policy development across the organization, focusing on AI governance and public interest advocacy. Draft legislative language, policy briefs, and talking points for lawmakers. Build coalitions with stakeholders across government, industry, and civil society. Conduct policy research and create communications materials under tight deadlines. Support multiple concurrent projects, including emergency responses and time-sensitive policy opportunities. Encode is a global, youth-led organisation that advocates for policies to ensure responsible AI develop...