Curated roles
Browse roles focused on reducing risks from advanced AI systems, including alignment research, safety engineering, evaluations and related operations.
357 active roles found.
Senior research engineer role on Cohere’s Safety / Modelling Safety and Trust team building data tooling and pipelines for training and evaluation data to support safer, more reliable models.
Research role focused on evaluating frontier AI models on real-world tasks, building benchmarks and rubrics, and analyzing model performance; directly relevant to AI evaluations and safety-adjacent capability assessment.
Lead research on frontier AI risk modeling across cyber, CBRN, and loss of control, setting methodological standards that inform safety cases, evaluations, mitigations, and AI governance.
Senior research role focused on creating next-generation evaluation methods, benchmarks, and infrastructure to measure LLM progress and model capabilities.
Senior technical staff role on Cohere’s Safety for Agents team focused on data generation, post-training algorithms, and evaluation methods to improve safety and trustworthiness of LLMs and agents.
Technical role at METR focused on executing and scaling AI evaluations for capabilities, risks, mitigations, autonomy, and alignment.
Senior programs role at FAR.AI focused on designing and curating AI safety events, convenings, and field-building programming across the AI safety ecosystem.
Remote hourly contract role analyzing AI and LLM security scenarios, probing frontier models for vulnerabilities, misuse, and adversarial threats; relevant because it directly involves AI system safety, red-teaming, and misuse prevention.
Research role focused on frontier model evaluations and environments to improve agent capabilities while steering models toward safe AGI/ASI, in collaboration with safety/alignment partners.
A full-time, in-person research fellowship in Singapore focused on technical AI safety and governance, with projects aimed at frontier AI safety practice and policy translation.
Editorial role on OpenAI’s Safety Systems team focused on producing and improving public-facing transparency materials about technical safety work, including evaluations, safeguards, red teaming, and deployment decisions for frontier models.
Technical AI Safety Project Sprint BlueDot Impact Remote, Global This course teaches how to make a meaningful contribution to AI safety research or engineering through a structured 30-hour project sprint. Includes weekly mentorship from an AI safety expert to scope, refine, and execute your project with rapid feedback. Publishes projects on the course website as a public signal of your technical AI safety skills to collaborators and employers. Provides collaborative check-ins with peers to receive feedback and build your AI safety portfolio. BlueDot Impact is a nonprofit that runs courses which aim to help participants develop the knowledge, ...
Senior Software Engineer Irregular San Francisco Bay Area In this role, you'll design, build, and scale production systems that power evaluation and security platforms for frontier AI models. Architect and scale production-grade systems and workflows for AI model evaluation. Build backend services, APIs, and monitoring tools that support large-scale evaluations. Design infrastructure that enables research experiments to run efficiently at scale. Implement agent frameworks and build security challenges to test AI models' evasion capabilities. Irregular Labs is a frontier security lab that aims to protect the world in a time of increasingly cap...
The Jailbreaking Lead will focus on identifying and mitigating vulnerabilities in frontier AI models, leading a red team to enhance AI safety and security through hands-on technical work and collaboration with AI developers and governments.
Senior Research Engineer FAR AI San Francisco Bay Area, Remote, Global, Remote, USA $150,000 - $250,000 In this role, you'll accelerate AI safety research by tackling challenging engineering problems and increasing research depth. Lead projects in detecting AI deception, preventing misuse, or building research infrastructure. Mentor team members in technical work to elevate the team's capabilities. Apply software engineering expertise and Python skills to solve complex AI safety challenges. Contribute specialized knowledge in machine learning, high-performance computing, or technical leadership. FAR AI aims to ensure AI systems are trustworth...
Research Manager / Research Managers, AIxCyber ERA Cambridge, UK £62,000 - £75,000 In this role, you'll lead the execution of ERA's AIxCyber Research Fellowship, supporting research fellows in developing and delivering their projects. Review and evaluate fellowship applications, then match fellows with mentors suited to their research focus. Help fellows scope research projects aligned with their skills and interests. Direct and oversee up to 5 research projects while providing guidance on planning, methodology, and publication. Organise workshops and events to support fellow professional development and strengthen relationships across the AI...
Research Scientist Patronus AI Remote, USA, San Francisco Bay Area, New York, NY In this role, you will help solve challenging open research problems facing society’s adoption of AI today, surrounding AI evaluation, language model understanding, and robustness challenges. Develop state-of-the-art systems for AI evaluation and implement algorithms based on NLP advancements. Conduct novel research on redteaming language models, automated evaluation, and alignment. Scope out and lead research projects, including experiment design and understanding results. Patronus AI aims to provide a security and risk management layer for AI by building an aut...
Join Apple's Responsible AI and Safety team as a Senior ML Researcher leading safety alignment and safeguards development for foundation models powering Apple products.
Cyber Researcher Irregular Tel Aviv, Israel In this role, you'll conduct research on AI security, focusing on protecting models against cyber threats and evaluating AI's cybersecurity capabilities. Develop cyber capabilities evaluation challenges including CTF-style vulnerability tests and network attack simulations. Research methods to mitigate AI misuse risks, model weight theft, and dangerous AI agent capabilities. Publish research findings and deliver results to customers. Advise on product development while exploring frontier questions about AI's potential in cybersecurity. Irregular Labs is a frontier security lab that aims to protect t...
Postdoctoral Researcher, Foundations for Emergent Deception in Human-AI Interaction University of Copenhagen Copenhagen, Denmark In this role, you'll develop computational approaches for understanding emergent deception in human-AI interaction by combining NLP, behavioral psychology, and economic perspectives. Conduct controlled experiments with human participants to study deceptive behavior in AI systems. Apply interpretability-based methods to detect and understand deception in AI. Collaborate with an interdisciplinary team across Computer Science, Psychology, and Economics. Contribute to research advancing frameworks for AI safety and alig...