AI Safety Expert - Adversarial ML

About the role

AI Safety Expert - Adversarial ML at Mercor. Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.

What you'll do

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
• Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on
• Work independently and asynchronously to meet deadlines while enhancing AI model safety

What you need

• Machine learning
• Penetration testing
• Writing