Fullstack AI Quality Engineer – Applied & Agentic AI Systems

About the role

We are seeking a highly skilled AI Quality Engineer specializing in testing Generative (and non-Generative) AI applications and agentic systems to join our team. The ideal candidate will have expertise in both traditional software testing and specialized testing methodologies for Large Language Models (LLMs)-based and AI-based systems.

What you'll do

• Generative & Agentic AI Testing Strategy: Design and implement comprehensive testing strategies specifically tailored for LLM-based applications and agentic systems
• Expand this to evaluate autonomous multi-agent behaviors and tool-use accuracy
• This spans both our Python backend services and modern TypeScript/React/Angular frontends
• Edge Case, Bias, and Fairness Testing: Identify and develop test scenarios for edge cases in LLM behavior, including handling of ambiguous inputs, potential biases
• Design and execute tests to identify potential biases in model outputs and ensure fair treatment across different user groups and use cases

What you need

• 7–13 years in data science & ai
• Python
• LLMs
• NLP
• AWS
• Test automation
• CI/CD
• B.Sc or M.Sc

Good to have

• TypeScript
• Unit testing
• JIRA
• Playwright
• Jest
• Cypress