QA Engineer

About the role

We are looking for a detail-oriented and analytical Chat and Voice Bot QA Specialist to join our Conversational AI team. In this role, you'll be responsible for evaluating the performance and quality of AI-driven chat and voice assistants. The ideal candidate brings a high level of first-principles thinking to assess bot responses, understands the fundamentals of generative AI, and is passionate about delivering seamless user experiences.

What you'll do

• Evaluate AI Responses: Systematically test chat and voice bot outputs for coherence, relevance, tone, factual accuracy, and alignment with business objectives
• Test Workflows: Assess conversation flows and user journeys for edge cases, logical consistency, and usability across different platforms (web, mobile, IVR)
• First-Principles Problem Solving: Analyze and break down complex issues using first-principles thinking; question assumptions and propose better alternatives
• Collaborate on Evaluation Frameworks: Help define or refine qualitative and quantitative criteria for bot performance and user experience

What you need

• LLMs
• Test cases
• User flows

Good to have

• User research