Test Analyst, AI

About the role

The AI Test Analyst is responsible for ensuring the quality, reliability, and effectiveness of AI-powered solutions, including generative AI applications, intelligent agents, and AI-enabled business processes. The role focuses on validating AI models and outputs, assessing data quality, monitoring performance, and ensuring adherence to Responsible AI principles, regulatory requirements, and organizational standards.

What you'll do

• Assess AI solution performance across dimensions such as accuracy, relevance, consistency, explainability, fairness, robustness, and reliability
• Collaborate with developers, business analysts, product owners, and project managers to define testing requirements, success criteria, and quality measures
• Manage the execution of automated test suites, monitor the test results and collaborate with teams to troubleshoot and resolve the issues promptly
• Identify opportunities to leverage AI-driven testing tools and automation techniques to improve testing efficiency and effectiveness
• Support the establishment and adoption of enterprise standards, processes, and quality controls for AI testing and validation

What you need

• 3–6 yrs of experience
• Test cases
• API testing
• Bug tracking
• Test automation
• Selenium
• JIRA
• Any graduate

Good to have

• Appium
• Python
• Postman
• Machine learning
• Azure
• CI/CD