Senior Test Analyst, AI

About the role

The Senior AI Test Analyst is responsible for defining, implementing, and executing testing strategies for AI-powered solutions, including AI agents, generative AI applications, machine learning models, APIs, and business process workflows.

What you'll do

• Assess AI solution performance across dimensions such as accuracy, relevance, consistency, explainability, fairness, robustness, and reliability
• Collaborate with developers, business analysts, product owners, and project managers to define testing requirements, success criteria, and quality measures
• Manage the execution of automated test suites, monitor the test results and collaborate with teams to troubleshoot and resolve the issues promptly
• Design, develop, execute, and maintain test cases and test scripts for AI, ML, and Generative AI applications
• Lead functional, integration, API, regression, user acceptance, and end-to-end testing of AI-enabled solutions

What you need

• 5–9 yrs of experience
• Test cases
• API testing
• Bug tracking
• Test automation
• Selenium
• Postman
• Any graduate

Good to have

• JIRA
• Appium
• Python
• Machine learning
• Azure
• CI/CD