Senior Test Analyst, AI
PuneFull-time5–9 yrsPosted over a month ago
Senior QA and testing role at Careers @ MUFG Pension & Market Services in Pune. Needs 5+ years.
About the role
The Senior AI Test Analyst is responsible for defining, implementing, and executing testing strategies for AI-powered solutions, including AI agents, generative AI applications, machine learning models, APIs, and business process workflows.
What you'll do
- Assess AI solution performance across dimensions such as accuracy, relevance, consistency, explainability, fairness, robustness, and reliability
- Collaborate with developers, business analysts, product owners, and project managers to define testing requirements, success criteria, and quality measures
- Manage the execution of automated test suites, monitor the test results and collaborate with teams to troubleshoot and resolve the issues promptly
- Design, develop, execute, and maintain test cases and test scripts for AI, ML, and Generative AI applications
- Lead functional, integration, API, regression, user acceptance, and end-to-end testing of AI-enabled solutions
What you need
- Test cases
- API testing
- Bug tracking
- Test automation
- Selenium
- Postman
Good to have
- JIRA
- Appium
- Python
- Machine learning
- Azure
- CI/CD