Test Analyst, AI
PuneFull-time3–6 yrsPosted over a month ago
Mid-level QA and testing role at Careers @ MUFG Pension & Market Services in Pune. Needs 3+ years.
About the role
The AI Test Analyst is responsible for ensuring the quality, reliability, and effectiveness of AI-powered solutions, including generative AI applications, intelligent agents, and AI-enabled business processes. The role focuses on validating AI models and outputs, assessing data quality, monitoring performance, and ensuring adherence to Responsible AI principles, regulatory requirements, and organizational standards.
What you'll do
- Assess AI solution performance across dimensions such as accuracy, relevance, consistency, explainability, fairness, robustness, and reliability
- Collaborate with developers, business analysts, product owners, and project managers to define testing requirements, success criteria, and quality measures
- Manage the execution of automated test suites, monitor the test results and collaborate with teams to troubleshoot and resolve the issues promptly
- Identify opportunities to leverage AI-driven testing tools and automation techniques to improve testing efficiency and effectiveness
- Support the establishment and adoption of enterprise standards, processes, and quality controls for AI testing and validation
What you need
- Test cases
- API testing
- Bug tracking
- Test automation
- Selenium
- JIRA
Good to have
- Appium
- Python
- Postman
- Machine learning
- Azure
- CI/CD