ML Data Associate III, AWS Quick

About the role

AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

What you'll do

• Design and execute linguistic test cases to validate Quick's natural language features across diverse inputs, edge cases, and user scenarios
• Evaluate model outputs for accuracy, fluency, and relevance by applying linguistic expertise to identify regressions, hallucinations, and quality gaps
• Develop and maintain testing guidelines and rubrics that ensure consistent, repeatable evaluation standards across annotators and test cycles
• Analyze test results and report findings using Python and SQL to surface patterns, quantify defect rates, and prioritize issues for engineering teams
• Collaborate with engineers, scientists, and PMs to define acceptance criteria, triage language-related bugs, and validate fixes before releases

What you need

• 3–6 years in data & business analytics
• Machine learning
• AWS
• SQL
• LLMs
• NLP
• Python
• B.Tech or B.E. or B.Sc or BCA

Good to have

• Test cases

What you get