Quality Lead, YouTube Global Vendor Operations

About the role

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company.

What you'll do

• Design Quality Lead (QA) Frameworks to ensure alignment with key business outcomes. Monitor AI QA model performance and accuracy using metrics such as Precision, Recall
• Manage the ingestion of human-validated Golden Labeling from manual overrides to drive continuous, high-fidelity model retraining
• Implement blind review protocols and complex multi-tiered human + AI arbitration to prevent Automation Bias
• Design stratified sampling methodologies that prioritize high-risk or ambiguous interactions (e.g., cases where AI confidence is low) for human review
• Partner with the training team to remediate quality gaps

What you need

• Arbitration

Good to have

• LLMs
• Prompt engineering