AI Product & Evals Analyst (Voice Agents)

About the role

We’re hiring an AI AI Product & Evals Analyst Analyst to own evaluation, quality measurement, dashboarding, and enterprise analytics for Bluemachines’ AI voice agents. You will work at the intersection of AI Engineering, Product, and Customer Delivery to define how voice agent quality is measured, monitored, and improved at scale.

What you'll do

• Track and analyze business KPIs tied to voice agent deployments (automation, containment, conversion, CSAT, cost savings, etc.)
• Support enterprise billing, audit, and reconciliation workflows through reliable usage and conversation analytics
• Translate AI behavior into clear operational and business impact insights for enterprise clients
• Automate repetitive analytics and reporting tasks using LLMs, copilots, and workflow tooling
• Drive AI-native ways of working across SQL, Python, dashboards, and insight generation

What you need

• 3–4 yrs of experience
• Dashboarding
• SQL
• Python
• Power BI
• Tableau
• Looker
• Any graduate

Good to have

• Prompt engineering
• LLMs
• Reconciliation
• Root cause analysis