AI Product & Evals Analyst (Voice Agents)
BengaluruFull-time3–4 yrsPosted 5 months ago
Mid-level customer support role at Blue Machines AI in Bengaluru. Needs 3–4 years.
About the role
We’re hiring an AI AI Product & Evals Analyst Analyst to own evaluation, quality measurement, dashboarding, and enterprise analytics for Bluemachines’ AI voice agents. You will work at the intersection of AI Engineering, Product, and Customer Delivery to define how voice agent quality is measured, monitored, and improved at scale.
What you'll do
- Track and analyze business KPIs tied to voice agent deployments (automation, containment, conversion, CSAT, cost savings, etc.)
- Support enterprise billing, audit, and reconciliation workflows through reliable usage and conversation analytics
- Translate AI behavior into clear operational and business impact insights for enterprise clients
- Automate repetitive analytics and reporting tasks using LLMs, copilots, and workflow tooling
- Drive AI-native ways of working across SQL, Python, dashboards, and insight generation
What you need
- Dashboarding
- SQL
- Python
- Power BI
- Tableau
- Looker
Good to have
- Prompt engineering
- LLMs
- Reconciliation
- Root cause analysis