AI Operations Analyst
BengaluruFull-time2–4 yrsPosted 3 months ago
Mid-level AI role at Albemarle in Bengaluru. Needs 2–4 years and a B.Tech, B.E. or B.Sc.
About the role
We are seeking a motivated and technically curious AI Operations Analyst to join our enterprise AI team and contribute to the development, enhancement, integration, and support of AI-powered applications across the organization.
What you'll do
- Assist in developing GenAI, Retrieval-Augmented Generation (RAG) , Agentic solutions involving prompt engineering, grounding, context management, structured responses
- Evaluate AI-generated responses for accuracy, relevance, groundedness, completeness, and user experience
- Analyze prompts, conversation flows, knowledge sources, retrieval results, and user feedback to identify opportunities for improvement
- Assist with building evaluation datasets, test cases and repeatable methods for measuring AI solution quality
- Identify opportunities to improve AI solutions through better prompts, retrieval techniques, knowledge content, integration, automation and application design
What you need
- Machine learning
- Python
- SQL
- LLMs
- Prompt engineering
- Data analysis
Good to have
- ITIL
- Azure
- Prototyping
- Data structures
- Test cases
- Root cause analysis