Senior Data Analyst - AI Evaluation (Life Sciences).
GurugramFull-timeMid levelPosted 3 weeks ago
Mid-level data analytics role at RELX India (Pvt) Ltd L&P div Company in Gurugram.
About the role
The Senior Data Analyst - AI Evaluation will support the evaluation of AI-powered solutions that use life sciences, chemistry, and regulatory data. Working with scientific domain experts, product, data science, and engineering teams, you will contribute to evaluation strategies and rubrics, evaluation scenarios, and acceptance criteria that reflect customer needs and product goals.
What you'll do
- Applying scientific expertise to contribute to customer-focused success criteria, evaluation rubrics, and acceptance criteria for AI solutions
- Contributing to the definition of evaluation scope, metrics, and scenarios using domain knowledge across drug discovery, drug development, and regulatory approval
- Building and curating scientific test sets and benchmarks that reflect real-world use of life sciences and regulatory data
- Adapting LLM-as-jury evaluation approaches to specific products, use cases, and metrics
- Conducting manual and automated evaluations of AI outputs, investigating discrepancies and failure modes, and providing evidence-based feedback on evaluation quality
What you need
- Python
- Pharmacology
- Git
- LLMs
- Chemistry