Senior Data Engineer II

About the role

The Libra Team is a core part of Elsevier’s Search and AI Platform . This team works on building an Evaluation Platform for Subject Matter Experts (SMEs) to review AI-generated medical content item-by-item, provide ratings/feedback based on predefined metrics, track team progress, and export results for quality assurance and model improvement purposes.

What you'll do

• Leading the design, prototyping and build of robust and scalable data pipelines
• Working with technologies including Python (Fast API), Java (Spring Boot), Data Warehouse, Spark, Airflow, Snowflake, ETL/ELT, Iceberg, Kafka and RDBMS
• Owning cloud infrastructure in AWS to host, monitor and scale the services, automating common tasks mercilessly and driving cost and performance optimisation
• Partnering with Product Managers, architects and engineering teams to translate product requirements into scalable technical solutions
• Mentoring and coaching engineers through design reviews, pair programming and code review, raising the technical bar of the team

What you need

• 6–11 yrs of experience
• SQL
• Python
• ETL
• AWS
• Snowflake
• Data warehousing
• Any graduate

Good to have

• Data modelling
• Terraform
• Airflow
• CI/CD
• Git
• Spark