Data Engineer Submission Data and Content Generation & Reuse (AIDCG) - Pharma R&D

About the role

The Senior IT Data Engineer is responsible for leading, designing, developing, and maintaining scalable and robust data pipelines and infrastructure. This role involves independently building ETL/ELT processes, optimizing data storage solutions (such as data warehouses and data lakes), ensuring data quality and reliability, and monitoring data systems.

What you'll do

• Accountability/Problem Solving: Solves complex data ingestion and processing problems. Optimizes data flows and actively enhances overall system performance
• Integrate data from databases, APIs, applications, files, streaming platforms, and third-party systems
• Develop robust data transformation and processing workflows using SQL, Python, and distributed processing technologies
• Develop reusable engineering components and follow software engineering practices including Git, CI/CD, testing, code reviews, and documentation
• Collaborate with technical leads across Data, Content, Integration, UI, and Platform, as well as architects, product teams, and business stakeholders

What you need

• SQL
• Python
• ETL
• Spark
• AWS
• Hadoop
• Any graduate

Good to have

• Scala
• GCP
• Azure
• Java
• CI/CD
• Git