Track Lead - Extract Transform Load (ETL), Data Lakes

About the role

We are looking for a Senior Data Engineer with strong Databricks, SQL and data warehousing experience to lead the migration of an existing Oracle-based data warehouse to Databricks on the Allianz Data Platform (ADP).

What you'll do

• Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETL–generated structures) and design the target model in Databricks
• Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks
• Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation
• Ensure data quality, performance, and reliability of the new Databricks-based data warehouse, enabling downstream analytics and AI/ML use cases
• Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices

What you need

• 5–9 yrs of experience
• ETL
• SQL
• Machine learning
• Data warehousing
• Databricks
• Spark
• B.Tech or B.E.

Good to have

• SAS
• Data modelling
• PostgreSQL
• ITIL
• Oracle Database