Data Engineer Advisor

About the role

A highly skilled 8 to 10 years of experience on SSIS. SQL Server, Azure Databricks, Pyspark, Hands-On Data Tech Lead to drive the modernization and scaling of our enterprise data platform to provide technical leadership while remaining deeply technical and actively writing code.

What you'll do

• Lead the migration of legacy SQL Server Integration Services (SSIS) packages to modern, cloud-native Azure Databricks / PySpark Lakehouse environments
• Architect end-to-end Modern Data Warehouse (MDW) and Medallion architecture systems (Bronze, Silver, Gold layers) within Azure
• Mentor and guide a team of data engineers, conducting stringent code reviews, enforcing design patterns, and establishing development standards
• Develop and optimize scalable, modular, high-performance batch and real-time ETL/ELT pipelines using PySpark on Azure Databricks cluster environments
• Implement Delta Lake features, managing transactions, schema evolution, and time-travel querying functionalities

What you need

• 8–10 yrs of experience
• SQL
• ETL
• Python
• Databricks
• Spark
• Data warehousing
• Any graduate

Good to have

• Azure Data Factory
• Data modelling
• Snowflake
• SSIS
• Azure
• SQL Server