Lead Data Engineer

About the role

We are seeking a highly skilled and experienced Lead Data Engineer to drive the modernization and design the future-state architecture of our Sales Validation platform. As a technical leader, you will be responsible for guiding the transition from legacy systems to advanced data engineering solutions, primarily focused on Databricks and Azure cloud technologies.

What you'll do

• Lead the architecture, implementation, and delivery of Databricks solutions to support data processing and analytics initiatives
• Oversee the migration efforts from Synapse Analytics to Databricks, ensuring minimal downtime and aligned best practices
• Develop and enforce engineering standards, reusable frameworks, and documentation to promote consistency and efficiency across teams
• Mentor data engineers through design reviews, knowledge sharing sessions, and technical guidance to foster professional growth and code quality
• Own end-to-end delivery of multiple complex workstreams, coordinate across teams, and manage technical risks

What you need

• 5–8 years in data science & ai
• SQL
• Databricks
• ETL
• Spark
• Azure Data Factory
• Data modelling
• Any graduate

Good to have

• Airflow
• Snowflake
• Azure
• CI/CD
• Root cause analysis
• Git