Databricks Lead

About the role

The Data Engineer Lead will be responsible for designing, building, and optimizing data pipelines and platforms to enable advanced analytics and business intelligence across the organization. This role requires strong expertise in Databricks, SQL, AWS, and Airflow, combined with a solid foundation in data analysis and engineering best practices.

What you'll do

• Build design specifications, data models, pipeline patterns, and solution architectures for the workstream
• Lead the design, development, and maintenance of data pipelines and ETL workflows using Databricks and Airflow
• Build reusable frameworks, templates, and engineering standards for ETL/ELT, streaming, and batch pipelines
• Ensure cloud-native designs aligned with AWS platform best practices
• Governance, Security & Optimization

What you need

• 8–18 yrs of experience
• Databricks
• SQL
• ETL
• AWS
• LLMs
• Airflow
• Any graduate

Good to have

• Spark
• Data modelling
• Redshift
• Unity