Databricks Engineer - Senior/ Lead

About the role

We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in Python, SQL, and Apache Spark to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate should have experience working with large datasets, distributed data processing, and modern data engineering practices.

What you'll do

• Design, develop, and maintain scalable data pipelines using Azure Databricks
• Implement ETL/ELT workflows using PySpark, Spark SQL, and Python
• Optimize Spark jobs for performance, cost, and scalability
• Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)
• Build and manage Delta Lake tables (ACID, time travel, schema evolution)

What you need

• 6–11 yrs of experience
• Databricks
• SQL
• Python
• Spark
• Azure Data Factory
• Data modelling
• Any graduate

Good to have

• Kafka
• Azure
• Machine learning
• ETL
• CI/CD
• Cloud security