Senior Consultant (Databricks)

About the role

We are seeking an experienced Senior Consultant – Databricks to design, develop, and optimize modern data platforms on Databricks. The ideal candidate will have strong expertise in data engineering, cloud technologies, ETL development, and big data processing. You will collaborate with cross-functional teams to build scalable, secure, and high-performance data solutions that support analytics, AI, and business intelligence initiatives.

What you'll do

• Design, develop, and maintain scalable data pipelines using Databricks
• Build and optimize ETL/ELT workflows using PySpark and Spark SQL
• Develop and manage Delta Lake architecture for reliable and efficient data processing
• Integrate data from multiple sources including databases, APIs, streaming platforms, and cloud storage
• Collaborate with business stakeholders, data analysts, and data scientists to understand business requirements

What you need

• Databricks
• SQL
• Spark
• Data modelling
• AWS
• Azure Data Factory

Good to have

• Airflow
• ETL
• CI/CD
• GCP
• Unity
• Azure