Senior Data Engineer - Azure Databricks Platform

About the role

The role will be responsible for taking technical ownership of key workstreams on EnerMech's Azure Databricks data platform, operating across the full platform stack: data modelling and pipeline development in Databricks, the underlying Azure infrastructure, and the CI/CD, DevOps and DataOps practices that keep the platform reliable, secure and scalable.

What you'll do

• Design, build, quality and reliable operation of assigned workstreams on the Azure Databricks data platform, from scoping through to production deployment
• Build and optimise Delta tables and materialized views, with attention to performance at scale
• Design and implement data quality frameworks (preferably DQX or equivalent), including quarantine/error handling and validation against data contracts
• Define job-specific compute configurations appropriate to each workload, balancing performance and cost
• Contribute to and troubleshoot Terraform-managed infrastructure (networking, storage, Key Vaults, Managed DevOps Pools, Dev Centers)

What you need

• 6–11 yrs of experience
• Databricks
• Azure
• Data modelling
• CI/CD
• Terraform
• B.Sc or B.Tech or B.E. or BCA

Good to have

• Data privacy