Senior Data Platform Engineer

About the role

The Databricks Platform Engineer is the technical owner of our Databricks Lakehouse platform — the shared foundation on which enterprise data products, analytics, reporting and AI/ML workloads are built. This is a hands-on individual-contributor role responsible for the reliability, scalability, security, automation, governance and cost efficiency of the Databricks platform.

What you'll do

• Own workspace- and account-level architecture: Unity Catalog, compute policies, Lakeflow Jobs and shared compute infrastructure, identity and service principals
• Design, build and review infrastructure-as-code, CI/CD and observability capabilities for the platform
• Own platform reliability: availability, capacity, incident management, root-cause analysis, and DR/BCP; define and meet platform SLOs for shared platform services
• Run Databricks FinOps: consumption monitoring, cost optimisation, budget and anomaly management, and chargeback/showback with transparent unit costs for consuming teams
• Implement platform security and governance controls: identity federation/SCIM, service principals, network controls, secrets, RBAC/ABAC, governed tags

What you need

• 3–5 yrs of experience
• AWS
• Terraform
• CI/CD
• Python
• Databricks
• SQL
• B.Sc or B.Tech or B.E. or BCA

Good to have

• SOX
• Unity
• Spark
• Performance management
• System design
• IAM