Azure Databricks Platform Engineer
PuneFull-timeHybrid5–9 yrsPosted today
Senior DevOps and cloud role at New Vision in Pune. Needs 5+ years and a degree. Hybrid.
About the role
We are looking for a Senior Azure Databricks Platform Engineer with strong hands-on experience in both Databricks development and platform operations. Workspace creation, maintenance, deployment using DEVOPS CICD is integral for the role.
What you'll do
- Design, develop, and optimize data pipelines using Azure Databricks, Python, PySpark, Spark SQL, and Delta Lake
- Develop and maintain Databricks notebooks, workflows, and scheduled jobs
- Configure and manage Databricks clusters, cluster policies, autoscaling, runtime versions, and libraries
- Support Databricks workspace configuration, infrastructure management, and platform operations
- Implement Unity Catalog access controls, data governance, and data lineage
What you need
- Azure
- Databricks
- CI/CD
- Terraform
- Python
- Spark
Good to have
- ETL
- Data structures
- SQL
- Unity