Lead Assistant Manager

About the role

We are looking for a skilled and passionate Databricks Engineer to design, build, and optimize enterprise-scale data lakehouse solutions on the Databricks platform.

What you'll do

• Design, build, and maintain Databricks workspaces, clusters, and compute pools across development, testing, and production environments
• Configure and manage Unity Catalog for data governance, fine-grained access control, permissions, metadata management, and data lineage
• Optimize Databricks cluster configurations, including instance types, auto-scaling, spot/preemptible nodes, and compute pools to improve performance and reduce costs
• Implement workspace best practices, including folder structures, access controls, secret management using Databricks Secrets, Azure Key Vault, or AWS Secrets Manager
• Create, schedule, and manage Databricks Jobs, Workflows, and multi-task job orchestration with dependency management

What you need

• 6–11 yrs of experience
• Machine learning
• SQL
• Python
• AWS
• ETL
• MLOps
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• IAM
• LLMs
• Databricks
• Kafka
• Spark
• dbt