Databricks Tech Lead
ChennaiFull-time8–14 yrsPosted 2 weeks ago
Leadership data science role at EXL in Chennai. Needs 8+ years and an M.Sc, B.Tech or B.E..
About the role
We are looking for a skilled and passionate Databricks Engineer to design, build, and optimize enterprise-scale data lakehouse solutions on the Databricks platform.
What you'll do
- Design, build, and maintain Databricks workspaces, clusters, and compute pools across dev/test/prod environments
- Configure and manage Databricks Unity Catalog for data governance, access control, fine-grained permissions, and data lineage
- Optimize cluster configurations — instance types, auto-scaling policies, spot/preemptible nodes — for cost and performance
- Implement workspace-level best practices: folder structures, access controls, secret management (Databricks Secrets / Azure Key Vault / AWS Secrets Manager)
- Manage Databricks jobs, workflows, and multi-task job orchestration with dependency management
What you need
- Databricks
- SQL
- AWS
- ETL
- Kafka
- AML
Good to have
- KYC
- Unity
- Azure