Databricks Engineer
ChennaiFull-time4–6 yrsPosted 3 months ago
Mid-level data science role at EXL in Chennai. Needs 4–6 years and an M.Sc, B.Tech or B.E..
About the role
We are looking for a skilled and passionate Databricks Engineer to design, build, and optimize enterprise-scale data lakehouse solutions on the Databricks platform.
What you'll do
- Design, build, and maintain Databricks workspaces, clusters, and compute pools across dev/test/prod environments
- Configure and manage Databricks Unity Catalog for data governance, access control, fine-grained permissions, and data lineage
- Optimize cluster configurations — instance types, auto-scaling policies, spot/preemptible nodes — for cost and performance
- Implement workspace-level best practices: folder structures, access controls, secret management (Databricks Secrets / Azure Key Vault / AWS Secrets Manager)
- Manage Databricks jobs, workflows, and multi-task job orchestration with dependency management
What you need
- Databricks
- Machine learning
- SQL
- ETL
- Spark
- MLOps
Good to have
- AWS
- LLMs
- Kafka
- dbt
- AML
- CI/CD