Principal Architect - Databricks
BengaluruFull-time12–22 yrsPosted over a month ago
Leadership data science role at Unisys India (Private) LTD-UGS Bangalore in Bengaluru. Needs 12+ years.
About the role
Architect enterprise Databricks Lakehouse platforms on Azure, AWS, or GCP — including Unity Catalog, Delta Live Tables (DLT), and Databricks SQL. Design multi-workspace, multi-region Databricks deployments with workspace federation, network isolation (Private Link / V Net injection), and identity federation via Azure AD / Okta / SCIM.
What you'll do
- Architect enterprise Databricks Lakehouse platforms on Azure, AWS, or GCP — including Unity Catalog, Delta Live Tables (DLT), and Databricks SQL
- Design multi-workspace, multi-region Databricks deployments with workspace federation, network isolation (Private Link / V Net injection)
- Define medallion architecture (Bronze / Silver / Gold) standards, enforcing schema evolution, data contracts, and SLA-tiered pipeline SLOs
- Lead migration of legacy data warehouses (Teradata, Netezza, Snowflake, Synapse) to the Databricks Lakehouse — including SQL translation, workload profiling
- Own cluster architecture decisions: autoscaling policies, instance fleet configurations, job vs. interactive cluster strategies, Photon engine enablement
What you need
- Databricks
- SQL
- Machine learning
- Spark
- AWS
- LLMs
Good to have
- MLOps
- Snowflake
- Kafka
- Azure
- CI/CD
- GCP