EY - GDS Consulting - AI And DATA - Databricks Architect - Senior Manager

About the role

Senior Data & AI Architect with 13+ years of experience in data engineering and data architecture, strong hands-on expertise in Databricks, Hadoop, Spark/PySpark, and cloud data platforms. This role combines deep technical ownership of enterprise Lakehouse and data platform architecture with hands-on experience building Agentic AI and Retrieval-Augmented Generation (RAG) solutions on Databricks.

What you'll do

• Design and optimize large-scale distributed data processing pipelines using Hadoop, Apache Spark, and PySpark
• Build reusable, production-grade Python frameworks and pipelines for batch and streaming data engineering workloads
• Own end-to-end ETL/ELT design, data ingestion, transformation, orchestration, and data quality frameworks across the platform
• Design dimensional data models (star/snowflake schemas, fact/dimension tables, SCD) to support analytical and reporting use cases
• Establish and enforce engineering best practices for Git-based version control, code reviews, and CI/CD across development, test, and production environments

What you need

• 13–23 yrs of experience
• Databricks
• Travel booking
• SQL
• Python
• ETL
• Hadoop
• Any graduate

Good to have

• Terraform
• Spark
• AWS
• LLMs
• Data modelling
• Snowflake