Senior Data Engineer (Databricks Lead)

About the role

Overview We are looking for a Senior Data Engineer (Databricks Lead) with 12-16 years of experience to lead the design, development, and optimization of enterprise-scale data platforms. The ideal candidate will have deep expertise in Databricks, Apache Spark, Snowflake, Kafka, Python, SQL, and AWS, along with experience building scalable data architectures that support analytics, real-time processing, AI/ML, and Generative AI initiatives. .

What you'll do

• Lead the architecture, design, and implementation of scalable, secure, and high-performance data platforms using Databricks, Snowflake, and AWS
• Design and optimize large-scale batch and real-time data pipelines using Spark and Kafka
• Develop and maintain robust ETL/ELT frameworks to ensure data reliability, scalability, and performance
• Implement real-time data ingestion and processing solutions using Kafka and Spark Streaming
• Build automated data integration frameworks leveraging REST APIs, GraphQL APIs, and Databricks APIs

What you need

• 12–16 years in data science & ai
• Databricks
• SQL
• Python
• AWS
• ETL
• Spark
• M.Sc or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA

Good to have

• Snowflake
• Kafka
• Data warehousing
• Data modelling
• Machine learning
• GraphQL