Lead Data Engineer

About the role

Data Platform & Orchestration is seeking a Lead Data Engineer to design and build next-generation, cloud-native data platforms supporting Mastercard’s global data ecosystem. In this role, you will lead the development of scalable batch and real-time data pipelines, enabling efficient data processing across Data Lakes and Data Warehouses.

What you'll do

• Design and build scalable batch and real-time data pipelines using Spark, Kafka, and (preferred) Apache Flink
• Develop robust ETL/ELT frameworks for structured and unstructured data
• Build and optimize data ingestion and transformation pipelines for Data Lakes and Data Warehouses
• Implement stream processing solutions for near real-time use cases
• Ensure data quality, lineage, observability, and governance across pipelines

What you need

• 6–10 years in data science & ai
• SQL
• ETL
• AWS
• Spark
• Data modelling
• Kafka
• B.Tech or B.E. or B.Sc or BCA

Good to have

• Python
• Java
• Go
• Databricks
• BigQuery
• Redshift