Principal Data Engineer (AWS, Databricks, Ai, ML Flow, Data Architecture, Apache Airflow)
PuneFull-time12–18 yrsPosted over a month ago
Leadership data science role at Mastercard in Pune. Needs 12–18 years and a B.Sc, B.Tech or B.E..
About the role
Mastercard Foundry R&D develops emerging technology solutions and transforms promising concepts into scalable products and platforms. We are seeking a Principal Data Engineer to design and build the data foundations that power advanced analytics, machine learning, generative AI, and agentic AI solutions.
What you'll do
- Lead the architecture, design, and engineering of scalable batch, streaming, and event-driven data platforms
- Design and build reliable data ingestion, transformation, enrichment, processing, and consumption pipelines
- Develop governed lakehouse and modern data platform architectures using cloud-native technologies and distributed data processing frameworks
- Build and operate platforms that support analytics, machine learning, generative AI, and agentic AI workloads
- Create reusable data products, services, APIs, and self-service capabilities that accelerate experimentation and production delivery
What you need
- Machine learning
- AWS
- Databricks
- Airflow
- SQL
- Python
Good to have
- MLOps
- Kafka
- Docker
- Kubernetes
- Data modelling
- Spark