Lead Data Engineer

About the role

Have you ever wanted to be part of something BIG? Now is the time to make an immediate impact at a leading global technology company, Mastercard. This role is part of the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend data systems, real time and batch pipelines, and AI enabled services that power analytics, decisioning, and automation across the organization.

What you'll do

• Backend & Data Platform Engineering
• Design, develop, and maintain backend services and data pipelines using Scala, Python and Java
• Build and optimize batch and streaming workloads on Cloudera Data Platform (CDP) using Spark
• Work with Cloudera Manager to support platform configuration, monitoring, performance tuning, and operational stability
• Design and implement high quality datamarts and curated datasets with strong emphasis on data integrity, performance, and reliability

What you need

• 6–10 years in data science & ai
• Python
• Machine learning
• AWS
• Spark
• ETL
• Databricks
• B.Sc or B.Tech or B.E. or BCA

Good to have

• LLMs
• Data modelling
• Kafka
• Hadoop
• Informatica
• Scala