Senior Data Engineer

About the role

The Senior Data Engineer – VARTA SENSE will be responsible for designing, developing, and managing scalable and reliable data pipelines that form the core data foundation of the VARTA SENSE platform. The role will work closely with the ML Lead, Solution Architect, Backend Engineering team and other technology stakeholders to transform complex banking and transaction data into standardized, reusable and production-ready datasets and features.

What you'll do

• Responsible for designing, developing, and managing scalable and reliable data pipelines that form the core data foundation of the VARTA SENSE platform
• Work closely with the ML Lead, Solution Architect, Backend Engineering team and other technology stakeholders to transform complex banking and transaction data into…
• Design and develop scalable batch, incremental and production-grade data pipelines for large volumes of transaction and customer data
• Build standardized and reusable data models and canonical schemas for transactions, customer attributes, offers, exposure and outcome events
• Develop configurable ingestion and mapping frameworks to integrate data received from different banks and source systems

What you need

• 5–8 yrs of experience
• Machine learning
• SQL
• Python
• ETL
• Spark
• Data modelling
• Any graduate

Good to have

• Kafka
• Airflow
• dbt
• Reconciliation
• CI/CD
• Git