Senior Data Engineer
NoidaFull-time5–8 yrsPosted over a month ago
Senior data science role at FCI Jobs at in Noida. Needs 5–8 years.
About the role
The Senior Data Engineer – VARTA SENSE will be responsible for designing, developing, and managing scalable and reliable data pipelines that form the core data foundation of the VARTA SENSE platform. The role will work closely with the ML Lead, Solution Architect, Backend Engineering team and other technology stakeholders to transform complex banking and transaction data into standardized, reusable and production-ready datasets and features.
What you'll do
- Responsible for designing, developing, and managing scalable and reliable data pipelines that form the core data foundation of the VARTA SENSE platform
- Work closely with the ML Lead, Solution Architect, Backend Engineering team and other technology stakeholders to transform complex banking and transaction data into…
- Design and develop scalable batch, incremental and production-grade data pipelines for large volumes of transaction and customer data
- Build standardized and reusable data models and canonical schemas for transactions, customer attributes, offers, exposure and outcome events
- Develop configurable ingestion and mapping frameworks to integrate data received from different banks and source systems
What you need
- Machine learning
- SQL
- Python
- ETL
- Spark
- Data modelling
Good to have
- Kafka
- Airflow
- dbt
- Reconciliation
- CI/CD
- Git