Senior Data Engineer
PuneFull-timeHybrid5–6 yrsPosted 2 months ago
Mid-level data science role at New Vision in Pune. Needs 5–6 years and a B.Sc, B.Tech or B.E.. Hybrid.
About the role
Senior Data Engineer with 5 + years of experience
What you'll do
- Design, develop, and maintain ETL pipelines to extract, transform, and load data from various sources into Azure data platforms
- Optimize ETL processes for performance and scalability
- Implement data quality and validation checks within ETL processes
- Develop and manage data integration workflows using Azure Data Factory (ADF) and/or Apache Airflow
- Schedule and monitor ETL jobs to ensure timely data processing and availability
What you need
- SQL
- Python
- ETL
- Spark
- Azure
- Data analysis
Good to have
- Hadoop
- Kafka
- Data visualisation
- Power BI
- Hive
- Tableau