Big Data Engineer II | Apply Now
IndiaFull-time5–8 yrsPosted 1 week ago
Senior data science role at MetLife. Needs 5–8 years and a B.Sc, B.Tech or B.E..
About the role
The Data Engineer is responsible for designing, building, and maintaining scalable data engineering solutions that enable reliable, secure, and high-quality data for analytics, reporting, and business decision-making. This role plays a critical part in the data and analytics lifecycle by developing production-grade data platforms and pipelines across cloud and on-premises environments.
What you'll do
- Design, build, and maintain robust ETL/ELT pipelines on Azure cloud and on-premises platforms for batch and real-time data processing
- Develop scalable data solutions to collect, ingest, transform, and store large volumes of structured and unstructured data
- Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, scalability, and performance
- Ensure adherence to data governance, security, privacy, compliance, and quality standards across all data engineering solutions
- Develop and implement data architectures including data lakes, data warehouses, data marts, and Medallion architecture frameworks
What you need
- SQL
- ETL
- Python
- Spark
- Databricks
- Azure Data Factory
Good to have
- LLMs
- CI/CD
- Shell scripting
- MongoDB
- Git
- Hadoop