Lead Big Data Engineer | Apply Now
IndiaFull-time12–14 yrsPosted 1 week ago
Leadership data science role at MetLife. Needs 12–14 years and a B.Sc, B.Tech or B.E..
About the role
As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data solutions that support enterprise-wide analytics and business intelligence initiatives. The role requires deep expertise in Big Data technologies, cloud platforms, and modern data engineering practices.
What you'll do
- Design, develop, and maintain robust ETL/ELT pipelines on Azure cloud and on-premises platforms for batch and real-time data processing
- Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets
- Solve complex business problems by leveraging data engineering best practices and advanced technologies
- Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, performance, and scalability
- Ensure adherence to data quality, governance, security, privacy, and compliance standards
What you need
- SQL
- ETL
- Python
- Spark
- Azure Data Factory
- Hadoop
Good to have
- LLMs
- Linux
- CI/CD
- Shell scripting
- MongoDB
- Git