Data Engineer | Apply Now
IndiaFull-time7–13 yrsPosted 1 week ago
Senior data science role at MetLife. Needs 7+ years and a B.Tech, B.E. or B.Sc.
About the role
Data Engineer | Apply Now at MetLife. Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
What you'll do
- Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake
- Build data models – logical, physical, dimensional, and integration – and maintain source-to-target mappings for workforce, organization, employee, position, job
- Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns
- Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling
- Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable
What you need
- SQL
- Databricks
- Spark
- ETL
- Data modelling
- Azure
Good to have
- CI/CD
- Power BI
- Unity
- Git
- Reconciliation
- Informatica