Data Engineer | Apply Now
IndiaFull-time2–5 yrsPosted 1 week ago
Mid-level data science role at MetLife. Needs 2+ years and a B.Tech, B.E. or B.Sc.
About the role
Data Engineer | Apply Now at MetLife. Develop and maintain assigned data pipelines using Azure Databricks, PySpark, Spark SQL, SQL, and Delta Lake.
What you'll do
- Develop and maintain assigned data pipelines using Azure Databricks, PySpark, Spark SQL, SQL, and Delta Lake
- Assist with converting legacy Informatica mappings, SQL, and stored procedures into Databricks processing
- Implement source-to-target mappings and transformation specs, and help build logical/physical, dimensional
- Perform data profiling, unit testing, and defect resolution; build data-quality and reconciliation checks and compare legacy vs. target-state outputs during parallel runs
- Produce clear technical documentation – mappings, data dictionaries, test cases, runbooks, and deployment instructions – following established naming, repository
What you need
- SQL
- ETL
- Python
- Databricks
- Spark
- Data modelling
Good to have
- CI/CD
- Unity
- Git
- Azure
- Informatica
- Unit testing