Lead Data Engineer - Azure + Fabric
GurugramFull-time8–14 yrsPosted 2 months ago
Leadership data science role at EXL in Gurugram. Needs 8+ years and a B.Tech, B.E. or B.Sc.
About the role
We are looking for a Data Engineer to develop and maintain a modern data platform leveraging Microsoft Fabric, OneLake, and the Medallion Architecture. The role will focus on building scalable data pipelines, implementing data transformation and quality processes, and supporting curated data products for analytics and Power BI.
What you'll do
- Develop and maintain Microsoft Fabric / OneLake Lakehouse solutions across Bronze, Silver, and Gold layers
- Build reusable data ingestion pipelines and CDC frameworks for sources including GCP, CSV, Excel, email files, and SharePoint
- Implement Bronze-layer ingestion with audit logging, schema validation, schema-drift detection, and error handling
- Develop Silver-layer transformations for cleansing, standardization, data quality, validation, and exception handling
- Build Gold-layer datasets including curated entities, conformed dimensions, business metrics, KPIs, aggregations, and secure views
What you need
- Azure
- SQL
- Python
- ETL
- Spark
- Power BI
Good to have
- Reconciliation
- GCP
- CI/CD
- Git