Area Manager-Data Engineering-Cloud Data Engineering

About the role

Area Manager-Data Engineering-Cloud Data Engineering at EXL. Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark.

What you'll do

• Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark
• Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes
• Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test
• Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making
• Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts

What you need

• 6–11 years in data science & ai
• SQL
• Python
• ETL
• Azure Data Factory
• Databricks
• Spark
• Any graduate

Good to have

• Data warehousing
• Data modelling
• Snowflake
• CI/CD
• Azure
• Jenkins