Data Engineering Consultant

About the role

Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale.

What you'll do

• Design, develop, test, and deploy scalable data pipelines using Azure Databricks, Spark SQL, Python, and Airflow
• Build and maintain data ingestion, transformation, and data curation processes across multiple enterprise data sources
• Develop complex SQL queries and optimize data processing workflows for performance and scalability
• Create, maintain, and support Airflow DAGs for orchestration, scheduling, monitoring, and error handling
• Collaborate with Product Owners, Business Analysts, and stakeholders during requirements gathering, backlog refinement, and sprint planning activities

What you need

• 4–7 yrs of experience
• SQL
• Python
• Databricks
• ETL
• Spark
• Airflow
• MCA or B.Tech or B.E. or B.Sc or BCA

Good to have

• Machine learning
• LLMs
• Snowflake
• Terraform
• Azure Data Factory
• Data warehousing