Azure Databricks + Pyspark

About the role

This hybrid Data Engineer role focuses on designing and optimizing Databricks SQL and PySpark solutions for complex payer and Medicare Medicaid claims processing. The role spans data engineering analytics and quality assurance to ensure accurate claim insights that support compliant healthcare decisions and improved member outcomes.

What you'll do

• Data Engineering - Pyspark Data bricks
• Design scalable Databricks SQL and PySpark solutions that process large volumes of payer and Medicare Medicaid claims data to ensure reliable analytics outputs
• Develop robust data pipelines that ingest transform and aggregate claims information to support timely decision making for healthcare operations
• Optimize PySpark jobs and Databricks SQL queries to improve runtime performance stability and cost efficiency across the hybrid cloud environment
• Implement reusable data models and curated datasets tailored for claims adjudication analytics risk scoring and operational reporting needs

What you need

• 8–12 yrs of experience
• Databricks
• Spark
• Azure
• SQL
• ETL
• Claims processing
• Any graduate

Good to have

• Test automation