Lead II - AWS Databricks Engineer

About the role

Lead Data Engineer (US Healthcare / Medicare Advantage) Position Overview We are seeking a Lead Data Engineer to architect, build, and optimize scalable, cloud-native data systems. In this role, you will lead the development of enterprise data platforms using Databricks and AWS. You must possess deep domain expertise in US Healthcare, with a strict requirement for hands-on experience handling Medicare Advantage data.

What you'll do

• Architect scalable lakehouse structures leveraging Apache Iceberg to ingest, process, and store complex healthcare data types
• Establish comprehensive data governance and data lineage frameworks using Databricks Unity Catalog
• Implement secure access controls, data masking, and row-level security through Role-Based Access Control (RBAC) to ensure data security rules are enforced
• Architect and scale ingestion frameworks capable of processing HL7 and FHIR data feeds natively into the lakehouse ecosystem
• Mentor junior engineers, conduct code reviews, and drive technical best practices across the data team

What you need

• 7–9 yrs of experience
• AWS
• Databricks
• Python
• Airflow
• SQL
• Data analysis
• Any graduate

Good to have

• ETL
• Spark
• Unity
• IAM