Lead II - AWS Databricks Engineer
Hyderabad, Bengaluru, Pune, ThiruvananthapuramFull-time7–9 yrsPosted 1 week ago
Senior data science role at UST in Hyderabad, Bengaluru and 2 more cities. Needs 7–9 years.
About the role
Lead Data Engineer (US Healthcare / Medicare Advantage) Position Overview We are seeking a Lead Data Engineer to architect, build, and optimize scalable, cloud-native data systems. In this role, you will lead the development of enterprise data platforms using Databricks and AWS. You must possess deep domain expertise in US Healthcare, with a strict requirement for hands-on experience handling Medicare Advantage data.
What you'll do
- Architect scalable lakehouse structures leveraging Apache Iceberg to ingest, process, and store complex healthcare data types
- Establish comprehensive data governance and data lineage frameworks using Databricks Unity Catalog
- Implement secure access controls, data masking, and row-level security through Role-Based Access Control (RBAC) to ensure data security rules are enforced
- Architect and scale ingestion frameworks capable of processing HL7 and FHIR data feeds natively into the lakehouse ecosystem
- Mentor junior engineers, conduct code reviews, and drive technical best practices across the data team
What you need
- AWS
- Databricks
- Python
- Airflow
- SQL
- Data analysis
Good to have
- ETL
- Spark
- Unity
- IAM